[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:15.207954 20891 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.102.254:44751
I20260709 12:08:15.209748 20891 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:15.210948 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:15.230348 20898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.230386 20900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:15.232261 20891 server_base.cc:1061] running on GCE node
W20260709 12:08:15.231457 20897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.492918 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.493235 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.493552 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598896493520 us; error 0 us; skew 500 ppm
I20260709 12:08:16.494628 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.502053 20891 webserver.cc:533] Webserver started at http://127.20.102.254:42653/ using document root <none> and password file <none>
I20260709 12:08:16.503185 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.503460 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.504060 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.512164 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/master-0-root/instance:
uuid: "4d80fc3f69964cea90dd41c9cc178bea"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-296p"
I20260709 12:08:16.522563 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:08:16.529284 20906 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.530982 20891 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:08:16.531526 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/master-0-root
uuid: "4d80fc3f69964cea90dd41c9cc178bea"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-296p"
I20260709 12:08:16.531975 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.600287 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.602358 20891 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:16.602959 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.693691 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.254:44751
I20260709 12:08:16.693801 20957 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.254:44751 every 8 connection(s)
I20260709 12:08:16.703135 20958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.726415 20958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea: Bootstrap starting.
I20260709 12:08:16.732687 20958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:16.734683 20958 log.cc:826] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:16.739915 20958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea: No bootstrap required, opened a new log
I20260709 12:08:16.761652 20958 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d80fc3f69964cea90dd41c9cc178bea" member_type: VOTER }
I20260709 12:08:16.762240 20958 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.762678 20958 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d80fc3f69964cea90dd41c9cc178bea, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.763687 20958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d80fc3f69964cea90dd41c9cc178bea" member_type: VOTER }
I20260709 12:08:16.764235 20958 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:16.764581 20958 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:16.765015 20958 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.770080 20958 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d80fc3f69964cea90dd41c9cc178bea" member_type: VOTER }
I20260709 12:08:16.771052 20958 leader_election.cc:304] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d80fc3f69964cea90dd41c9cc178bea; no voters: 
I20260709 12:08:16.773228 20958 leader_election.cc:290] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:16.773686 20961 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:16.776904 20961 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [term 1 LEADER]: Becoming Leader. State: Replica: 4d80fc3f69964cea90dd41c9cc178bea, State: Running, Role: LEADER
I20260709 12:08:16.778015 20961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d80fc3f69964cea90dd41c9cc178bea" member_type: VOTER }
I20260709 12:08:16.779053 20958 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:16.793601 20962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d80fc3f69964cea90dd41c9cc178bea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d80fc3f69964cea90dd41c9cc178bea" member_type: VOTER } }
I20260709 12:08:16.794584 20962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.795295 20963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d80fc3f69964cea90dd41c9cc178bea. Latest consensus state: current_term: 1 leader_uuid: "4d80fc3f69964cea90dd41c9cc178bea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d80fc3f69964cea90dd41c9cc178bea" member_type: VOTER } }
I20260709 12:08:16.795698 20963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.806818 20971 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:16.820044 20971 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:16.823025 20891 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:16.840380 20971 catalog_manager.cc:1383] Generated new cluster ID: d1a2cc5cb8394999abd5021e24e1be6d
I20260709 12:08:16.840806 20971 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:16.858996 20971 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:16.861465 20971 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:16.883677 20971 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea: Generated new TSK 0
I20260709 12:08:16.885113 20971 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:16.954871 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.965096 20980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.967368 20981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.975797 20891 server_base.cc:1061] running on GCE node
W20260709 12:08:16.975739 20983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.977226 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.977519 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.977722 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598896977701 us; error 0 us; skew 500 ppm
I20260709 12:08:16.978374 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.983688 20891 webserver.cc:533] Webserver started at http://127.20.102.193:46533/ using document root <none> and password file <none>
I20260709 12:08:16.984318 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.984551 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.984934 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.986260 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-0-root/instance:
uuid: "d8ced8b03c6340fa80989b0b4321a968"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-296p"
I20260709 12:08:16.993083 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:08:16.998226 20988 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.999396 20891 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:08:16.999874 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-0-root
uuid: "d8ced8b03c6340fa80989b0b4321a968"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-296p"
I20260709 12:08:17.000303 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.022116 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.024029 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.026960 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.032339 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.032660 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.033020 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.033254 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.132941 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.193:46579
I20260709 12:08:17.133097 21050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.193:46579 every 8 connection(s)
I20260709 12:08:17.142416 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.158332 21055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.162132 21056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.172111 20891 server_base.cc:1061] running on GCE node
W20260709 12:08:17.173735 21058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.175009 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.175325 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.175536 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598897175517 us; error 0 us; skew 500 ppm
I20260709 12:08:17.176322 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.180078 20891 webserver.cc:533] Webserver started at http://127.20.102.194:45219/ using document root <none> and password file <none>
I20260709 12:08:17.180137 21051 heartbeater.cc:344] Connected to a master server at 127.20.102.254:44751
I20260709 12:08:17.180745 21051 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.180881 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.181161 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.181535 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.182082 21051 heartbeater.cc:507] Master 127.20.102.254:44751 requested a full tablet report, sending...
I20260709 12:08:17.183116 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-1-root/instance:
uuid: "bd9039b92df84c748e75739057fd0227"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-296p"
I20260709 12:08:17.186421 20923 ts_manager.cc:194] Registered new tserver with Master: d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579)
I20260709 12:08:17.189787 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:08:17.190317 20923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52550
I20260709 12:08:17.194731 21063 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.195791 20891 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:08:17.196123 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-1-root
uuid: "bd9039b92df84c748e75739057fd0227"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-296p"
I20260709 12:08:17.196442 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.214954 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.216241 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.218551 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.222064 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.222286 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.222535 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.222797 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.330209 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.194:42863
I20260709 12:08:17.330466 21125 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.194:42863 every 8 connection(s)
I20260709 12:08:17.337286 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.346716 21129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.348383 21130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.354622 20891 server_base.cc:1061] running on GCE node
I20260709 12:08:17.355981 21126 heartbeater.cc:344] Connected to a master server at 127.20.102.254:44751
I20260709 12:08:17.356374 21126 heartbeater.cc:461] Registering TS with master...
W20260709 12:08:17.356721 21133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.357362 21126 heartbeater.cc:507] Master 127.20.102.254:44751 requested a full tablet report, sending...
I20260709 12:08:17.358028 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.358309 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.358518 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598897358497 us; error 0 us; skew 500 ppm
I20260709 12:08:17.359100 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.360349 20923 ts_manager.cc:194] Registered new tserver with Master: bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:17.362308 20923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52560
I20260709 12:08:17.364017 20891 webserver.cc:533] Webserver started at http://127.20.102.195:36861/ using document root <none> and password file <none>
I20260709 12:08:17.364576 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.364857 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.365155 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.366237 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-2-root/instance:
uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-296p"
I20260709 12:08:17.371031 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:08:17.375736 21137 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.376758 20891 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.002s
I20260709 12:08:17.377161 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-2-root
uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-296p"
I20260709 12:08:17.377472 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895025208-20891-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.407243 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.408634 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.410331 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.412714 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.413048 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.413342 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.413540 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.520802 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.195:35329
I20260709 12:08:17.520923 21199 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.195:35329 every 8 connection(s)
I20260709 12:08:17.540280 21200 heartbeater.cc:344] Connected to a master server at 127.20.102.254:44751
I20260709 12:08:17.540692 21200 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.541554 21200 heartbeater.cc:507] Master 127.20.102.254:44751 requested a full tablet report, sending...
I20260709 12:08:17.543848 20923 ts_manager.cc:194] Registered new tserver with Master: befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:17.544598 20891 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013631899s
I20260709 12:08:17.545595 20923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52570
I20260709 12:08:17.598953 20923 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52576:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:17.602770 20923 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:17.734326 21089 tablet_service.cc:1511] Processing CreateTablet for tablet ba76b132854c466c895b3fa9c466ade0 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.734679 21090 tablet_service.cc:1511] Processing CreateTablet for tablet 53230cea4b9a4d39b3a68a487c5eb080 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.736940 21088 tablet_service.cc:1511] Processing CreateTablet for tablet 119c2a6ed0824fa8976622bed056e160 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.746881 21088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 119c2a6ed0824fa8976622bed056e160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.755575 21015 tablet_service.cc:1511] Processing CreateTablet for tablet 53230cea4b9a4d39b3a68a487c5eb080 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.746517 21016 tablet_service.cc:1511] Processing CreateTablet for tablet 81d68b52cb364c8b89b940bbde3ae1b2 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.758541 21091 tablet_service.cc:1511] Processing CreateTablet for tablet 81d68b52cb364c8b89b940bbde3ae1b2 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.760825 21014 tablet_service.cc:1511] Processing CreateTablet for tablet ba76b132854c466c895b3fa9c466ade0 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.756444 21163 tablet_service.cc:1511] Processing CreateTablet for tablet ba76b132854c466c895b3fa9c466ade0 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.762465 21016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d68b52cb364c8b89b940bbde3ae1b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.754037 21165 tablet_service.cc:1511] Processing CreateTablet for tablet 81d68b52cb364c8b89b940bbde3ae1b2 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.760663 21012 tablet_service.cc:1511] Processing CreateTablet for tablet 1cac8f50f82e4c45873afaa45945dc3e (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.761868 21162 tablet_service.cc:1511] Processing CreateTablet for tablet 119c2a6ed0824fa8976622bed056e160 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.754022 21164 tablet_service.cc:1511] Processing CreateTablet for tablet 53230cea4b9a4d39b3a68a487c5eb080 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.766498 21091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d68b52cb364c8b89b940bbde3ae1b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.755673 21013 tablet_service.cc:1511] Processing CreateTablet for tablet 119c2a6ed0824fa8976622bed056e160 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.769685 21012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cac8f50f82e4c45873afaa45945dc3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.770476 21163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba76b132854c466c895b3fa9c466ade0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.774279 21013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 119c2a6ed0824fa8976622bed056e160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.771075 21087 tablet_service.cc:1511] Processing CreateTablet for tablet 1cac8f50f82e4c45873afaa45945dc3e (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.778303 21165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d68b52cb364c8b89b940bbde3ae1b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.780375 21164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53230cea4b9a4d39b3a68a487c5eb080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.782110 21162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 119c2a6ed0824fa8976622bed056e160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.782781 21087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cac8f50f82e4c45873afaa45945dc3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.785825 21015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53230cea4b9a4d39b3a68a487c5eb080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.791301 21089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba76b132854c466c895b3fa9c466ade0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.797222 21014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba76b132854c466c895b3fa9c466ade0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.799697 21090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53230cea4b9a4d39b3a68a487c5eb080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.806093 21161 tablet_service.cc:1511] Processing CreateTablet for tablet 1cac8f50f82e4c45873afaa45945dc3e (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
W20260709 12:08:17.817150 20970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:17.818236 21161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cac8f50f82e4c45873afaa45945dc3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.833228 21011 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfb3d37d9d840678db00b2b63d2400f (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.835618 21011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfb3d37d9d840678db00b2b63d2400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.852437 21086 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfb3d37d9d840678db00b2b63d2400f (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.858711 21086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfb3d37d9d840678db00b2b63d2400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.866128 21160 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfb3d37d9d840678db00b2b63d2400f (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.870992 21160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfb3d37d9d840678db00b2b63d2400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.876669 21010 tablet_service.cc:1511] Processing CreateTablet for tablet c8f76efae6fb414ab81d885d011ab891 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.885145 21010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f76efae6fb414ab81d885d011ab891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.910907 21085 tablet_service.cc:1511] Processing CreateTablet for tablet c8f76efae6fb414ab81d885d011ab891 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.913303 21085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f76efae6fb414ab81d885d011ab891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.956418 21009 tablet_service.cc:1511] Processing CreateTablet for tablet a5cad2433c904b948364ba8a49112d8d (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.961659 21009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cad2433c904b948364ba8a49112d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.948802 21159 tablet_service.cc:1511] Processing CreateTablet for tablet c8f76efae6fb414ab81d885d011ab891 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.974625 21159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f76efae6fb414ab81d885d011ab891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.989106 21158 tablet_service.cc:1511] Processing CreateTablet for tablet a5cad2433c904b948364ba8a49112d8d (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.990648 21158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cad2433c904b948364ba8a49112d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.997612 21218 tablet_bootstrap.cc:492] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227: Bootstrap starting.
I20260709 12:08:18.009008 21015 tablet_service.cc:1511] Processing CreateTablet for tablet 9893f92a39d9475abb74a13787ccf8c0 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.010303 21015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9893f92a39d9475abb74a13787ccf8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.013180 21091 tablet_service.cc:1511] Processing CreateTablet for tablet a5cad2433c904b948364ba8a49112d8d (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.014811 21091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cad2433c904b948364ba8a49112d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.040504 21219 tablet_bootstrap.cc:492] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968: Bootstrap starting.
I20260709 12:08:18.108918 21220 tablet_bootstrap.cc:492] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60: Bootstrap starting.
I20260709 12:08:18.138288 21085 tablet_service.cc:1511] Processing CreateTablet for tablet 9893f92a39d9475abb74a13787ccf8c0 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.141117 21085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9893f92a39d9475abb74a13787ccf8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.142786 21161 tablet_service.cc:1511] Processing CreateTablet for tablet 9893f92a39d9475abb74a13787ccf8c0 (DEFAULT_TABLE table=test-workload [id=cda79a9368c94ace81118a72803dd31b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.144930 21219 tablet_bootstrap.cc:654] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.145102 21161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9893f92a39d9475abb74a13787ccf8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.149456 21218 tablet_bootstrap.cc:654] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.170029 21220 tablet_bootstrap.cc:654] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.192900 21219 tablet_bootstrap.cc:492] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968: No bootstrap required, opened a new log
I20260709 12:08:18.193742 21219 ts_tablet_manager.cc:1403] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968: Time spent bootstrapping tablet: real 0.158s	user 0.008s	sys 0.023s
I20260709 12:08:18.194898 21051 heartbeater.cc:499] Master 127.20.102.254:44751 was elected leader, sending a full tablet report...
I20260709 12:08:18.197018 21219 raft_consensus.cc:359] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.197780 21219 raft_consensus.cc:385] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.198086 21219 raft_consensus.cc:740] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.198864 21219 consensus_queue.cc:260] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.201164 21220 tablet_bootstrap.cc:492] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60: No bootstrap required, opened a new log
I20260709 12:08:18.201789 21220 ts_tablet_manager.cc:1403] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.014s
I20260709 12:08:18.206728 21220 raft_consensus.cc:359] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.208045 21220 raft_consensus.cc:385] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.206785 21218 tablet_bootstrap.cc:492] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227: No bootstrap required, opened a new log
I20260709 12:08:18.209457 21218 ts_tablet_manager.cc:1403] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227: Time spent bootstrapping tablet: real 0.258s	user 0.017s	sys 0.023s
I20260709 12:08:18.208557 21220 raft_consensus.cc:740] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.212013 21219 ts_tablet_manager.cc:1434] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.006s
I20260709 12:08:18.213814 21219 tablet_bootstrap.cc:492] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968: Bootstrap starting.
I20260709 12:08:18.216125 21218 raft_consensus.cc:359] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:18.217087 21218 raft_consensus.cc:385] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.217478 21218 raft_consensus.cc:740] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.218439 21218 consensus_queue.cc:260] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:18.220306 21220 consensus_queue.cc:260] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.236550 21126 heartbeater.cc:499] Master 127.20.102.254:44751 was elected leader, sending a full tablet report...
I20260709 12:08:18.238323 21218 ts_tablet_manager.cc:1434] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.005s
I20260709 12:08:18.239745 21218 tablet_bootstrap.cc:492] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227: Bootstrap starting.
I20260709 12:08:18.240696 21219 tablet_bootstrap.cc:654] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.254516 21200 heartbeater.cc:499] Master 127.20.102.254:44751 was elected leader, sending a full tablet report...
I20260709 12:08:18.259968 21220 ts_tablet_manager.cc:1434] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent starting tablet: real 0.058s	user 0.013s	sys 0.006s
I20260709 12:08:18.262346 21219 tablet_bootstrap.cc:492] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968: No bootstrap required, opened a new log
I20260709 12:08:18.262890 21219 ts_tablet_manager.cc:1403] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.002s
I20260709 12:08:18.263221 21218 tablet_bootstrap.cc:654] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.265724 21220 tablet_bootstrap.cc:492] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60: Bootstrap starting.
I20260709 12:08:18.275218 21219 raft_consensus.cc:359] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.276100 21219 raft_consensus.cc:385] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.276412 21219 raft_consensus.cc:740] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.277243 21219 consensus_queue.cc:260] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.279480 21219 ts_tablet_manager.cc:1434] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:08:18.279601 21220 tablet_bootstrap.cc:654] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.280434 21219 tablet_bootstrap.cc:492] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968: Bootstrap starting.
W20260709 12:08:18.282829 21201 tablet.cc:2406] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:18.288129 21219 tablet_bootstrap.cc:654] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.315505 21219 tablet_bootstrap.cc:492] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968: No bootstrap required, opened a new log
I20260709 12:08:18.315999 21219 ts_tablet_manager.cc:1403] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.025s
I20260709 12:08:18.318903 21219 raft_consensus.cc:359] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.319692 21219 raft_consensus.cc:385] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.319995 21219 raft_consensus.cc:740] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.320739 21219 consensus_queue.cc:260] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.323181 21219 ts_tablet_manager.cc:1434] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:08:18.324154 21219 tablet_bootstrap.cc:492] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968: Bootstrap starting.
I20260709 12:08:18.330739 21219 tablet_bootstrap.cc:654] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.342272 21218 tablet_bootstrap.cc:492] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227: No bootstrap required, opened a new log
I20260709 12:08:18.342487 21219 tablet_bootstrap.cc:492] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968: No bootstrap required, opened a new log
I20260709 12:08:18.343134 21218 ts_tablet_manager.cc:1403] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227: Time spent bootstrapping tablet: real 0.104s	user 0.008s	sys 0.012s
I20260709 12:08:18.343191 21219 ts_tablet_manager.cc:1403] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.009s
I20260709 12:08:18.347097 21219 raft_consensus.cc:359] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.347831 21219 raft_consensus.cc:385] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.348347 21219 raft_consensus.cc:740] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.347718 21218 raft_consensus.cc:359] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.349339 21218 raft_consensus.cc:385] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.349130 21219 consensus_queue.cc:260] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.349798 21218 raft_consensus.cc:740] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.351660 21219 ts_tablet_manager.cc:1434] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:08:18.352686 21219 tablet_bootstrap.cc:492] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968: Bootstrap starting.
I20260709 12:08:18.359066 21219 tablet_bootstrap.cc:654] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.370748 21219 tablet_bootstrap.cc:492] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968: No bootstrap required, opened a new log
I20260709 12:08:18.371261 21219 ts_tablet_manager.cc:1403] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 12:08:18.371598 21218 consensus_queue.cc:260] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.372754 21220 tablet_bootstrap.cc:492] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60: No bootstrap required, opened a new log
I20260709 12:08:18.373292 21220 ts_tablet_manager.cc:1403] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent bootstrapping tablet: real 0.108s	user 0.058s	sys 0.042s
I20260709 12:08:18.374264 21219 raft_consensus.cc:359] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:18.375066 21219 raft_consensus.cc:385] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.375365 21219 raft_consensus.cc:740] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.376345 21219 consensus_queue.cc:260] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:18.376482 21220 raft_consensus.cc:359] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.377096 21225 raft_consensus.cc:493] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.377370 21220 raft_consensus.cc:385] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.377709 21220 raft_consensus.cc:740] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.377631 21225 raft_consensus.cc:515] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:18.378892 21219 ts_tablet_manager.cc:1434] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:08:18.378775 21220 consensus_queue.cc:260] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.379925 21219 tablet_bootstrap.cc:492] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968: Bootstrap starting.
I20260709 12:08:18.381646 21220 ts_tablet_manager.cc:1434] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:18.382880 21224 raft_consensus.cc:493] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.383200 21220 tablet_bootstrap.cc:492] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60: Bootstrap starting.
I20260709 12:08:18.383373 21224 raft_consensus.cc:515] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.386581 21224 leader_election.cc:290] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:18.415141 21225 leader_election.cc:290] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329), d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579)
I20260709 12:08:18.421566 21219 tablet_bootstrap.cc:654] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.434037 21220 tablet_bootstrap.cc:654] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.435642 21218 ts_tablet_manager.cc:1434] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227: Time spent starting tablet: real 0.092s	user 0.009s	sys 0.001s
I20260709 12:08:18.435662 21219 tablet_bootstrap.cc:492] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968: No bootstrap required, opened a new log
I20260709 12:08:18.436342 21219 ts_tablet_manager.cc:1403] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.029s
I20260709 12:08:18.436937 21218 tablet_bootstrap.cc:492] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227: Bootstrap starting.
I20260709 12:08:18.440022 21219 raft_consensus.cc:359] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.441084 21219 raft_consensus.cc:385] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.441531 21219 raft_consensus.cc:740] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.442699 21219 consensus_queue.cc:260] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.445282 21219 ts_tablet_manager.cc:1434] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:08:18.446504 21219 tablet_bootstrap.cc:492] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968: Bootstrap starting.
I20260709 12:08:18.453611 21219 tablet_bootstrap.cc:654] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.464864 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
W20260709 12:08:18.475005 20991 leader_election.cc:343] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.490824 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
W20260709 12:08:18.495309 21064 leader_election.cc:343] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.496084 21220 tablet_bootstrap.cc:492] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60: No bootstrap required, opened a new log
I20260709 12:08:18.497044 21219 tablet_bootstrap.cc:492] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968: No bootstrap required, opened a new log
I20260709 12:08:18.497539 21219 ts_tablet_manager.cc:1403] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.004s
I20260709 12:08:18.498095 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:18.499117 21220 ts_tablet_manager.cc:1403] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.017s
W20260709 12:08:18.500254 20989 leader_election.cc:343] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.500804 20989 leader_election.cc:304] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8ced8b03c6340fa80989b0b4321a968; no voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:18.504910 21224 raft_consensus.cc:2749] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.527225 21226 raft_consensus.cc:493] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.537977 21224 raft_consensus.cc:493] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.509898 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968" is_pre_election: true
I20260709 12:08:18.505765 21218 tablet_bootstrap.cc:654] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.538336 21226 raft_consensus.cc:515] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.538574 21224 raft_consensus.cc:515] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:18.540979 21224 leader_election.cc:290] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:18.541733 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:18.542294 21101 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 0.
I20260709 12:08:18.513019 21219 raft_consensus.cc:359] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.543480 20991 leader_election.cc:304] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:18.543776 21219 raft_consensus.cc:385] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.543927 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:18.544173 21219 raft_consensus.cc:740] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.544472 21224 raft_consensus.cc:2804] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.545054 21026 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 0.
I20260709 12:08:18.545080 21219 consensus_queue.cc:260] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.547354 21226 leader_election.cc:290] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:18.549046 21065 leader_election.cc:304] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968; no voters: befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:18.549649 21226 raft_consensus.cc:493] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.548285 21219 ts_tablet_manager.cc:1434] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.009s
I20260709 12:08:18.546159 21224 raft_consensus.cc:493] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.550077 21225 raft_consensus.cc:2804] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.511755 21220 raft_consensus.cc:359] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:18.551658 21224 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.551729 21225 raft_consensus.cc:493] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.551788 21220 raft_consensus.cc:385] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.553546 21225 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.562613 21220 raft_consensus.cc:740] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.550235 21226 raft_consensus.cc:515] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.566751 21220 consensus_queue.cc:260] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:18.575330 21219 tablet_bootstrap.cc:492] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968: Bootstrap starting.
I20260709 12:08:18.576570 21220 ts_tablet_manager.cc:1434] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.015s
I20260709 12:08:18.573138 21175 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 0.
I20260709 12:08:18.577648 21220 tablet_bootstrap.cc:492] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60: Bootstrap starting.
I20260709 12:08:18.599043 21244 raft_consensus.cc:493] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.608354 21220 tablet_bootstrap.cc:654] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.599819 21244 raft_consensus.cc:515] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.616194 21218 tablet_bootstrap.cc:492] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227: No bootstrap required, opened a new log
I20260709 12:08:18.616792 21218 ts_tablet_manager.cc:1403] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227: Time spent bootstrapping tablet: real 0.180s	user 0.018s	sys 0.018s
I20260709 12:08:18.617779 21219 tablet_bootstrap.cc:654] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.621022 21225 raft_consensus.cc:515] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:18.623817 21226 leader_election.cc:290] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:18.625746 21225 leader_election.cc:290] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 election: Requested vote from peers befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329), d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579)
I20260709 12:08:18.630772 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:18.631419 21218 raft_consensus.cc:359] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.633920 21218 raft_consensus.cc:385] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.633874 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f76efae6fb414ab81d885d011ab891" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:18.628636 21244 leader_election.cc:290] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:18.632284 21225 raft_consensus.cc:493] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.637498 21218 raft_consensus.cc:740] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.637197 21225 raft_consensus.cc:515] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
W20260709 12:08:18.645581 20989 leader_election.cc:343] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.652235 21244 raft_consensus.cc:493] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.652721 21244 raft_consensus.cc:515] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.653554 21225 leader_election.cc:290] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:18.654726 21244 leader_election.cc:290] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:18.657634 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:18.659109 21175 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.658963 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:18.654294 21218 consensus_queue.cc:260] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.651458 21224 raft_consensus.cc:515] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:18.666896 21218 ts_tablet_manager.cc:1434] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:08:18.668381 21218 tablet_bootstrap.cc:492] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227: Bootstrap starting.
I20260709 12:08:18.675379 21026 raft_consensus.cc:2393] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bd9039b92df84c748e75739057fd0227 in current term 1: Already voted for candidate d8ced8b03c6340fa80989b0b4321a968 in this term.
I20260709 12:08:18.660147 21174 raft_consensus.cc:2468] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 0.
I20260709 12:08:18.678112 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:18.679332 20989 leader_election.cc:304] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:18.679683 21173 raft_consensus.cc:2468] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 0.
I20260709 12:08:18.681356 21244 raft_consensus.cc:493] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.681831 21244 raft_consensus.cc:515] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.682308 21064 leader_election.cc:304] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:18.682438 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f76efae6fb414ab81d885d011ab891" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:18.685699 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:18.674072 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968" is_pre_election: true
I20260709 12:08:18.688534 21025 raft_consensus.cc:2468] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 0.
I20260709 12:08:18.687095 21100 raft_consensus.cc:2468] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 0.
W20260709 12:08:18.713770 20991 leader_election.cc:343] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.714650 21248 raft_consensus.cc:2804] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.725108 21225 raft_consensus.cc:493] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.730789 21249 raft_consensus.cc:493] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.731417 21249 raft_consensus.cc:515] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.732576 21225 raft_consensus.cc:515] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.722244 20991 leader_election.cc:304] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8ced8b03c6340fa80989b0b4321a968; no voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:18.737560 21225 leader_election.cc:290] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:18.741479 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968" is_pre_election: true
I20260709 12:08:18.744351 21175 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 1.
I20260709 12:08:18.758575 21244 leader_election.cc:290] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:18.760160 21025 raft_consensus.cc:2468] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 0.
W20260709 12:08:18.759368 20989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:35329, user_credentials={real_user=slave}} blocked reactor thread for 80757us
I20260709 12:08:18.772372 21254 raft_consensus.cc:2749] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.763989 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:18.776031 21220 tablet_bootstrap.cc:492] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60: No bootstrap required, opened a new log
I20260709 12:08:18.776612 21064 leader_election.cc:304] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:18.776922 21220 ts_tablet_manager.cc:1403] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60: Time spent bootstrapping tablet: real 0.199s	user 0.037s	sys 0.029s
I20260709 12:08:18.777681 21225 raft_consensus.cc:2804] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.769498 21244 raft_consensus.cc:2804] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.779176 21219 tablet_bootstrap.cc:492] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968: No bootstrap required, opened a new log
I20260709 12:08:18.779680 21219 ts_tablet_manager.cc:1403] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968: Time spent bootstrapping tablet: real 0.207s	user 0.030s	sys 0.007s
I20260709 12:08:18.780265 21244 raft_consensus.cc:493] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:08:18.773023 20991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:42863, user_credentials={real_user=slave}} blocked reactor thread for 60385.2us
I20260709 12:08:18.779803 21218 tablet_bootstrap.cc:654] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.781134 21065 leader_election.cc:304] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:18.781134 21244 raft_consensus.cc:3060] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.783947 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:18.793385 21024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968" is_pre_election: true
W20260709 12:08:18.786075 21064 leader_election.cc:343] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.792254 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:18.796747 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968" is_pre_election: true
I20260709 12:08:18.797263 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:18.799916 21225 raft_consensus.cc:697] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:18.797494 21025 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 0.
I20260709 12:08:18.797312 21175 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 0.
I20260709 12:08:18.817150 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:18.818845 21099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:18.820394 21099 raft_consensus.cc:2468] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 0.
W20260709 12:08:18.820595 20970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:18.821430 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:18.825326 21140 leader_election.cc:304] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:18.824590 21220 raft_consensus.cc:359] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.826654 21220 raft_consensus.cc:385] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:08:18.826843 21140 leader_election.cc:343] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.826989 21220 raft_consensus.cc:740] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.827113 21226 raft_consensus.cc:2804] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.828016 21226 raft_consensus.cc:493] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.828441 21226 raft_consensus.cc:3060] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.829401 21139 leader_election.cc:304] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: bd9039b92df84c748e75739057fd0227
I20260709 12:08:18.829334 21220 consensus_queue.cc:260] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
W20260709 12:08:18.827502 20991 leader_election.cc:343] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.833370 21245 raft_consensus.cc:2804] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.836879 21245 raft_consensus.cc:493] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.837617 21245 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.821980 21225 consensus_queue.cc:237] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:18.838851 20991 leader_election.cc:304] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: bd9039b92df84c748e75739057fd0227
I20260709 12:08:18.851505 21256 raft_consensus.cc:2804] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.072836 21256 raft_consensus.cc:493] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.073271 21256 raft_consensus.cc:3060] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.868660 21218 tablet_bootstrap.cc:492] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227: No bootstrap required, opened a new log
I20260709 12:08:19.079787 21218 ts_tablet_manager.cc:1403] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227: Time spent bootstrapping tablet: real 0.412s	user 0.021s	sys 0.009s
I20260709 12:08:18.841383 21219 raft_consensus.cc:359] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.082393 21219 raft_consensus.cc:385] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.082722 21219 raft_consensus.cc:740] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.083418 21219 consensus_queue.cc:260] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:18.861294 21220 ts_tablet_manager.cc:1434] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60: Time spent starting tablet: real 0.081s	user 0.015s	sys 0.004s
I20260709 12:08:19.086810 21220 tablet_bootstrap.cc:492] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60: Bootstrap starting.
I20260709 12:08:18.866333 21244 raft_consensus.cc:515] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.091686 21218 raft_consensus.cc:359] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.092437 21218 raft_consensus.cc:385] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.984645 21249 leader_election.cc:290] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:19.098125 21256 raft_consensus.cc:515] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.013239 21224 leader_election.cc:290] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:19.036832 21245 raft_consensus.cc:515] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.098770 21218 raft_consensus.cc:740] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.099664 21218 consensus_queue.cc:260] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.065663 21173 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 0.
I20260709 12:08:18.872256 21226 raft_consensus.cc:515] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.120338 21226 leader_election.cc:290] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:19.093148 21024 raft_consensus.cc:2393] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate befb81a6a97149ed9c5c6dad78b7aa60 in current term 1: Already voted for candidate d8ced8b03c6340fa80989b0b4321a968 in this term.
I20260709 12:08:19.092482 21244 leader_election.cc:290] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
W20260709 12:08:19.093354 20989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:35329, user_credentials={real_user=slave}} blocked reactor thread for 261465us
I20260709 12:08:19.125947 20989 leader_election.cc:304] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:19.126341 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:19.127931 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
W20260709 12:08:19.094554 20991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:42863, user_credentials={real_user=slave}} blocked reactor thread for 269519us
W20260709 12:08:19.130010 20991 leader_election.cc:343] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.130148 21024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:19.094734 21253 raft_consensus.cc:2804] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.131050 21024 raft_consensus.cc:2393] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate befb81a6a97149ed9c5c6dad78b7aa60 in current term 1: Already voted for candidate d8ced8b03c6340fa80989b0b4321a968 in this term.
I20260709 12:08:19.131212 21253 raft_consensus.cc:493] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.131773 21253 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.094686 21219 ts_tablet_manager.cc:1434] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968: Time spent starting tablet: real 0.315s	user 0.010s	sys 0.000s
I20260709 12:08:19.133373 21219 tablet_bootstrap.cc:492] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968: Bootstrap starting.
I20260709 12:08:19.048259 21248 raft_consensus.cc:493] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.137075 21248 raft_consensus.cc:3060] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.139288 21219 tablet_bootstrap.cc:654] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.103361 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:19.140658 21025 raft_consensus.cc:3060] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.142760 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:19.143651 21175 raft_consensus.cc:2393] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d8ced8b03c6340fa80989b0b4321a968 in current term 1: Already voted for candidate bd9039b92df84c748e75739057fd0227 in this term.
I20260709 12:08:19.103699 21245 leader_election.cc:290] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:19.103933 21256 leader_election.cc:290] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:19.145511 21099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:19.104826 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:19.105239 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:19.106290 21220 tablet_bootstrap.cc:654] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.106873 21218 ts_tablet_manager.cc:1434] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:08:19.128079 21244 raft_consensus.cc:2804] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.102938 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:19.149644 21244 raft_consensus.cc:493] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.151098 21244 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.148512 21098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:19.152119 20991 leader_election.cc:304] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8ced8b03c6340fa80989b0b4321a968; no voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60
W20260709 12:08:19.156320 21064 leader_election.cc:343] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.157843 21224 raft_consensus.cc:2749] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.151710 21174 raft_consensus.cc:2393] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d8ced8b03c6340fa80989b0b4321a968 in current term 1: Already voted for candidate befb81a6a97149ed9c5c6dad78b7aa60 in this term.
I20260709 12:08:19.150359 21100 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.159578 20989 leader_election.cc:304] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8ced8b03c6340fa80989b0b4321a968; no voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:19.160624 21224 raft_consensus.cc:2749] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.157075 21218 tablet_bootstrap.cc:492] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227: Bootstrap starting.
I20260709 12:08:19.169580 20923 catalog_manager.cc:5697] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.174288 21253 raft_consensus.cc:515] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.176396 21026 raft_consensus.cc:2393] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate befb81a6a97149ed9c5c6dad78b7aa60 in current term 1: Already voted for candidate d8ced8b03c6340fa80989b0b4321a968 in this term.
I20260709 12:08:19.178881 21098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:19.193095 21219 tablet_bootstrap.cc:492] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968: No bootstrap required, opened a new log
I20260709 12:08:19.193248 21100 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 1.
I20260709 12:08:19.193591 21219 ts_tablet_manager.cc:1403] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.026s
I20260709 12:08:19.194737 21140 leader_election.cc:304] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:19.196201 21245 raft_consensus.cc:2804] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.196759 21245 raft_consensus.cc:697] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Becoming Leader. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Running, Role: LEADER
I20260709 12:08:19.184264 21244 raft_consensus.cc:515] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.197711 21218 tablet_bootstrap.cc:654] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.197726 21245 consensus_queue.cc:237] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.199882 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:19.200400 21253 leader_election.cc:290] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:19.200436 21248 raft_consensus.cc:515] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.201414 21025 raft_consensus.cc:2468] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 1.
I20260709 12:08:19.202534 21098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:19.203190 21244 leader_election.cc:290] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:19.203465 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:19.213471 21173 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.207793 21219 raft_consensus.cc:359] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.209846 20989 leader_election.cc:304] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8ced8b03c6340fa80989b0b4321a968; no voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:19.214274 21219 raft_consensus.cc:385] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.209934 21220 tablet_bootstrap.cc:492] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60: No bootstrap required, opened a new log
I20260709 12:08:19.215884 21219 raft_consensus.cc:740] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Initialized, Role: FOLLOWER
W20260709 12:08:19.217038 20991 leader_election.cc:343] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.216883 21101 raft_consensus.cc:2393] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate befb81a6a97149ed9c5c6dad78b7aa60 in current term 1: Already voted for candidate bd9039b92df84c748e75739057fd0227 in this term.
I20260709 12:08:19.218497 21065 leader_election.cc:304] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968; no voters: befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:19.219704 21256 raft_consensus.cc:2804] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.220376 21220 ts_tablet_manager.cc:1403] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent bootstrapping tablet: real 0.134s	user 0.023s	sys 0.011s
I20260709 12:08:19.217970 21219 consensus_queue.cc:260] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.220187 21256 raft_consensus.cc:697] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:19.221602 21140 leader_election.cc:304] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60; no voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:19.221903 21256 consensus_queue.cc:237] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.216342 21253 raft_consensus.cc:2749] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.222736 21219 ts_tablet_manager.cc:1434] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 12:08:19.223272 21226 raft_consensus.cc:2749] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.226646 21248 leader_election.cc:290] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:19.230473 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:19.231742 21174 raft_consensus.cc:2393] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bd9039b92df84c748e75739057fd0227 in current term 1: Already voted for candidate befb81a6a97149ed9c5c6dad78b7aa60 in this term.
I20260709 12:08:19.233775 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:19.235224 21025 raft_consensus.cc:2393] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bd9039b92df84c748e75739057fd0227 in current term 1: Already voted for candidate d8ced8b03c6340fa80989b0b4321a968 in this term.
I20260709 12:08:19.236479 21065 leader_election.cc:304] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd9039b92df84c748e75739057fd0227; no voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:19.237695 21248 raft_consensus.cc:2749] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.230944 21173 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 1.
I20260709 12:08:19.241961 20989 leader_election.cc:304] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: bd9039b92df84c748e75739057fd0227
I20260709 12:08:19.243181 21253 raft_consensus.cc:2804] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.243719 21253 raft_consensus.cc:697] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 1 LEADER]: Becoming Leader. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:19.244655 21253 consensus_queue.cc:237] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.261355 21218 tablet_bootstrap.cc:492] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227: No bootstrap required, opened a new log
I20260709 12:08:19.262071 21218 ts_tablet_manager.cc:1403] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.006s
I20260709 12:08:19.266840 21218 raft_consensus.cc:359] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.269062 21218 raft_consensus.cc:385] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.270280 21218 raft_consensus.cc:740] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.271252 21218 consensus_queue.cc:260] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.278129 21220 raft_consensus.cc:359] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.279018 21220 raft_consensus.cc:385] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.279011 20922 catalog_manager.cc:5697] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "d8ced8b03c6340fa80989b0b4321a968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.280391 21220 raft_consensus.cc:740] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.281258 21220 consensus_queue.cc:260] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.282763 21218 ts_tablet_manager.cc:1434] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.005s
I20260709 12:08:19.282030 20919 catalog_manager.cc:5697] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 reported cstate change: term changed from 0 to 1, leader changed from <none> to befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.285779 21218 tablet_bootstrap.cc:492] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227: Bootstrap starting.
I20260709 12:08:19.283602 21220 ts_tablet_manager.cc:1434] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 12:08:19.291914 21220 tablet_bootstrap.cc:492] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60: Bootstrap starting.
I20260709 12:08:19.300045 21220 tablet_bootstrap.cc:654] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.300705 21218 tablet_bootstrap.cc:654] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.321326 21220 tablet_bootstrap.cc:492] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60: No bootstrap required, opened a new log
I20260709 12:08:19.322206 21220 ts_tablet_manager.cc:1403] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60: Time spent bootstrapping tablet: real 0.031s	user 0.004s	sys 0.012s
I20260709 12:08:19.325989 21220 raft_consensus.cc:359] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.326920 21220 raft_consensus.cc:385] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.327255 21220 raft_consensus.cc:740] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.331841 21253 raft_consensus.cc:493] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.332103 21220 consensus_queue.cc:260] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.332419 21253 raft_consensus.cc:515] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.334841 21253 leader_election.cc:290] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:19.335457 21218 tablet_bootstrap.cc:492] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227: No bootstrap required, opened a new log
I20260709 12:08:19.336091 21218 ts_tablet_manager.cc:1403] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.005s
I20260709 12:08:19.335991 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cad2433c904b948364ba8a49112d8d" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:19.337165 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cad2433c904b948364ba8a49112d8d" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:19.337540 20922 catalog_manager.cc:5697] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.339699 21218 raft_consensus.cc:359] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
W20260709 12:08:19.338981 20989 leader_election.cc:343] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.342954 21220 ts_tablet_manager.cc:1434] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:08:19.344103 21220 tablet_bootstrap.cc:492] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60: Bootstrap starting.
I20260709 12:08:19.340546 21218 raft_consensus.cc:385] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.349319 21218 raft_consensus.cc:740] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.350294 21218 consensus_queue.cc:260] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.351605 21101 raft_consensus.cc:2468] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 0.
I20260709 12:08:19.354056 21218 ts_tablet_manager.cc:1434] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.005s
I20260709 12:08:19.353828 20991 leader_election.cc:304] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968; no voters: befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:19.354813 21253 raft_consensus.cc:2804] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.355238 21253 raft_consensus.cc:493] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.355546 21253 raft_consensus.cc:3060] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.356042 21218 tablet_bootstrap.cc:492] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227: Bootstrap starting.
I20260709 12:08:19.362713 21253 raft_consensus.cc:515] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.366557 21220 tablet_bootstrap.cc:654] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.367364 21256 consensus_queue.cc:1048] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.368144 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cad2433c904b948364ba8a49112d8d" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:19.368671 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cad2433c904b948364ba8a49112d8d" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
W20260709 12:08:19.370421 20989 leader_election.cc:343] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.371074 21253 leader_election.cc:290] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:19.368798 21101 raft_consensus.cc:3060] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.378243 21218 tablet_bootstrap.cc:654] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.387071 21101 raft_consensus.cc:2468] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 1.
I20260709 12:08:19.388453 20991 leader_election.cc:304] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968; no voters: befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:19.390085 21253 raft_consensus.cc:2804] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.390657 21253 raft_consensus.cc:697] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 1 LEADER]: Becoming Leader. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:19.391516 21253 consensus_queue.cc:237] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.396561 21218 tablet_bootstrap.cc:492] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227: No bootstrap required, opened a new log
I20260709 12:08:19.397168 21218 ts_tablet_manager.cc:1403] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260709 12:08:19.396908 21225 consensus_queue.cc:1048] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.430016 21218 raft_consensus.cc:359] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.431514 21218 raft_consensus.cc:385] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.432116 21218 raft_consensus.cc:740] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.430713 21220 tablet_bootstrap.cc:492] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60: No bootstrap required, opened a new log
I20260709 12:08:19.433471 21220 ts_tablet_manager.cc:1403] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.011s
I20260709 12:08:19.432690 20922 catalog_manager.cc:5697] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "d8ced8b03c6340fa80989b0b4321a968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.433210 21218 consensus_queue.cc:260] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.437058 21218 ts_tablet_manager.cc:1434] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:08:19.437583 21220 raft_consensus.cc:359] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.438320 21218 tablet_bootstrap.cc:492] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227: Bootstrap starting.
I20260709 12:08:19.446924 21218 tablet_bootstrap.cc:654] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.438350 21220 raft_consensus.cc:385] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.449394 21220 raft_consensus.cc:740] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.450265 21220 consensus_queue.cc:260] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.453174 21220 ts_tablet_manager.cc:1434] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:08:19.453188 21253 raft_consensus.cc:493] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.454668 21253 raft_consensus.cc:515] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.454295 21220 tablet_bootstrap.cc:492] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60: Bootstrap starting.
I20260709 12:08:19.458133 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893f92a39d9475abb74a13787ccf8c0" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
W20260709 12:08:19.459848 20991 leader_election.cc:343] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.462399 21253 leader_election.cc:290] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:19.462667 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893f92a39d9475abb74a13787ccf8c0" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
W20260709 12:08:19.464171 20989 leader_election.cc:343] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.464658 20989 leader_election.cc:304] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8ced8b03c6340fa80989b0b4321a968; no voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:19.465879 21253 raft_consensus.cc:2749] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.477654 21220 tablet_bootstrap.cc:654] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.491706 21245 raft_consensus.cc:493] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.492367 21245 raft_consensus.cc:515] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.494695 21245 leader_election.cc:290] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:19.496038 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968" is_pre_election: true
I20260709 12:08:19.496454 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:19.497237 21025 raft_consensus.cc:2468] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 0.
I20260709 12:08:19.497449 21101 raft_consensus.cc:2468] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 0.
I20260709 12:08:19.498976 21140 leader_election.cc:304] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:19.500160 21245 raft_consensus.cc:2804] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.500552 21245 raft_consensus.cc:493] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.500944 21245 raft_consensus.cc:3060] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.507481 21218 tablet_bootstrap.cc:492] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227: No bootstrap required, opened a new log
I20260709 12:08:19.508021 21218 ts_tablet_manager.cc:1403] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.032s
I20260709 12:08:19.508149 21220 tablet_bootstrap.cc:492] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60: No bootstrap required, opened a new log
I20260709 12:08:19.508865 21220 ts_tablet_manager.cc:1403] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.000s
I20260709 12:08:19.510866 21218 raft_consensus.cc:359] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.511539 21218 raft_consensus.cc:385] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.511765 21218 raft_consensus.cc:740] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.512496 21218 consensus_queue.cc:260] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.513939 21220 raft_consensus.cc:359] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.516449 21218 ts_tablet_manager.cc:1434] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:08:19.517185 21220 raft_consensus.cc:385] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.517760 21220 raft_consensus.cc:740] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.518023 21218 tablet_bootstrap.cc:492] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227: Bootstrap starting.
I20260709 12:08:19.520931 21245 raft_consensus.cc:515] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.528083 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:19.528841 21025 raft_consensus.cc:3060] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.529276 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:19.529105 21220 consensus_queue.cc:260] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.529861 21101 raft_consensus.cc:3060] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.530277 21245 leader_election.cc:290] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:19.533221 21220 ts_tablet_manager.cc:1434] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:08:19.534269 21220 tablet_bootstrap.cc:492] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60: Bootstrap starting.
I20260709 12:08:19.528877 21218 tablet_bootstrap.cc:654] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.553014 21220 tablet_bootstrap.cc:654] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.556329 21218 tablet_bootstrap.cc:492] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227: No bootstrap required, opened a new log
I20260709 12:08:19.556875 21218 ts_tablet_manager.cc:1403] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.016s
I20260709 12:08:19.559940 21218 raft_consensus.cc:359] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.564309 21218 raft_consensus.cc:385] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.564638 21218 raft_consensus.cc:740] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.565630 21218 consensus_queue.cc:260] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.568203 21218 ts_tablet_manager.cc:1434] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:08:19.575749 21220 tablet_bootstrap.cc:492] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60: No bootstrap required, opened a new log
I20260709 12:08:19.576272 21220 ts_tablet_manager.cc:1403] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.007s
I20260709 12:08:19.578943 21220 raft_consensus.cc:359] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.579661 21220 raft_consensus.cc:385] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.579933 21220 raft_consensus.cc:740] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.580717 21220 consensus_queue.cc:260] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.582276 21225 raft_consensus.cc:493] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.582856 21225 raft_consensus.cc:515] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.585157 21220 ts_tablet_manager.cc:1434] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:08:19.585227 21225 leader_election.cc:290] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:19.586604 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f76efae6fb414ab81d885d011ab891" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968" is_pre_election: true
I20260709 12:08:19.587064 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f76efae6fb414ab81d885d011ab891" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:19.587278 21026 raft_consensus.cc:2468] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 0.
I20260709 12:08:19.587811 21173 raft_consensus.cc:2468] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 0.
I20260709 12:08:19.589421 21064 leader_election.cc:304] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:19.590397 21225 raft_consensus.cc:2804] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.590793 21225 raft_consensus.cc:493] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.591149 21225 raft_consensus.cc:3060] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.599830 21025 raft_consensus.cc:2468] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 1.
I20260709 12:08:19.599994 21101 raft_consensus.cc:2468] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 1.
I20260709 12:08:19.605005 21140 leader_election.cc:304] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:19.606308 21245 raft_consensus.cc:2804] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.606848 21245 raft_consensus.cc:697] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Becoming Leader. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Running, Role: LEADER
I20260709 12:08:19.607710 21245 consensus_queue.cc:237] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.621587 20921 catalog_manager.cc:5697] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 reported cstate change: term changed from 0 to 1, leader changed from <none> to befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.649897 21245 raft_consensus.cc:493] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.650651 21245 raft_consensus.cc:515] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.650820 21256 consensus_queue.cc:1048] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.653167 21245 leader_election.cc:290] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:19.653820 21173 raft_consensus.cc:3060] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.655434 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893f92a39d9475abb74a13787ccf8c0" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:19.656256 21101 raft_consensus.cc:2468] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 0.
I20260709 12:08:19.659512 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893f92a39d9475abb74a13787ccf8c0" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968" is_pre_election: true
I20260709 12:08:19.660427 21026 raft_consensus.cc:2468] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 0.
I20260709 12:08:19.661140 21245 raft_consensus.cc:493] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.661742 21245 raft_consensus.cc:515] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.662075 21140 leader_election.cc:304] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:19.664211 21226 raft_consensus.cc:2804] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.664346 21245 leader_election.cc:290] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:19.664794 21226 raft_consensus.cc:493] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.665273 21226 raft_consensus.cc:3060] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.667598 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cad2433c904b948364ba8a49112d8d" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968" is_pre_election: true
I20260709 12:08:19.676538 21098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cad2433c904b948364ba8a49112d8d" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:19.678238 21098 raft_consensus.cc:2393] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate befb81a6a97149ed9c5c6dad78b7aa60 in current term 1: Already voted for candidate d8ced8b03c6340fa80989b0b4321a968 in this term.
I20260709 12:08:19.680058 21140 leader_election.cc:304] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60; no voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:19.681478 21245 raft_consensus.cc:3060] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.684016 21287 consensus_queue.cc:1048] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.685822 21287 consensus_queue.cc:1048] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.687282 21101 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.747601 21225 raft_consensus.cc:515] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.750938 21225 leader_election.cc:290] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:19.751516 21225 consensus_queue.cc:1048] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:08:19.752907 21291 log.cc:927] Time spent T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:08:19.755604 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f76efae6fb414ab81d885d011ab891" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:19.756232 21026 raft_consensus.cc:3060] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.757319 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f76efae6fb414ab81d885d011ab891" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:19.757966 21173 raft_consensus.cc:3060] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.799630 21245 raft_consensus.cc:2749] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.800851 21226 raft_consensus.cc:515] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.801337 21173 raft_consensus.cc:2468] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 1.
I20260709 12:08:19.803078 21064 leader_election.cc:304] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:19.804225 21256 raft_consensus.cc:2804] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.803092 21226 leader_election.cc:290] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:19.804474 21253 consensus_queue.cc:1048] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.804804 21256 raft_consensus.cc:697] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:19.805621 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893f92a39d9475abb74a13787ccf8c0" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:19.805734 21256 consensus_queue.cc:237] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.806313 21101 raft_consensus.cc:3060] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.810065 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893f92a39d9475abb74a13787ccf8c0" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:19.810953 21025 raft_consensus.cc:3060] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.820020 21026 raft_consensus.cc:2468] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 1.
I20260709 12:08:19.832684 21244 consensus_queue.cc:1048] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:08:19.838879 20970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:19.839146 21244 consensus_queue.cc:1048] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.839773 20919 catalog_manager.cc:5697] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.843124 21244 consensus_queue.cc:1048] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:08:19.894555 20954 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 20894
W20260709 12:08:19.895563 20954 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 20957
W20260709 12:08:19.896638 20954 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6860 after lost signal to thread 21050
W20260709 12:08:19.897635 20954 debug-util.cc:398] Leaking SignalData structure 0x7b08001af4c0 after lost signal to thread 21125
W20260709 12:08:19.898528 20954 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba580 after lost signal to thread 21199
I20260709 12:08:19.902201 21025 raft_consensus.cc:2468] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 1.
I20260709 12:08:19.903250 21101 raft_consensus.cc:2468] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 1.
I20260709 12:08:19.904666 21140 leader_election.cc:304] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:19.906298 21226 raft_consensus.cc:2804] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.906898 21226 raft_consensus.cc:697] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Becoming Leader. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Running, Role: LEADER
I20260709 12:08:19.907742 21226 consensus_queue.cc:237] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:19.917305 20922 catalog_manager.cc:5697] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 reported cstate change: term changed from 0 to 1, leader changed from <none> to befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:20.008231 21226 consensus_queue.cc:1048] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.025040 21288 consensus_queue.cc:1048] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:20.319425 21288 consensus_queue.cc:1048] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.345008 21226 consensus_queue.cc:1048] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.350299 21256 consensus_queue.cc:1048] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:20.386181 21256 consensus_queue.cc:1048] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:20.676155 21253 raft_consensus.cc:493] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:20.676725 21253 raft_consensus.cc:515] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:20.678676 21253 leader_election.cc:290] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:20.679694 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:20.679991 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:20.680325 21101 raft_consensus.cc:2468] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 1.
I20260709 12:08:20.680874 21173 raft_consensus.cc:2468] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 1.
I20260709 12:08:20.681558 20991 leader_election.cc:304] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:20.682358 21253 raft_consensus.cc:2804] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:08:20.682734 21253 raft_consensus.cc:493] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:20.683033 21253 raft_consensus.cc:3060] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.688335 21253 raft_consensus.cc:515] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:20.690148 21253 leader_election.cc:290] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 2 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:20.691013 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:20.691417 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:20.691722 21101 raft_consensus.cc:3060] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.692016 21173 raft_consensus.cc:3060] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.697201 21173 raft_consensus.cc:2468] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 2.
I20260709 12:08:20.698547 20989 leader_election.cc:304] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:20.699288 21253 raft_consensus.cc:2804] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.699735 21253 raft_consensus.cc:697] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Becoming Leader. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:20.699795 21101 raft_consensus.cc:2468] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 2.
I20260709 12:08:20.700660 21253 consensus_queue.cc:237] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:20.709405 20921 catalog_manager.cc:5697] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 reported cstate change: term changed from 0 to 2, leader changed from <none> to d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "d8ced8b03c6340fa80989b0b4321a968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:21.112126 21173 raft_consensus.cc:1275] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:08:21.113865 21253 consensus_queue.cc:1048] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:21.127954 21101 raft_consensus.cc:1275] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:08:21.131233 21253 consensus_queue.cc:1048] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:21.291350 21101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
mode: GRACEFUL
new_leader_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:46916
I20260709 12:08:21.292289 21101 raft_consensus.cc:606] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Received request to transfer leadership to TS d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:21.309757 21173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080"
dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
mode: GRACEFUL
new_leader_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:35626
I20260709 12:08:21.310521 21173 raft_consensus.cc:606] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Received request to transfer leadership to TS d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:21.319675 21101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
mode: GRACEFUL
new_leader_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:46916
I20260709 12:08:21.320453 21101 raft_consensus.cc:606] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Received request to transfer leadership to TS d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:21.326574 21173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e"
dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
mode: GRACEFUL
new_leader_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:35626
I20260709 12:08:21.327208 21173 raft_consensus.cc:606] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Received request to transfer leadership to TS bd9039b92df84c748e75739057fd0227
I20260709 12:08:21.348196 21025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
mode: GRACEFUL
new_leader_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:37776
I20260709 12:08:21.348964 21025 raft_consensus.cc:606] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 1 LEADER]: Received request to transfer leadership to TS bd9039b92df84c748e75739057fd0227
I20260709 12:08:21.357204 21025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5cad2433c904b948364ba8a49112d8d"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
mode: GRACEFUL
new_leader_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:37776
I20260709 12:08:21.357939 21025 raft_consensus.cc:606] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 1 LEADER]: Received request to transfer leadership to TS bd9039b92df84c748e75739057fd0227
I20260709 12:08:21.421818 21321 raft_consensus.cc:993] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60: : Instructing follower bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:21.422307 21226 raft_consensus.cc:1081] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Signalling peer bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:21.424144 21101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:46912
I20260709 12:08:21.424727 21101 raft_consensus.cc:493] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:21.425185 21101 raft_consensus.cc:3060] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.430132 21101 raft_consensus.cc:515] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.432533 21101 leader_election.cc:290] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 2 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:21.433622 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:21.434243 21173 raft_consensus.cc:3055] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:21.434486 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:21.434576 21173 raft_consensus.cc:740] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Running, Role: LEADER
I20260709 12:08:21.435045 21025 raft_consensus.cc:3060] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.435827 21173 consensus_queue.cc:260] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.437244 21173 raft_consensus.cc:3060] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.442046 21025 raft_consensus.cc:2468] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 2.
I20260709 12:08:21.443567 21065 leader_election.cc:304] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:21.444134 21322 raft_consensus.cc:993] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227: : Instructing follower d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:21.444113 21173 raft_consensus.cc:2468] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 2.
I20260709 12:08:21.444662 21248 raft_consensus.cc:2804] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:21.447402 21322 raft_consensus.cc:1081] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Signalling peer d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:21.447917 21248 raft_consensus.cc:697] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:21.449380 21025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:37754
I20260709 12:08:21.449985 21025 raft_consensus.cc:493] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:21.449508 21248 consensus_queue.cc:237] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.450346 21025 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.455439 21025 raft_consensus.cc:515] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:21.458834 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:21.459122 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:21.459458 21101 raft_consensus.cc:3055] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:21.459638 21173 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.459808 21101 raft_consensus.cc:740] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:21.460655 21101 consensus_queue.cc:260] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:21.461978 21101 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.463694 20921 catalog_manager.cc:5697] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 1 to 2, leader changed from befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195) to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:21.467180 21173 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 2.
I20260709 12:08:21.468488 20989 leader_election.cc:304] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:21.468953 21101 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 2.
I20260709 12:08:21.469455 21253 raft_consensus.cc:2804] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:21.469952 21253 raft_consensus.cc:697] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Becoming Leader. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:21.470801 21025 leader_election.cc:290] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 2 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:21.470845 21253 consensus_queue.cc:237] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:21.480297 20919 catalog_manager.cc:5697] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 reported cstate change: term changed from 1 to 2, leader changed from bd9039b92df84c748e75739057fd0227 (127.20.102.194) to d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "d8ced8b03c6340fa80989b0b4321a968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:21.515573 21244 raft_consensus.cc:993] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968: : Instructing follower bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:21.516219 21253 raft_consensus.cc:1081] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 1 LEADER]: Signalling peer bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:21.518296 21101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:46904
I20260709 12:08:21.518843 21101 raft_consensus.cc:493] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:21.519187 21101 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.524241 21101 raft_consensus.cc:515] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.526302 21101 leader_election.cc:290] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 2 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:21.527599 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:21.527541 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:21.528435 21173 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.528596 21025 raft_consensus.cc:3055] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:21.529093 21025 raft_consensus.cc:740] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:21.529959 21025 consensus_queue.cc:260] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.531394 21025 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.533927 21173 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 2.
I20260709 12:08:21.534956 21064 leader_election.cc:304] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:21.535650 21248 raft_consensus.cc:2804] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:21.536103 21248 raft_consensus.cc:697] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:21.536947 21248 consensus_queue.cc:237] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.539476 21025 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 2.
I20260709 12:08:21.544466 20919 catalog_manager.cc:5697] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 1 to 2, leader changed from d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193) to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:21.568073 21323 raft_consensus.cc:993] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227: : Instructing follower d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:21.568549 21248 raft_consensus.cc:1081] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Signalling peer d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:21.570235 21025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:37754
I20260709 12:08:21.570966 21025 raft_consensus.cc:493] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:21.571413 21025 raft_consensus.cc:3060] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.579694 21025 raft_consensus.cc:515] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.582218 21025 leader_election.cc:290] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 2 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:21.582971 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:21.583655 21100 raft_consensus.cc:3055] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:21.584051 21100 raft_consensus.cc:740] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:21.584802 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:21.584937 21100 consensus_queue.cc:260] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.585556 21173 raft_consensus.cc:3060] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.586272 21100 raft_consensus.cc:3060] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.594199 21173 raft_consensus.cc:2468] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 2.
I20260709 12:08:21.594664 21100 raft_consensus.cc:2468] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 2.
I20260709 12:08:21.595635 20989 leader_election.cc:304] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:21.596468 21253 raft_consensus.cc:2804] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:21.597007 21253 raft_consensus.cc:697] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Becoming Leader. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:21.597767 21253 consensus_queue.cc:237] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.605273 20919 catalog_manager.cc:5697] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 reported cstate change: term changed from 1 to 2, leader changed from bd9039b92df84c748e75739057fd0227 (127.20.102.194) to d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "d8ced8b03c6340fa80989b0b4321a968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:21.641145 21321 raft_consensus.cc:993] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60: : Instructing follower d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:21.641639 21321 raft_consensus.cc:1081] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Signalling peer d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:21.643126 21025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:37760
I20260709 12:08:21.643666 21025 raft_consensus.cc:493] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:21.643985 21025 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.649978 21025 raft_consensus.cc:515] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.651711 21025 leader_election.cc:290] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 2 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:21.652904 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:21.652863 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:21.653677 21173 raft_consensus.cc:3055] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:21.653803 21100 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.654043 21173 raft_consensus.cc:740] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Running, Role: LEADER
I20260709 12:08:21.654901 21173 consensus_queue.cc:260] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.656121 21173 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.660683 21100 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 2.
I20260709 12:08:21.662026 20991 leader_election.cc:304] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:21.662952 21173 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 2.
I20260709 12:08:21.662925 21253 raft_consensus.cc:2804] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:21.664142 21253 raft_consensus.cc:697] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Becoming Leader. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:21.665254 21253 consensus_queue.cc:237] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.674082 20919 catalog_manager.cc:5697] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 reported cstate change: term changed from 1 to 2, leader changed from befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195) to d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "d8ced8b03c6340fa80989b0b4321a968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:21.746100 21333 raft_consensus.cc:993] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968: : Instructing follower bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:21.746624 21244 raft_consensus.cc:1081] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 1 LEADER]: Signalling peer bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:21.748281 21100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5cad2433c904b948364ba8a49112d8d"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:46904
I20260709 12:08:21.749001 21100 raft_consensus.cc:493] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:21.749424 21100 raft_consensus.cc:3060] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.758038 21100 raft_consensus.cc:515] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.760488 21100 leader_election.cc:290] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 2 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:21.761495 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cad2433c904b948364ba8a49112d8d" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:21.761529 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cad2433c904b948364ba8a49112d8d" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:21.762231 21025 raft_consensus.cc:3055] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:21.762447 21173 raft_consensus.cc:3060] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.762602 21025 raft_consensus.cc:740] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:21.763479 21025 consensus_queue.cc:260] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.764662 21025 raft_consensus.cc:3060] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.769732 21173 raft_consensus.cc:2468] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 2.
I20260709 12:08:21.771242 21064 leader_election.cc:304] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:21.771579 21025 raft_consensus.cc:2468] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 2.
I20260709 12:08:21.772269 21248 raft_consensus.cc:2804] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:21.772804 21248 raft_consensus.cc:697] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:21.773643 21248 consensus_queue.cc:237] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:21.782660 20919 catalog_manager.cc:5697] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 1 to 2, leader changed from d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193) to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:21.846678 21025 raft_consensus.cc:1275] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.848347 21248 consensus_queue.cc:1048] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.874873 21173 raft_consensus.cc:1275] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.876545 21322 consensus_queue.cc:1048] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:22.011891 21173 raft_consensus.cc:1275] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.013404 21244 consensus_queue.cc:1048] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:22.016050 21173 raft_consensus.cc:1275] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.018224 21322 consensus_queue.cc:1048] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:22.024950 21100 raft_consensus.cc:1275] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.027452 21253 consensus_queue.cc:1048] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:22.032549 21025 raft_consensus.cc:1275] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.039579 21322 consensus_queue.cc:1048] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:22.062783 21174 raft_consensus.cc:1275] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.064319 21244 consensus_queue.cc:1048] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:22.070983 21100 raft_consensus.cc:1275] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.072516 21244 consensus_queue.cc:1048] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:22.110968 21101 raft_consensus.cc:1275] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.112190 21333 consensus_queue.cc:1048] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:22.123922 21174 raft_consensus.cc:1275] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.127563 21333 consensus_queue.cc:1048] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:22.268026 21025 raft_consensus.cc:1275] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.269408 21322 consensus_queue.cc:1048] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:22.281678 21174 raft_consensus.cc:1275] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.283677 21344 consensus_queue.cc:1048] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:24.396627 20891 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:24.397517 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:24.414368 21100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
mode: GRACEFUL
new_leader_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
 from {username='slave'} at 127.0.0.1:40188
I20260709 12:08:24.414969 21100 raft_consensus.cc:606] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Received request to transfer leadership to TS befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:24.426488 21025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
mode: GRACEFUL
new_leader_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
 from {username='slave'} at 127.0.0.1:40718
I20260709 12:08:24.427078 21025 raft_consensus.cc:606] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Received request to transfer leadership to TS befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:24.428210 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:24.428682 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:24.598987 21253 raft_consensus.cc:993] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968: : Instructing follower befb81a6a97149ed9c5c6dad78b7aa60 to start an election
I20260709 12:08:24.599550 21253 raft_consensus.cc:1081] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Signalling peer befb81a6a97149ed9c5c6dad78b7aa60 to start an election
I20260709 12:08:24.601174 21174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080"
dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
 from {username='slave'} at 127.0.0.1:35610
I20260709 12:08:24.601827 21174 raft_consensus.cc:493] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:24.602130 21174 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:24.606791 21174 raft_consensus.cc:515] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:24.608520 21174 leader_election.cc:290] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 3 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:24.609630 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:24.609643 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:24.610347 21025 raft_consensus.cc:3055] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:24.610438 21100 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:24.610666 21025 raft_consensus.cc:740] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:24.611457 21025 consensus_queue.cc:260] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:24.612335 21025 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:24.615525 21100 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 3.
I20260709 12:08:24.617451 21140 leader_election.cc:304] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:24.618477 21354 raft_consensus.cc:2804] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:24.619831 21354 raft_consensus.cc:697] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Becoming Leader. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Running, Role: LEADER
I20260709 12:08:24.620055 21025 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 3.
I20260709 12:08:24.620916 21354 consensus_queue.cc:237] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:24.629570 20922 catalog_manager.cc:5697] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 reported cstate change: term changed from 2 to 3, leader changed from d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193) to befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:24.869347 21353 raft_consensus.cc:993] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227: : Instructing follower befb81a6a97149ed9c5c6dad78b7aa60 to start an election
I20260709 12:08:24.869807 21353 raft_consensus.cc:1081] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Signalling peer befb81a6a97149ed9c5c6dad78b7aa60 to start an election
I20260709 12:08:24.871388 21174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f"
dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
 from {username='slave'} at 127.0.0.1:35616
I20260709 12:08:24.871913 21174 raft_consensus.cc:493] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:24.872280 21174 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:24.878051 21174 raft_consensus.cc:515] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:24.881171 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:24.881381 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:24.881670 21174 leader_election.cc:290] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 3 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:24.881865 21025 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:24.882047 21101 raft_consensus.cc:3055] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:24.882485 21101 raft_consensus.cc:740] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:24.883205 21101 consensus_queue.cc:260] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:24.884150 21101 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:24.887305 21025 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 3.
I20260709 12:08:24.888489 21139 leader_election.cc:304] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:24.889309 21354 raft_consensus.cc:2804] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:24.889780 21354 raft_consensus.cc:697] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Becoming Leader. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Running, Role: LEADER
I20260709 12:08:24.890702 21354 consensus_queue.cc:237] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:24.892570 21101 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 3.
I20260709 12:08:24.900077 20922 catalog_manager.cc:5697] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 reported cstate change: term changed from 2 to 3, leader changed from bd9039b92df84c748e75739057fd0227 (127.20.102.194) to befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:25.113832 21101 raft_consensus.cc:1275] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Refusing update from remote peer befb81a6a97149ed9c5c6dad78b7aa60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:25.115254 21354 consensus_queue.cc:1048] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:25.121418 21025 raft_consensus.cc:1275] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Refusing update from remote peer befb81a6a97149ed9c5c6dad78b7aa60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:25.123538 21354 consensus_queue.cc:1048] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:25.430500 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.439888 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:25.440511 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.450578 21025 raft_consensus.cc:1275] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Refusing update from remote peer befb81a6a97149ed9c5c6dad78b7aa60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:25.452596 21359 consensus_queue.cc:1048] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:25.469519 21101 raft_consensus.cc:1275] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Refusing update from remote peer befb81a6a97149ed9c5c6dad78b7aa60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:25.471060 21375 consensus_queue.cc:1048] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:26.441912 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.447186 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.447645 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.448571 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.454938 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.455327 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.456322 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.461601 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.462024 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.463191 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.469213 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.469702 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:30.470760 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:30.476212 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:30.476626 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:31.477607 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:31.483397 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:31.483861 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:32.484920 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:32.489952 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:32.490363 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:33.491387 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:33.496743 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:33.497218 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:34.531666 20891 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:34.536438 21025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
mode: GRACEFUL
new_leader_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:37776
I20260709 12:08:34.537135 21025 raft_consensus.cc:606] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Received request to transfer leadership to TS bd9039b92df84c748e75739057fd0227
I20260709 12:08:34.542454 21174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080"
dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
mode: GRACEFUL
new_leader_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:35626
I20260709 12:08:34.543018 21174 raft_consensus.cc:606] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Received request to transfer leadership to TS bd9039b92df84c748e75739057fd0227
I20260709 12:08:34.548350 21025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
mode: GRACEFUL
new_leader_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:37776
I20260709 12:08:34.549018 21025 raft_consensus.cc:606] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Received request to transfer leadership to TS bd9039b92df84c748e75739057fd0227
I20260709 12:08:34.554247 21025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
mode: GRACEFUL
new_leader_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:37776
I20260709 12:08:34.554749 21025 raft_consensus.cc:606] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Received request to transfer leadership to TS bd9039b92df84c748e75739057fd0227
I20260709 12:08:34.562808 21174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f"
dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
mode: GRACEFUL
new_leader_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:35626
I20260709 12:08:34.563437 21174 raft_consensus.cc:606] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Received request to transfer leadership to TS bd9039b92df84c748e75739057fd0227
I20260709 12:08:34.623911 21253 raft_consensus.cc:993] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968: : Instructing follower bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:34.624356 21253 raft_consensus.cc:1081] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Signalling peer bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:34.626534 21100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:46904
I20260709 12:08:34.627187 21100 raft_consensus.cc:493] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:34.627628 21100 raft_consensus.cc:3060] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.633955 21100 raft_consensus.cc:515] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:34.636483 21100 leader_election.cc:290] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 3 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:34.637637 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:34.637712 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "119c2a6ed0824fa8976622bed056e160" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:34.638459 21174 raft_consensus.cc:3060] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.638499 21025 raft_consensus.cc:3055] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:34.639026 21025 raft_consensus.cc:740] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:34.639812 21025 consensus_queue.cc:260] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:34.640889 21025 raft_consensus.cc:3060] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.644928 21174 raft_consensus.cc:2468] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 3.
I20260709 12:08:34.646004 21383 raft_consensus.cc:993] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60: : Instructing follower bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:34.646402 21064 leader_election.cc:304] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:34.646663 21378 raft_consensus.cc:1081] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Signalling peer bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:34.647475 21381 raft_consensus.cc:2804] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:34.647436 21025 raft_consensus.cc:2468] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 3.
I20260709 12:08:34.649092 21100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:46912
I20260709 12:08:34.649864 21381 raft_consensus.cc:697] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 3 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:34.650477 21100 raft_consensus.cc:493] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:34.650993 21100 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.651177 21381 consensus_queue.cc:237] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:34.652105 21384 raft_consensus.cc:993] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968: : Instructing follower bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:34.652590 21253 raft_consensus.cc:1081] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Signalling peer bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:34.654403 21101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:46904
I20260709 12:08:34.655059 21101 raft_consensus.cc:493] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:34.655606 21101 raft_consensus.cc:3060] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.658947 21100 raft_consensus.cc:515] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:34.661306 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:34.661562 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:34.661839 21025 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.661002 20919 catalog_manager.cc:5697] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 2 to 3, leader changed from d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193) to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 3 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:34.662015 21174 raft_consensus.cc:3055] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:34.662365 21174 raft_consensus.cc:740] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Running, Role: LEADER
I20260709 12:08:34.663098 21174 consensus_queue.cc:260] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:34.663396 21101 raft_consensus.cc:515] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:34.664212 21174 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:34.667229 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:34.668052 21025 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 4.
I20260709 12:08:34.668092 21026 raft_consensus.cc:3055] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:34.668723 21026 raft_consensus.cc:740] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:34.669740 21026 consensus_queue.cc:260] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:34.670454 21174 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 4.
I20260709 12:08:34.670670 21026 raft_consensus.cc:3060] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.671334 21100 leader_election.cc:290] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 4 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:34.672029 21064 leader_election.cc:304] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:34.672984 21381 raft_consensus.cc:2804] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:34.673454 21381 raft_consensus.cc:697] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 4 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:34.673697 21101 leader_election.cc:290] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 3 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:34.674289 21381 consensus_queue.cc:237] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:34.674930 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba76b132854c466c895b3fa9c466ade0" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:34.675482 21174 raft_consensus.cc:3060] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.684995 21384 raft_consensus.cc:993] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968: : Instructing follower bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:34.680126 21026 raft_consensus.cc:2468] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 3.
I20260709 12:08:34.685541 21253 raft_consensus.cc:1081] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Signalling peer bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:34.682723 21174 raft_consensus.cc:2468] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 3.
I20260709 12:08:34.686954 21064 leader_election.cc:304] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:34.687384 21101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:46904
I20260709 12:08:34.687947 21101 raft_consensus.cc:493] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:34.688287 21101 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.688019 21385 raft_consensus.cc:2804] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:34.689915 21385 raft_consensus.cc:697] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 3 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:34.691082 21385 consensus_queue.cc:237] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:34.694159 21101 raft_consensus.cc:515] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:34.697469 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:34.698019 21174 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.698915 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:34.699739 21026 raft_consensus.cc:3055] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:34.700162 21026 raft_consensus.cc:740] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:34.701304 21026 consensus_queue.cc:260] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:34.702235 21026 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.702862 21174 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 3.
I20260709 12:08:34.704258 21064 leader_election.cc:304] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:34.705191 21101 leader_election.cc:290] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 3 election: Requested vote from peers befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329), d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579)
I20260709 12:08:34.705435 21385 raft_consensus.cc:2804] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:34.706450 21385 raft_consensus.cc:697] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 3 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:34.707451 21385 consensus_queue.cc:237] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:34.710414 21026 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 3.
I20260709 12:08:34.716471 20919 catalog_manager.cc:5697] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 3 to 4, leader changed from befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195) to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 4 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:34.717978 20919 catalog_manager.cc:5697] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 2 to 3, leader changed from d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193) to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 3 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:34.719408 20919 catalog_manager.cc:5697] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 2 to 3, leader changed from d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193) to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 3 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.078821 21383 raft_consensus.cc:993] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60: : Instructing follower bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:35.079434 21378 raft_consensus.cc:1081] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Signalling peer bd9039b92df84c748e75739057fd0227 to start an election
I20260709 12:08:35.081534 21101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
 from {username='slave'} at 127.0.0.1:46912
I20260709 12:08:35.082110 21101 raft_consensus.cc:493] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.082422 21101 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.089090 21101 raft_consensus.cc:515] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:35.091063 21101 leader_election.cc:290] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 4 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:35.092252 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:35.092478 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:35.092962 21174 raft_consensus.cc:3055] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:35.092974 21026 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.093416 21174 raft_consensus.cc:740] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Running, Role: LEADER
I20260709 12:08:35.094249 21174 consensus_queue.cc:260] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:35.095389 21174 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.100080 21026 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 4.
I20260709 12:08:35.101320 21174 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 4.
I20260709 12:08:35.101449 21065 leader_election.cc:304] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:35.102324 21385 raft_consensus.cc:2804] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:35.102840 21385 raft_consensus.cc:697] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 4 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:35.103535 21385 consensus_queue.cc:237] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:35.111581 20919 catalog_manager.cc:5697] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 3 to 4, leader changed from befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195) to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 4 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.129968 21026 raft_consensus.cc:1275] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.131307 21385 consensus_queue.cc:1048] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.137951 21025 raft_consensus.cc:1275] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 4 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:35.139477 21390 consensus_queue.cc:1048] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:35.144070 21174 raft_consensus.cc:1275] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.146099 21381 consensus_queue.cc:1048] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.153977 21173 raft_consensus.cc:1275] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.156065 21390 consensus_queue.cc:1048] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:35.158281 21173 raft_consensus.cc:1275] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:35.160952 21390 consensus_queue.cc:1048] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:35.188987 21026 raft_consensus.cc:1275] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.190541 21390 consensus_queue.cc:1048] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.190860 21175 raft_consensus.cc:1275] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:08:35.192540 21390 consensus_queue.cc:1048] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:35.211103 21026 raft_consensus.cc:1275] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:08:35.212531 21385 consensus_queue.cc:1048] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:35.513142 21173 raft_consensus.cc:1275] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:35.515327 21385 consensus_queue.cc:1048] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:35.531145 21026 raft_consensus.cc:1275] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 4 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:35.533810 21390 consensus_queue.cc:1048] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:37.603721 20891 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:37.604755 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.612660 21101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
mode: GRACEFUL
new_leader_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
 from {username='slave'} at 127.0.0.1:40188
I20260709 12:08:37.613322 21101 raft_consensus.cc:606] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Received request to transfer leadership to TS befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:37.616171 21101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
mode: GRACEFUL
new_leader_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:40188
I20260709 12:08:37.616607 21101 raft_consensus.cc:606] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 4 LEADER]: Received request to transfer leadership to TS d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:37.619035 21101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
mode: GRACEFUL
new_leader_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:40188
I20260709 12:08:37.619441 21101 raft_consensus.cc:606] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 4 LEADER]: Received request to transfer leadership to TS d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:37.621697 21101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
mode: GRACEFUL
new_leader_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:40188
I20260709 12:08:37.622103 21101 raft_consensus.cc:606] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 3 LEADER]: Received request to transfer leadership to TS d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:37.624298 21101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f76efae6fb414ab81d885d011ab891"
dest_uuid: "bd9039b92df84c748e75739057fd0227"
mode: GRACEFUL
new_leader_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
 from {username='slave'} at 127.0.0.1:40188
I20260709 12:08:37.624748 21101 raft_consensus.cc:606] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Received request to transfer leadership to TS befb81a6a97149ed9c5c6dad78b7aa60
I20260709 12:08:37.626140 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:37.626719 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:37.714805 21412 raft_consensus.cc:993] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227: : Instructing follower d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:37.715637 21381 raft_consensus.cc:1081] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 3 LEADER]: Signalling peer d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:37.717387 21026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:37754
I20260709 12:08:37.718007 21026 raft_consensus.cc:493] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:37.718327 21026 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:37.723541 21026 raft_consensus.cc:515] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:37.725564 21026 leader_election.cc:290] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 4 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:37.726938 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:37.726990 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:37.727618 21101 raft_consensus.cc:3055] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:37.727674 21173 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:37.728004 21101 raft_consensus.cc:740] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:37.728754 21101 consensus_queue.cc:260] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:37.729713 21101 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:37.733409 21173 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 4.
I20260709 12:08:37.734198 21101 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 4.
I20260709 12:08:37.734962 20989 leader_election.cc:304] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:37.736572 21413 raft_consensus.cc:2804] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:37.737588 21413 raft_consensus.cc:697] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 4 LEADER]: Becoming Leader. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:37.738477 21413 consensus_queue.cc:237] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:37.745280 20921 catalog_manager.cc:5697] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 reported cstate change: term changed from 3 to 4, leader changed from bd9039b92df84c748e75739057fd0227 (127.20.102.194) to d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193). New cstate: current_term: 4 leader_uuid: "d8ced8b03c6340fa80989b0b4321a968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:37.803493 21412 raft_consensus.cc:993] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227: : Instructing follower d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:37.803987 21412 raft_consensus.cc:1081] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 4 LEADER]: Signalling peer d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:37.805475 21026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:37754
I20260709 12:08:37.805935 21026 raft_consensus.cc:493] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:37.806214 21026 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.811079 21026 raft_consensus.cc:515] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:37.812578 21026 leader_election.cc:290] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 5 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:37.813712 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:37.813799 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:37.814268 21101 raft_consensus.cc:3055] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:37.814436 21173 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.814654 21101 raft_consensus.cc:740] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:37.815469 21101 consensus_queue.cc:260] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:37.816622 21101 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.821311 21173 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 5.
I20260709 12:08:37.821626 21101 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 5.
I20260709 12:08:37.822474 20989 leader_election.cc:304] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:37.823345 21413 raft_consensus.cc:2804] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:37.823912 21413 raft_consensus.cc:697] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 5 LEADER]: Becoming Leader. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:37.824695 21413 consensus_queue.cc:237] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:37.832237 20921 catalog_manager.cc:5697] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 reported cstate change: term changed from 4 to 5, leader changed from bd9039b92df84c748e75739057fd0227 (127.20.102.194) to d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193). New cstate: current_term: 5 leader_uuid: "d8ced8b03c6340fa80989b0b4321a968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:37.854887 21381 raft_consensus.cc:993] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227: : Instructing follower befb81a6a97149ed9c5c6dad78b7aa60 to start an election
I20260709 12:08:37.855528 21412 raft_consensus.cc:1081] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Signalling peer befb81a6a97149ed9c5c6dad78b7aa60 to start an election
I20260709 12:08:37.857479 21173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e"
dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
 from {username='slave'} at 127.0.0.1:35616
I20260709 12:08:37.858014 21173 raft_consensus.cc:493] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:37.858311 21173 raft_consensus.cc:3060] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:37.862378 21173 raft_consensus.cc:515] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:37.864066 21173 leader_election.cc:290] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 3 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:37.865090 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:37.865286 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cac8f50f82e4c45873afaa45945dc3e" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:37.865666 21026 raft_consensus.cc:3060] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:37.865736 21101 raft_consensus.cc:3055] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:37.866057 21101 raft_consensus.cc:740] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:37.866819 21101 consensus_queue.cc:260] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:37.867867 21101 raft_consensus.cc:3060] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:37.871685 21026 raft_consensus.cc:2468] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 3.
I20260709 12:08:37.873181 21139 leader_election.cc:304] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:37.873543 21101 raft_consensus.cc:2468] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 3.
I20260709 12:08:37.874246 21378 raft_consensus.cc:2804] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:37.875362 21378 raft_consensus.cc:697] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Becoming Leader. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Running, Role: LEADER
I20260709 12:08:37.876266 21378 consensus_queue.cc:237] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:37.883476 20921 catalog_manager.cc:5697] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 reported cstate change: term changed from 2 to 3, leader changed from bd9039b92df84c748e75739057fd0227 (127.20.102.194) to befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:37.976317 21412 raft_consensus.cc:993] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227: : Instructing follower d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:37.976824 21381 raft_consensus.cc:1081] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 4 LEADER]: Signalling peer d8ced8b03c6340fa80989b0b4321a968 to start an election
I20260709 12:08:37.978453 21025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f"
dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
 from {username='slave'} at 127.0.0.1:37754
I20260709 12:08:37.978900 21025 raft_consensus.cc:493] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:37.979209 21025 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.983637 21025 raft_consensus.cc:515] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:37.985191 21025 leader_election.cc:290] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 5 election: Requested vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:37.986235 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:37.986423 21173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "d8ced8b03c6340fa80989b0b4321a968" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:37.986970 21173 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.986970 21101 raft_consensus.cc:3055] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:37.987506 21101 raft_consensus.cc:740] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:37.988327 21101 consensus_queue.cc:260] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:37.989539 21101 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.994274 21173 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 5.
I20260709 12:08:37.995532 20989 leader_election.cc:304] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:37.996388 21413 raft_consensus.cc:2804] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:37.996447 21101 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ced8b03c6340fa80989b0b4321a968 in term 5.
I20260709 12:08:37.997219 21413 raft_consensus.cc:697] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 5 LEADER]: Becoming Leader. State: Replica: d8ced8b03c6340fa80989b0b4321a968, State: Running, Role: LEADER
I20260709 12:08:37.998250 21413 consensus_queue.cc:237] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:38.005868 20921 catalog_manager.cc:5697] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 reported cstate change: term changed from 4 to 5, leader changed from bd9039b92df84c748e75739057fd0227 (127.20.102.194) to d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193). New cstate: current_term: 5 leader_uuid: "d8ced8b03c6340fa80989b0b4321a968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:38.187879 21412 raft_consensus.cc:993] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227: : Instructing follower befb81a6a97149ed9c5c6dad78b7aa60 to start an election
I20260709 12:08:38.188300 21412 raft_consensus.cc:1081] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Signalling peer befb81a6a97149ed9c5c6dad78b7aa60 to start an election
I20260709 12:08:38.189932 21173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f76efae6fb414ab81d885d011ab891"
dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
 from {username='slave'} at 127.0.0.1:35616
I20260709 12:08:38.190433 21173 raft_consensus.cc:493] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:38.190721 21173 raft_consensus.cc:3060] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:38.195640 21173 raft_consensus.cc:515] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:38.197311 21173 leader_election.cc:290] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 2 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:38.198312 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f76efae6fb414ab81d885d011ab891" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8ced8b03c6340fa80989b0b4321a968"
I20260709 12:08:38.198544 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f76efae6fb414ab81d885d011ab891" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:38.198922 21025 raft_consensus.cc:3060] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:38.199185 21101 raft_consensus.cc:3055] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:38.199581 21101 raft_consensus.cc:740] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:38.200270 21101 consensus_queue.cc:260] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:38.201192 21101 raft_consensus.cc:3060] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:38.204193 21025 raft_consensus.cc:2468] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 2.
I20260709 12:08:38.205260 21139 leader_election.cc:304] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968; no voters: 
I20260709 12:08:38.205826 21101 raft_consensus.cc:2468] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 2.
I20260709 12:08:38.206087 21378 raft_consensus.cc:2804] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:38.206669 21378 raft_consensus.cc:697] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 LEADER]: Becoming Leader. State: Replica: befb81a6a97149ed9c5c6dad78b7aa60, State: Running, Role: LEADER
I20260709 12:08:38.207847 21378 consensus_queue.cc:237] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:38.224511 20921 catalog_manager.cc:5697] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 reported cstate change: term changed from 1 to 2, leader changed from bd9039b92df84c748e75739057fd0227 (127.20.102.194) to befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:38.228358 21101 raft_consensus.cc:1275] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:38.229971 21413 consensus_queue.cc:1048] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:38.242538 21173 raft_consensus.cc:1275] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:38.244418 21427 consensus_queue.cc:1048] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:38.287989 21101 raft_consensus.cc:1275] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Refusing update from remote peer befb81a6a97149ed9c5c6dad78b7aa60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:38.289795 21378 consensus_queue.cc:1048] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:38.300719 21025 raft_consensus.cc:1275] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Refusing update from remote peer befb81a6a97149ed9c5c6dad78b7aa60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:38.302853 21421 consensus_queue.cc:1048] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:38.325811 21101 raft_consensus.cc:1275] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:38.327339 21427 consensus_queue.cc:1048] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:38.337800 21173 raft_consensus.cc:1275] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:38.339481 21414 consensus_queue.cc:1048] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:38.511005 21101 raft_consensus.cc:1275] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:38.512444 21413 consensus_queue.cc:1048] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:38.521891 21173 raft_consensus.cc:1275] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Refusing update from remote peer d8ced8b03c6340fa80989b0b4321a968: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:38.523828 21414 consensus_queue.cc:1048] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:38.628013 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.632894 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.633293 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:38.689692 21025 raft_consensus.cc:1275] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Refusing update from remote peer befb81a6a97149ed9c5c6dad78b7aa60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:38.690938 21421 consensus_queue.cc:1048] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:38.700709 21101 raft_consensus.cc:1275] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Refusing update from remote peer befb81a6a97149ed9c5c6dad78b7aa60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:38.702701 21378 consensus_queue.cc:1048] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:39.634353 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.639102 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.639523 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.640592 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.645536 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.645982 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.647063 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.653051 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.653404 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:42.654528 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:42.660367 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:42.660825 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.661798 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:43.666422 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:43.666781 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:44.667897 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:44.672626 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:44.672994 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:45.674620 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:45.681041 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:45.681571 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:46.682811 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:46.687886 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:46.688325 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:47.752942 20891 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:47.753778 20891 tablet_server.cc:179] TabletServer@127.20.102.193:0 shutting down...
I20260709 12:08:47.791482 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:47.792341 20891 tablet_replica.cc:333] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968: stopping tablet replica
I20260709 12:08:47.793304 20891 raft_consensus.cc:2243] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.793937 20891 raft_consensus.cc:2272] T 9893f92a39d9475abb74a13787ccf8c0 P d8ced8b03c6340fa80989b0b4321a968 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.796227 20891 tablet_replica.cc:333] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968: stopping tablet replica
I20260709 12:08:47.796726 20891 raft_consensus.cc:2243] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.797292 20891 raft_consensus.cc:2272] T a5cad2433c904b948364ba8a49112d8d P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.799106 20891 tablet_replica.cc:333] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968: stopping tablet replica
I20260709 12:08:47.799590 20891 raft_consensus.cc:2243] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.800021 20891 raft_consensus.cc:2272] T ba76b132854c466c895b3fa9c466ade0 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.801723 20891 tablet_replica.cc:333] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968: stopping tablet replica
I20260709 12:08:47.802261 20891 raft_consensus.cc:2243] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.802803 20891 raft_consensus.cc:2272] T 119c2a6ed0824fa8976622bed056e160 P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.804915 20891 tablet_replica.cc:333] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968: stopping tablet replica
I20260709 12:08:47.805562 20891 raft_consensus.cc:2243] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.806267 20891 raft_consensus.cc:2272] T c8f76efae6fb414ab81d885d011ab891 P d8ced8b03c6340fa80989b0b4321a968 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.807955 20891 tablet_replica.cc:333] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968: stopping tablet replica
I20260709 12:08:47.808394 20891 raft_consensus.cc:2243] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.809222 20891 raft_consensus.cc:2272] T 1cfb3d37d9d840678db00b2b63d2400f P d8ced8b03c6340fa80989b0b4321a968 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.810818 20891 tablet_replica.cc:333] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968: stopping tablet replica
I20260709 12:08:47.811262 20891 raft_consensus.cc:2243] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.811964 20891 raft_consensus.cc:2272] T 81d68b52cb364c8b89b940bbde3ae1b2 P d8ced8b03c6340fa80989b0b4321a968 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.813583 20891 tablet_replica.cc:333] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968: stopping tablet replica
I20260709 12:08:47.814000 20891 raft_consensus.cc:2243] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.814340 20891 raft_consensus.cc:2272] T 1cac8f50f82e4c45873afaa45945dc3e P d8ced8b03c6340fa80989b0b4321a968 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.815810 20891 tablet_replica.cc:333] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968: stopping tablet replica
I20260709 12:08:47.816183 20891 raft_consensus.cc:2243] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.816980 20891 raft_consensus.cc:2272] T 53230cea4b9a4d39b3a68a487c5eb080 P d8ced8b03c6340fa80989b0b4321a968 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:47.917071 21139 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111)
W20260709 12:08:47.920624 21139 consensus_peers.cc:597] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:48.013986 21139 consensus_peers.cc:597] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:48.070070 21065 consensus_peers.cc:597] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:48.091012 21139 consensus_peers.cc:597] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:48.110494 21065 consensus_peers.cc:597] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:48.124518 21065 consensus_peers.cc:597] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:48.575137 21047 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5060 after lost signal to thread 20894
W20260709 12:08:48.576258 21047 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5740 after lost signal to thread 20957
W20260709 12:08:48.577939 21047 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5a00 after lost signal to thread 21125
W20260709 12:08:48.578838 21047 debug-util.cc:398] Leaking SignalData structure 0x7b0800098820 after lost signal to thread 21199
I20260709 12:08:48.711391 21464 raft_consensus.cc:493] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d8ced8b03c6340fa80989b0b4321a968)
I20260709 12:08:48.712011 21464 raft_consensus.cc:515] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:48.714191 21464 leader_election.cc:290] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863), d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579)
I20260709 12:08:48.715529 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
W20260709 12:08:48.718735 21139 leader_election.cc:336] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111)
I20260709 12:08:48.719126 21139 leader_election.cc:304] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60; no voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:48.719760 21464 raft_consensus.cc:2749] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:08:48.876829 21465 raft_consensus.cc:493] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d8ced8b03c6340fa80989b0b4321a968)
I20260709 12:08:48.877542 21465 raft_consensus.cc:515] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:48.880167 21465 leader_election.cc:290] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329), d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579)
I20260709 12:08:48.881083 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:48.881773 21174 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 4.
I20260709 12:08:48.883132 21064 leader_election.cc:304] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:48.884014 21465 raft_consensus.cc:2804] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:08:48.884387 21465 raft_consensus.cc:493] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d8ced8b03c6340fa80989b0b4321a968)
I20260709 12:08:48.884825 21465 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:08:48.884903 21065 leader_election.cc:336] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111)
I20260709 12:08:48.890324 21465 raft_consensus.cc:515] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:48.891974 21465 leader_election.cc:290] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 5 election: Requested vote from peers befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329), d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579)
I20260709 12:08:48.893162 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d68b52cb364c8b89b940bbde3ae1b2" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:48.893615 21174 raft_consensus.cc:3060] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:08:48.897223 21065 leader_election.cc:336] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111)
I20260709 12:08:48.898145 21464 raft_consensus.cc:493] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d8ced8b03c6340fa80989b0b4321a968)
I20260709 12:08:48.898638 21464 raft_consensus.cc:515] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:48.899065 21174 raft_consensus.cc:2468] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 5.
I20260709 12:08:48.900134 21064 leader_election.cc:304] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:48.901165 21465 raft_consensus.cc:2804] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:48.901678 21465 raft_consensus.cc:697] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 5 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:48.901770 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
I20260709 12:08:48.902669 21465 consensus_queue.cc:237] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } }
I20260709 12:08:48.903551 21464 leader_election.cc:290] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
W20260709 12:08:48.907418 21139 leader_election.cc:336] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111)
I20260709 12:08:48.908010 21139 leader_election.cc:304] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60; no voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:48.908967 21464 raft_consensus.cc:2749] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:08:48.913825 20891 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21047)
I20260709 12:08:48.913745 20919 catalog_manager.cc:5697] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 4 to 5, leader changed from d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193) to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 5 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.191751 21465 raft_consensus.cc:493] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d8ced8b03c6340fa80989b0b4321a968)
I20260709 12:08:49.192441 21465 raft_consensus.cc:515] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:49.195102 21465 leader_election.cc:290] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:49.195998 21466 raft_consensus.cc:493] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d8ced8b03c6340fa80989b0b4321a968)
I20260709 12:08:49.196390 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:49.196573 21466 raft_consensus.cc:515] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:49.197047 21174 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 5.
I20260709 12:08:49.198251 21064 leader_election.cc:304] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: 
I20260709 12:08:49.199129 21466 leader_election.cc:290] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:49.200202 21466 raft_consensus.cc:2804] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:08:49.200728 21466 raft_consensus.cc:493] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d8ced8b03c6340fa80989b0b4321a968)
I20260709 12:08:49.201344 21466 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:08:49.203743 21065 leader_election.cc:336] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111)
I20260709 12:08:49.201864 21464 raft_consensus.cc:493] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d8ced8b03c6340fa80989b0b4321a968)
I20260709 12:08:49.204562 21464 raft_consensus.cc:515] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
W20260709 12:08:49.206761 21065 leader_election.cc:336] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111)
I20260709 12:08:49.209769 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" is_pre_election: true
I20260709 12:08:49.210381 21174 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 5.
I20260709 12:08:49.212740 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227" is_pre_election: true
W20260709 12:08:49.212889 21139 leader_election.cc:336] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111)
I20260709 12:08:49.213359 21101 raft_consensus.cc:2468] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate befb81a6a97149ed9c5c6dad78b7aa60 in term 5.
I20260709 12:08:49.213814 21464 leader_election.cc:290] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:49.214761 21140 leader_election.cc:304] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:49.214533 21064 leader_election.cc:304] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:49.215942 21472 raft_consensus.cc:2804] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:08:49.216048 21464 raft_consensus.cc:2804] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:08:49.216454 21472 raft_consensus.cc:493] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d8ced8b03c6340fa80989b0b4321a968)
I20260709 12:08:49.215489 21466 raft_consensus.cc:515] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:49.216701 21464 raft_consensus.cc:493] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d8ced8b03c6340fa80989b0b4321a968)
I20260709 12:08:49.217013 21472 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:08:49.217386 21464 raft_consensus.cc:3060] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:08:49.223606 21174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53230cea4b9a4d39b3a68a487c5eb080" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:49.224192 21174 raft_consensus.cc:3060] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:08:49.225108 21472 raft_consensus.cc:515] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:49.228478 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "bd9039b92df84c748e75739057fd0227" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "befb81a6a97149ed9c5c6dad78b7aa60"
I20260709 12:08:49.228178 21464 raft_consensus.cc:515] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
W20260709 12:08:49.229102 21065 leader_election.cc:336] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111)
I20260709 12:08:49.229161 21472 leader_election.cc:290] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:49.229756 21175 raft_consensus.cc:2393] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd9039b92df84c748e75739057fd0227 in current term 6: Already voted for candidate befb81a6a97149ed9c5c6dad78b7aa60 in this term.
I20260709 12:08:49.221238 21466 leader_election.cc:290] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), befb81a6a97149ed9c5c6dad78b7aa60 (127.20.102.195:35329)
I20260709 12:08:49.233618 21464 leader_election.cc:290] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 6 election: Requested vote from peers d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579), bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863)
I20260709 12:08:49.234681 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfb3d37d9d840678db00b2b63d2400f" candidate_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bd9039b92df84c748e75739057fd0227"
I20260709 12:08:49.235436 21101 raft_consensus.cc:2393] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate befb81a6a97149ed9c5c6dad78b7aa60 in current term 6: Already voted for candidate bd9039b92df84c748e75739057fd0227 in this term.
I20260709 12:08:49.235311 21174 raft_consensus.cc:2468] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9039b92df84c748e75739057fd0227 in term 6.
I20260709 12:08:49.236524 21064 leader_election.cc:304] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd9039b92df84c748e75739057fd0227, befb81a6a97149ed9c5c6dad78b7aa60; no voters: d8ced8b03c6340fa80989b0b4321a968
W20260709 12:08:49.237360 21065 leader_election.cc:336] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111)
W20260709 12:08:49.237470 21139 leader_election.cc:336] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111)
I20260709 12:08:49.237609 21466 raft_consensus.cc:2804] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:08:49.237864 21065 leader_election.cc:304] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd9039b92df84c748e75739057fd0227; no voters: befb81a6a97149ed9c5c6dad78b7aa60, d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:49.238302 21466 raft_consensus.cc:697] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 6 LEADER]: Becoming Leader. State: Replica: bd9039b92df84c748e75739057fd0227, State: Running, Role: LEADER
I20260709 12:08:49.238102 21139 leader_election.cc:304] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: befb81a6a97149ed9c5c6dad78b7aa60; no voters: bd9039b92df84c748e75739057fd0227, d8ced8b03c6340fa80989b0b4321a968
I20260709 12:08:49.239486 21464 raft_consensus.cc:2749] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:08:49.239295 21466 consensus_queue.cc:237] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } }
I20260709 12:08:49.239658 21465 raft_consensus.cc:2749] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:08:49.248952 20919 catalog_manager.cc:5697] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 reported cstate change: term changed from 5 to 6, leader changed from d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193) to bd9039b92df84c748e75739057fd0227 (127.20.102.194). New cstate: current_term: 6 leader_uuid: "bd9039b92df84c748e75739057fd0227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ced8b03c6340fa80989b0b4321a968" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9039b92df84c748e75739057fd0227" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 } health_report { overall_health: UNKNOWN } } }
W20260709 12:08:49.384354 21065 consensus_peers.cc:597] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:49.519261 21174 raft_consensus.cc:1275] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:49.520645 21466 consensus_queue.cc:1048] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:08:49.623122 21174 raft_consensus.cc:1275] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 6 FOLLOWER]: Refusing update from remote peer bd9039b92df84c748e75739057fd0227: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:08:49.624598 21465 consensus_queue.cc:1048] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befb81a6a97149ed9c5c6dad78b7aa60" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:08:49.644186 21065 consensus_peers.cc:597] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:49.914443 20891 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21047)
W20260709 12:08:50.404878 21065 consensus_peers.cc:597] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:08:50.488758 21139 consensus_peers.cc:597] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:08:50.522167 21139 consensus_peers.cc:597] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:08:50.554540 21065 consensus_peers.cc:597] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:08:50.576651 21065 consensus_peers.cc:597] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:08:50.685921 21139 consensus_peers.cc:597] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 -> Peer d8ced8b03c6340fa80989b0b4321a968 (127.20.102.193:46579): Couldn't send request to peer d8ced8b03c6340fa80989b0b4321a968. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46579: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:08:50.915035 20891 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 21047)
I20260709 12:08:51.085712 20891 tablet_server.cc:196] TabletServer@127.20.102.193:0 shutdown complete.
I20260709 12:08:51.110862 20891 tablet_server.cc:179] TabletServer@127.20.102.194:0 shutting down...
I20260709 12:08:51.140409 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:51.141134 20891 tablet_replica.cc:333] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227: stopping tablet replica
I20260709 12:08:51.141738 20891 raft_consensus.cc:2243] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:51.142135 20891 raft_consensus.cc:2272] T 9893f92a39d9475abb74a13787ccf8c0 P bd9039b92df84c748e75739057fd0227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.143867 20891 tablet_replica.cc:333] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227: stopping tablet replica
I20260709 12:08:51.144336 20891 raft_consensus.cc:2243] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:51.144724 20891 raft_consensus.cc:2272] T 1cac8f50f82e4c45873afaa45945dc3e P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.146427 20891 tablet_replica.cc:333] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227: stopping tablet replica
I20260709 12:08:51.146840 20891 raft_consensus.cc:2243] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:51.147492 20891 raft_consensus.cc:2272] T a5cad2433c904b948364ba8a49112d8d P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.149286 20891 tablet_replica.cc:333] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227: stopping tablet replica
I20260709 12:08:51.149729 20891 raft_consensus.cc:2243] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:51.150383 20891 raft_consensus.cc:2272] T ba76b132854c466c895b3fa9c466ade0 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.152320 20891 tablet_replica.cc:333] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227: stopping tablet replica
I20260709 12:08:51.152750 20891 raft_consensus.cc:2243] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:51.153479 20891 raft_consensus.cc:2272] T 119c2a6ed0824fa8976622bed056e160 P bd9039b92df84c748e75739057fd0227 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.154989 20891 tablet_replica.cc:333] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227: stopping tablet replica
I20260709 12:08:51.155422 20891 raft_consensus.cc:2243] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:51.155846 20891 raft_consensus.cc:2272] T 1cfb3d37d9d840678db00b2b63d2400f P bd9039b92df84c748e75739057fd0227 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.157325 20891 tablet_replica.cc:333] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227: stopping tablet replica
I20260709 12:08:51.157732 20891 raft_consensus.cc:2243] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:51.158385 20891 raft_consensus.cc:2272] T 81d68b52cb364c8b89b940bbde3ae1b2 P bd9039b92df84c748e75739057fd0227 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.159999 20891 tablet_replica.cc:333] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227: stopping tablet replica
I20260709 12:08:51.160411 20891 raft_consensus.cc:2243] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:51.160980 20891 raft_consensus.cc:2272] T c8f76efae6fb414ab81d885d011ab891 P bd9039b92df84c748e75739057fd0227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.162796 20891 tablet_replica.cc:333] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227: stopping tablet replica
I20260709 12:08:51.163404 20891 raft_consensus.cc:2243] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:08:51.164139 20891 raft_consensus.cc:2272] T 53230cea4b9a4d39b3a68a487c5eb080 P bd9039b92df84c748e75739057fd0227 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.195227 20891 tablet_server.cc:196] TabletServer@127.20.102.194:0 shutdown complete.
I20260709 12:08:51.215708 20891 tablet_server.cc:179] TabletServer@127.20.102.195:0 shutting down...
I20260709 12:08:51.249867 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:51.250954 20891 tablet_replica.cc:333] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60: stopping tablet replica
I20260709 12:08:51.251756 20891 raft_consensus.cc:2243] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:51.252733 20891 raft_consensus.cc:2272] T 9893f92a39d9475abb74a13787ccf8c0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.255095 20891 tablet_replica.cc:333] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60: stopping tablet replica
I20260709 12:08:51.255694 20891 raft_consensus.cc:2243] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:51.256291 20891 raft_consensus.cc:2272] T a5cad2433c904b948364ba8a49112d8d P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.258188 20891 tablet_replica.cc:333] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60: stopping tablet replica
I20260709 12:08:51.258690 20891 raft_consensus.cc:2243] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:51.259511 20891 raft_consensus.cc:2272] T 1cac8f50f82e4c45873afaa45945dc3e P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.261534 20891 tablet_replica.cc:333] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60: stopping tablet replica
I20260709 12:08:51.262095 20891 raft_consensus.cc:2243] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:51.262660 20891 raft_consensus.cc:2272] T ba76b132854c466c895b3fa9c466ade0 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.265091 20891 tablet_replica.cc:333] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60: stopping tablet replica
I20260709 12:08:51.265810 20891 raft_consensus.cc:2243] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:51.266302 20891 raft_consensus.cc:2272] T 119c2a6ed0824fa8976622bed056e160 P befb81a6a97149ed9c5c6dad78b7aa60 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:51.266721 21140 consensus_peers.cc:597] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 -> Peer bd9039b92df84c748e75739057fd0227 (127.20.102.194:42863): Couldn't send request to peer bd9039b92df84c748e75739057fd0227. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:42863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:51.268183 20891 tablet_replica.cc:333] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60: stopping tablet replica
I20260709 12:08:51.268740 20891 raft_consensus.cc:2243] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:51.269837 20891 raft_consensus.cc:2272] T c8f76efae6fb414ab81d885d011ab891 P befb81a6a97149ed9c5c6dad78b7aa60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.271996 20891 tablet_replica.cc:333] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60: stopping tablet replica
I20260709 12:08:51.272567 20891 raft_consensus.cc:2243] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:51.273180 20891 raft_consensus.cc:2272] T 1cfb3d37d9d840678db00b2b63d2400f P befb81a6a97149ed9c5c6dad78b7aa60 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.275332 20891 tablet_replica.cc:333] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60: stopping tablet replica
I20260709 12:08:51.275923 20891 raft_consensus.cc:2243] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:51.276484 20891 raft_consensus.cc:2272] T 81d68b52cb364c8b89b940bbde3ae1b2 P befb81a6a97149ed9c5c6dad78b7aa60 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.278328 20891 tablet_replica.cc:333] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60: stopping tablet replica
I20260709 12:08:51.278864 20891 raft_consensus.cc:2243] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:51.279367 20891 raft_consensus.cc:2272] T 53230cea4b9a4d39b3a68a487c5eb080 P befb81a6a97149ed9c5c6dad78b7aa60 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.310452 20891 tablet_server.cc:196] TabletServer@127.20.102.195:0 shutdown complete.
I20260709 12:08:51.332448 20891 master.cc:562] Master@127.20.102.254:44751 shutting down...
I20260709 12:08:51.382243 20978 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:08:51.482446 20891 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:51.483129 20891 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:51.483485 20891 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4d80fc3f69964cea90dd41c9cc178bea: stopping tablet replica
I20260709 12:08:51.532266 20891 master.cc:584] Master@127.20.102.254:44751 shutdown complete.
bd9039b92df84c748e75739057fd0227  4
befb81a6a97149ed9c5c6dad78b7aa60  1
d8ced8b03c6340fa80989b0b4321a968  4
bd9039b92df84c748e75739057fd0227  3
befb81a6a97149ed9c5c6dad78b7aa60  3
d8ced8b03c6340fa80989b0b4321a968  3
bd9039b92df84c748e75739057fd0227  8
befb81a6a97149ed9c5c6dad78b7aa60  1
d8ced8b03c6340fa80989b0b4321a968  0
bd9039b92df84c748e75739057fd0227  3
befb81a6a97149ed9c5c6dad78b7aa60  3
d8ced8b03c6340fa80989b0b4321a968  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (36375 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:51.580554 20891 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.102.254:34453
I20260709 12:08:51.581916 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:51.588454 21479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:51.588886 21480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:51.590456 20891 server_base.cc:1061] running on GCE node
W20260709 12:08:51.590641 21482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:51.591784 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:51.592056 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:51.592214 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598931592201 us; error 0 us; skew 500 ppm
I20260709 12:08:51.592743 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:51.595515 20891 webserver.cc:533] Webserver started at http://127.20.102.254:33791/ using document root <none> and password file <none>
I20260709 12:08:51.596068 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:51.596315 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:51.596627 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:51.597846 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/master-0-root/instance:
uuid: "1670f8f1ea0e440ca86410635136a65a"
format_stamp: "Formatted at 2026-07-09 12:08:51 on dist-test-slave-296p"
I20260709 12:08:51.602691 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:51.606662 21487 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:51.607900 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:08:51.608290 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/master-0-root
uuid: "1670f8f1ea0e440ca86410635136a65a"
format_stamp: "Formatted at 2026-07-09 12:08:51 on dist-test-slave-296p"
I20260709 12:08:51.608625 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:51.632432 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:51.634008 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:51.676868 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.254:34453
I20260709 12:08:51.677035 21538 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.254:34453 every 8 connection(s)
I20260709 12:08:51.681238 21539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:51.693318 21539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a: Bootstrap starting.
I20260709 12:08:51.699347 21539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:51.704464 21539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a: No bootstrap required, opened a new log
I20260709 12:08:51.706964 21539 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1670f8f1ea0e440ca86410635136a65a" member_type: VOTER }
I20260709 12:08:51.707376 21539 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:51.707623 21539 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1670f8f1ea0e440ca86410635136a65a, State: Initialized, Role: FOLLOWER
I20260709 12:08:51.708302 21539 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1670f8f1ea0e440ca86410635136a65a" member_type: VOTER }
I20260709 12:08:51.708818 21539 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:51.709097 21539 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:51.709380 21539 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.714687 21539 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1670f8f1ea0e440ca86410635136a65a" member_type: VOTER }
I20260709 12:08:51.715291 21539 leader_election.cc:304] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1670f8f1ea0e440ca86410635136a65a; no voters: 
I20260709 12:08:51.716566 21539 leader_election.cc:290] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:51.717046 21542 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:51.718495 21542 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [term 1 LEADER]: Becoming Leader. State: Replica: 1670f8f1ea0e440ca86410635136a65a, State: Running, Role: LEADER
I20260709 12:08:51.719250 21542 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1670f8f1ea0e440ca86410635136a65a" member_type: VOTER }
I20260709 12:08:51.719745 21539 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:51.723645 21544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1670f8f1ea0e440ca86410635136a65a. Latest consensus state: current_term: 1 leader_uuid: "1670f8f1ea0e440ca86410635136a65a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1670f8f1ea0e440ca86410635136a65a" member_type: VOTER } }
I20260709 12:08:51.723501 21543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1670f8f1ea0e440ca86410635136a65a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1670f8f1ea0e440ca86410635136a65a" member_type: VOTER } }
I20260709 12:08:51.724385 21543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:51.726402 21544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:51.728223 21549 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:51.733518 21549 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:51.737104 20891 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:51.742980 21549 catalog_manager.cc:1383] Generated new cluster ID: 9ea767ac7de843798bf862beb9f32293
I20260709 12:08:51.743253 21549 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:51.756693 21549 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:51.757941 21549 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:51.770855 21549 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a: Generated new TSK 0
I20260709 12:08:51.771517 21549 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:51.804131 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:51.810811 21560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:51.812057 21561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:51.814029 21563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:51.814924 20891 server_base.cc:1061] running on GCE node
I20260709 12:08:51.816120 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:51.816326 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:51.816468 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598931816455 us; error 0 us; skew 500 ppm
I20260709 12:08:51.817076 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:51.819638 20891 webserver.cc:533] Webserver started at http://127.20.102.193:33297/ using document root <none> and password file <none>
I20260709 12:08:51.820147 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:51.820322 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:51.820562 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:51.821907 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-0-root/instance:
uuid: "46b93a657c04412893cee20a58e10fd8"
format_stamp: "Formatted at 2026-07-09 12:08:51 on dist-test-slave-296p"
I20260709 12:08:51.826838 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:51.830889 21568 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:51.831807 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:08:51.832103 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-0-root
uuid: "46b93a657c04412893cee20a58e10fd8"
format_stamp: "Formatted at 2026-07-09 12:08:51 on dist-test-slave-296p"
I20260709 12:08:51.832369 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:51.855723 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:51.857133 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:51.858765 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:51.861435 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:51.861634 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:51.861985 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:51.862156 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:51.910439 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.193:33527
I20260709 12:08:51.910610 21630 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.193:33527 every 8 connection(s)
I20260709 12:08:51.916069 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:51.923979 21635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:51.924044 21636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:51.927913 21638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:51.929304 20891 server_base.cc:1061] running on GCE node
I20260709 12:08:51.930521 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:51.930804 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:51.931097 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598931931058 us; error 0 us; skew 500 ppm
I20260709 12:08:51.931679 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:51.934473 20891 webserver.cc:533] Webserver started at http://127.20.102.194:43799/ using document root <none> and password file <none>
I20260709 12:08:51.935096 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:51.935371 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:51.935745 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:51.937362 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-1-root/instance:
uuid: "57f7be88080046528640d139ebf0f179"
format_stamp: "Formatted at 2026-07-09 12:08:51 on dist-test-slave-296p"
I20260709 12:08:51.939186 21631 heartbeater.cc:344] Connected to a master server at 127.20.102.254:34453
I20260709 12:08:51.939620 21631 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:51.940389 21631 heartbeater.cc:507] Master 127.20.102.254:34453 requested a full tablet report, sending...
I20260709 12:08:51.942951 21504 ts_manager.cc:194] Registered new tserver with Master: 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527)
I20260709 12:08:51.943238 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 12:08:51.945621 21504 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58970
I20260709 12:08:51.948570 21643 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:51.949631 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:08:51.949996 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-1-root
uuid: "57f7be88080046528640d139ebf0f179"
format_stamp: "Formatted at 2026-07-09 12:08:51 on dist-test-slave-296p"
I20260709 12:08:51.950325 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:51.971071 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:51.972885 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:51.974668 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:51.977389 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:51.977660 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:51.977933 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:51.978139 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:52.026305 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.194:35657
I20260709 12:08:52.026471 21705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.194:35657 every 8 connection(s)
I20260709 12:08:52.031387 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:52.038754 21709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:52.039654 21710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:52.045203 21712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:52.045758 20891 server_base.cc:1061] running on GCE node
I20260709 12:08:52.046409 21706 heartbeater.cc:344] Connected to a master server at 127.20.102.254:34453
I20260709 12:08:52.046798 21706 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:52.046900 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:52.047223 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:52.047436 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598932047414 us; error 0 us; skew 500 ppm
I20260709 12:08:52.047662 21706 heartbeater.cc:507] Master 127.20.102.254:34453 requested a full tablet report, sending...
I20260709 12:08:52.048157 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:52.050230 21504 ts_manager.cc:194] Registered new tserver with Master: 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:52.051435 20891 webserver.cc:533] Webserver started at http://127.20.102.195:36987/ using document root <none> and password file <none>
I20260709 12:08:52.051986 21504 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58976
I20260709 12:08:52.052196 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:52.052520 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:52.052914 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:52.054438 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-2-root/instance:
uuid: "8114007c96f34dccad8aaacdaed1ee30"
format_stamp: "Formatted at 2026-07-09 12:08:52 on dist-test-slave-296p"
I20260709 12:08:52.059666 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:08:52.063421 21717 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:52.064323 20891 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:08:52.064641 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-2-root
uuid: "8114007c96f34dccad8aaacdaed1ee30"
format_stamp: "Formatted at 2026-07-09 12:08:52 on dist-test-slave-296p"
I20260709 12:08:52.065001 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895025208-20891-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:52.080178 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:52.081650 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:52.083300 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:52.085872 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:52.086063 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:52.086347 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:52.086517 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:52.135644 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.195:36259
I20260709 12:08:52.135825 21779 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.195:36259 every 8 connection(s)
I20260709 12:08:52.150789 21780 heartbeater.cc:344] Connected to a master server at 127.20.102.254:34453
I20260709 12:08:52.151196 21780 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:52.152063 21780 heartbeater.cc:507] Master 127.20.102.254:34453 requested a full tablet report, sending...
I20260709 12:08:52.154336 21504 ts_manager.cc:194] Registered new tserver with Master: 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:52.155134 20891 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015875063s
I20260709 12:08:52.156041 21504 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58986
I20260709 12:08:52.182942 21504 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58992:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:52.185763 21504 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:52.270309 21596 tablet_service.cc:1511] Processing CreateTablet for tablet 482e49afdcf1484988d7d53ef5046aa6 (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:52.271972 21596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482e49afdcf1484988d7d53ef5046aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.276014 21595 tablet_service.cc:1511] Processing CreateTablet for tablet 596d854d1a6f40bb80d8a615e1f55179 (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:52.281010 21744 tablet_service.cc:1511] Processing CreateTablet for tablet 596d854d1a6f40bb80d8a615e1f55179 (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:52.281211 21671 tablet_service.cc:1511] Processing CreateTablet for tablet 482e49afdcf1484988d7d53ef5046aa6 (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:52.282018 21595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596d854d1a6f40bb80d8a615e1f55179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.282413 21744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596d854d1a6f40bb80d8a615e1f55179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.282312 21670 tablet_service.cc:1511] Processing CreateTablet for tablet 596d854d1a6f40bb80d8a615e1f55179 (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:52.282932 21671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482e49afdcf1484988d7d53ef5046aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.283905 21670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596d854d1a6f40bb80d8a615e1f55179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.277992 21594 tablet_service.cc:1511] Processing CreateTablet for tablet 560f69feb04f4639840c43c413893e2b (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:52.279042 21745 tablet_service.cc:1511] Processing CreateTablet for tablet 482e49afdcf1484988d7d53ef5046aa6 (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:52.279889 21593 tablet_service.cc:1511] Processing CreateTablet for tablet 725150cbfcf748c2acfc0062e6b8daa8 (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:52.285514 21743 tablet_service.cc:1511] Processing CreateTablet for tablet 560f69feb04f4639840c43c413893e2b (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:52.285575 21668 tablet_service.cc:1511] Processing CreateTablet for tablet 725150cbfcf748c2acfc0062e6b8daa8 (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:52.285748 21594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 560f69feb04f4639840c43c413893e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.287334 21668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725150cbfcf748c2acfc0062e6b8daa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.287685 21743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 560f69feb04f4639840c43c413893e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.289181 21593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725150cbfcf748c2acfc0062e6b8daa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.293619 21745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482e49afdcf1484988d7d53ef5046aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.294301 21669 tablet_service.cc:1511] Processing CreateTablet for tablet 560f69feb04f4639840c43c413893e2b (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:52.295971 21669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 560f69feb04f4639840c43c413893e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.312086 21667 tablet_service.cc:1511] Processing CreateTablet for tablet 8783b31e20a64a2d829c793b0ec15afa (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:52.314079 21667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8783b31e20a64a2d829c793b0ec15afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.318222 21742 tablet_service.cc:1511] Processing CreateTablet for tablet 725150cbfcf748c2acfc0062e6b8daa8 (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:52.319787 21742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725150cbfcf748c2acfc0062e6b8daa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.323010 21592 tablet_service.cc:1511] Processing CreateTablet for tablet 8783b31e20a64a2d829c793b0ec15afa (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:52.324605 21592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8783b31e20a64a2d829c793b0ec15afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.329231 21671 tablet_service.cc:1511] Processing CreateTablet for tablet 6f122f1414c247308d07604c02fe241c (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:52.331604 21671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f122f1414c247308d07604c02fe241c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.346242 21591 tablet_service.cc:1511] Processing CreateTablet for tablet 6f122f1414c247308d07604c02fe241c (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:52.348567 21591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f122f1414c247308d07604c02fe241c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.348371 21741 tablet_service.cc:1511] Processing CreateTablet for tablet 6f122f1414c247308d07604c02fe241c (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:52.349854 21741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f122f1414c247308d07604c02fe241c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.360598 21795 tablet_bootstrap.cc:492] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179: Bootstrap starting.
I20260709 12:08:52.365082 21666 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad191e972bc4ca2860bb9a8f5746cdc (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:52.366858 21666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad191e972bc4ca2860bb9a8f5746cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.366758 21590 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad191e972bc4ca2860bb9a8f5746cdc (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:52.368199 21590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad191e972bc4ca2860bb9a8f5746cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.369045 21743 tablet_service.cc:1511] Processing CreateTablet for tablet 8783b31e20a64a2d829c793b0ec15afa (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:52.370841 21743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8783b31e20a64a2d829c793b0ec15afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.371877 21589 tablet_service.cc:1511] Processing CreateTablet for tablet 1166690bbf6e48a6900df89ee5e5e91d (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:52.369175 21740 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad191e972bc4ca2860bb9a8f5746cdc (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:52.373606 21589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1166690bbf6e48a6900df89ee5e5e91d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.373777 21740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad191e972bc4ca2860bb9a8f5746cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.374327 21739 tablet_service.cc:1511] Processing CreateTablet for tablet 1166690bbf6e48a6900df89ee5e5e91d (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:52.375780 21739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1166690bbf6e48a6900df89ee5e5e91d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.376459 21795 tablet_bootstrap.cc:654] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.393397 21588 tablet_service.cc:1511] Processing CreateTablet for tablet d8f1d0a35e4947558427e37c41ece94f (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:52.394915 21588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f1d0a35e4947558427e37c41ece94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.396190 21665 tablet_service.cc:1511] Processing CreateTablet for tablet d8f1d0a35e4947558427e37c41ece94f (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:52.397886 21665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f1d0a35e4947558427e37c41ece94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.397580 21670 tablet_service.cc:1511] Processing CreateTablet for tablet 1166690bbf6e48a6900df89ee5e5e91d (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:52.398888 21670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1166690bbf6e48a6900df89ee5e5e91d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.404632 21738 tablet_service.cc:1511] Processing CreateTablet for tablet d8f1d0a35e4947558427e37c41ece94f (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:52.412078 21738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f1d0a35e4947558427e37c41ece94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.415046 21595 tablet_service.cc:1511] Processing CreateTablet for tablet 54a9c67654414ea5a7a73ef1bb9dcd6a (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:52.417893 21666 tablet_service.cc:1511] Processing CreateTablet for tablet 54a9c67654414ea5a7a73ef1bb9dcd6a (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:52.419385 21666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a9c67654414ea5a7a73ef1bb9dcd6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.416657 21595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a9c67654414ea5a7a73ef1bb9dcd6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.432076 21739 tablet_service.cc:1511] Processing CreateTablet for tablet 54a9c67654414ea5a7a73ef1bb9dcd6a (DEFAULT_TABLE table=test-workload [id=752aba8fc18f4358bdc4be0a97ee8362]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:52.433688 21739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a9c67654414ea5a7a73ef1bb9dcd6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:52.435016 21797 tablet_bootstrap.cc:492] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8: Bootstrap starting.
I20260709 12:08:52.449731 21796 tablet_bootstrap.cc:492] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30: Bootstrap starting.
I20260709 12:08:52.471966 21796 tablet_bootstrap.cc:654] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.483996 21797 tablet_bootstrap.cc:654] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.484725 21795 tablet_bootstrap.cc:492] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179: No bootstrap required, opened a new log
I20260709 12:08:52.485422 21795 ts_tablet_manager.cc:1403] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.006s
I20260709 12:08:52.489050 21795 raft_consensus.cc:359] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.489934 21795 raft_consensus.cc:385] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.490301 21795 raft_consensus.cc:740] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.491415 21795 consensus_queue.cc:260] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.496148 21797 tablet_bootstrap.cc:492] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8: No bootstrap required, opened a new log
I20260709 12:08:52.496500 21795 ts_tablet_manager.cc:1434] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:08:52.496668 21797 ts_tablet_manager.cc:1403] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.008s
I20260709 12:08:52.496865 21796 tablet_bootstrap.cc:492] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30: No bootstrap required, opened a new log
I20260709 12:08:52.497359 21796 ts_tablet_manager.cc:1403] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.003s
I20260709 12:08:52.497455 21706 heartbeater.cc:499] Master 127.20.102.254:34453 was elected leader, sending a full tablet report...
I20260709 12:08:52.497678 21795 tablet_bootstrap.cc:492] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179: Bootstrap starting.
I20260709 12:08:52.500252 21797 raft_consensus.cc:359] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:52.500698 21796 raft_consensus.cc:359] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.501178 21797 raft_consensus.cc:385] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.501607 21796 raft_consensus.cc:385] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.501690 21797 raft_consensus.cc:740] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.502135 21796 raft_consensus.cc:740] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.502887 21797 consensus_queue.cc:260] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:52.502954 21796 consensus_queue.cc:260] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.504473 21795 tablet_bootstrap.cc:654] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.513417 21796 ts_tablet_manager.cc:1434] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.006s
I20260709 12:08:52.514462 21780 heartbeater.cc:499] Master 127.20.102.254:34453 was elected leader, sending a full tablet report...
I20260709 12:08:52.521078 21796 tablet_bootstrap.cc:492] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30: Bootstrap starting.
I20260709 12:08:52.530485 21796 tablet_bootstrap.cc:654] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.531930 21795 tablet_bootstrap.cc:492] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179: No bootstrap required, opened a new log
I20260709 12:08:52.532477 21795 ts_tablet_manager.cc:1403] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.023s
I20260709 12:08:52.536135 21795 raft_consensus.cc:359] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:52.537112 21795 raft_consensus.cc:385] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:08:52.537227 21707 tablet.cc:2406] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:52.537460 21795 raft_consensus.cc:740] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.538252 21795 consensus_queue.cc:260] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:52.541554 21795 ts_tablet_manager.cc:1434] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.007s
I20260709 12:08:52.542150 21631 heartbeater.cc:499] Master 127.20.102.254:34453 was elected leader, sending a full tablet report...
I20260709 12:08:52.542625 21797 ts_tablet_manager.cc:1434] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8: Time spent starting tablet: real 0.045s	user 0.029s	sys 0.015s
I20260709 12:08:52.542917 21795 tablet_bootstrap.cc:492] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179: Bootstrap starting.
I20260709 12:08:52.543601 21797 tablet_bootstrap.cc:492] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8: Bootstrap starting.
I20260709 12:08:52.550836 21797 tablet_bootstrap.cc:654] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.551009 21795 tablet_bootstrap.cc:654] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.554811 21796 tablet_bootstrap.cc:492] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30: No bootstrap required, opened a new log
I20260709 12:08:52.555437 21796 ts_tablet_manager.cc:1403] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30: Time spent bootstrapping tablet: real 0.035s	user 0.026s	sys 0.002s
I20260709 12:08:52.559372 21796 raft_consensus.cc:359] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.560403 21796 raft_consensus.cc:385] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.560937 21796 raft_consensus.cc:740] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.562131 21796 consensus_queue.cc:260] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.565781 21796 ts_tablet_manager.cc:1434] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:08:52.567504 21796 tablet_bootstrap.cc:492] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30: Bootstrap starting.
I20260709 12:08:52.568948 21795 tablet_bootstrap.cc:492] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179: No bootstrap required, opened a new log
I20260709 12:08:52.569442 21795 ts_tablet_manager.cc:1403] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.007s
I20260709 12:08:52.572336 21795 raft_consensus.cc:359] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.573115 21795 raft_consensus.cc:385] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.573415 21795 raft_consensus.cc:740] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.574301 21795 consensus_queue.cc:260] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.576802 21795 ts_tablet_manager.cc:1434] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:08:52.577775 21795 tablet_bootstrap.cc:492] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179: Bootstrap starting.
I20260709 12:08:52.578971 21796 tablet_bootstrap.cc:654] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.584088 21795 tablet_bootstrap.cc:654] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.584615 21797 tablet_bootstrap.cc:492] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8: No bootstrap required, opened a new log
I20260709 12:08:52.585251 21797 ts_tablet_manager.cc:1403] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8: Time spent bootstrapping tablet: real 0.042s	user 0.030s	sys 0.004s
I20260709 12:08:52.588369 21797 raft_consensus.cc:359] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.589205 21797 raft_consensus.cc:385] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.589553 21797 raft_consensus.cc:740] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.590334 21797 consensus_queue.cc:260] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.592533 21797 ts_tablet_manager.cc:1434] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:08:52.593608 21797 tablet_bootstrap.cc:492] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8: Bootstrap starting.
I20260709 12:08:52.596307 21795 tablet_bootstrap.cc:492] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179: No bootstrap required, opened a new log
I20260709 12:08:52.596967 21795 ts_tablet_manager.cc:1403] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.003s
I20260709 12:08:52.597280 21796 tablet_bootstrap.cc:492] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30: No bootstrap required, opened a new log
I20260709 12:08:52.597910 21796 ts_tablet_manager.cc:1403] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
I20260709 12:08:52.600648 21797 tablet_bootstrap.cc:654] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.600224 21795 raft_consensus.cc:359] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.601163 21795 raft_consensus.cc:385] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.600888 21796 raft_consensus.cc:359] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.601550 21795 raft_consensus.cc:740] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.601786 21796 raft_consensus.cc:385] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.602221 21796 raft_consensus.cc:740] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.602537 21795 consensus_queue.cc:260] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.603190 21796 consensus_queue.cc:260] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.605479 21795 ts_tablet_manager.cc:1434] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:08:52.606812 21795 tablet_bootstrap.cc:492] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179: Bootstrap starting.
I20260709 12:08:52.609172 21796 ts_tablet_manager.cc:1434] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:08:52.610358 21796 tablet_bootstrap.cc:492] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30: Bootstrap starting.
I20260709 12:08:52.611075 21803 raft_consensus.cc:493] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:52.611533 21803 raft_consensus.cc:515] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.614025 21795 tablet_bootstrap.cc:654] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.614204 21803 leader_election.cc:290] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:52.616915 21796 tablet_bootstrap.cc:654] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.618117 21797 tablet_bootstrap.cc:492] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8: No bootstrap required, opened a new log
I20260709 12:08:52.618644 21797 ts_tablet_manager.cc:1403] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.005s
I20260709 12:08:52.622416 21797 raft_consensus.cc:359] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.623443 21797 raft_consensus.cc:385] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.623898 21797 raft_consensus.cc:740] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.624956 21797 consensus_queue.cc:260] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.628000 21797 ts_tablet_manager.cc:1434] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:08:52.629335 21797 tablet_bootstrap.cc:492] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8: Bootstrap starting.
I20260709 12:08:52.637326 21802 raft_consensus.cc:493] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:52.637974 21802 raft_consensus.cc:515] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.637530 21797 tablet_bootstrap.cc:654] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.644236 21802 leader_election.cc:290] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:52.644917 21802 raft_consensus.cc:493] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:52.645843 21802 raft_consensus.cc:515] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.649072 21802 leader_election.cc:290] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:52.671252 21797 tablet_bootstrap.cc:492] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8: No bootstrap required, opened a new log
I20260709 12:08:52.677353 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30" is_pre_election: true
I20260709 12:08:52.678278 21797 ts_tablet_manager.cc:1403] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.011s
I20260709 12:08:52.679327 21754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725150cbfcf748c2acfc0062e6b8daa8" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30" is_pre_election: true
I20260709 12:08:52.681160 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:52.681646 21797 raft_consensus.cc:359] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.681934 21681 raft_consensus.cc:2468] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 0.
W20260709 12:08:52.681202 21572 leader_election.cc:343] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:52.682437 21797 raft_consensus.cc:385] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.682803 21797 raft_consensus.cc:740] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Initialized, Role: FOLLOWER
W20260709 12:08:52.683102 21572 leader_election.cc:343] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:52.683658 21718 leader_election.cc:304] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:52.683511 21797 consensus_queue.cc:260] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.684582 21803 raft_consensus.cc:2804] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:52.685226 21803 raft_consensus.cc:493] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:52.685643 21803 raft_consensus.cc:3060] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:52.687004 21797 ts_tablet_manager.cc:1434] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:08:52.691989 21796 tablet_bootstrap.cc:492] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30: No bootstrap required, opened a new log
I20260709 12:08:52.692483 21606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8" is_pre_election: true
I20260709 12:08:52.693799 21797 tablet_bootstrap.cc:492] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8: Bootstrap starting.
I20260709 12:08:52.695896 21795 tablet_bootstrap.cc:492] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179: No bootstrap required, opened a new log
I20260709 12:08:52.696427 21795 ts_tablet_manager.cc:1403] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.028s
I20260709 12:08:52.699404 21795 raft_consensus.cc:359] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.700277 21795 raft_consensus.cc:385] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.700636 21795 raft_consensus.cc:740] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.694084 21803 raft_consensus.cc:515] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.701639 21795 consensus_queue.cc:260] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.703003 21803 leader_election.cc:290] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:52.703501 21803 raft_consensus.cc:493] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:52.703917 21803 raft_consensus.cc:515] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.705827 21803 leader_election.cc:290] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:52.706248 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:52.706488 21796 ts_tablet_manager.cc:1403] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30: Time spent bootstrapping tablet: real 0.096s	user 0.030s	sys 0.039s
I20260709 12:08:52.706771 21681 raft_consensus.cc:3060] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:52.709408 21796 raft_consensus.cc:359] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:52.710526 21796 raft_consensus.cc:385] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.710952 21796 raft_consensus.cc:740] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.711308 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:52.711975 21680 raft_consensus.cc:2468] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 0.
I20260709 12:08:52.711846 21796 consensus_queue.cc:260] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:52.714119 21796 ts_tablet_manager.cc:1434] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:52.715083 21796 tablet_bootstrap.cc:492] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30: Bootstrap starting.
I20260709 12:08:52.717146 21718 leader_election.cc:304] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:52.717993 21797 tablet_bootstrap.cc:654] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.723106 21681 raft_consensus.cc:2468] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 1.
I20260709 12:08:52.726862 21718 leader_election.cc:304] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:52.723697 21803 raft_consensus.cc:2804] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:52.728129 21803 raft_consensus.cc:493] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:52.728677 21803 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:52.725265 21796 tablet_bootstrap.cc:654] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:52.732414 21552 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:52.738536 21803 raft_consensus.cc:515] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.739936 21814 raft_consensus.cc:493] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:52.725363 21795 ts_tablet_manager.cc:1434] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:08:52.740509 21814 raft_consensus.cc:515] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.741451 21795 tablet_bootstrap.cc:492] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179: Bootstrap starting.
I20260709 12:08:52.741528 21796 tablet_bootstrap.cc:492] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30: No bootstrap required, opened a new log
I20260709 12:08:52.743357 21796 ts_tablet_manager.cc:1403] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30: Time spent bootstrapping tablet: real 0.028s	user 0.003s	sys 0.010s
I20260709 12:08:52.747921 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:52.748229 21796 raft_consensus.cc:359] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.749030 21796 raft_consensus.cc:385] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.748822 21681 raft_consensus.cc:2468] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 0.
I20260709 12:08:52.749356 21796 raft_consensus.cc:740] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.750106 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725150cbfcf748c2acfc0062e6b8daa8" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:52.750248 21796 consensus_queue.cc:260] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.751850 21679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560f69feb04f4639840c43c413893e2b" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:52.752722 21679 raft_consensus.cc:2468] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 0.
I20260709 12:08:52.753976 21795 tablet_bootstrap.cc:654] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.756280 21569 leader_election.cc:304] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 8114007c96f34dccad8aaacdaed1ee30
W20260709 12:08:52.757897 21569 leader_election.cc:343] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:52.758463 21569 leader_election.cc:304] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8; no voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30
I20260709 12:08:52.759807 21802 raft_consensus.cc:2804] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:52.760309 21802 raft_consensus.cc:493] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:52.760465 21817 raft_consensus.cc:2804] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:52.760802 21802 raft_consensus.cc:3060] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:52.761215 21721 leader_election.cc:343] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:52.763015 21814 leader_election.cc:290] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:52.763595 21814 raft_consensus.cc:2749] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:52.764555 21754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560f69feb04f4639840c43c413893e2b" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30" is_pre_election: true
I20260709 12:08:52.765475 21754 raft_consensus.cc:2468] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 0.
I20260709 12:08:52.767215 21572 leader_election.cc:304] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:52.768409 21814 raft_consensus.cc:2804] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:52.768941 21814 raft_consensus.cc:493] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:52.769487 21814 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:52.770961 21803 leader_election.cc:290] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:52.772605 21679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:52.773214 21679 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:52.773368 21797 tablet_bootstrap.cc:492] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8: No bootstrap required, opened a new log
I20260709 12:08:52.773844 21797 ts_tablet_manager.cc:1403] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8: Time spent bootstrapping tablet: real 0.080s	user 0.026s	sys 0.016s
I20260709 12:08:52.769002 21802 raft_consensus.cc:515] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.783576 21679 raft_consensus.cc:2468] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 1.
I20260709 12:08:52.784006 21754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:52.785936 21718 leader_election.cc:304] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
W20260709 12:08:52.786882 21572 leader_election.cc:343] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:52.787014 21606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:08:52.785110 21797 raft_consensus.cc:359] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.789255 21822 raft_consensus.cc:2804] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:52.789561 21797 raft_consensus.cc:385] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.790000 21822 raft_consensus.cc:697] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Becoming Leader. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:08:52.790046 21797 raft_consensus.cc:740] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.791188 21822 consensus_queue.cc:237] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.791745 21605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8" is_pre_election: true
I20260709 12:08:52.791267 21797 consensus_queue.cc:260] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.784605 21802 leader_election.cc:290] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:52.792618 21606 raft_consensus.cc:3060] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:52.789507 21604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:08:52.788182 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:52.794250 21680 raft_consensus.cc:3060] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:52.801887 21721 leader_election.cc:343] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:52.803200 21721 leader_election.cc:343] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:52.803975 21606 raft_consensus.cc:2468] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 1.
I20260709 12:08:52.807852 21680 raft_consensus.cc:2468] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 1.
I20260709 12:08:52.810127 21797 ts_tablet_manager.cc:1434] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.004s
I20260709 12:08:52.784811 21817 raft_consensus.cc:697] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Becoming Leader. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:08:52.812394 21797 tablet_bootstrap.cc:492] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8: Bootstrap starting.
I20260709 12:08:52.815997 21569 leader_election.cc:304] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 8114007c96f34dccad8aaacdaed1ee30
I20260709 12:08:52.812573 21817 consensus_queue.cc:237] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.816253 21801 raft_consensus.cc:493] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:52.818771 21801 raft_consensus.cc:515] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:52.821265 21801 leader_election.cc:290] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:52.826642 21795 tablet_bootstrap.cc:492] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179: No bootstrap required, opened a new log
I20260709 12:08:52.827317 21795 ts_tablet_manager.cc:1403] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179: Time spent bootstrapping tablet: real 0.086s	user 0.027s	sys 0.005s
I20260709 12:08:52.831048 21796 ts_tablet_manager.cc:1434] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30: Time spent starting tablet: real 0.087s	user 0.016s	sys 0.016s
I20260709 12:08:52.830770 21795 raft_consensus.cc:359] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.831420 21821 raft_consensus.cc:2804] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:52.831658 21795 raft_consensus.cc:385] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.832267 21795 raft_consensus.cc:740] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.830813 21797 tablet_bootstrap.cc:654] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.832240 21796 tablet_bootstrap.cc:492] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30: Bootstrap starting.
I20260709 12:08:52.832352 21821 raft_consensus.cc:697] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:08:52.815402 21814 raft_consensus.cc:515] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.840296 21795 consensus_queue.cc:260] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.843910 21802 raft_consensus.cc:493] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:52.844456 21802 raft_consensus.cc:515] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:52.839504 21821 consensus_queue.cc:237] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.845690 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560f69feb04f4639840c43c413893e2b" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:52.846344 21680 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:52.846729 21802 leader_election.cc:290] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:52.850203 21795 ts_tablet_manager.cc:1434] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:08:52.850454 21504 catalog_manager.cc:5697] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "8114007c96f34dccad8aaacdaed1ee30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:52.851378 21795 tablet_bootstrap.cc:492] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179: Bootstrap starting.
I20260709 12:08:52.853993 21680 raft_consensus.cc:2468] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 1.
I20260709 12:08:52.854002 21754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30" is_pre_election: true
I20260709 12:08:52.855016 21754 raft_consensus.cc:2468] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 0.
I20260709 12:08:52.856524 21572 leader_election.cc:304] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:52.857569 21802 raft_consensus.cc:2804] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:52.857987 21802 raft_consensus.cc:493] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:52.858404 21802 raft_consensus.cc:3060] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:52.859567 21795 tablet_bootstrap.cc:654] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.860298 21569 leader_election.cc:304] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 
I20260709 12:08:52.860889 21814 leader_election.cc:290] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:52.861650 21754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560f69feb04f4639840c43c413893e2b" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:52.862265 21754 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:52.852286 21504 catalog_manager.cc:5697] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "8114007c96f34dccad8aaacdaed1ee30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:52.863397 21814 raft_consensus.cc:2804] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:52.864091 21814 raft_consensus.cc:697] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:08:52.865072 21814 consensus_queue.cc:237] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.871104 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:52.871996 21680 raft_consensus.cc:2468] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 0.
I20260709 12:08:52.892377 21796 tablet_bootstrap.cc:654] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.890791 21802 raft_consensus.cc:515] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:52.895956 21606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8" is_pre_election: true
I20260709 12:08:52.897462 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30" is_pre_election: true
I20260709 12:08:52.898329 21755 raft_consensus.cc:2468] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 0.
I20260709 12:08:52.900157 21606 raft_consensus.cc:2393] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57f7be88080046528640d139ebf0f179 in current term 1: Already voted for candidate 46b93a657c04412893cee20a58e10fd8 in this term.
I20260709 12:08:52.902848 21797 tablet_bootstrap.cc:492] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8: No bootstrap required, opened a new log
I20260709 12:08:52.902616 21647 leader_election.cc:304] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:52.903342 21797 ts_tablet_manager.cc:1403] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.012s
I20260709 12:08:52.903545 21801 raft_consensus.cc:2804] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:52.903870 21801 raft_consensus.cc:493] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:52.904210 21801 raft_consensus.cc:3060] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:52.906828 21797 raft_consensus.cc:359] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.907615 21797 raft_consensus.cc:385] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.907977 21797 raft_consensus.cc:740] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.908910 21797 consensus_queue.cc:260] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.912170 21801 raft_consensus.cc:515] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:52.913668 21797 ts_tablet_manager.cc:1434] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:08:52.914126 21754 raft_consensus.cc:2468] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 1.
I20260709 12:08:52.914923 21797 tablet_bootstrap.cc:492] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8: Bootstrap starting.
I20260709 12:08:52.910044 21501 catalog_manager.cc:5697] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:52.916180 21801 leader_election.cc:290] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:52.916401 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:52.918505 21606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:08:52.919569 21606 raft_consensus.cc:2393] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 57f7be88080046528640d139ebf0f179 in current term 1: Already voted for candidate 46b93a657c04412893cee20a58e10fd8 in this term.
I20260709 12:08:52.921051 21755 raft_consensus.cc:3060] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:52.934082 21754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:52.937341 21802 leader_election.cc:290] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:52.938498 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:52.939438 21680 raft_consensus.cc:2393] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 46b93a657c04412893cee20a58e10fd8 in current term 1: Already voted for candidate 57f7be88080046528640d139ebf0f179 in this term.
I20260709 12:08:52.940598 21755 raft_consensus.cc:2468] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 1.
I20260709 12:08:52.940939 21569 leader_election.cc:304] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8; no voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30
I20260709 12:08:52.941619 21796 tablet_bootstrap.cc:492] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30: No bootstrap required, opened a new log
I20260709 12:08:52.942148 21796 ts_tablet_manager.cc:1403] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.004s
I20260709 12:08:52.941958 21647 leader_election.cc:304] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 46b93a657c04412893cee20a58e10fd8
I20260709 12:08:52.942257 21802 raft_consensus.cc:2749] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:52.943199 21801 raft_consensus.cc:2804] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:52.944823 21797 tablet_bootstrap.cc:654] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.945288 21796 raft_consensus.cc:359] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.946087 21796 raft_consensus.cc:385] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.946388 21796 raft_consensus.cc:740] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.948423 21796 consensus_queue.cc:260] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.950209 21795 tablet_bootstrap.cc:492] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179: No bootstrap required, opened a new log
I20260709 12:08:52.951043 21795 ts_tablet_manager.cc:1403] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179: Time spent bootstrapping tablet: real 0.100s	user 0.023s	sys 0.012s
I20260709 12:08:52.951727 21801 raft_consensus.cc:697] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Becoming Leader. State: Replica: 57f7be88080046528640d139ebf0f179, State: Running, Role: LEADER
I20260709 12:08:52.952055 21796 ts_tablet_manager.cc:1434] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:08:52.953140 21796 tablet_bootstrap.cc:492] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30: Bootstrap starting.
I20260709 12:08:52.952886 21801 consensus_queue.cc:237] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:52.955513 21795 raft_consensus.cc:359] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.959223 21795 raft_consensus.cc:385] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.959599 21795 raft_consensus.cc:740] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Initialized, Role: FOLLOWER
I20260709 12:08:52.961838 21814 raft_consensus.cc:493] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:52.962433 21814 raft_consensus.cc:515] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.960908 21795 consensus_queue.cc:260] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.964677 21814 leader_election.cc:290] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:52.966302 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f122f1414c247308d07604c02fe241c" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:52.969735 21797 tablet_bootstrap.cc:492] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8: No bootstrap required, opened a new log
I20260709 12:08:52.970232 21797 ts_tablet_manager.cc:1403] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.005s
W20260709 12:08:52.970774 21569 leader_election.cc:343] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:52.967945 21795 ts_tablet_manager.cc:1434] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:08:52.973604 21795 tablet_bootstrap.cc:492] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179: Bootstrap starting.
I20260709 12:08:52.972664 21797 raft_consensus.cc:359] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.974647 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f122f1414c247308d07604c02fe241c" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30" is_pre_election: true
I20260709 12:08:52.974871 21797 raft_consensus.cc:385] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:52.975159 21797 raft_consensus.cc:740] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Initialized, Role: FOLLOWER
W20260709 12:08:52.976471 21572 leader_election.cc:343] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:52.977100 21572 leader_election.cc:304] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8; no voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30
I20260709 12:08:52.977545 21797 consensus_queue.cc:260] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:52.978217 21814 raft_consensus.cc:2749] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:52.982465 21796 tablet_bootstrap.cc:654] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.982641 21797 ts_tablet_manager.cc:1434] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.006s
I20260709 12:08:52.987519 21795 tablet_bootstrap.cc:654] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:52.991950 21797 tablet_bootstrap.cc:492] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8: Bootstrap starting.
I20260709 12:08:53.001806 21801 raft_consensus.cc:493] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:53.002442 21801 raft_consensus.cc:515] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.005545 21801 leader_election.cc:290] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:53.005885 21501 catalog_manager.cc:5697] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:53.008281 21606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a9c67654414ea5a7a73ef1bb9dcd6a" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8" is_pre_election: true
I20260709 12:08:53.008723 21797 tablet_bootstrap.cc:654] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:53.009150 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a9c67654414ea5a7a73ef1bb9dcd6a" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30" is_pre_election: true
I20260709 12:08:53.009341 21504 catalog_manager.cc:5697] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57f7be88080046528640d139ebf0f179 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "57f7be88080046528640d139ebf0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: HEALTHY } } }
W20260709 12:08:53.011686 21647 leader_election.cc:343] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:53.012466 21647 leader_election.cc:343] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:53.012910 21647 leader_election.cc:304] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57f7be88080046528640d139ebf0f179; no voters: 46b93a657c04412893cee20a58e10fd8, 8114007c96f34dccad8aaacdaed1ee30
I20260709 12:08:53.014093 21801 raft_consensus.cc:2749] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:53.022238 21795 tablet_bootstrap.cc:492] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179: No bootstrap required, opened a new log
I20260709 12:08:53.022887 21795 ts_tablet_manager.cc:1403] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.008s
I20260709 12:08:53.023414 21796 tablet_bootstrap.cc:492] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30: No bootstrap required, opened a new log
I20260709 12:08:53.025806 21795 raft_consensus.cc:359] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.026659 21795 raft_consensus.cc:385] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:53.026995 21795 raft_consensus.cc:740] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Initialized, Role: FOLLOWER
I20260709 12:08:53.024117 21796 ts_tablet_manager.cc:1403] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.010s
I20260709 12:08:53.027956 21795 consensus_queue.cc:260] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.030781 21795 ts_tablet_manager.cc:1434] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:53.030830 21796 raft_consensus.cc:359] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.031855 21795 tablet_bootstrap.cc:492] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179: Bootstrap starting.
I20260709 12:08:53.031844 21796 raft_consensus.cc:385] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:53.033125 21796 raft_consensus.cc:740] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Initialized, Role: FOLLOWER
I20260709 12:08:53.034317 21797 tablet_bootstrap.cc:492] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8: No bootstrap required, opened a new log
I20260709 12:08:53.033987 21796 consensus_queue.cc:260] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.034878 21797 ts_tablet_manager.cc:1403] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.009s
I20260709 12:08:53.037984 21797 raft_consensus.cc:359] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.038581 21795 tablet_bootstrap.cc:654] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:53.038882 21797 raft_consensus.cc:385] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:53.039417 21797 raft_consensus.cc:740] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Initialized, Role: FOLLOWER
I20260709 12:08:53.040537 21797 consensus_queue.cc:260] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.042368 21796 ts_tablet_manager.cc:1434] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 12:08:53.042603 21797 ts_tablet_manager.cc:1434] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:53.043469 21796 tablet_bootstrap.cc:492] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30: Bootstrap starting.
I20260709 12:08:53.043512 21797 tablet_bootstrap.cc:492] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8: Bootstrap starting.
I20260709 12:08:53.050089 21797 tablet_bootstrap.cc:654] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:53.050089 21796 tablet_bootstrap.cc:654] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:53.062711 21817 raft_consensus.cc:493] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:53.063258 21817 raft_consensus.cc:515] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.064392 21797 tablet_bootstrap.cc:492] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8: No bootstrap required, opened a new log
I20260709 12:08:53.064615 21795 tablet_bootstrap.cc:492] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179: No bootstrap required, opened a new log
I20260709 12:08:53.064910 21797 ts_tablet_manager.cc:1403] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 12:08:53.065258 21795 ts_tablet_manager.cc:1403] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179: Time spent bootstrapping tablet: real 0.034s	user 0.027s	sys 0.005s
I20260709 12:08:53.065421 21817 leader_election.cc:290] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:53.067891 21606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725150cbfcf748c2acfc0062e6b8daa8" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8" is_pre_election: true
I20260709 12:08:53.067843 21797 raft_consensus.cc:359] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.068475 21796 tablet_bootstrap.cc:492] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30: No bootstrap required, opened a new log
I20260709 12:08:53.068581 21797 raft_consensus.cc:385] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:53.069103 21797 raft_consensus.cc:740] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Initialized, Role: FOLLOWER
I20260709 12:08:53.068862 21795 raft_consensus.cc:359] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.069259 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725150cbfcf748c2acfc0062e6b8daa8" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:53.069617 21795 raft_consensus.cc:385] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:53.069994 21795 raft_consensus.cc:740] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Initialized, Role: FOLLOWER
I20260709 12:08:53.068594 21606 raft_consensus.cc:2468] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 0.
I20260709 12:08:53.069888 21797 consensus_queue.cc:260] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.069269 21796 ts_tablet_manager.cc:1403] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.003s
I20260709 12:08:53.071002 21795 consensus_queue.cc:260] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.072278 21797 ts_tablet_manager.cc:1434] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:08:53.072208 21680 raft_consensus.cc:2468] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 0.
I20260709 12:08:53.073109 21721 leader_election.cc:304] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:53.073367 21797 tablet_bootstrap.cc:492] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8: Bootstrap starting.
I20260709 12:08:53.073734 21795 ts_tablet_manager.cc:1434] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:08:53.074687 21795 tablet_bootstrap.cc:492] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179: Bootstrap starting.
I20260709 12:08:53.078552 21817 raft_consensus.cc:2804] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:53.079051 21817 raft_consensus.cc:493] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:53.079474 21817 raft_consensus.cc:3060] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.079946 21797 tablet_bootstrap.cc:654] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:53.081055 21795 tablet_bootstrap.cc:654] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:53.093258 21814 raft_consensus.cc:493] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:53.094082 21814 raft_consensus.cc:515] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.097177 21796 raft_consensus.cc:359] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.098176 21796 raft_consensus.cc:385] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:53.098517 21796 raft_consensus.cc:740] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Initialized, Role: FOLLOWER
I20260709 12:08:53.098685 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f1d0a35e4947558427e37c41ece94f" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:53.099735 21680 raft_consensus.cc:2468] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 0.
I20260709 12:08:53.099463 21796 consensus_queue.cc:260] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.102298 21796 ts_tablet_manager.cc:1434] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:08:53.102830 21569 leader_election.cc:304] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 
I20260709 12:08:53.103566 21796 tablet_bootstrap.cc:492] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30: Bootstrap starting.
I20260709 12:08:53.103819 21802 raft_consensus.cc:2804] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:53.104238 21802 raft_consensus.cc:493] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:53.104728 21802 raft_consensus.cc:3060] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.113762 21814 leader_election.cc:290] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:53.115113 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f1d0a35e4947558427e37c41ece94f" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30" is_pre_election: true
W20260709 12:08:53.116748 21572 leader_election.cc:343] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:53.124008 21820 raft_consensus.cc:493] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:53.124848 21820 raft_consensus.cc:515] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.129448 21820 leader_election.cc:290] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:53.129616 21606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8" is_pre_election: true
I20260709 12:08:53.131290 21801 raft_consensus.cc:493] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:53.131430 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:53.131870 21801 raft_consensus.cc:515] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
W20260709 12:08:53.133261 21718 leader_election.cc:343] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:53.134172 21801 leader_election.cc:290] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
W20260709 12:08:53.134815 21721 leader_election.cc:343] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:53.123991 21817 raft_consensus.cc:515] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.135267 21721 leader_election.cc:304] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8114007c96f34dccad8aaacdaed1ee30; no voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179
I20260709 12:08:53.136627 21820 raft_consensus.cc:2749] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:53.127275 21802 raft_consensus.cc:515] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.137773 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f122f1414c247308d07604c02fe241c" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30" is_pre_election: true
I20260709 12:08:53.138442 21755 raft_consensus.cc:2468] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 0.
I20260709 12:08:53.139899 21647 leader_election.cc:304] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:53.142203 21796 tablet_bootstrap.cc:654] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:53.142606 21802 leader_election.cc:290] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:53.143306 21797 tablet_bootstrap.cc:492] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8: No bootstrap required, opened a new log
I20260709 12:08:53.143997 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f1d0a35e4947558427e37c41ece94f" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:53.143018 21604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f122f1414c247308d07604c02fe241c" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8" is_pre_election: true
I20260709 12:08:53.144384 21679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725150cbfcf748c2acfc0062e6b8daa8" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:53.144652 21680 raft_consensus.cc:3060] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.145038 21679 raft_consensus.cc:3060] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.144202 21797 ts_tablet_manager.cc:1403] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8: Time spent bootstrapping tablet: real 0.071s	user 0.034s	sys 0.035s
I20260709 12:08:53.148355 21606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725150cbfcf748c2acfc0062e6b8daa8" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:08:53.149214 21606 raft_consensus.cc:3060] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.143105 21817 leader_election.cc:290] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:53.149605 21797 raft_consensus.cc:359] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.150547 21797 raft_consensus.cc:385] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:53.150923 21797 raft_consensus.cc:740] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Initialized, Role: FOLLOWER
I20260709 12:08:53.144874 21604 raft_consensus.cc:2468] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 0.
I20260709 12:08:53.152060 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f1d0a35e4947558427e37c41ece94f" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:53.151970 21797 consensus_queue.cc:260] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
W20260709 12:08:53.153693 21572 leader_election.cc:343] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:53.154865 21796 tablet_bootstrap.cc:492] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30: No bootstrap required, opened a new log
I20260709 12:08:53.155449 21801 raft_consensus.cc:2804] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:53.155697 21679 raft_consensus.cc:2468] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 1.
I20260709 12:08:53.155956 21801 raft_consensus.cc:493] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:53.157191 21718 leader_election.cc:304] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:53.157658 21797 ts_tablet_manager.cc:1434] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:08:53.158164 21817 raft_consensus.cc:2804] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:53.158699 21817 raft_consensus.cc:697] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Becoming Leader. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:08:53.159611 21817 consensus_queue.cc:237] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.160391 21801 raft_consensus.cc:3060] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.155431 21796 ts_tablet_manager.cc:1403] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.001s
I20260709 12:08:53.167528 21796 raft_consensus.cc:359] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.168049 21796 raft_consensus.cc:385] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:53.168228 21796 raft_consensus.cc:740] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Initialized, Role: FOLLOWER
I20260709 12:08:53.168731 21796 consensus_queue.cc:260] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.169812 21606 raft_consensus.cc:2468] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 1.
I20260709 12:08:53.170984 21796 ts_tablet_manager.cc:1434] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:08:53.172516 21795 tablet_bootstrap.cc:492] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179: No bootstrap required, opened a new log
I20260709 12:08:53.173079 21795 ts_tablet_manager.cc:1403] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179: Time spent bootstrapping tablet: real 0.099s	user 0.027s	sys 0.023s
I20260709 12:08:53.174239 21801 raft_consensus.cc:515] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.173110 21796 tablet_bootstrap.cc:492] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30: Bootstrap starting.
I20260709 12:08:53.176488 21801 leader_election.cc:290] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:53.171594 21680 raft_consensus.cc:2468] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 1.
I20260709 12:08:53.180610 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f122f1414c247308d07604c02fe241c" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:53.181353 21755 raft_consensus.cc:3060] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.181953 21796 tablet_bootstrap.cc:654] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:53.181268 21503 catalog_manager.cc:5697] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "8114007c96f34dccad8aaacdaed1ee30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:53.182371 21795 raft_consensus.cc:359] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.183255 21795 raft_consensus.cc:385] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:53.183579 21795 raft_consensus.cc:740] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Initialized, Role: FOLLOWER
I20260709 12:08:53.184322 21795 consensus_queue.cc:260] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.184962 21569 leader_election.cc:304] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 8114007c96f34dccad8aaacdaed1ee30
I20260709 12:08:53.186208 21802 raft_consensus.cc:2804] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:53.186759 21802 raft_consensus.cc:697] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:08:53.187597 21802 consensus_queue.cc:237] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.190352 21837 raft_consensus.cc:493] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:53.190900 21837 raft_consensus.cc:515] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.194136 21604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8" is_pre_election: true
I20260709 12:08:53.194851 21604 raft_consensus.cc:2468] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 0.
I20260709 12:08:53.196448 21647 leader_election.cc:304] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 
I20260709 12:08:53.197350 21801 raft_consensus.cc:2804] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:53.197834 21837 leader_election.cc:290] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:53.198024 21801 raft_consensus.cc:493] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:53.199877 21754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30" is_pre_election: true
I20260709 12:08:53.200884 21754 raft_consensus.cc:2468] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 0.
I20260709 12:08:53.203183 21606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f122f1414c247308d07604c02fe241c" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:08:53.203811 21606 raft_consensus.cc:3060] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.204867 21801 raft_consensus.cc:3060] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.207065 21503 catalog_manager.cc:5697] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:53.213001 21604 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.213330 21796 tablet_bootstrap.cc:492] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30: No bootstrap required, opened a new log
I20260709 12:08:53.213829 21796 ts_tablet_manager.cc:1403] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.011s
I20260709 12:08:53.216109 21801 raft_consensus.cc:515] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.216691 21796 raft_consensus.cc:359] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.217411 21796 raft_consensus.cc:385] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:53.217687 21796 raft_consensus.cc:740] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Initialized, Role: FOLLOWER
I20260709 12:08:53.218329 21801 leader_election.cc:290] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:53.218379 21796 consensus_queue.cc:260] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.219589 21795 ts_tablet_manager.cc:1434] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:08:53.219823 21605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:08:53.220371 21605 raft_consensus.cc:3060] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.211627 21755 raft_consensus.cc:2468] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 1.
I20260709 12:08:53.220732 21796 ts_tablet_manager.cc:1434] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:08:53.222790 21606 raft_consensus.cc:2468] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 1.
I20260709 12:08:53.223980 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:53.224637 21755 raft_consensus.cc:3060] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.225348 21647 leader_election.cc:304] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:53.226214 21801 raft_consensus.cc:2804] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:53.226840 21801 raft_consensus.cc:697] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Becoming Leader. State: Replica: 57f7be88080046528640d139ebf0f179, State: Running, Role: LEADER
I20260709 12:08:53.229202 21801 consensus_queue.cc:237] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.230726 21605 raft_consensus.cc:2468] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 1.
I20260709 12:08:53.231977 21647 leader_election.cc:304] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 
I20260709 12:08:53.232825 21837 raft_consensus.cc:2804] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:53.234921 21755 raft_consensus.cc:2468] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 1.
I20260709 12:08:53.235496 21817 consensus_queue.cc:1048] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.243474 21820 consensus_queue.cc:1048] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.244910 21820 consensus_queue.cc:1048] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.256098 21837 raft_consensus.cc:697] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Becoming Leader. State: Replica: 57f7be88080046528640d139ebf0f179, State: Running, Role: LEADER
I20260709 12:08:53.257159 21837 consensus_queue.cc:237] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.265520 21503 catalog_manager.cc:5697] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57f7be88080046528640d139ebf0f179 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "57f7be88080046528640d139ebf0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:53.275421 21802 raft_consensus.cc:493] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:53.276129 21802 raft_consensus.cc:515] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.280687 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a9c67654414ea5a7a73ef1bb9dcd6a" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30" is_pre_election: true
I20260709 12:08:53.281579 21755 raft_consensus.cc:2468] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 0.
I20260709 12:08:53.285159 21572 leader_election.cc:304] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:53.286303 21814 raft_consensus.cc:2804] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:53.286723 21814 raft_consensus.cc:493] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:53.287066 21814 raft_consensus.cc:3060] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.292276 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a9c67654414ea5a7a73ef1bb9dcd6a" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:53.293164 21681 raft_consensus.cc:2468] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 0.
I20260709 12:08:53.295315 21820 consensus_queue.cc:1048] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.296877 21802 leader_election.cc:290] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:53.303169 21814 raft_consensus.cc:515] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.305702 21814 leader_election.cc:290] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Requested vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:53.307672 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a9c67654414ea5a7a73ef1bb9dcd6a" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:53.308452 21681 raft_consensus.cc:3060] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.311007 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a9c67654414ea5a7a73ef1bb9dcd6a" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:53.311605 21755 raft_consensus.cc:3060] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.311635 21504 catalog_manager.cc:5697] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57f7be88080046528640d139ebf0f179 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "57f7be88080046528640d139ebf0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:53.316247 21681 raft_consensus.cc:2468] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 1.
I20260709 12:08:53.319267 21569 leader_election.cc:304] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 
I20260709 12:08:53.320370 21814 raft_consensus.cc:2804] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:53.321161 21814 raft_consensus.cc:697] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:08:53.322186 21814 consensus_queue.cc:237] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.323453 21755 raft_consensus.cc:2468] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 1.
I20260709 12:08:53.331055 21802 consensus_queue.cc:1048] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.333396 21501 catalog_manager.cc:5697] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:53.346485 21814 consensus_queue.cc:1048] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:53.351055 21803 raft_consensus.cc:493] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:53.351555 21803 raft_consensus.cc:515] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.356050 21604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8" is_pre_election: true
I20260709 12:08:53.358633 21803 leader_election.cc:290] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:53.359292 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:53.359993 21680 raft_consensus.cc:2393] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8114007c96f34dccad8aaacdaed1ee30 in current term 1: Already voted for candidate 46b93a657c04412893cee20a58e10fd8 in this term.
I20260709 12:08:53.361155 21718 leader_election.cc:304] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8114007c96f34dccad8aaacdaed1ee30; no voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179
I20260709 12:08:53.362064 21803 raft_consensus.cc:3060] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.368911 21803 raft_consensus.cc:2749] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:53.386165 21803 raft_consensus.cc:493] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:53.386689 21803 raft_consensus.cc:515] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.388491 21803 leader_election.cc:290] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:53.389794 21680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f1d0a35e4947558427e37c41ece94f" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57f7be88080046528640d139ebf0f179" is_pre_election: true
I20260709 12:08:53.389793 21604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f1d0a35e4947558427e37c41ece94f" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46b93a657c04412893cee20a58e10fd8" is_pre_election: true
I20260709 12:08:53.390828 21680 raft_consensus.cc:2393] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8114007c96f34dccad8aaacdaed1ee30 in current term 1: Already voted for candidate 46b93a657c04412893cee20a58e10fd8 in this term.
I20260709 12:08:53.392249 21718 leader_election.cc:304] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8114007c96f34dccad8aaacdaed1ee30; no voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179
I20260709 12:08:53.393081 21803 raft_consensus.cc:3060] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:53.398391 21803 raft_consensus.cc:2749] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:53.412086 21814 consensus_queue.cc:1048] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.413458 21802 consensus_queue.cc:1048] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.449811 21837 consensus_queue.cc:1048] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.461334 21801 consensus_queue.cc:1048] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.551545 21681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6"
dest_uuid: "57f7be88080046528640d139ebf0f179"
mode: GRACEFUL
new_leader_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:51920
I20260709 12:08:53.552459 21681 raft_consensus.cc:606] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Received request to transfer leadership to TS 46b93a657c04412893cee20a58e10fd8
I20260709 12:08:53.553349 21803 consensus_queue.cc:1048] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:53.568143 21817 consensus_queue.cc:1048] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.572314 21755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179"
dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
mode: GRACEFUL
new_leader_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:38158
I20260709 12:08:53.573135 21755 raft_consensus.cc:606] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Received request to transfer leadership to TS 46b93a657c04412893cee20a58e10fd8
I20260709 12:08:53.583775 21755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "725150cbfcf748c2acfc0062e6b8daa8"
dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
mode: GRACEFUL
new_leader_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:38158
I20260709 12:08:53.584532 21755 raft_consensus.cc:606] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Received request to transfer leadership to TS 46b93a657c04412893cee20a58e10fd8
I20260709 12:08:53.597282 21755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc"
dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
mode: GRACEFUL
new_leader_uuid: "57f7be88080046528640d139ebf0f179"
 from {username='slave'} at 127.0.0.1:38158
I20260709 12:08:53.597834 21755 raft_consensus.cc:606] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Received request to transfer leadership to TS 57f7be88080046528640d139ebf0f179
I20260709 12:08:53.615911 21604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f1d0a35e4947558427e37c41ece94f"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
mode: GRACEFUL
new_leader_uuid: "57f7be88080046528640d139ebf0f179"
 from {username='slave'} at 127.0.0.1:58014
I20260709 12:08:53.616483 21604 raft_consensus.cc:606] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Received request to transfer leadership to TS 57f7be88080046528640d139ebf0f179
I20260709 12:08:53.622469 21604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54a9c67654414ea5a7a73ef1bb9dcd6a"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
mode: GRACEFUL
new_leader_uuid: "8114007c96f34dccad8aaacdaed1ee30"
 from {username='slave'} at 127.0.0.1:58014
I20260709 12:08:53.623067 21604 raft_consensus.cc:606] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Received request to transfer leadership to TS 8114007c96f34dccad8aaacdaed1ee30
I20260709 12:08:53.724141 21801 consensus_queue.cc:1048] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.726410 21814 consensus_queue.cc:1048] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:53.738862 21837 consensus_queue.cc:1048] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.746254 21821 consensus_queue.cc:1048] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:53.759143 21837 consensus_queue.cc:1048] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:53.769353 21802 consensus_queue.cc:1048] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:53.771564 21814 raft_consensus.cc:993] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8: : Instructing follower 8114007c96f34dccad8aaacdaed1ee30 to start an election
I20260709 12:08:53.772166 21814 raft_consensus.cc:1081] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Signalling peer 8114007c96f34dccad8aaacdaed1ee30 to start an election
I20260709 12:08:53.774788 21817 raft_consensus.cc:993] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30: : Instructing follower 57f7be88080046528640d139ebf0f179 to start an election
I20260709 12:08:53.775331 21817 raft_consensus.cc:1081] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Signalling peer 57f7be88080046528640d139ebf0f179 to start an election
I20260709 12:08:53.777348 21681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc"
dest_uuid: "57f7be88080046528640d139ebf0f179"
 from {username='slave'} at 127.0.0.1:51900
I20260709 12:08:53.778134 21681 raft_consensus.cc:493] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:53.778635 21681 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.779803 21755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54a9c67654414ea5a7a73ef1bb9dcd6a"
dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
 from {username='slave'} at 127.0.0.1:38146
I20260709 12:08:53.780524 21755 raft_consensus.cc:493] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:53.781042 21755 raft_consensus.cc:3060] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.790931 21814 consensus_queue.cc:1048] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:53.792640 21755 raft_consensus.cc:515] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.796311 21755 leader_election.cc:290] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 2 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:53.797530 21679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a9c67654414ea5a7a73ef1bb9dcd6a" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:53.798349 21679 raft_consensus.cc:3060] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.799453 21605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a9c67654414ea5a7a73ef1bb9dcd6a" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:08:53.800137 21605 raft_consensus.cc:3055] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:53.800474 21605 raft_consensus.cc:740] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:08:53.801319 21605 consensus_queue.cc:260] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.802618 21605 raft_consensus.cc:3060] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.807192 21856 consensus_queue.cc:1048] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:53.808085 21679 raft_consensus.cc:2468] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 2.
I20260709 12:08:53.810029 21681 raft_consensus.cc:515] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.812420 21681 leader_election.cc:290] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 2 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:53.812700 21718 leader_election.cc:304] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:53.813676 21817 raft_consensus.cc:2804] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:53.814244 21817 raft_consensus.cc:697] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Becoming Leader. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:08:53.815064 21817 consensus_queue.cc:237] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.817111 21814 raft_consensus.cc:993] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8: : Instructing follower 57f7be88080046528640d139ebf0f179 to start an election
I20260709 12:08:53.817415 21606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:08:53.817828 21814 raft_consensus.cc:1081] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Signalling peer 57f7be88080046528640d139ebf0f179 to start an election
I20260709 12:08:53.818066 21606 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.818405 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:53.819108 21755 raft_consensus.cc:3055] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:53.819469 21755 raft_consensus.cc:740] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:08:53.824100 21681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8f1d0a35e4947558427e37c41ece94f"
dest_uuid: "57f7be88080046528640d139ebf0f179"
 from {username='slave'} at 127.0.0.1:51916
I20260709 12:08:53.826754 21606 raft_consensus.cc:2468] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 2.
I20260709 12:08:53.828229 21647 leader_election.cc:304] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 
I20260709 12:08:53.829137 21681 raft_consensus.cc:493] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:53.829715 21681 raft_consensus.cc:3060] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.830106 21605 raft_consensus.cc:2468] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 2.
I20260709 12:08:53.831894 21856 raft_consensus.cc:2804] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:53.832549 21856 raft_consensus.cc:697] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 2 LEADER]: Becoming Leader. State: Replica: 57f7be88080046528640d139ebf0f179, State: Running, Role: LEADER
I20260709 12:08:53.832171 21503 catalog_manager.cc:5697] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 reported cstate change: term changed from 1 to 2, leader changed from 46b93a657c04412893cee20a58e10fd8 (127.20.102.193) to 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "8114007c96f34dccad8aaacdaed1ee30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:53.833750 21856 consensus_queue.cc:237] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.835492 21755 consensus_queue.cc:260] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.836928 21755 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.839840 21681 raft_consensus.cc:515] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.842024 21681 leader_election.cc:290] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 2 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:53.843598 21604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f1d0a35e4947558427e37c41ece94f" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:08:53.844218 21604 raft_consensus.cc:3055] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:53.844110 21753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f1d0a35e4947558427e37c41ece94f" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:53.844750 21604 raft_consensus.cc:740] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:08:53.845095 21753 raft_consensus.cc:3060] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.845626 21604 consensus_queue.cc:260] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.846975 21604 raft_consensus.cc:3060] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.846833 21755 raft_consensus.cc:2468] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 2.
I20260709 12:08:53.853940 21753 raft_consensus.cc:2468] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 2.
I20260709 12:08:53.855376 21647 leader_election.cc:304] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:53.856216 21856 raft_consensus.cc:2804] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:53.856300 21604 raft_consensus.cc:2468] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 2.
I20260709 12:08:53.856907 21856 raft_consensus.cc:697] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 2 LEADER]: Becoming Leader. State: Replica: 57f7be88080046528640d139ebf0f179, State: Running, Role: LEADER
I20260709 12:08:53.857955 21856 consensus_queue.cc:237] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.862339 21503 catalog_manager.cc:5697] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 reported cstate change: term changed from 1 to 2, leader changed from 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195) to 57f7be88080046528640d139ebf0f179 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "57f7be88080046528640d139ebf0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:53.875730 21503 catalog_manager.cc:5697] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 reported cstate change: term changed from 1 to 2, leader changed from 46b93a657c04412893cee20a58e10fd8 (127.20.102.193) to 57f7be88080046528640d139ebf0f179 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "57f7be88080046528640d139ebf0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:53.918566 21803 raft_consensus.cc:993] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30: : Instructing follower 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:08:53.919015 21817 raft_consensus.cc:1081] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Signalling peer 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:08:53.920889 21604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:57990
I20260709 12:08:53.921393 21604 raft_consensus.cc:493] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:53.921711 21604 raft_consensus.cc:3060] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.926272 21604 raft_consensus.cc:515] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.927975 21604 leader_election.cc:290] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:53.929000 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:53.929205 21753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:53.929741 21753 raft_consensus.cc:3055] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:53.929692 21681 raft_consensus.cc:3060] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.930205 21753 raft_consensus.cc:740] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:08:53.931105 21753 consensus_queue.cc:260] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.932044 21753 raft_consensus.cc:3060] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:53.935951 21681 raft_consensus.cc:2468] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 2.
I20260709 12:08:53.936726 21753 raft_consensus.cc:2468] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 2.
I20260709 12:08:53.937291 21569 leader_election.cc:304] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 
I20260709 12:08:53.938195 21814 raft_consensus.cc:2804] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:53.938722 21814 raft_consensus.cc:697] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:08:53.939632 21814 consensus_queue.cc:237] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:53.946564 21503 catalog_manager.cc:5697] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 1 to 2, leader changed from 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195) to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:54.019172 21854 raft_consensus.cc:993] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179: : Instructing follower 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:08:54.019794 21854 raft_consensus.cc:1081] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Signalling peer 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:08:54.022148 21604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:58002
I20260709 12:08:54.022783 21604 raft_consensus.cc:493] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:54.023010 21822 raft_consensus.cc:993] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30: : Instructing follower 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:08:54.023188 21604 raft_consensus.cc:3060] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:54.023505 21817 raft_consensus.cc:1081] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Signalling peer 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:08:54.025344 21605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "725150cbfcf748c2acfc0062e6b8daa8"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:57990
I20260709 12:08:54.025914 21605 raft_consensus.cc:493] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:54.026291 21605 raft_consensus.cc:3060] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:54.030133 21604 raft_consensus.cc:515] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:54.032970 21604 leader_election.cc:290] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:54.033298 21753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:54.033332 21605 raft_consensus.cc:515] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:54.034232 21753 raft_consensus.cc:3060] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:54.033689 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482e49afdcf1484988d7d53ef5046aa6" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:54.034993 21681 raft_consensus.cc:3055] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:54.035408 21681 raft_consensus.cc:740] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Running, Role: LEADER
I20260709 12:08:54.036273 21681 consensus_queue.cc:260] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:54.036602 21679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725150cbfcf748c2acfc0062e6b8daa8" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:54.036700 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725150cbfcf748c2acfc0062e6b8daa8" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:08:54.037282 21679 raft_consensus.cc:3060] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:54.037410 21755 raft_consensus.cc:3055] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:54.037686 21681 raft_consensus.cc:3060] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:54.037851 21755 raft_consensus.cc:740] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:08:54.038697 21755 consensus_queue.cc:260] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:54.039582 21755 raft_consensus.cc:3060] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:54.042321 21605 leader_election.cc:290] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:08:54.046065 21681 raft_consensus.cc:2468] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 2.
I20260709 12:08:54.046114 21679 raft_consensus.cc:2468] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 2.
I20260709 12:08:54.046343 21755 raft_consensus.cc:2468] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 2.
I20260709 12:08:54.047807 21569 leader_election.cc:304] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 
I20260709 12:08:54.048069 21572 leader_election.cc:304] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:54.048864 21814 raft_consensus.cc:2804] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:54.049197 21880 raft_consensus.cc:2804] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:54.049270 21753 raft_consensus.cc:2468] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 2.
I20260709 12:08:54.049510 21814 raft_consensus.cc:697] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:08:54.049811 21880 raft_consensus.cc:697] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:08:54.050787 21880 consensus_queue.cc:237] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:54.050700 21814 consensus_queue.cc:237] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } }
I20260709 12:08:54.059173 21503 catalog_manager.cc:5697] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 1 to 2, leader changed from 57f7be88080046528640d139ebf0f179 (127.20.102.194) to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:54.071941 21503 catalog_manager.cc:5697] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 1 to 2, leader changed from 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195) to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:54.233407 21605 raft_consensus.cc:1275] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Refusing update from remote peer 8114007c96f34dccad8aaacdaed1ee30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.234964 21817 consensus_queue.cc:1048] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:54.243774 21681 raft_consensus.cc:1275] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Refusing update from remote peer 8114007c96f34dccad8aaacdaed1ee30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.245345 21822 consensus_queue.cc:1048] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:54.252853 21605 raft_consensus.cc:1275] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Refusing update from remote peer 57f7be88080046528640d139ebf0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.254252 21854 consensus_queue.cc:1048] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:54.262903 21753 raft_consensus.cc:1275] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Refusing update from remote peer 57f7be88080046528640d139ebf0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.264470 21837 consensus_queue.cc:1048] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:54.335865 21753 raft_consensus.cc:1275] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Refusing update from remote peer 57f7be88080046528640d139ebf0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.337244 21856 consensus_queue.cc:1048] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:54.345657 21605 raft_consensus.cc:1275] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Refusing update from remote peer 57f7be88080046528640d139ebf0f179: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.347863 21801 consensus_queue.cc:1048] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:54.382246 21681 raft_consensus.cc:1275] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.383622 21814 consensus_queue.cc:1048] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:54.392899 21753 raft_consensus.cc:1275] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.394773 21821 consensus_queue.cc:1048] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:54.578925 21681 raft_consensus.cc:1275] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.580451 21821 consensus_queue.cc:1048] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:54.583613 21753 raft_consensus.cc:1275] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.585600 21821 consensus_queue.cc:1048] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:54.592458 21755 raft_consensus.cc:1275] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.594341 21814 consensus_queue.cc:1048] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:54.613379 21681 raft_consensus.cc:1275] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:54.615142 21821 consensus_queue.cc:1048] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:56.661962 20891 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:56.662855 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.681932 21604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "560f69feb04f4639840c43c413893e2b"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
mode: GRACEFUL
new_leader_uuid: "8114007c96f34dccad8aaacdaed1ee30"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:08:56.682636 21604 raft_consensus.cc:606] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Received request to transfer leadership to TS 8114007c96f34dccad8aaacdaed1ee30
I20260709 12:08:56.685359 21604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
mode: GRACEFUL
new_leader_uuid: "8114007c96f34dccad8aaacdaed1ee30"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:08:56.685819 21604 raft_consensus.cc:606] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Received request to transfer leadership to TS 8114007c96f34dccad8aaacdaed1ee30
I20260709 12:08:56.686844 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:56.687283 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.757450 21821 raft_consensus.cc:993] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8: : Instructing follower 8114007c96f34dccad8aaacdaed1ee30 to start an election
I20260709 12:08:56.758762 21899 raft_consensus.cc:1081] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Signalling peer 8114007c96f34dccad8aaacdaed1ee30 to start an election
I20260709 12:08:56.760951 21753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa"
dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
 from {username='slave'} at 127.0.0.1:38146
I20260709 12:08:56.761678 21753 raft_consensus.cc:493] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:56.762195 21753 raft_consensus.cc:3060] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:56.769079 21753 raft_consensus.cc:515] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:56.771039 21753 leader_election.cc:290] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 2 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:56.772416 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:56.772294 21604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:08:56.773289 21681 raft_consensus.cc:3060] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:56.773406 21604 raft_consensus.cc:3055] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:56.773830 21604 raft_consensus.cc:740] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:08:56.774641 21604 consensus_queue.cc:260] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:56.775671 21604 raft_consensus.cc:3060] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:56.779762 21681 raft_consensus.cc:2468] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 2.
I20260709 12:08:56.781445 21718 leader_election.cc:304] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:56.782526 21894 raft_consensus.cc:2804] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:56.782692 21604 raft_consensus.cc:2468] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 2.
I20260709 12:08:56.784072 21894 raft_consensus.cc:697] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Becoming Leader. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:08:56.785041 21894 consensus_queue.cc:237] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:56.793915 21502 catalog_manager.cc:5697] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 reported cstate change: term changed from 1 to 2, leader changed from 46b93a657c04412893cee20a58e10fd8 (127.20.102.193) to 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "8114007c96f34dccad8aaacdaed1ee30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:56.920418 21901 raft_consensus.cc:993] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8: : Instructing follower 8114007c96f34dccad8aaacdaed1ee30 to start an election
I20260709 12:08:56.920899 21899 raft_consensus.cc:1081] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Signalling peer 8114007c96f34dccad8aaacdaed1ee30 to start an election
I20260709 12:08:56.922399 21753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "560f69feb04f4639840c43c413893e2b"
dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
 from {username='slave'} at 127.0.0.1:38146
I20260709 12:08:56.923020 21753 raft_consensus.cc:493] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:56.923343 21753 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:56.929126 21753 raft_consensus.cc:515] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:56.930915 21753 leader_election.cc:290] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 2 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:08:56.932030 21604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560f69feb04f4639840c43c413893e2b" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:08:56.932062 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560f69feb04f4639840c43c413893e2b" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:08:56.932688 21604 raft_consensus.cc:3055] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:56.932819 21681 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:56.933090 21604 raft_consensus.cc:740] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:08:56.934032 21604 consensus_queue.cc:260] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:56.935017 21604 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:56.938449 21681 raft_consensus.cc:2468] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 2.
I20260709 12:08:56.939505 21718 leader_election.cc:304] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:08:56.940351 21894 raft_consensus.cc:2804] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:56.940510 21604 raft_consensus.cc:2468] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 2.
I20260709 12:08:56.940882 21894 raft_consensus.cc:697] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Becoming Leader. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:08:56.941989 21894 consensus_queue.cc:237] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:08:56.949803 21502 catalog_manager.cc:5697] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 reported cstate change: term changed from 1 to 2, leader changed from 46b93a657c04412893cee20a58e10fd8 (127.20.102.193) to 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "8114007c96f34dccad8aaacdaed1ee30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:57.167362 21681 raft_consensus.cc:1275] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Refusing update from remote peer 8114007c96f34dccad8aaacdaed1ee30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:57.168602 21894 consensus_queue.cc:1048] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:57.190831 21604 raft_consensus.cc:1275] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Refusing update from remote peer 8114007c96f34dccad8aaacdaed1ee30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:57.192466 21894 consensus_queue.cc:1048] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:57.495348 21604 raft_consensus.cc:1275] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Refusing update from remote peer 8114007c96f34dccad8aaacdaed1ee30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:57.496722 21894 consensus_queue.cc:1048] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:57.506129 21681 raft_consensus.cc:1275] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Refusing update from remote peer 8114007c96f34dccad8aaacdaed1ee30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:57.508241 21902 consensus_queue.cc:1048] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:57.688292 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.693789 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.694276 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.695394 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.700662 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.701136 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.702200 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:59.707513 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:59.707975 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:00.709199 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:00.714658 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:00.715075 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:01.716004 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:01.722754 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:01.723161 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:02.724237 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:02.730268 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:02.730823 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:03.731925 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:03.737401 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:03.737844 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:04.738893 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:04.744686 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:04.745203 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:05.746383 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:05.752454 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:05.752918 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:06.789419 20891 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:09:06.800601 21753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "560f69feb04f4639840c43c413893e2b"
dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
mode: GRACEFUL
new_leader_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:38158
I20260709 12:09:06.801383 21753 raft_consensus.cc:606] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Received request to transfer leadership to TS 46b93a657c04412893cee20a58e10fd8
I20260709 12:09:06.809571 21753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa"
dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
mode: GRACEFUL
new_leader_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:38158
I20260709 12:09:06.810243 21753 raft_consensus.cc:606] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Received request to transfer leadership to TS 46b93a657c04412893cee20a58e10fd8
I20260709 12:09:06.816546 21681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f122f1414c247308d07604c02fe241c"
dest_uuid: "57f7be88080046528640d139ebf0f179"
mode: GRACEFUL
new_leader_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:51920
I20260709 12:09:06.817178 21681 raft_consensus.cc:606] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Received request to transfer leadership to TS 46b93a657c04412893cee20a58e10fd8
I20260709 12:09:06.822790 21681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc"
dest_uuid: "57f7be88080046528640d139ebf0f179"
mode: GRACEFUL
new_leader_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:51920
I20260709 12:09:06.823226 21681 raft_consensus.cc:606] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 2 LEADER]: Received request to transfer leadership to TS 46b93a657c04412893cee20a58e10fd8
I20260709 12:09:06.828836 21681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d"
dest_uuid: "57f7be88080046528640d139ebf0f179"
mode: GRACEFUL
new_leader_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:51920
I20260709 12:09:06.829419 21681 raft_consensus.cc:606] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Received request to transfer leadership to TS 46b93a657c04412893cee20a58e10fd8
I20260709 12:09:06.902041 21920 raft_consensus.cc:993] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179: : Instructing follower 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:09:06.902652 21929 raft_consensus.cc:1081] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Signalling peer 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:09:06.904525 21605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:58002
I20260709 12:09:06.905181 21605 raft_consensus.cc:493] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:06.905632 21605 raft_consensus.cc:3060] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:06.914258 21605 raft_consensus.cc:515] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:06.916790 21605 leader_election.cc:290] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:09:06.918211 21753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:09:06.917959 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:09:06.918948 21753 raft_consensus.cc:3060] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:06.919059 21681 raft_consensus.cc:3055] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:06.919446 21681 raft_consensus.cc:740] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Running, Role: LEADER
I20260709 12:09:06.920492 21681 consensus_queue.cc:260] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:06.922236 21681 raft_consensus.cc:3060] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:06.927933 21753 raft_consensus.cc:2468] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 2.
I20260709 12:09:06.929703 21572 leader_election.cc:304] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:09:06.930876 21928 raft_consensus.cc:2804] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:06.931155 21681 raft_consensus.cc:2468] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 2.
I20260709 12:09:06.932158 21928 raft_consensus.cc:697] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:09:06.933876 21928 consensus_queue.cc:237] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:06.935647 21920 raft_consensus.cc:993] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179: : Instructing follower 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:09:06.936266 21929 raft_consensus.cc:1081] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 2 LEADER]: Signalling peer 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:09:06.938189 21605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:58002
I20260709 12:09:06.938865 21605 raft_consensus.cc:493] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:06.939289 21605 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:06.946516 21501 catalog_manager.cc:5697] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 1 to 2, leader changed from 57f7be88080046528640d139ebf0f179 (127.20.102.194) to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:06.948724 21605 raft_consensus.cc:515] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:06.951723 21605 leader_election.cc:290] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:09:06.952257 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:09:06.953001 21681 raft_consensus.cc:3055] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:06.953166 21753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:09:06.953420 21681 raft_consensus.cc:740] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Running, Role: LEADER
I20260709 12:09:06.953867 21753 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:06.954406 21681 consensus_queue.cc:260] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:06.955801 21681 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:06.960144 21753 raft_consensus.cc:2468] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 3.
I20260709 12:09:06.962060 21572 leader_election.cc:304] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:09:06.962872 21681 raft_consensus.cc:2468] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 3.
I20260709 12:09:06.963322 21928 raft_consensus.cc:2804] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:06.964072 21928 raft_consensus.cc:697] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:09:06.965411 21928 consensus_queue.cc:237] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:06.974365 21501 catalog_manager.cc:5697] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 2 to 3, leader changed from 57f7be88080046528640d139ebf0f179 (127.20.102.194) to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:07.111209 21920 raft_consensus.cc:993] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179: : Instructing follower 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:09:07.111639 21929 raft_consensus.cc:1081] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Signalling peer 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:09:07.113067 21605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f122f1414c247308d07604c02fe241c"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:58002
I20260709 12:09:07.113632 21605 raft_consensus.cc:493] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:07.113942 21605 raft_consensus.cc:3060] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:07.119333 21605 raft_consensus.cc:515] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:07.120889 21605 leader_election.cc:290] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 2 election: Requested vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:09:07.121655 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f122f1414c247308d07604c02fe241c" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:09:07.121941 21753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f122f1414c247308d07604c02fe241c" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:09:07.122277 21681 raft_consensus.cc:3055] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:07.122612 21681 raft_consensus.cc:740] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57f7be88080046528640d139ebf0f179, State: Running, Role: LEADER
I20260709 12:09:07.122627 21753 raft_consensus.cc:3060] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:07.123440 21681 consensus_queue.cc:260] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:07.124398 21681 raft_consensus.cc:3060] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:07.127251 21753 raft_consensus.cc:2468] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 2.
I20260709 12:09:07.128222 21572 leader_election.cc:304] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:09:07.128933 21928 raft_consensus.cc:2804] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:07.129060 21681 raft_consensus.cc:2468] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 2.
I20260709 12:09:07.129385 21928 raft_consensus.cc:697] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:09:07.130390 21928 consensus_queue.cc:237] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:07.137310 21501 catalog_manager.cc:5697] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 1 to 2, leader changed from 57f7be88080046528640d139ebf0f179 (127.20.102.194) to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:07.331382 21927 raft_consensus.cc:993] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30: : Instructing follower 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:09:07.331969 21939 raft_consensus.cc:1081] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Signalling peer 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:09:07.333523 21605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "560f69feb04f4639840c43c413893e2b"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:57990
I20260709 12:09:07.334028 21605 raft_consensus.cc:493] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:07.334316 21605 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:07.339495 21605 raft_consensus.cc:515] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:07.341188 21605 leader_election.cc:290] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:09:07.342144 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560f69feb04f4639840c43c413893e2b" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:09:07.342298 21753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560f69feb04f4639840c43c413893e2b" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:09:07.342679 21681 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:07.342891 21753 raft_consensus.cc:3055] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:07.343259 21753 raft_consensus.cc:740] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:09:07.343945 21753 consensus_queue.cc:260] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:07.345202 21753 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:07.347293 21681 raft_consensus.cc:2468] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 3.
I20260709 12:09:07.348409 21569 leader_election.cc:304] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 
I20260709 12:09:07.349232 21928 raft_consensus.cc:2804] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:07.349676 21928 raft_consensus.cc:697] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:09:07.350520 21928 consensus_queue.cc:237] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:07.350822 21753 raft_consensus.cc:2468] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 3.
I20260709 12:09:07.358343 21501 catalog_manager.cc:5697] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 2 to 3, leader changed from 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195) to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:07.366907 21753 raft_consensus.cc:1275] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:07.368203 21928 consensus_queue.cc:1048] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:07.373777 21939 raft_consensus.cc:993] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30: : Instructing follower 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:09:07.374274 21939 raft_consensus.cc:1081] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Signalling peer 46b93a657c04412893cee20a58e10fd8 to start an election
I20260709 12:09:07.376312 21605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
 from {username='slave'} at 127.0.0.1:57990
I20260709 12:09:07.376968 21605 raft_consensus.cc:493] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:07.377393 21605 raft_consensus.cc:3060] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:07.385811 21681 raft_consensus.cc:1275] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:07.387333 21928 consensus_queue.cc:1048] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:07.387506 21605 raft_consensus.cc:515] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:07.390779 21605 leader_election.cc:290] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 3 election: Requested vote from peers 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:09:07.391893 21755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:09:07.392232 21679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783b31e20a64a2d829c793b0ec15afa" candidate_uuid: "46b93a657c04412893cee20a58e10fd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:09:07.392700 21755 raft_consensus.cc:3055] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:07.392949 21679 raft_consensus.cc:3060] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:07.393328 21755 raft_consensus.cc:740] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:09:07.394881 21755 consensus_queue.cc:260] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:07.396706 21755 raft_consensus.cc:3060] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:07.400249 21679 raft_consensus.cc:2468] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 3.
I20260709 12:09:07.401558 21569 leader_election.cc:304] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93a657c04412893cee20a58e10fd8, 57f7be88080046528640d139ebf0f179; no voters: 
I20260709 12:09:07.402356 21928 raft_consensus.cc:2804] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:07.402843 21928 raft_consensus.cc:697] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Becoming Leader. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:09:07.403807 21928 consensus_queue.cc:237] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:07.404946 21755 raft_consensus.cc:2468] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93a657c04412893cee20a58e10fd8 in term 3.
I20260709 12:09:07.408643 21681 raft_consensus.cc:1275] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:07.413559 21928 consensus_queue.cc:1048] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:07.415059 21501 catalog_manager.cc:5697] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 reported cstate change: term changed from 2 to 3, leader changed from 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195) to 46b93a657c04412893cee20a58e10fd8 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "46b93a657c04412893cee20a58e10fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:07.423645 21755 raft_consensus.cc:1275] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:07.425487 21930 consensus_queue.cc:1048] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:07.656745 21755 raft_consensus.cc:1275] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:07.658164 21930 consensus_queue.cc:1048] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:07.668685 21681 raft_consensus.cc:1275] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:07.670238 21930 consensus_queue.cc:1048] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:07.777423 21681 raft_consensus.cc:1275] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:07.778756 21930 consensus_queue.cc:1048] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:07.790503 21755 raft_consensus.cc:1275] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:07.792047 21950 consensus_queue.cc:1048] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:07.793708 21681 raft_consensus.cc:1275] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:07.795014 21930 consensus_queue.cc:1048] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:07.805586 21755 raft_consensus.cc:1275] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Refusing update from remote peer 46b93a657c04412893cee20a58e10fd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:07.806993 21928 consensus_queue.cc:1048] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:09.868192 20891 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:09.868991 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.876868 21605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
mode: GRACEFUL
new_leader_uuid: "57f7be88080046528640d139ebf0f179"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:09:09.877523 21605 raft_consensus.cc:606] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Received request to transfer leadership to TS 57f7be88080046528640d139ebf0f179
I20260709 12:09:09.880227 21605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "560f69feb04f4639840c43c413893e2b"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
mode: GRACEFUL
new_leader_uuid: "57f7be88080046528640d139ebf0f179"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:09:09.880677 21605 raft_consensus.cc:606] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Received request to transfer leadership to TS 57f7be88080046528640d139ebf0f179
I20260709 12:09:09.883293 21605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
mode: GRACEFUL
new_leader_uuid: "8114007c96f34dccad8aaacdaed1ee30"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:09:09.883769 21605 raft_consensus.cc:606] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Received request to transfer leadership to TS 8114007c96f34dccad8aaacdaed1ee30
I20260709 12:09:09.886430 21605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc"
dest_uuid: "46b93a657c04412893cee20a58e10fd8"
mode: GRACEFUL
new_leader_uuid: "8114007c96f34dccad8aaacdaed1ee30"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:09:09.886883 21605 raft_consensus.cc:606] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Received request to transfer leadership to TS 8114007c96f34dccad8aaacdaed1ee30
I20260709 12:09:09.888000 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:09.888620 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:09.935920 21950 raft_consensus.cc:993] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8: : Instructing follower 8114007c96f34dccad8aaacdaed1ee30 to start an election
I20260709 12:09:09.936491 21956 raft_consensus.cc:1081] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Signalling peer 8114007c96f34dccad8aaacdaed1ee30 to start an election
I20260709 12:09:09.938150 21753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc"
dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
 from {username='slave'} at 127.0.0.1:38146
I20260709 12:09:09.938575 21753 raft_consensus.cc:493] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:09.938808 21753 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:09.943594 21753 raft_consensus.cc:515] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:09.945662 21753 leader_election.cc:290] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 4 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:09:09.946888 21681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:09:09.946962 21605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad191e972bc4ca2860bb9a8f5746cdc" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:09:09.947438 21681 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:09.947692 21605 raft_consensus.cc:3055] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:09.948087 21605 raft_consensus.cc:740] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:09:09.948916 21605 consensus_queue.cc:260] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:09.950147 21605 raft_consensus.cc:3060] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:09.952970 21681 raft_consensus.cc:2468] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 4.
I20260709 12:09:09.954208 21718 leader_election.cc:304] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:09:09.954980 21927 raft_consensus.cc:2804] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:09.956118 21927 raft_consensus.cc:697] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 4 LEADER]: Becoming Leader. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:09:09.957350 21605 raft_consensus.cc:2468] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 4.
I20260709 12:09:09.957118 21927 consensus_queue.cc:237] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:09.964247 21502 catalog_manager.cc:5697] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 reported cstate change: term changed from 3 to 4, leader changed from 46b93a657c04412893cee20a58e10fd8 (127.20.102.193) to 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195). New cstate: current_term: 4 leader_uuid: "8114007c96f34dccad8aaacdaed1ee30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:10.096936 21950 raft_consensus.cc:993] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8: : Instructing follower 8114007c96f34dccad8aaacdaed1ee30 to start an election
I20260709 12:09:10.097438 21956 raft_consensus.cc:1081] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Signalling peer 8114007c96f34dccad8aaacdaed1ee30 to start an election
I20260709 12:09:10.098971 21753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179"
dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
 from {username='slave'} at 127.0.0.1:38146
I20260709 12:09:10.099486 21753 raft_consensus.cc:493] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:10.099769 21753 raft_consensus.cc:3060] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:10.104218 21753 raft_consensus.cc:515] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:10.106233 21753 leader_election.cc:290] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 3 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657)
I20260709 12:09:10.107335 21679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57f7be88080046528640d139ebf0f179"
I20260709 12:09:10.107342 21605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596d854d1a6f40bb80d8a615e1f55179" candidate_uuid: "8114007c96f34dccad8aaacdaed1ee30" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:09:10.108037 21679 raft_consensus.cc:3060] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:10.108171 21605 raft_consensus.cc:3055] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:10.108559 21605 raft_consensus.cc:740] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:09:10.109259 21605 consensus_queue.cc:260] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:10.110321 21605 raft_consensus.cc:3060] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:10.113307 21679 raft_consensus.cc:2468] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 3.
I20260709 12:09:10.114336 21718 leader_election.cc:304] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:09:10.115082 21927 raft_consensus.cc:2804] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:10.115531 21927 raft_consensus.cc:697] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 3 LEADER]: Becoming Leader. State: Replica: 8114007c96f34dccad8aaacdaed1ee30, State: Running, Role: LEADER
I20260709 12:09:10.116470 21605 raft_consensus.cc:2468] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8114007c96f34dccad8aaacdaed1ee30 in term 3.
I20260709 12:09:10.116302 21927 consensus_queue.cc:237] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:10.123840 21502 catalog_manager.cc:5697] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 reported cstate change: term changed from 2 to 3, leader changed from 46b93a657c04412893cee20a58e10fd8 (127.20.102.193) to 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "8114007c96f34dccad8aaacdaed1ee30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:10.314673 21950 raft_consensus.cc:993] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8: : Instructing follower 57f7be88080046528640d139ebf0f179 to start an election
I20260709 12:09:10.315166 21956 raft_consensus.cc:1081] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Signalling peer 57f7be88080046528640d139ebf0f179 to start an election
I20260709 12:09:10.316533 21681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "560f69feb04f4639840c43c413893e2b"
dest_uuid: "57f7be88080046528640d139ebf0f179"
 from {username='slave'} at 127.0.0.1:51916
I20260709 12:09:10.316967 21681 raft_consensus.cc:493] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:10.317206 21681 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:10.321278 21681 raft_consensus.cc:515] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:10.323072 21681 leader_election.cc:290] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 4 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:09:10.324245 21605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560f69feb04f4639840c43c413893e2b" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:09:10.324488 21753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560f69feb04f4639840c43c413893e2b" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:09:10.324994 21605 raft_consensus.cc:3055] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:10.324994 21753 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:10.325649 21605 raft_consensus.cc:740] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:09:10.326465 21605 consensus_queue.cc:260] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:10.327699 21605 raft_consensus.cc:3060] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:10.332832 21753 raft_consensus.cc:2468] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 4.
I20260709 12:09:10.334376 21647 leader_election.cc:304] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:09:10.334642 21605 raft_consensus.cc:2468] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 4.
I20260709 12:09:10.335299 21929 raft_consensus.cc:2804] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:10.336500 21929 raft_consensus.cc:697] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 4 LEADER]: Becoming Leader. State: Replica: 57f7be88080046528640d139ebf0f179, State: Running, Role: LEADER
I20260709 12:09:10.337348 21929 consensus_queue.cc:237] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:10.344437 21502 catalog_manager.cc:5697] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 reported cstate change: term changed from 3 to 4, leader changed from 46b93a657c04412893cee20a58e10fd8 (127.20.102.193) to 57f7be88080046528640d139ebf0f179 (127.20.102.194). New cstate: current_term: 4 leader_uuid: "57f7be88080046528640d139ebf0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:10.360620 21950 raft_consensus.cc:993] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8: : Instructing follower 57f7be88080046528640d139ebf0f179 to start an election
I20260709 12:09:10.361315 21956 raft_consensus.cc:1081] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Signalling peer 57f7be88080046528640d139ebf0f179 to start an election
I20260709 12:09:10.362721 21681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d"
dest_uuid: "57f7be88080046528640d139ebf0f179"
 from {username='slave'} at 127.0.0.1:51916
I20260709 12:09:10.363155 21681 raft_consensus.cc:493] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:10.363375 21681 raft_consensus.cc:3060] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:10.367537 21681 raft_consensus.cc:515] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:10.369037 21681 leader_election.cc:290] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 3 election: Requested vote from peers 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527), 8114007c96f34dccad8aaacdaed1ee30 (127.20.102.195:36259)
I20260709 12:09:10.369881 21605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46b93a657c04412893cee20a58e10fd8"
I20260709 12:09:10.370414 21605 raft_consensus.cc:3055] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:10.370342 21753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166690bbf6e48a6900df89ee5e5e91d" candidate_uuid: "57f7be88080046528640d139ebf0f179" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8114007c96f34dccad8aaacdaed1ee30"
I20260709 12:09:10.370770 21605 raft_consensus.cc:740] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46b93a657c04412893cee20a58e10fd8, State: Running, Role: LEADER
I20260709 12:09:10.370895 21753 raft_consensus.cc:3060] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:10.371568 21605 consensus_queue.cc:260] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:10.372691 21605 raft_consensus.cc:3060] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:10.377131 21753 raft_consensus.cc:2468] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 3.
I20260709 12:09:10.378321 21647 leader_election.cc:304] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57f7be88080046528640d139ebf0f179, 8114007c96f34dccad8aaacdaed1ee30; no voters: 
I20260709 12:09:10.378722 21605 raft_consensus.cc:2468] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57f7be88080046528640d139ebf0f179 in term 3.
I20260709 12:09:10.379065 21929 raft_consensus.cc:2804] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:10.379534 21929 raft_consensus.cc:697] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 3 LEADER]: Becoming Leader. State: Replica: 57f7be88080046528640d139ebf0f179, State: Running, Role: LEADER
I20260709 12:09:10.380324 21929 consensus_queue.cc:237] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } }
I20260709 12:09:10.387766 21502 catalog_manager.cc:5697] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 reported cstate change: term changed from 2 to 3, leader changed from 46b93a657c04412893cee20a58e10fd8 (127.20.102.193) to 57f7be88080046528640d139ebf0f179 (127.20.102.194). New cstate: current_term: 3 leader_uuid: "57f7be88080046528640d139ebf0f179" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:10.393633 21681 raft_consensus.cc:1275] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 4 FOLLOWER]: Refusing update from remote peer 8114007c96f34dccad8aaacdaed1ee30: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:10.394860 21927 consensus_queue.cc:1048] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:10.405295 21605 raft_consensus.cc:1275] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 4 FOLLOWER]: Refusing update from remote peer 8114007c96f34dccad8aaacdaed1ee30: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:10.406783 21957 consensus_queue.cc:1048] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:10.529346 21681 raft_consensus.cc:1275] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Refusing update from remote peer 8114007c96f34dccad8aaacdaed1ee30: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:10.531279 21957 consensus_queue.cc:1048] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57f7be88080046528640d139ebf0f179" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 35657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:10.541584 21605 raft_consensus.cc:1275] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Refusing update from remote peer 8114007c96f34dccad8aaacdaed1ee30: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:10.545230 21969 consensus_queue.cc:1048] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:10.814317 21604 raft_consensus.cc:1275] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Refusing update from remote peer 57f7be88080046528640d139ebf0f179: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:10.815676 21929 consensus_queue.cc:1048] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:10.826232 21753 raft_consensus.cc:1275] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Refusing update from remote peer 57f7be88080046528640d139ebf0f179: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:10.828586 21977 consensus_queue.cc:1048] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:10.889859 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.897543 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.898020 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.903262 21753 raft_consensus.cc:1275] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 4 FOLLOWER]: Refusing update from remote peer 57f7be88080046528640d139ebf0f179: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:10.904596 21977 consensus_queue.cc:1048] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8114007c96f34dccad8aaacdaed1ee30" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:10.913743 21604 raft_consensus.cc:1275] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 4 FOLLOWER]: Refusing update from remote peer 57f7be88080046528640d139ebf0f179: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:10.915745 21980 consensus_queue.cc:1048] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46b93a657c04412893cee20a58e10fd8" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:11.899214 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:11.905589 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:11.906141 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.907302 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:12.914791 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:12.915279 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:13.916373 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:13.922416 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:13.922933 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:14.923954 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:14.929220 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:14.929695 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:15.931345 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:15.939452 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:15.940043 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:16.941552 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:16.947459 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:16.947997 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:17.949074 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:17.954941 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:17.955492 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:18.956564 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:18.962704 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:18.963210 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:20.000905 20891 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:20.001575 20891 tablet_server.cc:179] TabletServer@127.20.102.193:0 shutting down...
W20260709 12:09:20.022789 21721 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 58 similar messages]
W20260709 12:09:20.030289 21721 consensus_peers.cc:597] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 -> Peer 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527): Couldn't send request to peer 46b93a657c04412893cee20a58e10fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.040602 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:20.041786 20891 tablet_replica.cc:333] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8: stopping tablet replica
I20260709 12:09:20.042873 20891 raft_consensus.cc:2243] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.044049 20891 raft_consensus.cc:2272] T 1166690bbf6e48a6900df89ee5e5e91d P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:20.046092 21647 consensus_peers.cc:597] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 -> Peer 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527): Couldn't send request to peer 46b93a657c04412893cee20a58e10fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.047887 20891 tablet_replica.cc:333] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8: stopping tablet replica
I20260709 12:09:20.049081 20891 raft_consensus.cc:2243] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.049793 20891 raft_consensus.cc:2272] T 5ad191e972bc4ca2860bb9a8f5746cdc P 46b93a657c04412893cee20a58e10fd8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.053421 20891 tablet_replica.cc:333] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8: stopping tablet replica
W20260709 12:09:20.053906 21721 consensus_peers.cc:597] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 -> Peer 46b93a657c04412893cee20a58e10fd8 (127.20.102.193:33527): Couldn't send request to peer 46b93a657c04412893cee20a58e10fd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.054416 20891 raft_consensus.cc:2243] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.055195 20891 raft_consensus.cc:2272] T d8f1d0a35e4947558427e37c41ece94f P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.057758 20891 tablet_replica.cc:333] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8: stopping tablet replica
I20260709 12:09:20.058476 20891 raft_consensus.cc:2243] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:20.059348 20891 raft_consensus.cc:2272] T 6f122f1414c247308d07604c02fe241c P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.061615 20891 tablet_replica.cc:333] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8: stopping tablet replica
I20260709 12:09:20.062227 20891 raft_consensus.cc:2243] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.062692 20891 raft_consensus.cc:2272] T 596d854d1a6f40bb80d8a615e1f55179 P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.064859 20891 tablet_replica.cc:333] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8: stopping tablet replica
I20260709 12:09:20.065439 20891 raft_consensus.cc:2243] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.065979 20891 raft_consensus.cc:2272] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.068162 20891 tablet_replica.cc:333] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8: stopping tablet replica
I20260709 12:09:20.068708 20891 raft_consensus.cc:2243] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.069247 20891 raft_consensus.cc:2272] T 560f69feb04f4639840c43c413893e2b P 46b93a657c04412893cee20a58e10fd8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.071190 20891 tablet_replica.cc:333] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8: stopping tablet replica
I20260709 12:09:20.071828 20891 raft_consensus.cc:2243] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:20.073079 20891 raft_consensus.cc:2272] T 725150cbfcf748c2acfc0062e6b8daa8 P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.075181 20891 tablet_replica.cc:333] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8: stopping tablet replica
I20260709 12:09:20.075675 20891 raft_consensus.cc:2243] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:20.076524 20891 raft_consensus.cc:2272] T 8783b31e20a64a2d829c793b0ec15afa P 46b93a657c04412893cee20a58e10fd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.078611 20891 tablet_replica.cc:333] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8: stopping tablet replica
I20260709 12:09:20.079087 20891 raft_consensus.cc:2243] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:20.079898 20891 raft_consensus.cc:2272] T 482e49afdcf1484988d7d53ef5046aa6 P 46b93a657c04412893cee20a58e10fd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.115334 20891 tablet_server.cc:196] TabletServer@127.20.102.193:0 shutdown complete.
I20260709 12:09:20.137104 20891 tablet_server.cc:179] TabletServer@127.20.102.194:0 shutting down...
I20260709 12:09:20.168700 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:20.169669 20891 tablet_replica.cc:333] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179: stopping tablet replica
I20260709 12:09:20.170681 20891 raft_consensus.cc:2243] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:09:20.171211 21718 consensus_peers.cc:597] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 -> Peer 57f7be88080046528640d139ebf0f179 (127.20.102.194:35657): Couldn't send request to peer 57f7be88080046528640d139ebf0f179. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.171377 20891 raft_consensus.cc:2272] T 6f122f1414c247308d07604c02fe241c P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.173735 20891 tablet_replica.cc:333] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179: stopping tablet replica
I20260709 12:09:20.174320 20891 raft_consensus.cc:2243] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:20.175199 20891 raft_consensus.cc:2272] T d8f1d0a35e4947558427e37c41ece94f P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.177156 20891 tablet_replica.cc:333] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179: stopping tablet replica
I20260709 12:09:20.177760 20891 raft_consensus.cc:2243] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.178372 20891 raft_consensus.cc:2272] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.180447 20891 tablet_replica.cc:333] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179: stopping tablet replica
I20260709 12:09:20.181058 20891 raft_consensus.cc:2243] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:20.181880 20891 raft_consensus.cc:2272] T 560f69feb04f4639840c43c413893e2b P 57f7be88080046528640d139ebf0f179 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.183789 20891 tablet_replica.cc:333] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179: stopping tablet replica
I20260709 12:09:20.184286 20891 raft_consensus.cc:2243] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.184746 20891 raft_consensus.cc:2272] T 725150cbfcf748c2acfc0062e6b8daa8 P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.186677 20891 tablet_replica.cc:333] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179: stopping tablet replica
I20260709 12:09:20.187201 20891 raft_consensus.cc:2243] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.187673 20891 raft_consensus.cc:2272] T 8783b31e20a64a2d829c793b0ec15afa P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.189584 20891 tablet_replica.cc:333] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179: stopping tablet replica
I20260709 12:09:20.190080 20891 raft_consensus.cc:2243] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:20.190928 20891 raft_consensus.cc:2272] T 1166690bbf6e48a6900df89ee5e5e91d P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.192821 20891 tablet_replica.cc:333] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179: stopping tablet replica
I20260709 12:09:20.193351 20891 raft_consensus.cc:2243] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.193789 20891 raft_consensus.cc:2272] T 5ad191e972bc4ca2860bb9a8f5746cdc P 57f7be88080046528640d139ebf0f179 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.195577 20891 tablet_replica.cc:333] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179: stopping tablet replica
I20260709 12:09:20.196046 20891 raft_consensus.cc:2243] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.196532 20891 raft_consensus.cc:2272] T 482e49afdcf1484988d7d53ef5046aa6 P 57f7be88080046528640d139ebf0f179 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.198385 20891 tablet_replica.cc:333] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179: stopping tablet replica
I20260709 12:09:20.198834 20891 raft_consensus.cc:2243] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.199239 20891 raft_consensus.cc:2272] T 596d854d1a6f40bb80d8a615e1f55179 P 57f7be88080046528640d139ebf0f179 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.232064 20891 tablet_server.cc:196] TabletServer@127.20.102.194:0 shutdown complete.
I20260709 12:09:20.252730 20891 tablet_server.cc:179] TabletServer@127.20.102.195:0 shutting down...
I20260709 12:09:20.286041 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:20.286890 20891 tablet_replica.cc:333] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30: stopping tablet replica
I20260709 12:09:20.287667 20891 raft_consensus.cc:2243] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.288292 20891 raft_consensus.cc:2272] T d8f1d0a35e4947558427e37c41ece94f P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.290676 20891 tablet_replica.cc:333] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30: stopping tablet replica
I20260709 12:09:20.291303 20891 raft_consensus.cc:2243] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.291831 20891 raft_consensus.cc:2272] T 6f122f1414c247308d07604c02fe241c P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.293841 20891 tablet_replica.cc:333] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30: stopping tablet replica
I20260709 12:09:20.294435 20891 raft_consensus.cc:2243] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.294946 20891 raft_consensus.cc:2272] T 1166690bbf6e48a6900df89ee5e5e91d P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.296996 20891 tablet_replica.cc:333] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30: stopping tablet replica
I20260709 12:09:20.297528 20891 raft_consensus.cc:2243] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:20.298445 20891 raft_consensus.cc:2272] T 5ad191e972bc4ca2860bb9a8f5746cdc P 8114007c96f34dccad8aaacdaed1ee30 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.300452 20891 tablet_replica.cc:333] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30: stopping tablet replica
I20260709 12:09:20.301115 20891 raft_consensus.cc:2243] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.301576 20891 raft_consensus.cc:2272] T 482e49afdcf1484988d7d53ef5046aa6 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.303472 20891 tablet_replica.cc:333] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30: stopping tablet replica
I20260709 12:09:20.304032 20891 raft_consensus.cc:2243] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.304520 20891 raft_consensus.cc:2272] T 8783b31e20a64a2d829c793b0ec15afa P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.306430 20891 tablet_replica.cc:333] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30: stopping tablet replica
I20260709 12:09:20.306990 20891 raft_consensus.cc:2243] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.307453 20891 raft_consensus.cc:2272] T 725150cbfcf748c2acfc0062e6b8daa8 P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.309338 20891 tablet_replica.cc:333] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30: stopping tablet replica
I20260709 12:09:20.309831 20891 raft_consensus.cc:2243] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:20.310992 20891 raft_consensus.cc:2272] T 54a9c67654414ea5a7a73ef1bb9dcd6a P 8114007c96f34dccad8aaacdaed1ee30 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.312953 20891 tablet_replica.cc:333] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30: stopping tablet replica
I20260709 12:09:20.313475 20891 raft_consensus.cc:2243] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:20.313990 20891 raft_consensus.cc:2272] T 560f69feb04f4639840c43c413893e2b P 8114007c96f34dccad8aaacdaed1ee30 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.315959 20891 tablet_replica.cc:333] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30: stopping tablet replica
I20260709 12:09:20.316461 20891 raft_consensus.cc:2243] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:20.317394 20891 raft_consensus.cc:2272] T 596d854d1a6f40bb80d8a615e1f55179 P 8114007c96f34dccad8aaacdaed1ee30 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.348716 20891 tablet_server.cc:196] TabletServer@127.20.102.195:0 shutdown complete.
I20260709 12:09:20.371675 20891 master.cc:562] Master@127.20.102.254:34453 shutting down...
I20260709 12:09:20.398275 20891 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:20.398896 20891 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:20.399209 20891 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1670f8f1ea0e440ca86410635136a65a: stopping tablet replica
I20260709 12:09:20.420629 20891 master.cc:584] Master@127.20.102.254:34453 shutdown complete.
46b93a657c04412893cee20a58e10fd8  5
57f7be88080046528640d139ebf0f179  4
8114007c96f34dccad8aaacdaed1ee30  1
46b93a657c04412893cee20a58e10fd8  3
57f7be88080046528640d139ebf0f179  4
8114007c96f34dccad8aaacdaed1ee30  3
46b93a657c04412893cee20a58e10fd8  8
57f7be88080046528640d139ebf0f179  1
8114007c96f34dccad8aaacdaed1ee30  1
46b93a657c04412893cee20a58e10fd8  4
57f7be88080046528640d139ebf0f179  3
8114007c96f34dccad8aaacdaed1ee30  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28889 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:20.469600 20891 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.102.254:38171
I20260709 12:09:20.470965 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:20.478020 21997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:20.478416 21996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:20.479265 21999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:20.479929 20891 server_base.cc:1061] running on GCE node
I20260709 12:09:20.481156 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:20.481405 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:20.481568 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598960481550 us; error 0 us; skew 500 ppm
I20260709 12:09:20.482108 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:20.485172 20891 webserver.cc:533] Webserver started at http://127.20.102.254:41443/ using document root <none> and password file <none>
I20260709 12:09:20.485675 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:20.485873 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:20.486155 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:20.487300 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/master-0-root/instance:
uuid: "724c00f1bc7e49c9835e5c0e664b7356"
format_stamp: "Formatted at 2026-07-09 12:09:20 on dist-test-slave-296p"
I20260709 12:09:20.492084 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:09:20.495860 22004 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:20.496915 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:09:20.497256 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/master-0-root
uuid: "724c00f1bc7e49c9835e5c0e664b7356"
format_stamp: "Formatted at 2026-07-09 12:09:20 on dist-test-slave-296p"
I20260709 12:09:20.497598 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:20.519542 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:20.521060 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:20.570047 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.254:38171
I20260709 12:09:20.570138 22055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.254:38171 every 8 connection(s)
I20260709 12:09:20.574436 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.584563 22056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Bootstrap starting.
I20260709 12:09:20.589360 22056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.594249 22056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: No bootstrap required, opened a new log
I20260709 12:09:20.596377 22056 raft_consensus.cc:359] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724c00f1bc7e49c9835e5c0e664b7356" member_type: VOTER }
I20260709 12:09:20.596839 22056 raft_consensus.cc:385] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.597026 22056 raft_consensus.cc:740] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 724c00f1bc7e49c9835e5c0e664b7356, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.597648 22056 consensus_queue.cc:260] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724c00f1bc7e49c9835e5c0e664b7356" member_type: VOTER }
I20260709 12:09:20.598132 22056 raft_consensus.cc:399] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:20.598335 22056 raft_consensus.cc:493] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:20.598559 22056 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.603557 22056 raft_consensus.cc:515] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724c00f1bc7e49c9835e5c0e664b7356" member_type: VOTER }
I20260709 12:09:20.604225 22056 leader_election.cc:304] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 724c00f1bc7e49c9835e5c0e664b7356; no voters: 
I20260709 12:09:20.605542 22056 leader_election.cc:290] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:20.605959 22059 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.607702 22059 raft_consensus.cc:697] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [term 1 LEADER]: Becoming Leader. State: Replica: 724c00f1bc7e49c9835e5c0e664b7356, State: Running, Role: LEADER
I20260709 12:09:20.608572 22059 consensus_queue.cc:237] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724c00f1bc7e49c9835e5c0e664b7356" member_type: VOTER }
I20260709 12:09:20.609031 22056 sys_catalog.cc:565] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:20.614718 22061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 724c00f1bc7e49c9835e5c0e664b7356. Latest consensus state: current_term: 1 leader_uuid: "724c00f1bc7e49c9835e5c0e664b7356" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724c00f1bc7e49c9835e5c0e664b7356" member_type: VOTER } }
I20260709 12:09:20.614822 22060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "724c00f1bc7e49c9835e5c0e664b7356" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "724c00f1bc7e49c9835e5c0e664b7356" member_type: VOTER } }
I20260709 12:09:20.615942 22060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:20.615931 22061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:20.621531 22067 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:20.629783 22067 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:20.630874 20891 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:20.639830 22067 catalog_manager.cc:1383] Generated new cluster ID: df524cd2d1a44c8396d168b07ee2ca5c
I20260709 12:09:20.640179 22067 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:20.664052 22067 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:20.665367 22067 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:20.681733 22067 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Generated new TSK 0
I20260709 12:09:20.682425 22067 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:20.697525 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:20.703953 22077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:20.705251 22078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:20.708209 20891 server_base.cc:1061] running on GCE node
W20260709 12:09:20.708453 22080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:20.709430 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:20.709661 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:20.709842 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598960709828 us; error 0 us; skew 500 ppm
I20260709 12:09:20.710469 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:20.713004 20891 webserver.cc:533] Webserver started at http://127.20.102.193:34611/ using document root <none> and password file <none>
I20260709 12:09:20.713510 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:20.713703 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:20.713979 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:20.715063 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/instance:
uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
format_stamp: "Formatted at 2026-07-09 12:09:20 on dist-test-slave-296p"
I20260709 12:09:20.719837 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:09:20.723574 22085 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:20.724509 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:09:20.724921 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root
uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
format_stamp: "Formatted at 2026-07-09 12:09:20 on dist-test-slave-296p"
I20260709 12:09:20.725201 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:20.745997 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:20.747242 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:20.748848 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:20.751325 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:20.751506 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:20.751811 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:20.751993 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:20.797132 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.193:39673
I20260709 12:09:20.797314 22147 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.193:39673 every 8 connection(s)
I20260709 12:09:20.802363 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:20.811264 22153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:20.812207 22152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:20.813261 22155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:20.814182 20891 server_base.cc:1061] running on GCE node
I20260709 12:09:20.815703 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:20.815897 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:20.816104 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598960816090 us; error 0 us; skew 500 ppm
I20260709 12:09:20.816665 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:20.819726 20891 webserver.cc:533] Webserver started at http://127.20.102.194:33805/ using document root <none> and password file <none>
I20260709 12:09:20.820402 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:20.820640 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:20.821012 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:20.822489 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/instance:
uuid: "7d3f536360b444b1886777f4776be22c"
format_stamp: "Formatted at 2026-07-09 12:09:20 on dist-test-slave-296p"
I20260709 12:09:20.822561 22148 heartbeater.cc:344] Connected to a master server at 127.20.102.254:38171
I20260709 12:09:20.823064 22148 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:20.823874 22148 heartbeater.cc:507] Master 127.20.102.254:38171 requested a full tablet report, sending...
I20260709 12:09:20.826253 22021 ts_manager.cc:194] Registered new tserver with Master: ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673)
I20260709 12:09:20.827880 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:09:20.828645 22021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45126
I20260709 12:09:20.831945 22160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:20.832875 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:09:20.833214 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root
uuid: "7d3f536360b444b1886777f4776be22c"
format_stamp: "Formatted at 2026-07-09 12:09:20 on dist-test-slave-296p"
I20260709 12:09:20.833477 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:20.850960 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:20.852237 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:20.853880 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:20.856173 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:20.856400 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:20.856644 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:20.856850 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:09:20.899411 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.194:36735
I20260709 12:09:20.899605 22222 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.194:36735 every 8 connection(s)
I20260709 12:09:20.904238 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:20.911581 22226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:20.914541 22227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:20.915398 20891 server_base.cc:1061] running on GCE node
W20260709 12:09:20.917120 22229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:20.918327 22223 heartbeater.cc:344] Connected to a master server at 127.20.102.254:38171
I20260709 12:09:20.918324 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:20.918886 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:20.918978 22223 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:20.919077 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598960919043 us; error 0 us; skew 500 ppm
I20260709 12:09:20.919821 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:20.919970 22223 heartbeater.cc:507] Master 127.20.102.254:38171 requested a full tablet report, sending...
I20260709 12:09:20.922729 20891 webserver.cc:533] Webserver started at http://127.20.102.195:43669/ using document root <none> and password file <none>
I20260709 12:09:20.922761 22021 ts_manager.cc:194] Registered new tserver with Master: 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:20.923449 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:20.923683 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:20.923974 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:20.924593 22021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45132
I20260709 12:09:20.925226 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/instance:
uuid: "cc9b9c8894084021a0c6ddaf659d222e"
format_stamp: "Formatted at 2026-07-09 12:09:20 on dist-test-slave-296p"
I20260709 12:09:20.930047 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:09:20.933563 22234 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:20.934499 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:09:20.934854 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root
uuid: "cc9b9c8894084021a0c6ddaf659d222e"
format_stamp: "Formatted at 2026-07-09 12:09:20 on dist-test-slave-296p"
I20260709 12:09:20.935145 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:20.951478 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:20.952704 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:20.954321 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:20.956593 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:20.956840 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:09:20.957108 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:20.957276 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:21.001789 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.195:38085
I20260709 12:09:21.002029 22296 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.195:38085 every 8 connection(s)
I20260709 12:09:21.016378 22297 heartbeater.cc:344] Connected to a master server at 127.20.102.254:38171
I20260709 12:09:21.016883 22297 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:21.017755 22297 heartbeater.cc:507] Master 127.20.102.254:38171 requested a full tablet report, sending...
I20260709 12:09:21.019902 22021 ts_manager.cc:194] Registered new tserver with Master: cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:21.020015 20891 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015083436s
I20260709 12:09:21.021602 22021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45140
I20260709 12:09:21.049607 22021 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45146:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:21.056020 22021 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:21.268759 22113 tablet_service.cc:1511] Processing CreateTablet for tablet 9911e3b1b2f64b93b2ad9740ea9810bc (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:21.270530 22113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9911e3b1b2f64b93b2ad9740ea9810bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.271916 22111 tablet_service.cc:1511] Processing CreateTablet for tablet 497837e9d32f4d9c809e44f8fabb9d03 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:21.273492 22111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497837e9d32f4d9c809e44f8fabb9d03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.275161 22109 tablet_service.cc:1511] Processing CreateTablet for tablet 791f1d0e9076481dad104e8c3b503af8 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:21.276762 22109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791f1d0e9076481dad104e8c3b503af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.278095 22112 tablet_service.cc:1511] Processing CreateTablet for tablet 1baa23cb6635453b9a9cd5ec7e452f6a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:21.278326 22188 tablet_service.cc:1511] Processing CreateTablet for tablet 9911e3b1b2f64b93b2ad9740ea9810bc (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:21.270249 22110 tablet_service.cc:1511] Processing CreateTablet for tablet 37a6582c89c24e6e838bf8ce6d550b23 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:21.280004 22188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9911e3b1b2f64b93b2ad9740ea9810bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.282303 22187 tablet_service.cc:1511] Processing CreateTablet for tablet 1baa23cb6635453b9a9cd5ec7e452f6a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:21.286657 22186 tablet_service.cc:1511] Processing CreateTablet for tablet 497837e9d32f4d9c809e44f8fabb9d03 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:21.287566 22257 tablet_service.cc:1511] Processing CreateTablet for tablet f3728a188c254ff78ba0aff2361f13e3 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:21.289268 22107 tablet_service.cc:1511] Processing CreateTablet for tablet f86b841ece254f9bbfd1bd07c08f7004 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:21.289960 22258 tablet_service.cc:1511] Processing CreateTablet for tablet 791f1d0e9076481dad104e8c3b503af8 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:21.291607 22258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791f1d0e9076481dad104e8c3b503af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.292065 22182 tablet_service.cc:1511] Processing CreateTablet for tablet f86b841ece254f9bbfd1bd07c08f7004 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:21.294083 22259 tablet_service.cc:1511] Processing CreateTablet for tablet 37a6582c89c24e6e838bf8ce6d550b23 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:21.295496 22259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a6582c89c24e6e838bf8ce6d550b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.295056 22256 tablet_service.cc:1511] Processing CreateTablet for tablet f86b841ece254f9bbfd1bd07c08f7004 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:21.296605 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86b841ece254f9bbfd1bd07c08f7004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.297662 22260 tablet_service.cc:1511] Processing CreateTablet for tablet 497837e9d32f4d9c809e44f8fabb9d03 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:21.299115 22260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497837e9d32f4d9c809e44f8fabb9d03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.299453 22106 tablet_service.cc:1511] Processing CreateTablet for tablet 28f727fa1b2e45f2a0c5ab11ecf61a9e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:21.301927 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 28f727fa1b2e45f2a0c5ab11ecf61a9e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:21.302063 22262 tablet_service.cc:1511] Processing CreateTablet for tablet 9911e3b1b2f64b93b2ad9740ea9810bc (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:21.303507 22262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9911e3b1b2f64b93b2ad9740ea9810bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.304358 22255 tablet_service.cc:1511] Processing CreateTablet for tablet 28f727fa1b2e45f2a0c5ab11ecf61a9e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:21.305815 22255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f727fa1b2e45f2a0c5ab11ecf61a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.305584 22183 tablet_service.cc:1511] Processing CreateTablet for tablet f3728a188c254ff78ba0aff2361f13e3 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:21.308043 22108 tablet_service.cc:1511] Processing CreateTablet for tablet f3728a188c254ff78ba0aff2361f13e3 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:21.309000 22254 tablet_service.cc:1511] Processing CreateTablet for tablet 9255592b74304240a5fa1df814fbb726 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:21.310487 22184 tablet_service.cc:1511] Processing CreateTablet for tablet 791f1d0e9076481dad104e8c3b503af8 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:21.310371 22105 tablet_service.cc:1511] Processing CreateTablet for tablet 9255592b74304240a5fa1df814fbb726 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:21.310411 22254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9255592b74304240a5fa1df814fbb726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.313635 22185 tablet_service.cc:1511] Processing CreateTablet for tablet 37a6582c89c24e6e838bf8ce6d550b23 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:21.313774 22104 tablet_service.cc:1511] Processing CreateTablet for tablet 6d2d43361a72435b8868d1f3cdb436a3 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:21.284017 22187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1baa23cb6635453b9a9cd5ec7e452f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.314354 22261 tablet_service.cc:1511] Processing CreateTablet for tablet 1baa23cb6635453b9a9cd5ec7e452f6a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:21.319414 22257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3728a188c254ff78ba0aff2361f13e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.313879 22180 tablet_service.cc:1511] Processing CreateTablet for tablet 9255592b74304240a5fa1df814fbb726 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:21.320811 22112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1baa23cb6635453b9a9cd5ec7e452f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.322994 22179 tablet_service.cc:1511] Processing CreateTablet for tablet 6d2d43361a72435b8868d1f3cdb436a3 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:21.329828 22253 tablet_service.cc:1511] Processing CreateTablet for tablet 6d2d43361a72435b8868d1f3cdb436a3 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:21.338794 22261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1baa23cb6635453b9a9cd5ec7e452f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.341190 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2d43361a72435b8868d1f3cdb436a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.342638 22185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a6582c89c24e6e838bf8ce6d550b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.344353 22108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3728a188c254ff78ba0aff2361f13e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.346676 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9255592b74304240a5fa1df814fbb726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.347389 22110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a6582c89c24e6e838bf8ce6d550b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.347905 22183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3728a188c254ff78ba0aff2361f13e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.349843 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2d43361a72435b8868d1f3cdb436a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.353209 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9255592b74304240a5fa1df814fbb726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.356274 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f727fa1b2e45f2a0c5ab11ecf61a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.356989 22184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791f1d0e9076481dad104e8c3b503af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.361186 22186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497837e9d32f4d9c809e44f8fabb9d03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.365165 22182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86b841ece254f9bbfd1bd07c08f7004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.353209 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2d43361a72435b8868d1f3cdb436a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.371321 22106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f727fa1b2e45f2a0c5ab11ecf61a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.373121 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86b841ece254f9bbfd1bd07c08f7004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.439859 22111 tablet_service.cc:1511] Processing CreateTablet for tablet 7fac2244705d40569bd4a6e8161fb5e9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:21.447180 22312 tablet_bootstrap.cc:492] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:21.461356 22111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fac2244705d40569bd4a6e8161fb5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.483851 22185 tablet_service.cc:1511] Processing CreateTablet for tablet c4074b27f51549b4bf3fae4c6e734506 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:21.485208 22185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4074b27f51549b4bf3fae4c6e734506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.492421 22253 tablet_service.cc:1511] Processing CreateTablet for tablet 7fac2244705d40569bd4a6e8161fb5e9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:21.493721 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fac2244705d40569bd4a6e8161fb5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.497464 22254 tablet_service.cc:1511] Processing CreateTablet for tablet c4074b27f51549b4bf3fae4c6e734506 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:21.498806 22254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4074b27f51549b4bf3fae4c6e734506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.507337 22262 tablet_service.cc:1511] Processing CreateTablet for tablet 7f1b154b48c54be6b421b01ed436bf21 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:21.512061 22187 tablet_service.cc:1511] Processing CreateTablet for tablet 7fac2244705d40569bd4a6e8161fb5e9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:21.513778 22187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fac2244705d40569bd4a6e8161fb5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.524298 22262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f1b154b48c54be6b421b01ed436bf21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.504647 22109 tablet_service.cc:1511] Processing CreateTablet for tablet c4074b27f51549b4bf3fae4c6e734506 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:21.537454 22109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4074b27f51549b4bf3fae4c6e734506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.538224 22108 tablet_service.cc:1511] Processing CreateTablet for tablet 7f1b154b48c54be6b421b01ed436bf21 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:21.534385 22260 tablet_service.cc:1511] Processing CreateTablet for tablet f5d4cdb3f6584a3d98a8736d0f93ddaf (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:21.556887 22180 tablet_service.cc:1511] Processing CreateTablet for tablet 7f1b154b48c54be6b421b01ed436bf21 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:21.558321 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f1b154b48c54be6b421b01ed436bf21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.559130 22111 tablet_service.cc:1511] Processing CreateTablet for tablet f5d4cdb3f6584a3d98a8736d0f93ddaf (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:21.560916 22108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f1b154b48c54be6b421b01ed436bf21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.561713 22111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d4cdb3f6584a3d98a8736d0f93ddaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.562422 22260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d4cdb3f6584a3d98a8736d0f93ddaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.579946 22110 tablet_service.cc:1511] Processing CreateTablet for tablet 1f10864c994f49ed830c4951cfadea5e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:21.587154 22181 tablet_service.cc:1511] Processing CreateTablet for tablet f5d4cdb3f6584a3d98a8736d0f93ddaf (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:21.587746 22179 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec86d794d1447b58c35b6fb35b481f8 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:21.588531 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d4cdb3f6584a3d98a8736d0f93ddaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.592626 22180 tablet_service.cc:1511] Processing CreateTablet for tablet 1f10864c994f49ed830c4951cfadea5e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:21.535688 22257 tablet_service.cc:1511] Processing CreateTablet for tablet 1f10864c994f49ed830c4951cfadea5e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:21.597738 22257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f10864c994f49ed830c4951cfadea5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.598693 22113 tablet_service.cc:1511] Processing CreateTablet for tablet 6109e5c745bb4d53948d7f39ab4cf4ec (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:21.626070 22188 tablet_service.cc:1511] Processing CreateTablet for tablet 6109e5c745bb4d53948d7f39ab4cf4ec (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:21.614425 22106 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec86d794d1447b58c35b6fb35b481f8 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:21.614917 22314 tablet_bootstrap.cc:492] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:21.615615 22110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f10864c994f49ed830c4951cfadea5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.615754 22313 tablet_bootstrap.cc:492] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:21.617990 22104 tablet_service.cc:1511] Processing CreateTablet for tablet 907dafb5bddd48fdbc0a660020256df1 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:21.618444 22111 tablet_service.cc:1511] Processing CreateTablet for tablet dccbaccd2369440b957f9e2e49c0b59e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:21.636627 22259 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec86d794d1447b58c35b6fb35b481f8 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:21.638411 22259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec86d794d1447b58c35b6fb35b481f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.656231 22185 tablet_service.cc:1511] Processing CreateTablet for tablet 907dafb5bddd48fdbc0a660020256df1 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:21.621053 22107 tablet_service.cc:1511] Processing CreateTablet for tablet 0a461ebb30e94378a21b03f9c6c7a018 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:21.609656 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f10864c994f49ed830c4951cfadea5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.657859 22185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907dafb5bddd48fdbc0a660020256df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.630198 22106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec86d794d1447b58c35b6fb35b481f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.661876 22254 tablet_service.cc:1511] Processing CreateTablet for tablet 6109e5c745bb4d53948d7f39ab4cf4ec (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:21.663570 22254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6109e5c745bb4d53948d7f39ab4cf4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.664085 22111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dccbaccd2369440b957f9e2e49c0b59e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.664856 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec86d794d1447b58c35b6fb35b481f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.667834 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907dafb5bddd48fdbc0a660020256df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.669078 22113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6109e5c745bb4d53948d7f39ab4cf4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.675061 22188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6109e5c745bb4d53948d7f39ab4cf4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.677735 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a461ebb30e94378a21b03f9c6c7a018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.687554 22255 tablet_service.cc:1511] Processing CreateTablet for tablet 907dafb5bddd48fdbc0a660020256df1 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:21.690428 22312 tablet_bootstrap.cc:654] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.694875 22258 tablet_service.cc:1511] Processing CreateTablet for tablet dccbaccd2369440b957f9e2e49c0b59e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:21.700018 22183 tablet_service.cc:1511] Processing CreateTablet for tablet dccbaccd2369440b957f9e2e49c0b59e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:21.701037 22187 tablet_service.cc:1511] Processing CreateTablet for tablet 0a461ebb30e94378a21b03f9c6c7a018 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
W20260709 12:09:21.702212 22006 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 87936.2us
W20260709 12:09:21.702435 22007 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 66447.9us
I20260709 12:09:21.733731 22187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a461ebb30e94378a21b03f9c6c7a018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.734866 22256 tablet_service.cc:1511] Processing CreateTablet for tablet 0a461ebb30e94378a21b03f9c6c7a018 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
W20260709 12:09:21.704361 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:21.707517 22184 tablet_service.cc:1511] Processing CreateTablet for tablet 60967fd8cf404b7bb1b9f9c03875f4f3 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:21.708367 22182 tablet_service.cc:1511] Processing CreateTablet for tablet a466ed4a4d8b45e6bc22f4def613313a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:21.715009 22314 tablet_bootstrap.cc:654] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.742832 22255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907dafb5bddd48fdbc0a660020256df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.754490 22258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dccbaccd2369440b957f9e2e49c0b59e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.758038 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a461ebb30e94378a21b03f9c6c7a018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.753108 22108 tablet_service.cc:1511] Processing CreateTablet for tablet a466ed4a4d8b45e6bc22f4def613313a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:21.760563 22108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a466ed4a4d8b45e6bc22f4def613313a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.704491 22105 tablet_service.cc:1511] Processing CreateTablet for tablet 60967fd8cf404b7bb1b9f9c03875f4f3 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:21.778170 22110 tablet_service.cc:1511] Processing CreateTablet for tablet 44679affd4554006a2cb59b10b589a27 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:21.799700 22182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a466ed4a4d8b45e6bc22f4def613313a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.801515 22109 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea5fe59611e4539abcf87b4fd1a282c (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:21.796128 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60967fd8cf404b7bb1b9f9c03875f4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.810773 22109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea5fe59611e4539abcf87b4fd1a282c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.824890 22257 tablet_service.cc:1511] Processing CreateTablet for tablet 60967fd8cf404b7bb1b9f9c03875f4f3 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:21.829762 22314 tablet_bootstrap.cc:492] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:21.831489 22148 heartbeater.cc:499] Master 127.20.102.254:38171 was elected leader, sending a full tablet report...
I20260709 12:09:21.872675 22257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60967fd8cf404b7bb1b9f9c03875f4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.846674 22107 tablet_service.cc:1511] Processing CreateTablet for tablet c1fb787db87147b3be49bef974365af1 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:21.831224 22260 tablet_service.cc:1511] Processing CreateTablet for tablet a466ed4a4d8b45e6bc22f4def613313a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:21.833137 22110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44679affd4554006a2cb59b10b589a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.877678 22260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a466ed4a4d8b45e6bc22f4def613313a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.836262 22183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dccbaccd2369440b957f9e2e49c0b59e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.880859 22314 ts_tablet_manager.cc:1403] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.266s	user 0.021s	sys 0.017s
I20260709 12:09:21.881098 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1fb787db87147b3be49bef974365af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.838632 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 44679affd4554006a2cb59b10b589a27 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:21.876682 22262 tablet_service.cc:1511] Processing CreateTablet for tablet 55006a12f7594727bebe695d1ffbe74f (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:21.885689 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44679affd4554006a2cb59b10b589a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.886099 22262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55006a12f7594727bebe695d1ffbe74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.840328 22112 tablet_service.cc:1511] Processing CreateTablet for tablet ff2900731305497ebb6cfec2d7557d25 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:21.884290 22314 raft_consensus.cc:359] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:21.889678 22112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2900731305497ebb6cfec2d7557d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.889451 22314 raft_consensus.cc:385] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.890419 22314 raft_consensus.cc:740] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.891405 22314 consensus_queue.cc:260] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:21.843078 22104 tablet_service.cc:1511] Processing CreateTablet for tablet 55006a12f7594727bebe695d1ffbe74f (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:21.890442 22257 tablet_service.cc:1511] Processing CreateTablet for tablet c1fb787db87147b3be49bef974365af1 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:21.894548 22257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1fb787db87147b3be49bef974365af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.897507 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55006a12f7594727bebe695d1ffbe74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.900722 22254 tablet_service.cc:1511] Processing CreateTablet for tablet 3753b5634bb143e1ab2c70fbe2900044 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:21.901378 22184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60967fd8cf404b7bb1b9f9c03875f4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.901229 22180 tablet_service.cc:1511] Processing CreateTablet for tablet 43c89655d0564df0b63993d88160eb8e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:21.902172 22254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3753b5634bb143e1ab2c70fbe2900044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.902448 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c89655d0564df0b63993d88160eb8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.906698 22113 tablet_service.cc:1511] Processing CreateTablet for tablet 8f168c463b75448c945cd40fd0ad742f (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:21.908200 22113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f168c463b75448c945cd40fd0ad742f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.843683 22313 tablet_bootstrap.cc:654] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.843995 22179 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea5fe59611e4539abcf87b4fd1a282c (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:21.845624 22106 tablet_service.cc:1511] Processing CreateTablet for tablet 3753b5634bb143e1ab2c70fbe2900044 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:21.846665 22186 tablet_service.cc:1511] Processing CreateTablet for tablet ff2900731305497ebb6cfec2d7557d25 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:21.851962 22312 tablet_bootstrap.cc:492] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:21.852712 22187 tablet_service.cc:1511] Processing CreateTablet for tablet 55006a12f7594727bebe695d1ffbe74f (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:21.854687 22188 tablet_service.cc:1511] Processing CreateTablet for tablet 3753b5634bb143e1ab2c70fbe2900044 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:21.860982 22256 tablet_service.cc:1511] Processing CreateTablet for tablet 44679affd4554006a2cb59b10b589a27 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:21.926343 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44679affd4554006a2cb59b10b589a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.863327 22253 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea5fe59611e4539abcf87b4fd1a282c (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:21.927847 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea5fe59611e4539abcf87b4fd1a282c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.929852 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea5fe59611e4539abcf87b4fd1a282c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.931114 22259 tablet_service.cc:1511] Processing CreateTablet for tablet 43c89655d0564df0b63993d88160eb8e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:21.932471 22259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c89655d0564df0b63993d88160eb8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.864310 22108 tablet_service.cc:1511] Processing CreateTablet for tablet fc3d186560a74d7e8c4d29066e4e3567 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:21.933737 22108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3d186560a74d7e8c4d29066e4e3567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.934168 22187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55006a12f7594727bebe695d1ffbe74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.908550 22258 tablet_service.cc:1511] Processing CreateTablet for tablet fc3d186560a74d7e8c4d29066e4e3567 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:21.864414 22185 tablet_service.cc:1511] Processing CreateTablet for tablet c1fb787db87147b3be49bef974365af1 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:21.866173 22182 tablet_service.cc:1511] Processing CreateTablet for tablet fc3d186560a74d7e8c4d29066e4e3567 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:21.867707 22109 tablet_service.cc:1511] Processing CreateTablet for tablet 43c89655d0564df0b63993d88160eb8e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:21.871522 22261 tablet_service.cc:1511] Processing CreateTablet for tablet ff2900731305497ebb6cfec2d7557d25 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:21.924331 22223 heartbeater.cc:499] Master 127.20.102.254:38171 was elected leader, sending a full tablet report...
I20260709 12:09:21.937391 22185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1fb787db87147b3be49bef974365af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.937574 22109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c89655d0564df0b63993d88160eb8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.938994 22312 ts_tablet_manager.cc:1403] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.497s	user 0.012s	sys 0.018s
I20260709 12:09:21.941586 22106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3753b5634bb143e1ab2c70fbe2900044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.942641 22312 raft_consensus.cc:359] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:21.943565 22312 raft_consensus.cc:385] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.943949 22312 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.950117 22314 ts_tablet_manager.cc:1434] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.069s	user 0.003s	sys 0.008s
I20260709 12:09:21.980052 22314 tablet_bootstrap.cc:492] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:21.949460 22258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3d186560a74d7e8c4d29066e4e3567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.952759 22262 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0832297a8d44da9dba2792bf6c4c35 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:21.949465 22186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2900731305497ebb6cfec2d7557d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.954329 22107 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd2e5184fad402e8f3b26ea46e3c996 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:21.958541 22255 tablet_service.cc:1511] Processing CreateTablet for tablet 8f168c463b75448c945cd40fd0ad742f (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:21.876578 22111 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0832297a8d44da9dba2792bf6c4c35 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:21.989238 22261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2900731305497ebb6cfec2d7557d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.001590 22110 tablet_service.cc:1511] Processing CreateTablet for tablet 97ce44fb81b642f9ad6b0f0d68e82820 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:22.004189 22314 tablet_bootstrap.cc:654] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.989526 22188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3753b5634bb143e1ab2c70fbe2900044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.005815 22182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3d186560a74d7e8c4d29066e4e3567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.004904 22262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0832297a8d44da9dba2792bf6c4c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.990140 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd2e5184fad402e8f3b26ea46e3c996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.990800 22312 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.017159 22111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0832297a8d44da9dba2792bf6c4c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.021080 22255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f168c463b75448c945cd40fd0ad742f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.024528 22297 heartbeater.cc:499] Master 127.20.102.254:38171 was elected leader, sending a full tablet report...
I20260709 12:09:22.025000 22110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ce44fb81b642f9ad6b0f0d68e82820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.981004 22105 tablet_service.cc:1511] Processing CreateTablet for tablet ed4182733145491a94be746238e892f9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:22.031621 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4182733145491a94be746238e892f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.034189 22180 tablet_service.cc:1511] Processing CreateTablet for tablet 8f168c463b75448c945cd40fd0ad742f (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:22.040215 22260 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd2e5184fad402e8f3b26ea46e3c996 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:22.041834 22260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd2e5184fad402e8f3b26ea46e3c996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.042124 22109 tablet_service.cc:1511] Processing CreateTablet for tablet d97f4392fa434ad9bf2e7d3e78bfdf4c (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:22.043455 22109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97f4392fa434ad9bf2e7d3e78bfdf4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.057866 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f168c463b75448c945cd40fd0ad742f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.058095 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd2e5184fad402e8f3b26ea46e3c996 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:22.064224 22184 tablet_service.cc:1511] Processing CreateTablet for tablet ed4182733145491a94be746238e892f9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:22.066138 22184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4182733145491a94be746238e892f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.068358 22254 tablet_service.cc:1511] Processing CreateTablet for tablet ed4182733145491a94be746238e892f9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:22.070133 22254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4182733145491a94be746238e892f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.075968 22313 tablet_bootstrap.cc:492] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:22.076508 22313 ts_tablet_manager.cc:1403] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.461s	user 0.021s	sys 0.004s
I20260709 12:09:22.078791 22257 tablet_service.cc:1511] Processing CreateTablet for tablet 97ce44fb81b642f9ad6b0f0d68e82820 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:22.079555 22313 raft_consensus.cc:359] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.080286 22313 raft_consensus.cc:385] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.086423 22112 tablet_service.cc:1511] Processing CreateTablet for tablet 54878b51479940bebc76fc9d84de64cb (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:22.087817 22112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54878b51479940bebc76fc9d84de64cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.023979 22183 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0832297a8d44da9dba2792bf6c4c35 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:22.108954 22257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ce44fb81b642f9ad6b0f0d68e82820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.114022 22113 tablet_service.cc:1511] Processing CreateTablet for tablet 68d3fd71ae0648daa990f506abe35c85 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:22.114336 22109 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5facb1c9654266b70a6d04d1e002f2 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:22.115720 22113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d3fd71ae0648daa990f506abe35c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.117488 22111 tablet_service.cc:1511] Processing CreateTablet for tablet b4bae45452334273a1c277a0a512021f (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:22.080587 22313 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.127724 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd2e5184fad402e8f3b26ea46e3c996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.138984 22108 tablet_service.cc:1511] Processing CreateTablet for tablet a1f011a3d3cd4ee8ba13b1e9bfd25e6a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:22.147303 22262 tablet_service.cc:1511] Processing CreateTablet for tablet 54878b51479940bebc76fc9d84de64cb (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:22.148671 22183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0832297a8d44da9dba2792bf6c4c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.152634 22314 tablet_bootstrap.cc:492] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:22.153173 22314 ts_tablet_manager.cc:1403] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.003s
I20260709 12:09:22.153752 22110 tablet_service.cc:1511] Processing CreateTablet for tablet 83a858eff9ef460fa5e0587bb1ea61f9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:22.145571 22261 tablet_service.cc:1511] Processing CreateTablet for tablet d97f4392fa434ad9bf2e7d3e78bfdf4c (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:22.162083 22312 ts_tablet_manager.cc:1434] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.223s	user 0.013s	sys 0.005s
I20260709 12:09:22.163412 22312 tablet_bootstrap.cc:492] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:22.164245 22319 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.164819 22319 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.167295 22256 tablet_service.cc:1511] Processing CreateTablet for tablet 68d3fd71ae0648daa990f506abe35c85 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:22.132580 22109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5facb1c9654266b70a6d04d1e002f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.177321 22179 tablet_service.cc:1511] Processing CreateTablet for tablet 97ce44fb81b642f9ad6b0f0d68e82820 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:22.178886 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ce44fb81b642f9ad6b0f0d68e82820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.181646 22319 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:22.182789 22186 tablet_service.cc:1511] Processing CreateTablet for tablet d97f4392fa434ad9bf2e7d3e78bfdf4c (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:22.184170 22186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97f4392fa434ad9bf2e7d3e78bfdf4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.186401 22104 tablet_service.cc:1511] Processing CreateTablet for tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:22.188545 22259 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5facb1c9654266b70a6d04d1e002f2 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:22.156692 22106 tablet_service.cc:1511] Processing CreateTablet for tablet 5c953802abd84140ba6c6a85dcdbf124 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:22.199704 22108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f011a3d3cd4ee8ba13b1e9bfd25e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.200974 22314 raft_consensus.cc:359] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.207684 22253 tablet_service.cc:1511] Processing CreateTablet for tablet b4bae45452334273a1c277a0a512021f (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:22.208889 22260 tablet_service.cc:1511] Processing CreateTablet for tablet a1f011a3d3cd4ee8ba13b1e9bfd25e6a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:22.148677 22262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54878b51479940bebc76fc9d84de64cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.231556 22314 raft_consensus.cc:385] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.236814 22314 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.236680 22105 tablet_service.cc:1511] Processing CreateTablet for tablet 180ca53d6ccc4c27a39b8000ee3b67ff (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:22.237991 22314 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.238222 22188 tablet_service.cc:1511] Processing CreateTablet for tablet 54878b51479940bebc76fc9d84de64cb (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:22.243534 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.171252 22313 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.261137 22106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c953802abd84140ba6c6a85dcdbf124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.254801 22259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5facb1c9654266b70a6d04d1e002f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.207684 22187 tablet_service.cc:1511] Processing CreateTablet for tablet 68d3fd71ae0648daa990f506abe35c85 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:22.289040 22188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54878b51479940bebc76fc9d84de64cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.292883 22110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a858eff9ef460fa5e0587bb1ea61f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.297367 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180ca53d6ccc4c27a39b8000ee3b67ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.305325 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d3fd71ae0648daa990f506abe35c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.311100 22261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97f4392fa434ad9bf2e7d3e78bfdf4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.312249 22187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d3fd71ae0648daa990f506abe35c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.317304 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bae45452334273a1c277a0a512021f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.316809 22107 tablet_service.cc:1511] Processing CreateTablet for tablet 011db458534b4bc8876e63453a07b86b (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:22.318985 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011db458534b4bc8876e63453a07b86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.321559 22111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bae45452334273a1c277a0a512021f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.249172 22185 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5facb1c9654266b70a6d04d1e002f2 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:22.331929 22317 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.349658 22317 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.350687 22314 ts_tablet_manager.cc:1434] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.197s	user 0.010s	sys 0.000s
I20260709 12:09:22.351771 22314 tablet_bootstrap.cc:492] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:22.351975 22182 tablet_service.cc:1511] Processing CreateTablet for tablet b4bae45452334273a1c277a0a512021f (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:22.354992 22182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bae45452334273a1c277a0a512021f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.356324 22258 tablet_service.cc:1511] Processing CreateTablet for tablet 83a858eff9ef460fa5e0587bb1ea61f9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:22.362491 22258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a858eff9ef460fa5e0587bb1ea61f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.365417 22260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f011a3d3cd4ee8ba13b1e9bfd25e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.369118 22317 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:22.369690 22317 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.369906 22185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5facb1c9654266b70a6d04d1e002f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.370153 22317 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.371770 22324 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.372278 22324 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.376724 22313 ts_tablet_manager.cc:1434] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.300s	user 0.031s	sys 0.053s
I20260709 12:09:22.382997 22184 tablet_service.cc:1511] Processing CreateTablet for tablet a1f011a3d3cd4ee8ba13b1e9bfd25e6a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:22.377264 22312 tablet_bootstrap.cc:654] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.391887 22254 tablet_service.cc:1511] Processing CreateTablet for tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:22.396325 22253 tablet_service.cc:1511] Processing CreateTablet for tablet 5c953802abd84140ba6c6a85dcdbf124 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:22.417049 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c953802abd84140ba6c6a85dcdbf124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.417402 22183 tablet_service.cc:1511] Processing CreateTablet for tablet 83a858eff9ef460fa5e0587bb1ea61f9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:22.418830 22183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a858eff9ef460fa5e0587bb1ea61f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.421784 22184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f011a3d3cd4ee8ba13b1e9bfd25e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.409555 22180 tablet_service.cc:1511] Processing CreateTablet for tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:22.427018 22254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.412132 22314 tablet_bootstrap.cc:654] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.427670 22262 tablet_service.cc:1511] Processing CreateTablet for tablet 180ca53d6ccc4c27a39b8000ee3b67ff (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:22.434155 22112 tablet_service.cc:1511] Processing CreateTablet for tablet f0f94aa1b7ea46adad8a5d877b78cef9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:22.435557 22112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f94aa1b7ea46adad8a5d877b78cef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.429684 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.429260 22324 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:22.452737 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:22.456187 22123 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:22.451391 22262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180ca53d6ccc4c27a39b8000ee3b67ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.449391 22313 tablet_bootstrap.cc:492] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:22.474634 22257 tablet_service.cc:1511] Processing CreateTablet for tablet 011db458534b4bc8876e63453a07b86b (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:22.476215 22257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011db458534b4bc8876e63453a07b86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.498133 22253 tablet_service.cc:1511] Processing CreateTablet for tablet f0f94aa1b7ea46adad8a5d877b78cef9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:22.499908 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f94aa1b7ea46adad8a5d877b78cef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.538195 22104 tablet_service.cc:1511] Processing CreateTablet for tablet 69f06d3e4d31493d8aa24b2983f369fe (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:22.539521 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f06d3e4d31493d8aa24b2983f369fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:22.571039 22149 tablet.cc:2406] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:22.577605 22113 tablet_service.cc:1511] Processing CreateTablet for tablet 8d6f694768d144aa85616d8c7b2453f0 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:22.579273 22113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d6f694768d144aa85616d8c7b2453f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.583000 22313 tablet_bootstrap.cc:654] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.589505 22255 tablet_service.cc:1511] Processing CreateTablet for tablet 8d6f694768d144aa85616d8c7b2453f0 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:22.590847 22255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d6f694768d144aa85616d8c7b2453f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.602955 22108 tablet_service.cc:1511] Processing CreateTablet for tablet 6d0c08f3aeaa409eae4bd1665895337e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:22.609591 22181 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 32) took 1009 ms. Trace:
I20260709 12:09:22.619899 22108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d0c08f3aeaa409eae4bd1665895337e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.623296 22179 tablet_service.cc:1511] Processing CreateTablet for tablet 5c953802abd84140ba6c6a85dcdbf124 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:22.645938 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c953802abd84140ba6c6a85dcdbf124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.630239 22314 tablet_bootstrap.cc:492] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:22.650318 22314 ts_tablet_manager.cc:1403] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.299s	user 0.011s	sys 0.006s
I20260709 12:09:22.630839 22259 tablet_service.cc:1511] Processing CreateTablet for tablet ca8c98b2e5e2428790f3422299acaffb (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:22.633144 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:22.634352 22109 tablet_service.cc:1511] Processing CreateTablet for tablet ca8c98b2e5e2428790f3422299acaffb (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:22.637955 22107 tablet_service.cc:1511] Processing CreateTablet for tablet 575c887e89834da7b6e222b41a19b692 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:22.639730 22260 tablet_service.cc:1511] Processing CreateTablet for tablet 6d0c08f3aeaa409eae4bd1665895337e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:22.643175 22106 tablet_service.cc:1511] Processing CreateTablet for tablet 863b392474d94720808349fe27669b5b (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:22.610170 22181 rpcz_store.cc:276] 0709 12:09:21.600000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.056486 (+456486us) service_pool.cc:224] Handling call
0709 12:09:22.059460 (+  2974us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.059609 (+   149us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.397786 (+338177us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:22.607598 (+209812us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:22.609510 (+  1912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:22.649379 22184 tablet_service.cc:1511] Processing CreateTablet for tablet 180ca53d6ccc4c27a39b8000ee3b67ff (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:22.616060 22317 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:22.661046 22259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8c98b2e5e2428790f3422299acaffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.661796 22319 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.670687 22319 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.671149 22260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d0c08f3aeaa409eae4bd1665895337e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.664448 22109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8c98b2e5e2428790f3422299acaffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.666193 22181 tablet_service.cc:1511] Processing CreateTablet for tablet f0f94aa1b7ea46adad8a5d877b78cef9 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:22.674546 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f94aa1b7ea46adad8a5d877b78cef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.678576 22186 tablet_service.cc:1511] Processing CreateTablet for tablet 8d6f694768d144aa85616d8c7b2453f0 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:22.681787 22258 tablet_service.cc:1511] Processing CreateTablet for tablet 575c887e89834da7b6e222b41a19b692 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:22.683044 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:22.685619 22163 leader_election.cc:343] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.686450 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:22.689043 22163 leader_election.cc:343] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.690078 22258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575c887e89834da7b6e222b41a19b692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.671088 22319 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.694432 22312 tablet_bootstrap.cc:492] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:22.694921 22312 ts_tablet_manager.cc:1403] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.532s	user 0.034s	sys 0.024s
I20260709 12:09:22.697742 22182 tablet_service.cc:1511] Processing CreateTablet for tablet 011db458534b4bc8876e63453a07b86b (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:22.698841 22106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863b392474d94720808349fe27669b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.698990 22254 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6c5fdc849b4d1b8df5ffb293137964 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:22.668116 22111 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6c5fdc849b4d1b8df5ffb293137964 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:22.691725 22256 tablet_service.cc:1511] Processing CreateTablet for tablet 69f06d3e4d31493d8aa24b2983f369fe (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:22.663939 22314 raft_consensus.cc:359] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.692647 22261 tablet_service.cc:1511] Processing CreateTablet for tablet 863b392474d94720808349fe27669b5b (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:22.702236 22111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6c5fdc849b4d1b8df5ffb293137964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.705909 22253 tablet_service.cc:1511] Processing CreateTablet for tablet 44711cbd4d234e36807a94726a691570 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:22.690135 22112 tablet_service.cc:1511] Processing CreateTablet for tablet 44711cbd4d234e36807a94726a691570 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:22.707125 22314 raft_consensus.cc:385] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.712572 22314 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.712963 22112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44711cbd4d234e36807a94726a691570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.713771 22314 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.714779 22317 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.715263 22317 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.719691 22317 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:22.722036 22254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6c5fdc849b4d1b8df5ffb293137964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.722151 22314 ts_tablet_manager.cc:1434] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.070s	user 0.003s	sys 0.003s
I20260709 12:09:22.725100 22186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d6f694768d144aa85616d8c7b2453f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.725147 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:22.727280 22163 leader_election.cc:343] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.728168 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f06d3e4d31493d8aa24b2983f369fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.729597 22261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863b392474d94720808349fe27669b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.730666 22184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180ca53d6ccc4c27a39b8000ee3b67ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.731596 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575c887e89834da7b6e222b41a19b692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.732856 22182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011db458534b4bc8876e63453a07b86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.735658 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44711cbd4d234e36807a94726a691570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.706013 22105 tablet_service.cc:1511] Processing CreateTablet for tablet 9726d3fa41c64b6184468cabcb37dd5a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:22.741120 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9726d3fa41c64b6184468cabcb37dd5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.745270 22187 tablet_service.cc:1511] Processing CreateTablet for tablet 69f06d3e4d31493d8aa24b2983f369fe (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:22.746764 22187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f06d3e4d31493d8aa24b2983f369fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.749408 22262 tablet_service.cc:1511] Processing CreateTablet for tablet a8f422c5da2840e0b466894312ebcd44 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:22.751868 22262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f422c5da2840e0b466894312ebcd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.765812 22312 raft_consensus.cc:359] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.766834 22312 raft_consensus.cc:385] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.767182 22312 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.768308 22185 tablet_service.cc:1511] Processing CreateTablet for tablet ca8c98b2e5e2428790f3422299acaffb (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:22.769733 22188 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 36) took 1016 ms. Trace:
I20260709 12:09:22.770211 22188 rpcz_store.cc:276] 0709 12:09:21.753605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.207205 (+453600us) service_pool.cc:224] Handling call
0709 12:09:22.249505 (+ 42300us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.258739 (+  9234us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.368410 (+109671us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:22.688440 (+320030us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:22.769640 (+ 81200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:22.779284 22314 tablet_bootstrap.cc:492] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:22.789384 22112 tablet_service.cc:1511] Processing CreateTablet for tablet a8f422c5da2840e0b466894312ebcd44 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:22.790767 22112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f422c5da2840e0b466894312ebcd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.795830 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:22.798241 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:22.800163 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:22.800333 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:09:22.801323 22006 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 64930.1us
I20260709 12:09:22.802433 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:09:22.805079 22007 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57692.7us
I20260709 12:09:22.806495 22180 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 42) took 1001 ms. Trace:
I20260709 12:09:22.806882 22180 rpcz_store.cc:276] 0709 12:09:21.805416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.408456 (+603040us) service_pool.cc:224] Handling call
0709 12:09:22.425255 (+ 16799us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.425353 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.598496 (+173143us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:22.805891 (+207395us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:22.806414 (+   523us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:22.807514 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.808720 22112 tablet_service.cc:1511] Processing CreateTablet for tablet 6a694c1edf6f4d74a37990fe7e53a6af (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:22.810099 22112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a694c1edf6f4d74a37990fe7e53a6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.811645 22319 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.817150 22272 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 1: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:22.820185 22313 tablet_bootstrap.cc:492] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:22.820752 22313 ts_tablet_manager.cc:1403] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.389s	user 0.012s	sys 0.024s
I20260709 12:09:22.824007 22313 raft_consensus.cc:359] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.827481 22185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8c98b2e5e2428790f3422299acaffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.832350 22104 tablet_service.cc:1511] Processing CreateTablet for tablet 5063e8815c77400bb77029ed9db742c1 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:22.833490 22110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36132 (request call id 41) took 1038 ms. Trace:
I20260709 12:09:22.833885 22110 rpcz_store.cc:276] 0709 12:09:21.800153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.152751 (+352598us) service_pool.cc:224] Handling call
0709 12:09:22.154597 (+  1846us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.154702 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.693328 (+538626us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:22.832963 (+139635us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:22.833413 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:22.842994 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:09:22.844635 22087 leader_election.cc:343] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.845165 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:22.846437 22324 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.851255 22314 tablet_bootstrap.cc:654] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.854182 22324 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.855289 22260 tablet_service.cc:1511] Processing CreateTablet for tablet 6a694c1edf6f4d74a37990fe7e53a6af (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:22.856645 22260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a694c1edf6f4d74a37990fe7e53a6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.860848 22313 raft_consensus.cc:385] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.861290 22313 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.862241 22313 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:22.862644 22312 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:22.869302 22236 leader_election.cc:343] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.876206 22162 leader_election.cc:343] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.876819 22162 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:22.773171 22188 tablet_service.cc:1511] Processing CreateTablet for tablet 6d0c08f3aeaa409eae4bd1665895337e (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:22.854187 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5063e8815c77400bb77029ed9db742c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.878680 22188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d0c08f3aeaa409eae4bd1665895337e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.880198 22185 tablet_service.cc:1511] Processing CreateTablet for tablet 575c887e89834da7b6e222b41a19b692 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:22.891399 22317 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.893718 22257 tablet_service.cc:1511] Processing CreateTablet for tablet 9726d3fa41c64b6184468cabcb37dd5a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:22.895581 22257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9726d3fa41c64b6184468cabcb37dd5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.868745 22184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 44) took 1062 ms. Trace:
I20260709 12:09:22.902436 22184 rpcz_store.cc:276] 0709 12:09:21.806819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.648441 (+841622us) service_pool.cc:224] Handling call
0709 12:09:22.729924 (+ 81483us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.730082 (+   158us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.846921 (+116839us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:22.868225 (+ 21304us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:22.868679 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:22.864624 22313 ts_tablet_manager.cc:1434] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.002s
I20260709 12:09:22.909726 22313 tablet_bootstrap.cc:492] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:22.912357 22184 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6c5fdc849b4d1b8df5ffb293137964 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:22.899739 22180 tablet_service.cc:1511] Processing CreateTablet for tablet 863b392474d94720808349fe27669b5b (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:09:22.936892 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 67631.5us
I20260709 12:09:22.937861 22256 tablet_service.cc:1511] Processing CreateTablet for tablet 5063e8815c77400bb77029ed9db742c1 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:22.938827 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:22.939252 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5063e8815c77400bb77029ed9db742c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.945791 22182 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 45) took 1138 ms. Trace:
I20260709 12:09:22.950271 22123 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:22.952353 22255 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57876 (request call id 47) took 1083 ms. Trace:
I20260709 12:09:22.966022 22185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575c887e89834da7b6e222b41a19b692. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:22.955029 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 76759.6us
I20260709 12:09:22.953267 22182 rpcz_store.cc:276] 0709 12:09:21.807588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.659955 (+852367us) service_pool.cc:224] Handling call
0709 12:09:22.713816 (+ 53861us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800196598. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9de9c 00007fcceac9da5b 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2df6831 00007fccf2dd3ac3 00007fccf2d82400 00007fccec207af4 00007fccec207a82 00007fccec2079b1
0709 12:09:22.732260 (+ 18444us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.732403 (+   143us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.855358 (+122955us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:22.943417 (+ 88059us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:22.945502 (+  2085us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3383552}
I20260709 12:09:22.960852 22113 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36132 (request call id 47) took 1093 ms. Trace:
I20260709 12:09:22.974071 22184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6c5fdc849b4d1b8df5ffb293137964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.989091 22113 rpcz_store.cc:276] 0709 12:09:21.866386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.532981 (+666595us) service_pool.cc:224] Handling call
0709 12:09:22.578596 (+ 45615us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.578840 (+   244us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.850472 (+271632us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:22.956685 (+106213us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:22.958564 (+  1879us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10165}
I20260709 12:09:22.972095 22183 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 41) took 1172 ms. Trace:
I20260709 12:09:22.992715 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863b392474d94720808349fe27669b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.997131 22183 rpcz_store.cc:276] 0709 12:09:21.800499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.388266 (+587767us) service_pool.cc:224] Handling call
0709 12:09:22.418285 (+ 30019us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.418380 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.604074 (+185694us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:22.952457 (+348383us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:22.970569 (+ 18112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:22.968858 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:22.966348 22255 rpcz_store.cc:276] 0709 12:09:21.868701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.588468 (+719767us) service_pool.cc:224] Handling call
0709 12:09:22.590361 (+  1893us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.590457 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.793518 (+203061us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:22.951833 (+158315us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:22.952289 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:22.978211 22162 leader_election.cc:343] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.003589 22162 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:23.004570 22317 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.005165 22339 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:23.006304 22162 leader_election.cc:343] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.006340 22314 tablet_bootstrap.cc:492] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:23.007032 22162 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:23.007393 22314 ts_tablet_manager.cc:1403] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.228s	user 0.021s	sys 0.017s
I20260709 12:09:23.007931 22317 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.006377 22186 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 47) took 1117 ms. Trace:
I20260709 12:09:23.008955 22186 rpcz_store.cc:276] 0709 12:09:21.867482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.677554 (+810072us) service_pool.cc:224] Handling call
0709 12:09:22.679452 (+  1898us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.679550 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.847512 (+167962us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:22.984492 (+136980us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:22.984966 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:23.010911 22181 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 46) took 1155 ms. Trace:
I20260709 12:09:23.011001 22186 tablet_service.cc:1511] Processing CreateTablet for tablet 9726d3fa41c64b6184468cabcb37dd5a (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:23.011430 22181 rpcz_store.cc:276] 0709 12:09:21.855789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.665055 (+809266us) service_pool.cc:224] Handling call
0709 12:09:22.674042 (+  8987us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.674141 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.856096 (+181955us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:23.010011 (+153915us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:23.010841 (+   830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:23.012305 22186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9726d3fa41c64b6184468cabcb37dd5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.965235 22319 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.014219 22179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 43) took 1207 ms. Trace:
I20260709 12:09:23.014551 22179 rpcz_store.cc:276] 0709 12:09:21.806495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.622403 (+815908us) service_pool.cc:224] Handling call
0709 12:09:22.645475 (+ 23072us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.645573 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.939855 (+294282us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:23.013814 (+ 73959us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:23.014173 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:23.016255 22179 tablet_service.cc:1511] Processing CreateTablet for tablet 5063e8815c77400bb77029ed9db742c1 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:23.017292 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5063e8815c77400bb77029ed9db742c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:23.017580 22183 tablet_service.cc:1511] Processing CreateTablet for tablet a8f422c5da2840e0b466894312ebcd44 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:23.019063 22183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f422c5da2840e0b466894312ebcd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:22.986162 22182 tablet_service.cc:1511] Processing CreateTablet for tablet 44711cbd4d234e36807a94726a691570 (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:23.022330 22182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44711cbd4d234e36807a94726a691570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:23.023151 22314 raft_consensus.cc:359] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.032941 22314 raft_consensus.cc:385] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.033368 22314 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.034291 22314 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.035995 22313 tablet_bootstrap.cc:654] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.036664 22314 ts_tablet_manager.cc:1434] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 12:09:23.037874 22314 tablet_bootstrap.cc:492] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:23.038290 22109 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36132 (request call id 49) took 1064 ms. Trace:
I20260709 12:09:23.038681 22109 rpcz_store.cc:276] 0709 12:09:21.974320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.584583 (+610263us) service_pool.cc:224] Handling call
0709 12:09:22.663890 (+ 79307us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.664015 (+   125us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.860014 (+195999us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:23.037738 (+177724us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:23.038218 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:23.041040 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:09:23.042572 22236 leader_election.cc:343] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.044481 22314 tablet_bootstrap.cc:654] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.065809 22187 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 48) took 1142 ms. Trace:
I20260709 12:09:23.066632 22187 rpcz_store.cc:276] 0709 12:09:21.923905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.709057 (+785152us) service_pool.cc:224] Handling call
0709 12:09:22.746245 (+ 37188us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.746352 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.975969 (+229617us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:23.065002 (+ 89033us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:23.065711 (+   709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:23.033394 22312 ts_tablet_manager.cc:1434] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.338s	user 0.014s	sys 0.009s
I20260709 12:09:23.085495 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 6a694c1edf6f4d74a37990fe7e53a6af (DEFAULT_TABLE table=test-workload [id=ad4588232900411b98860e921e1369e2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:23.087018 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a694c1edf6f4d74a37990fe7e53a6af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:23.092082 22312 tablet_bootstrap.cc:492] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:23.107820 22314 tablet_bootstrap.cc:492] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:23.108652 22314 ts_tablet_manager.cc:1403] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.012s
I20260709 12:09:23.113271 22339 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:23.126749 22312 tablet_bootstrap.cc:654] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.128265 22188 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 50) took 1104 ms. Trace:
I20260709 12:09:23.128830 22185 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 51) took 1027 ms. Trace:
I20260709 12:09:23.128705 22188 rpcz_store.cc:276] 0709 12:09:22.023586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.771884 (+748298us) service_pool.cc:224] Handling call
0709 12:09:22.878109 (+106225us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.878247 (+   138us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:23.099759 (+221512us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:23.127667 (+ 27908us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:23.128191 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2013}
I20260709 12:09:23.129887 22313 tablet_bootstrap.cc:492] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.129288 22185 rpcz_store.cc:276] 0709 12:09:22.101675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.876569 (+774894us) service_pool.cc:224] Handling call
0709 12:09:22.891625 (+ 15056us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.891809 (+   184us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:23.036675 (+144866us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:23.128290 (+ 91615us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:23.128748 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:23.130689 22313 ts_tablet_manager.cc:1403] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.221s	user 0.007s	sys 0.008s
I20260709 12:09:23.127683 22314 raft_consensus.cc:359] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.133368 22314 raft_consensus.cc:385] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.133719 22314 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.134039 22313 raft_consensus.cc:359] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.134868 22313 raft_consensus.cc:385] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.135167 22258 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57876 (request call id 51) took 1047 ms. Trace:
I20260709 12:09:23.135202 22313 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.135812 22258 rpcz_store.cc:276] 0709 12:09:22.088095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.658816 (+570721us) service_pool.cc:224] Handling call
0709 12:09:22.686260 (+ 27444us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.689674 (+  3414us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:22.946077 (+256403us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:23.134689 (+188612us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:23.135106 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:23.136381 22313 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.137786 22314 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.138944 22313 ts_tablet_manager.cc:1434] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:23.137267 22339 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.140259 22314 ts_tablet_manager.cc:1434] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.031s	user 0.001s	sys 0.005s
I20260709 12:09:23.140300 22313 tablet_bootstrap.cc:492] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.133991 22180 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56158 (request call id 52) took 1031 ms. Trace:
I20260709 12:09:23.144008 22180 rpcz_store.cc:276] 0709 12:09:22.102646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:22.898388 (+795742us) service_pool.cc:224] Handling call
0709 12:09:22.924460 (+ 26072us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:22.924574 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:23.057354 (+132780us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:23.133497 (+ 76143us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:23.133929 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:23.150619 22313 tablet_bootstrap.cc:654] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.150640 22314 tablet_bootstrap.cc:492] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:23.154235 22019 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.162245 22314 tablet_bootstrap.cc:654] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.164535 22312 tablet_bootstrap.cc:492] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:23.167672 22312 ts_tablet_manager.cc:1403] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.007s
I20260709 12:09:23.171774 22312 raft_consensus.cc:359] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.172631 22312 raft_consensus.cc:385] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.173015 22312 raft_consensus.cc:740] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.174085 22312 consensus_queue.cc:260] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.175724 22313 tablet_bootstrap.cc:492] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.176275 22313 ts_tablet_manager.cc:1403] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.003s
I20260709 12:09:23.176424 22314 tablet_bootstrap.cc:492] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:23.177114 22312 ts_tablet_manager.cc:1434] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:09:23.177245 22314 ts_tablet_manager.cc:1403] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.009s
I20260709 12:09:23.178236 22312 tablet_bootstrap.cc:492] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:23.179350 22313 raft_consensus.cc:359] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.180109 22313 raft_consensus.cc:385] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.180414 22313 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.181591 22314 raft_consensus.cc:359] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.181838 22313 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.182828 22314 raft_consensus.cc:385] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.183358 22314 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.185204 22313 ts_tablet_manager.cc:1434] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:09:23.184605 22314 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.186990 22313 tablet_bootstrap.cc:492] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.189386 22314 ts_tablet_manager.cc:1434] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:09:23.193571 22312 tablet_bootstrap.cc:654] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.193802 22313 tablet_bootstrap.cc:654] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.196861 22314 tablet_bootstrap.cc:492] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:23.209760 22314 tablet_bootstrap.cc:654] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.214936 22313 tablet_bootstrap.cc:492] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.215610 22313 ts_tablet_manager.cc:1403] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.007s
I20260709 12:09:23.214936 22312 tablet_bootstrap.cc:492] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:23.216756 22312 ts_tablet_manager.cc:1403] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.009s
I20260709 12:09:23.219317 22314 tablet_bootstrap.cc:492] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:23.218930 22313 raft_consensus.cc:359] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.219862 22314 ts_tablet_manager.cc:1403] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:09:23.219815 22313 raft_consensus.cc:385] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.219748 22312 raft_consensus.cc:359] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.220598 22313 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.221005 22312 raft_consensus.cc:385] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.221340 22312 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.221601 22313 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.223271 22314 raft_consensus.cc:359] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.223870 22314 raft_consensus.cc:385] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.223973 22313 ts_tablet_manager.cc:1434] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:23.224186 22314 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.222262 22312 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.225463 22313 tablet_bootstrap.cc:492] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.225097 22314 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.227391 22314 ts_tablet_manager.cc:1434] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 12:09:23.228436 22314 tablet_bootstrap.cc:492] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:23.232842 22313 tablet_bootstrap.cc:654] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.233711 22312 ts_tablet_manager.cc:1434] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:23.234769 22312 tablet_bootstrap.cc:492] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:23.235491 22314 tablet_bootstrap.cc:654] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.243001 22312 tablet_bootstrap.cc:654] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.243749 22339 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.244395 22313 tablet_bootstrap.cc:492] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.244990 22313 ts_tablet_manager.cc:1403] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.002s
I20260709 12:09:23.244570 22339 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.247505 22340 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.248265 22340 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.248798 22313 raft_consensus.cc:359] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.249886 22313 raft_consensus.cc:385] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.250293 22313 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.251808 22324 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.252344 22324 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.252941 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.253639 22123 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:23.254664 22314 tablet_bootstrap.cc:492] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:23.255337 22314 ts_tablet_manager.cc:1403] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.000s
I20260709 12:09:23.256063 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:09:23.257737 22087 leader_election.cc:343] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.257201 22313 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.259034 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:23.260048 22339 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.260645 22339 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.261000 22339 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.261093 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:23.261370 22314 raft_consensus.cc:359] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.262368 22314 raft_consensus.cc:385] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.262403 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.262924 22314 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.262989 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.263773 22198 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:23.267782 22340 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.268118 22312 tablet_bootstrap.cc:492] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:23.261417 22339 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.268913 22312 ts_tablet_manager.cc:1403] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.014s
W20260709 12:09:23.273528 22236 leader_election.cc:343] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.273699 22312 raft_consensus.cc:359] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.274390 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:23.274916 22312 raft_consensus.cc:385] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.275360 22340 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.275378 22312 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.276043 22340 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.276643 22340 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.277370 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.276878 22312 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.254665 22324 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:09:23.276446 22088 leader_election.cc:343] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.279697 22088 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:23.280449 22312 ts_tablet_manager.cc:1434] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.008s
I20260709 12:09:23.280907 22324 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.281852 22312 tablet_bootstrap.cc:492] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
W20260709 12:09:23.281833 22236 leader_election.cc:343] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.263999 22314 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.291496 22314 ts_tablet_manager.cc:1434] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 12:09:23.293251 22317 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.293816 22317 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.294404 22312 tablet_bootstrap.cc:654] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.297405 22317 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.298270 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:23.299943 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.301105 22123 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 1: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:23.301594 22314 tablet_bootstrap.cc:492] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:23.303418 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:23.305055 22317 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.288260 22340 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.305300 22339 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.307400 22324 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.317324 22324 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.318876 22313 ts_tablet_manager.cc:1434] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.074s	user 0.025s	sys 0.014s
I20260709 12:09:23.320494 22313 tablet_bootstrap.cc:492] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.320654 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.314673 22314 tablet_bootstrap.cc:654] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.322594 22087 leader_election.cc:343] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.325210 22317 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.316066 22357 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.326068 22357 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.327562 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:23.328962 22088 leader_election.cc:343] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.329438 22088 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:23.329715 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:23.330470 22313 tablet_bootstrap.cc:654] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.332742 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:09:23.334685 22087 leader_election.cc:343] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.335433 22324 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.336295 22324 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.337471 22312 tablet_bootstrap.cc:492] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:23.338171 22313 tablet_bootstrap.cc:492] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.338338 22312 ts_tablet_manager.cc:1403] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.032s
I20260709 12:09:23.338949 22313 ts_tablet_manager.cc:1403] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.005s
I20260709 12:09:23.340806 22357 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.342916 22313 raft_consensus.cc:359] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.343009 22312 raft_consensus.cc:359] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.343773 22313 raft_consensus.cc:385] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.343834 22312 raft_consensus.cc:385] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.344177 22313 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.344321 22312 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.345012 22313 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.345145 22312 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.346097 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:23.346752 22198 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.347383 22313 ts_tablet_manager.cc:1434] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:23.347841 22312 ts_tablet_manager.cc:1434] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:09:23.348363 22313 tablet_bootstrap.cc:492] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.349205 22312 tablet_bootstrap.cc:492] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:23.352991 22340 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.356003 22313 tablet_bootstrap.cc:654] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.356418 22312 tablet_bootstrap.cc:654] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.356969 22198 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:23.358713 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:23.367458 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:23.368494 22313 tablet_bootstrap.cc:492] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.369022 22313 ts_tablet_manager.cc:1403] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.014s
W20260709 12:09:23.369191 22236 leader_election.cc:343] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.369560 22340 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.369179 22312 tablet_bootstrap.cc:492] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:23.370463 22312 ts_tablet_manager.cc:1403] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 12:09:23.371698 22313 raft_consensus.cc:359] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.372411 22313 raft_consensus.cc:385] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.372641 22313 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.373332 22313 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.373353 22339 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.374686 22319 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.375082 22313 ts_tablet_manager.cc:1434] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:23.375474 22312 raft_consensus.cc:359] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.375595 22319 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.376303 22313 tablet_bootstrap.cc:492] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.376267 22312 raft_consensus.cc:385] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.376843 22312 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.377628 22312 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.378440 22319 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.381395 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.382302 22197 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:23.383819 22313 tablet_bootstrap.cc:654] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.384114 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:23.385303 22319 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.385792 22319 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.386226 22319 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.387984 22312 ts_tablet_manager.cc:1434] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.005s
I20260709 12:09:23.389624 22312 tablet_bootstrap.cc:492] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:23.399097 22312 tablet_bootstrap.cc:654] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.374111 22340 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:23.401669 22364 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.401153 22340 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.402582 22313 tablet_bootstrap.cc:492] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.402190 22364 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.403062 22313 ts_tablet_manager.cc:1403] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 12:09:23.404410 22364 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.405686 22313 raft_consensus.cc:359] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.406349 22313 raft_consensus.cc:385] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.406453 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.406618 22313 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.407454 22197 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
W20260709 12:09:23.407167 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 78225us
I20260709 12:09:23.408391 22313 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.409147 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:23.409337 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:23.409912 22123 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.412150 22313 ts_tablet_manager.cc:1434] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:23.413836 22364 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.414227 22364 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.414537 22364 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.414616 22313 tablet_bootstrap.cc:492] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.421082 22313 tablet_bootstrap.cc:654] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.421782 22317 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.422397 22317 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.423108 22364 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.424764 22317 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.425983 22364 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.427147 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:23.428591 22123 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
W20260709 12:09:23.428728 22163 leader_election.cc:343] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.426259 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.429579 22122 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
W20260709 12:09:23.430795 22088 leader_election.cc:343] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.430840 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.431370 22088 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:23.432535 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:23.432662 22360 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.433189 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:23.433821 22123 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.433938 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.434904 22317 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.435283 22317 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.435644 22317 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.437803 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:23.438751 22364 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:23.439013 22236 leader_election.cc:343] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.439687 22364 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:23.441073 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:23.441932 22197 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.441030 22364 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.441073 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:23.451996 22317 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:23.440052 22236 leader_election.cc:343] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.453931 22236 leader_election.cc:343] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.454604 22313 tablet_bootstrap.cc:492] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.457213 22313 ts_tablet_manager.cc:1403] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.013s
I20260709 12:09:23.457604 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:23.458937 22197 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
W20260709 12:09:23.459586 22163 leader_election.cc:343] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.455097 22317 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.455701 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:23.460173 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:23.460305 22313 raft_consensus.cc:359] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.460654 22122 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.461109 22339 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.461057 22313 raft_consensus.cc:385] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.462101 22313 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.462983 22313 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.469141 22314 tablet_bootstrap.cc:492] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:23.469699 22314 ts_tablet_manager.cc:1403] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.168s	user 0.014s	sys 0.024s
I20260709 12:09:23.473065 22319 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.474694 22123 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:23.475638 22312 tablet_bootstrap.cc:492] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:23.476331 22312 ts_tablet_manager.cc:1403] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.087s	user 0.029s	sys 0.021s
I20260709 12:09:23.478060 22313 ts_tablet_manager.cc:1434] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:09:23.479456 22313 tablet_bootstrap.cc:492] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.483054 22314 raft_consensus.cc:359] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.484138 22314 raft_consensus.cc:385] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.484524 22314 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.485731 22314 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.482151 22339 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:23.488867 22314 ts_tablet_manager.cc:1434] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 12:09:23.489400 22313 tablet_bootstrap.cc:654] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.489861 22314 tablet_bootstrap.cc:492] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:23.492791 22317 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.493367 22317 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.496908 22339 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.493520 22122 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:23.498185 22317 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.499017 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:23.499318 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:23.499989 22319 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.500664 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:23.500888 22317 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.502615 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:09:23.508098 22163 leader_election.cc:343] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.508533 22197 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.508893 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.509697 22123 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:23.510851 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:09:23.511961 22236 leader_election.cc:343] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.515030 22312 raft_consensus.cc:359] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.515729 22312 raft_consensus.cc:385] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.516131 22312 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.518955 22312 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.520874 22314 tablet_bootstrap.cc:654] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.521013 22312 ts_tablet_manager.cc:1434] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 12:09:23.524835 22312 tablet_bootstrap.cc:492] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:23.530254 22373 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.530735 22373 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.531085 22373 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.532687 22312 tablet_bootstrap.cc:654] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.534850 22317 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:23.535813 22317 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.536211 22197 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:23.537551 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:23.538530 22340 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.539336 22340 raft_consensus.cc:697] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:23.537592 22019 catalog_manager.cc:5697] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.540329 22340 consensus_queue.cc:237] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.539527 22373 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.541538 22019 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.548350 22314 tablet_bootstrap.cc:492] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:23.549831 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:23.550331 22313 tablet_bootstrap.cc:492] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.550468 22123 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.550812 22313 ts_tablet_manager.cc:1403] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.008s
I20260709 12:09:23.570451 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:09:23.572368 22163 leader_election.cc:343] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.554499 22372 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.551115 22314 ts_tablet_manager.cc:1403] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.006s
I20260709 12:09:23.573518 22372 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.578318 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:09:23.579780 22162 leader_election.cc:343] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.581807 22372 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.582278 22123 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:23.584297 22313 raft_consensus.cc:359] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.586077 22313 raft_consensus.cc:385] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.586334 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:23.587749 22163 leader_election.cc:343] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.586337 22313 raft_consensus.cc:740] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.588176 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:23.589438 22313 consensus_queue.cc:260] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.589893 22317 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.591207 22312 tablet_bootstrap.cc:492] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:23.591836 22313 ts_tablet_manager.cc:1434] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:09:23.592873 22312 ts_tablet_manager.cc:1403] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.000s
I20260709 12:09:23.592660 22314 raft_consensus.cc:359] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.593153 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:23.593441 22314 raft_consensus.cc:385] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.593716 22314 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.594223 22317 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.594720 22317 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:23.594575 22314 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.596289 22313 tablet_bootstrap.cc:492] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.565541 22373 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.596148 22360 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.595273 22021 catalog_manager.cc:5697] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.597374 22360 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.595655 22312 raft_consensus.cc:359] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.598953 22312 raft_consensus.cc:385] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.595569 22317 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.599434 22312 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.598937 22021 catalog_manager.cc:5697] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.600427 22312 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.602696 22312 ts_tablet_manager.cc:1434] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:09:23.603523 22372 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.603682 22312 tablet_bootstrap.cc:492] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:23.604184 22360 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.604116 22372 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.605713 22360 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.605897 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.606194 22360 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.606968 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:23.607851 22087 leader_election.cc:343] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.608254 22360 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:09:23.608378 22088 leader_election.cc:343] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.610064 22088 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:23.610932 22360 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.611308 22340 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.612314 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:23.613019 22272 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:23.613164 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.615525 22197 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:23.617112 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:23.618141 22019 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.627527 22372 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.635592 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.636198 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:23.636689 22123 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 1: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:23.639384 22313 tablet_bootstrap.cc:654] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.639190 22163 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:23.626892 22360 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.642045 22360 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.642467 22360 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.642567 22317 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.651600 22317 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.656929 22313 tablet_bootstrap.cc:492] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.657785 22312 tablet_bootstrap.cc:654] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.658205 22313 ts_tablet_manager.cc:1403] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.002s
I20260709 12:09:23.656519 22360 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.661455 22313 raft_consensus.cc:359] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.662460 22313 raft_consensus.cc:385] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.662878 22313 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.663733 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:23.664517 22272 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.663784 22313 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.666518 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:23.666930 22313 ts_tablet_manager.cc:1434] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:23.667136 22197 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.668406 22313 tablet_bootstrap.cc:492] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.673084 22324 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.673250 22360 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.673800 22272 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:23.673653 22324 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.675156 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:23.676023 22360 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.676548 22313 tablet_bootstrap.cc:654] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.676844 22360 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:23.678476 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.678532 22360 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:23.683853 22087 leader_election.cc:343] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.685695 22324 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.686368 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:23.687901 22088 leader_election.cc:343] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.688395 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:23.692375 22019 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.693374 22340 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.696956 22357 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.704428 22197 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:23.728593 22314 ts_tablet_manager.cc:1434] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.155s	user 0.020s	sys 0.021s
I20260709 12:09:23.735952 22314 tablet_bootstrap.cc:492] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:23.747331 22312 tablet_bootstrap.cc:492] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:23.747965 22312 ts_tablet_manager.cc:1403] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.144s	user 0.029s	sys 0.025s
I20260709 12:09:23.754107 22312 raft_consensus.cc:359] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.754905 22312 raft_consensus.cc:385] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.755173 22312 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.756011 22312 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.758364 22312 ts_tablet_manager.cc:1434] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:23.759011 22314 tablet_bootstrap.cc:654] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.759379 22312 tablet_bootstrap.cc:492] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:23.760272 22340 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.760747 22340 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.761770 22313 tablet_bootstrap.cc:492] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.762290 22313 ts_tablet_manager.cc:1403] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.053s
I20260709 12:09:23.762933 22340 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.765427 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.766757 22121 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:23.765501 22313 raft_consensus.cc:359] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.767508 22313 raft_consensus.cc:385] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.767907 22313 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.768038 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:23.769106 22340 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.768867 22313 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.769497 22340 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.769974 22340 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.772089 22313 ts_tablet_manager.cc:1434] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:09:23.773402 22313 tablet_bootstrap.cc:492] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.779244 22019 catalog_manager.cc:5697] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.781716 22312 tablet_bootstrap.cc:654] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.781808 22313 tablet_bootstrap.cc:654] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.783272 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:09:23.785377 22236 leader_election.cc:343] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.787621 22314 tablet_bootstrap.cc:492] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:23.788224 22314 ts_tablet_manager.cc:1403] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.015s
I20260709 12:09:23.787735 22340 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.790087 22340 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.791322 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:23.791765 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:23.792382 22121 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.793069 22236 leader_election.cc:343] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.798594 22312 tablet_bootstrap.cc:492] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:23.798496 22314 raft_consensus.cc:359] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.799286 22314 raft_consensus.cc:385] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.799324 22312 ts_tablet_manager.cc:1403] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.002s
I20260709 12:09:23.799914 22314 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.800009 22121 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:23.800812 22314 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.801467 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:23.802536 22340 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.802872 22314 ts_tablet_manager.cc:1434] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:23.803038 22340 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:23.803972 22313 tablet_bootstrap.cc:492] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.803892 22340 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.804492 22313 ts_tablet_manager.cc:1403] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.003s
I20260709 12:09:23.805819 22312 raft_consensus.cc:359] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.806567 22312 raft_consensus.cc:385] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.806763 22314 tablet_bootstrap.cc:492] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:23.806900 22312 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.807775 22313 raft_consensus.cc:359] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.808494 22313 raft_consensus.cc:385] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.807965 22312 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.808806 22313 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
W20260709 12:09:23.811321 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:23.811465 22312 ts_tablet_manager.cc:1434] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:09:23.812229 22382 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.813136 22312 tablet_bootstrap.cc:492] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:23.812754 22382 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.815284 22382 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.816494 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:23.817008 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.817252 22272 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:23.817704 22121 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:23.818638 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:23.819940 22382 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.820410 22312 tablet_bootstrap.cc:654] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.820317 22382 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.820845 22382 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.811564 22313 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.824522 22314 tablet_bootstrap.cc:654] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.830875 22313 ts_tablet_manager.cc:1434] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:09:23.831013 22382 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.832180 22313 tablet_bootstrap.cc:492] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.833992 22312 tablet_bootstrap.cc:492] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:23.834462 22312 ts_tablet_manager.cc:1403] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 12:09:23.834750 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:23.835397 22121 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.837798 22312 raft_consensus.cc:359] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.839043 22312 raft_consensus.cc:385] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.839324 22312 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.840014 22312 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.842192 22312 ts_tablet_manager.cc:1434] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:23.843127 22312 tablet_bootstrap.cc:492] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:23.846897 22382 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.847908 22314 tablet_bootstrap.cc:492] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:23.848413 22314 ts_tablet_manager.cc:1403] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.006s
I20260709 12:09:23.850973 22313 tablet_bootstrap.cc:654] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.851029 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:23.852057 22314 raft_consensus.cc:359] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.852574 22314 raft_consensus.cc:385] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.852818 22314 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.851760 22272 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.853904 22314 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.856362 22314 ts_tablet_manager.cc:1434] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:23.859429 22340 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.860415 22272 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:23.860611 22314 tablet_bootstrap.cc:492] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:23.861943 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:23.862804 22382 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.862104 22021 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.863507 22382 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:23.861052 22340 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.865039 22382 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.866726 22340 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.868742 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.869001 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.869498 22123 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
W20260709 12:09:23.870350 22236 leader_election.cc:343] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.870875 22339 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.871337 22339 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.870369 22340 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.874369 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:23.874661 22340 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.875787 22319 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.876186 22319 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.876559 22319 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.884189 22339 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.884891 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.885632 22123 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:23.885954 22340 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.889410 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.890583 22197 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:23.891283 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.891486 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.890530 22236 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:23.888866 22121 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:23.890894 22021 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:23.894361 22236 leader_election.cc:343] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.894999 22360 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.895529 22360 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.893911 22340 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.896489 22340 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.897202 22312 tablet_bootstrap.cc:654] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.897704 22360 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:23.894774 22313 tablet_bootstrap.cc:492] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:23.895015 22123 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:23.898626 22313 ts_tablet_manager.cc:1403] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.067s	user 0.019s	sys 0.014s
I20260709 12:09:23.898219 22340 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.899734 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:23.900620 22198 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:23.901750 22313 raft_consensus.cc:359] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.902041 22087 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:23.902443 22313 raft_consensus.cc:385] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.902710 22313 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.902963 22360 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.903319 22360 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.903681 22360 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.903417 22313 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.905494 22313 ts_tablet_manager.cc:1434] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:23.906395 22313 tablet_bootstrap.cc:492] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:23.898048 22339 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.917146 22340 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.925938 22364 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.927006 22364 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.931713 22364 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.929435 22319 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:23.914852 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:23.933741 22319 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:23.934437 22319 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.936097 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:23.937245 22319 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.937740 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:23.936926 22314 tablet_bootstrap.cc:654] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.945138 22123 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:23.988705 22313 tablet_bootstrap.cc:654] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.940482 22319 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.998275 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:24.009565 22360 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.012681 22360 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.006873 22369 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:09:24.016461 22312 tablet_bootstrap.cc:492] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:24.017170 22312 ts_tablet_manager.cc:1403] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.024s
I20260709 12:09:24.017230 22313 tablet_bootstrap.cc:492] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:24.018630 22313 ts_tablet_manager.cc:1403] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.007s
I20260709 12:09:24.050508 22312 raft_consensus.cc:359] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.051190 22312 raft_consensus.cc:385] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.051446 22312 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.052042 22312 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.053718 22312 ts_tablet_manager.cc:1434] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 12:09:24.054703 22312 tablet_bootstrap.cc:492] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:24.058663 22313 raft_consensus.cc:359] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.059523 22313 raft_consensus.cc:385] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.059809 22313 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.017717 22319 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.060437 22313 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.066855 22319 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:24.068254 22312 tablet_bootstrap.cc:654] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.072183 22313 ts_tablet_manager.cc:1434] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.008s
I20260709 12:09:24.073318 22314 tablet_bootstrap.cc:492] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:24.073318 22313 tablet_bootstrap.cc:492] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:24.073997 22314 ts_tablet_manager.cc:1403] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.214s	user 0.008s	sys 0.026s
I20260709 12:09:24.077330 22314 raft_consensus.cc:359] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.078052 22314 raft_consensus.cc:385] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.078352 22314 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.079006 22314 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.081638 22314 ts_tablet_manager.cc:1434] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:24.082572 22314 tablet_bootstrap.cc:492] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:24.082831 22313 tablet_bootstrap.cc:654] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.091611 22314 tablet_bootstrap.cc:654] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.093303 22312 tablet_bootstrap.cc:492] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:24.093885 22312 ts_tablet_manager.cc:1403] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.008s
I20260709 12:09:24.097576 22312 raft_consensus.cc:359] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.098179 22313 tablet_bootstrap.cc:492] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:24.098320 22312 raft_consensus.cc:385] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.098765 22312 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.098979 22313 ts_tablet_manager.cc:1403] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 12:09:24.099637 22340 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:24.099634 22312 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.099895 22314 tablet_bootstrap.cc:492] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:24.101372 22314 ts_tablet_manager.cc:1403] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.002s
I20260709 12:09:24.102257 22313 raft_consensus.cc:359] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.103016 22313 raft_consensus.cc:385] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.103343 22313 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.103585 22312 ts_tablet_manager.cc:1434] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:24.104094 22313 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.105013 22314 raft_consensus.cc:359] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.106319 22314 raft_consensus.cc:385] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.106501 22313 ts_tablet_manager.cc:1434] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:24.106611 22314 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.107971 22313 tablet_bootstrap.cc:492] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:24.107796 22314 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.104569 22312 tablet_bootstrap.cc:492] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:24.110139 22314 ts_tablet_manager.cc:1434] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:09:24.111135 22314 tablet_bootstrap.cc:492] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:24.116947 22313 tablet_bootstrap.cc:654] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.117174 22312 tablet_bootstrap.cc:654] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.118067 22314 tablet_bootstrap.cc:654] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.131948 22314 tablet_bootstrap.cc:492] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:24.132516 22314 ts_tablet_manager.cc:1403] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.012s
I20260709 12:09:24.135882 22314 raft_consensus.cc:359] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.136735 22314 raft_consensus.cc:385] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.137106 22314 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.137842 22314 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.140257 22314 ts_tablet_manager.cc:1434] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:24.140638 22360 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.141287 22314 tablet_bootstrap.cc:492] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:24.141120 22360 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.143054 22360 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.148176 22314 tablet_bootstrap.cc:654] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.160024 22314 tablet_bootstrap.cc:492] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:24.160575 22314 ts_tablet_manager.cc:1403] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 12:09:24.163422 22314 raft_consensus.cc:359] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.164268 22314 raft_consensus.cc:385] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.164614 22314 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.165094 22312 tablet_bootstrap.cc:492] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:24.165063 22313 tablet_bootstrap.cc:492] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:24.165349 22314 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.165886 22313 ts_tablet_manager.cc:1403] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.058s	user 0.031s	sys 0.023s
I20260709 12:09:24.165886 22312 ts_tablet_manager.cc:1403] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.029s
I20260709 12:09:24.168651 22314 ts_tablet_manager.cc:1434] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:09:24.171195 22313 raft_consensus.cc:359] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.171319 22312 raft_consensus.cc:359] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.172248 22313 raft_consensus.cc:385] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.172364 22312 raft_consensus.cc:385] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.172705 22314 tablet_bootstrap.cc:492] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:24.172657 22313 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.173835 22313 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.172709 22312 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.176699 22313 ts_tablet_manager.cc:1434] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:24.177771 22313 tablet_bootstrap.cc:492] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:24.177582 22312 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.179072 22314 tablet_bootstrap.cc:654] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.181063 22312 ts_tablet_manager.cc:1434] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:09:24.182283 22312 tablet_bootstrap.cc:492] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:24.185110 22313 tablet_bootstrap.cc:654] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.189055 22312 tablet_bootstrap.cc:654] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.190586 22314 tablet_bootstrap.cc:492] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:24.191126 22314 ts_tablet_manager.cc:1403] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:09:24.193152 22324 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.193696 22324 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.196062 22324 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.198510 22271 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.205272 22312 tablet_bootstrap.cc:492] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:24.205404 22313 tablet_bootstrap.cc:492] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:24.205926 22312 ts_tablet_manager.cc:1403] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:09:24.205960 22313 ts_tablet_manager.cc:1403] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.001s
W20260709 12:09:24.209527 22236 leader_election.cc:343] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.211325 22314 raft_consensus.cc:359] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.212191 22314 raft_consensus.cc:385] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.212500 22314 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.213307 22314 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.213410 22382 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.215656 22314 ts_tablet_manager.cc:1434] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:09:24.216831 22314 tablet_bootstrap.cc:492] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:24.218344 22313 raft_consensus.cc:359] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.219091 22313 raft_consensus.cc:385] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.219381 22313 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.219995 22313 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.221477 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:24.222139 22313 ts_tablet_manager.cc:1434] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:24.223114 22312 raft_consensus.cc:359] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.223815 22312 raft_consensus.cc:385] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.224112 22312 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.224432 22314 tablet_bootstrap.cc:654] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.224714 22312 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.225740 22340 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.226415 22340 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.229002 22317 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.229890 22314 tablet_bootstrap.cc:492] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:24.230410 22314 ts_tablet_manager.cc:1403] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:09:24.230477 22312 ts_tablet_manager.cc:1434] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:09:24.231791 22312 tablet_bootstrap.cc:492] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:24.233604 22314 raft_consensus.cc:359] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.234313 22314 raft_consensus.cc:385] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.234664 22314 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.235518 22314 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.238103 22314 ts_tablet_manager.cc:1434] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:09:24.239085 22314 tablet_bootstrap.cc:492] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:24.239766 22312 tablet_bootstrap.cc:654] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.253507 22317 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.257714 22340 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:09:24.243049 22236 leader_election.cc:343] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.277107 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:24.278013 22193 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.285308 22272 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.301640 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:24.303231 22270 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.309973 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:24.319618 22088 leader_election.cc:343] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.320175 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:24.320993 22268 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:24.325197 22270 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:24.327656 22360 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:24.349802 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 90905.8us
I20260709 12:09:24.350158 22360 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.351297 22319 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.352494 22360 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.353310 22360 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.354635 22313 tablet_bootstrap.cc:492] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:24.354790 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:24.355019 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:24.355590 22194 raft_consensus.cc:2393] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 1: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:24.355724 22197 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:24.356655 22360 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.357463 22360 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.359563 22319 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.360117 22319 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.360438 22360 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.340346 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:24.362419 22319 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:24.362587 22324 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.362790 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:24.362967 22324 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.363195 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:24.363476 22121 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.363520 22324 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.367262 22197 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.372041 22121 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:24.374198 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:24.374848 22123 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.377089 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:24.377998 22192 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.378417 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:24.379141 22194 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:24.340407 22416 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:24.343567 22314 tablet_bootstrap.cc:654] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.398356 22123 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:24.401727 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:24.402495 22122 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.001581 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:24.404861 22121 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.409479 22324 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.414639 22314 tablet_bootstrap.cc:492] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:24.415326 22314 ts_tablet_manager.cc:1403] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.007s
I20260709 12:09:24.419025 22314 raft_consensus.cc:359] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.443472 22314 raft_consensus.cc:385] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.424665 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:24.415328 22324 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.424830 22122 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:24.444056 22314 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.449862 22313 tablet_bootstrap.cc:654] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.460269 22312 tablet_bootstrap.cc:492] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:24.454362 22193 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:24.460930 22312 ts_tablet_manager.cc:1403] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.229s	user 0.031s	sys 0.007s
I20260709 12:09:24.462848 22314 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.456871 22123 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.491832 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:24.492954 22118 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:24.502421 22382 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.503232 22382 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.506618 22382 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.508966 22314 ts_tablet_manager.cc:1434] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.001s
I20260709 12:09:24.510424 22314 tablet_bootstrap.cc:492] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
W20260709 12:09:24.513895 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 172528us
I20260709 12:09:24.513432 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:24.513187 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:24.549654 22382 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.557562 22340 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:24.569438 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 66122.7us
I20260709 12:09:24.576921 22419 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.577517 22419 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.577708 22236 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:24.579412 22419 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.579613 22369 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.580466 22369 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:24.567902 22324 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:24.563570 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51445.8us
I20260709 12:09:24.561118 22382 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.583813 22340 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:24.595832 22192 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:24.595711 22340 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.583446 22364 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:09:24.587445 22324 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:24.590524 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:24.604274 22312 raft_consensus.cc:359] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.605051 22313 tablet_bootstrap.cc:492] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:24.605101 22312 raft_consensus.cc:385] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.605847 22312 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.605999 22313 ts_tablet_manager.cc:1403] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.252s	user 0.015s	sys 0.025s
I20260709 12:09:24.589792 22422 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.611598 22424 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.612143 22424 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.612655 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:24.614573 22422 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.615089 22424 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.615260 22382 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.616698 22324 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:24.616994 22163 leader_election.cc:343] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.617219 22422 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.618494 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:24.619474 22312 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.620893 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:24.623139 22314 tablet_bootstrap.cc:654] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.622795 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:24.624024 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:24.627907 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:24.626801 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:24.629766 22272 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.599916 22369 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.607329 22416 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:09:24.634243 22339 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.642364 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:24.643986 22312 ts_tablet_manager.cc:1434] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.161s	user 0.007s	sys 0.002s
I20260709 12:09:24.644618 22319 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.645795 22319 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:24.646790 22319 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.654084 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:24.657830 22364 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.660624 22364 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:24.660801 22163 leader_election.cc:343] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.661129 22364 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.661561 22163 leader_election.cc:343] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.662189 22163 leader_election.cc:343] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.672835 22369 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:24.676471 22313 raft_consensus.cc:359] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.677215 22313 raft_consensus.cc:385] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.677474 22313 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.678424 22313 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.677419 22312 tablet_bootstrap.cc:492] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:24.686650 22314 tablet_bootstrap.cc:492] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:24.687394 22313 ts_tablet_manager.cc:1434] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 12:09:24.687896 22314 ts_tablet_manager.cc:1403] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.178s	user 0.015s	sys 0.009s
I20260709 12:09:24.689765 22313 tablet_bootstrap.cc:492] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:24.701041 22339 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:24.705766 22312 tablet_bootstrap.cc:654] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.683708 22369 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 12:09:24.709381 22088 leader_election.cc:343] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.712709 22088 leader_election.cc:343] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.717710 22313 tablet_bootstrap.cc:654] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.719683 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 339583us
I20260709 12:09:24.725608 22364 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.726184 22087 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:24.728672 22419 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.732606 22364 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:24.746786 22314 raft_consensus.cc:359] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.747900 22314 raft_consensus.cc:385] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.748206 22314 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.748982 22314 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.762727 22019 catalog_manager.cc:5697] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.771199 22314 ts_tablet_manager.cc:1434] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.003s
I20260709 12:09:24.772244 22314 tablet_bootstrap.cc:492] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:24.748374 22364 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.770933 22419 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:24.776491 22434 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:09:24.786158 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:24.791003 22122 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:24.786831 22313 tablet_bootstrap.cc:492] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:24.789819 22236 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:24.794744 22369 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:24.796624 22369 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.780033 22419 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.797847 22313 ts_tablet_manager.cc:1403] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.108s	user 0.010s	sys 0.009s
I20260709 12:09:24.796496 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:24.799365 22419 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.799984 22319 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.800931 22319 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.802490 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:24.803297 22119 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.805124 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:24.805846 22117 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:24.809019 22272 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:24.810490 22313 raft_consensus.cc:359] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.816668 22313 raft_consensus.cc:385] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.817055 22313 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.817818 22313 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:24.818212 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:24.780251 22364 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.823029 22422 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.823593 22422 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.824277 22364 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:24.825778 22422 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.835779 22313 ts_tablet_manager.cc:1434] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:09:24.837222 22313 tablet_bootstrap.cc:492] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:24.826696 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:24.851080 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:24.852605 22419 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.854929 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:24.853206 22419 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:24.856475 22419 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.862303 22422 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.862882 22422 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.864903 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:24.865017 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:24.867237 22426 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.872442 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:24.868281 22426 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.873840 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:09:24.874284 22088 leader_election.cc:343] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.875450 22426 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.876900 22422 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:24.871470 22118 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:24.879171 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:24.879688 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:24.883347 22440 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:09:24.885883 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:24.886615 22195 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:24.887972 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:24.888568 22195 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.892305 22236 leader_election.cc:343] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.890667 22119 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:24.936687 22312 tablet_bootstrap.cc:492] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:24.937278 22312 ts_tablet_manager.cc:1403] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.260s	user 0.018s	sys 0.006s
I20260709 12:09:24.941025 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:24.942828 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:24.943751 22197 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:24.945317 22369 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.945992 22369 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:24.947185 22369 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:24.949012 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:24.950353 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:24.950675 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:24.950785 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:24.951331 22197 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:24.951952 22119 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 1: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:24.952116 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:24.953210 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:24.953655 22324 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.965523 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:24.965869 22360 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.966208 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:09:24.966630 22448 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:09:24.973860 22314 tablet_bootstrap.cc:654] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.966269 22192 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.966243 22360 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.968163 22420 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:24.977092 22360 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.978322 22313 tablet_bootstrap.cc:654] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.974483 22419 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.977038 22117 raft_consensus.cc:2393] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 1: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:24.987041 22419 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.987766 22419 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.004910 22360 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.015867 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:25.018262 22422 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:25.007804 22195 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:25.030815 22192 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:25.033519 22312 raft_consensus.cc:359] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.035073 22312 raft_consensus.cc:385] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.035372 22312 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.037003 22312 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.042253 22360 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:25.038668 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:25.045778 22422 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.046273 22422 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.046648 22422 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.048273 22364 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.049058 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:09:25.051069 22088 leader_election.cc:343] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.053915 22312 ts_tablet_manager.cc:1434] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.116s	user 0.011s	sys 0.011s
I20260709 12:09:25.055088 22312 tablet_bootstrap.cc:492] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:25.058388 22419 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.056727 22422 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.061877 22422 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:25.049234 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:25.066812 22422 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.066679 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:25.067257 22422 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.067596 22422 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:25.138041 22459 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:09:25.152557 22420 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.153309 22420 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.167303 22314 tablet_bootstrap.cc:492] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:25.167217 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:25.167729 22313 tablet_bootstrap.cc:492] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:25.167862 22314 ts_tablet_manager.cc:1403] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.396s	user 0.024s	sys 0.008s
I20260709 12:09:25.168198 22313 ts_tablet_manager.cc:1403] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.331s	user 0.014s	sys 0.028s
I20260709 12:09:25.170962 22314 raft_consensus.cc:359] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.171649 22314 raft_consensus.cc:385] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.171905 22314 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.172550 22314 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.173051 22422 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.173856 22419 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:25.174959 22314 ts_tablet_manager.cc:1434] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:09:25.175163 22422 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:25.175989 22314 tablet_bootstrap.cc:492] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:25.182969 22420 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:25.183053 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:25.183259 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:25.185124 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 136442us
W20260709 12:09:25.186398 22162 leader_election.cc:343] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.188937 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:25.190569 22426 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.191969 22162 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:25.199816 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:25.200045 22313 raft_consensus.cc:359] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.200826 22426 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.200940 22422 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.201467 22422 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.201419 22162 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:25.202037 22422 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.200806 22313 raft_consensus.cc:385] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.193560 22312 tablet_bootstrap.cc:654] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:25.180408 22163 leader_election.cc:343] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.205197 22313 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.188753 22314 tablet_bootstrap.cc:654] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.210100 22416 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:25.211735 22163 leader_election.cc:343] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.215868 22426 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:25.229060 22088 leader_election.cc:343] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:25.230008 22088 leader_election.cc:343] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.230172 22162 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:25.231428 22382 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.242450 22340 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.243758 22339 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.236044 22021 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.250120 22021 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.256973 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:25.258467 22360 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.258975 22360 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.259323 22360 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:25.259778 22236 leader_election.cc:343] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.260288 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:25.261090 22340 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.265960 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:25.266816 22118 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 1: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:09:25.267736 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:25.268568 22191 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:25.270087 22313 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:25.278368 22293 debug-util.cc:398] Leaking SignalData structure 0x7b0800166ac0 after lost signal to thread 20894
I20260709 12:09:25.271555 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:09:25.279549 22293 debug-util.cc:398] Leaking SignalData structure 0x7b0800198fa0 after lost signal to thread 22055
I20260709 12:09:25.279893 22193 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:25.281437 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:25.282235 22123 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 1: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:09:25.221968 22422 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.286723 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:25.289529 22419 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.292294 22419 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.292740 22419 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.294795 22419 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:25.298343 22313 ts_tablet_manager.cc:1434] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.130s	user 0.009s	sys 0.000s
I20260709 12:09:25.299690 22313 tablet_bootstrap.cc:492] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
W20260709 12:09:25.295557 22293 debug-util.cc:398] Leaking SignalData structure 0x7b0800098d80 after lost signal to thread 22147
W20260709 12:09:25.302209 22293 debug-util.cc:398] Leaking SignalData structure 0x7b08000fc3a0 after lost signal to thread 22222
W20260709 12:09:25.303215 22293 debug-util.cc:398] Leaking SignalData structure 0x7b0800102ce0 after lost signal to thread 22296
I20260709 12:09:25.305962 22312 tablet_bootstrap.cc:492] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:25.306448 22312 ts_tablet_manager.cc:1403] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.252s	user 0.043s	sys 0.053s
I20260709 12:09:25.277598 22382 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.311599 22019 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.320242 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:25.320878 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:25.322322 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:25.322881 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:09:25.323468 22087 leader_election.cc:343] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.323737 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:25.323046 22422 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:25.323935 22087 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:25.324981 22420 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.331184 22312 raft_consensus.cc:359] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.333168 22312 raft_consensus.cc:385] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.334054 22312 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.327461 22416 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.325279 22419 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.339704 22312 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.332911 22324 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:25.343429 22163 leader_election.cc:343] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.350024 22324 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.354650 22340 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:25.358529 22340 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.375916 22314 tablet_bootstrap.cc:492] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:25.376655 22314 ts_tablet_manager.cc:1403] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.201s	user 0.012s	sys 0.010s
I20260709 12:09:25.391806 22312 ts_tablet_manager.cc:1434] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.085s	user 0.011s	sys 0.000s
I20260709 12:09:25.396426 22312 tablet_bootstrap.cc:492] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:25.364838 22360 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.438283 22360 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:25.486582 22314 raft_consensus.cc:359] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.487644 22314 raft_consensus.cc:385] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.487977 22314 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
W20260709 12:09:25.492111 22467 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.122s	user 0.002s	sys 0.004s
I20260709 12:09:25.495122 22369 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.500411 22369 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.507089 22314 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.511473 22314 ts_tablet_manager.cc:1434] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.134s	user 0.009s	sys 0.000s
I20260709 12:09:25.513919 22314 tablet_bootstrap.cc:492] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
W20260709 12:09:25.516197 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 192084us
I20260709 12:09:25.528749 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:25.529651 22382 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.530642 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:25.531371 22191 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
W20260709 12:09:25.526614 22088 leader_election.cc:343] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.525667 22364 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.536759 22364 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.538642 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:25.539709 22197 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:25.539897 22364 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:25.541779 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:25.542847 22122 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 1: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:09:25.544181 22313 tablet_bootstrap.cc:654] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.545003 22364 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:09:25.565795 22369 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:25.572220 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:25.574618 22472 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.583304 22473 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.583851 22473 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.575253 22472 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.585455 22473 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.596987 22472 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:25.597405 22312 tablet_bootstrap.cc:654] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.631548 22020 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:25.638221 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 71693.9us
I20260709 12:09:25.639760 22020 catalog_manager.cc:5697] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.664512 22476 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.666141 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:25.654320 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:25.669674 22192 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:25.670300 22480 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.672319 22480 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.673985 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:09:25.674675 22163 leader_election.cc:343] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.675117 22198 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:25.685698 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:25.691443 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:25.692149 22123 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:25.710322 22312 tablet_bootstrap.cc:492] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:25.711311 22312 ts_tablet_manager.cc:1403] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.315s	user 0.027s	sys 0.006s
I20260709 12:09:25.710616 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:25.713795 22313 tablet_bootstrap.cc:492] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:25.721921 22313 ts_tablet_manager.cc:1403] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.422s	user 0.029s	sys 0.009s
I20260709 12:09:25.721958 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:25.717494 22369 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.727730 22314 tablet_bootstrap.cc:654] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.729741 22480 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:25.740262 22312 raft_consensus.cc:359] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.743482 22312 raft_consensus.cc:385] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.743861 22312 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.744350 22162 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:25.744835 22312 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.746701 22472 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.748585 22313 raft_consensus.cc:359] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.749817 22313 raft_consensus.cc:385] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.750130 22313 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.751520 22312 ts_tablet_manager.cc:1434] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 12:09:25.752656 22313 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:25.774005 22162 leader_election.cc:343] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.774626 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:25.775663 22472 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.781903 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:25.783468 22369 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.784054 22369 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.784487 22369 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.798334 22313 ts_tablet_manager.cc:1434] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.000s
I20260709 12:09:25.800849 22473 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.803117 22121 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:09:25.812505 22313 tablet_bootstrap.cc:492] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:25.827397 22312 tablet_bootstrap.cc:492] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:25.828639 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:25.829520 22195 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:25.842104 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:25.843302 22476 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.843703 22476 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.844061 22476 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:25.893993 22088 leader_election.cc:343] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.894688 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:25.906088 22324 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:25.908434 22419 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.944762 22476 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.947222 22476 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:09:25.949541 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 149033us
I20260709 12:09:25.962865 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:25.965296 22314 tablet_bootstrap.cc:492] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:25.966089 22314 ts_tablet_manager.cc:1403] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.452s	user 0.045s	sys 0.025s
I20260709 12:09:25.956139 22473 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:25.969623 22319 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.970239 22319 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.970818 22319 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:25.973402 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:25.976842 22314 raft_consensus.cc:359] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.977646 22314 raft_consensus.cc:385] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.977926 22314 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.978691 22314 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.953531 22369 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:25.981137 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:25.981951 22195 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.986675 22340 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.992056 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:25.994575 22314 ts_tablet_manager.cc:1434] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:09:25.995126 22192 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.001003 22314 tablet_bootstrap.cc:492] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:26.034284 22369 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:26.034735 22312 tablet_bootstrap.cc:654] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.040633 22313 tablet_bootstrap.cc:654] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.042306 22319 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.051136 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:26.053375 22269 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 1: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:26.056479 22319 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:26.059819 22195 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:26.061414 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:26.062383 22419 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.062906 22419 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:26.063884 22419 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.072319 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:26.073501 22272 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 1: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:26.081079 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:26.084374 22267 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 1: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:26.095379 22314 tablet_bootstrap.cc:654] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.100651 22192 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:26.109825 22312 tablet_bootstrap.cc:492] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:26.110489 22312 ts_tablet_manager.cc:1403] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.284s	user 0.018s	sys 0.014s
I20260709 12:09:26.113715 22312 raft_consensus.cc:359] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.114401 22312 raft_consensus.cc:385] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.114686 22312 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.115404 22312 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.121387 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:26.122179 22319 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.122834 22319 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.123230 22312 ts_tablet_manager.cc:1434] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:09:26.124711 22312 tablet_bootstrap.cc:492] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:26.127909 22319 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:26.129856 22419 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.131018 22419 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:26.132004 22419 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.140892 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:26.147145 22312 tablet_bootstrap.cc:654] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.149923 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:26.150873 22192 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:09:26.153541 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:26.153541 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:26.155471 22192 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:09:26.162578 22476 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.163205 22476 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.166710 22476 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:26.167140 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:09:26.169113 22087 leader_election.cc:343] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.174748 22313 tablet_bootstrap.cc:492] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:26.175366 22313 ts_tablet_manager.cc:1403] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.363s	user 0.019s	sys 0.008s
I20260709 12:09:26.179296 22313 raft_consensus.cc:359] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.181488 22313 raft_consensus.cc:385] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.181743 22313 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.184742 22312 tablet_bootstrap.cc:492] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:26.185315 22312 ts_tablet_manager.cc:1403] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.008s
I20260709 12:09:26.188745 22312 raft_consensus.cc:359] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.193149 22312 raft_consensus.cc:385] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.193444 22312 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.194082 22312 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.195925 22312 ts_tablet_manager.cc:1434] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.002s
I20260709 12:09:26.196861 22312 tablet_bootstrap.cc:492] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:26.197572 22313 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.205101 22312 tablet_bootstrap.cc:654] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.225071 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:26.229071 22313 ts_tablet_manager.cc:1434] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.006s
I20260709 12:09:26.230295 22313 tablet_bootstrap.cc:492] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:26.237972 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:26.239941 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:26.242322 22319 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.242967 22195 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:26.243605 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:26.244341 22319 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:09:26.239701 22088 leader_election.cc:343] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.257452 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:26.258599 22324 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.261205 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.262436 22121 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:09:26.264410 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:26.265364 22319 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.279224 22319 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.286944 22313 tablet_bootstrap.cc:654] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.290756 22314 tablet_bootstrap.cc:492] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:26.293256 22314 ts_tablet_manager.cc:1403] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.293s	user 0.032s	sys 0.049s
I20260709 12:09:26.294400 22312 tablet_bootstrap.cc:492] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:26.295037 22312 ts_tablet_manager.cc:1403] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.018s
I20260709 12:09:26.296103 22314 raft_consensus.cc:359] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.296702 22314 raft_consensus.cc:385] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.297009 22314 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.297695 22314 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.298339 22021 catalog_manager.cc:5697] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.299872 22314 ts_tablet_manager.cc:1434] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:26.300976 22314 tablet_bootstrap.cc:492] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:26.300241 22021 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.309365 22314 tablet_bootstrap.cc:654] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.311832 22312 raft_consensus.cc:359] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.312933 22312 raft_consensus.cc:385] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.313274 22312 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.314337 22312 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.322335 22314 tablet_bootstrap.cc:492] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:26.322827 22314 ts_tablet_manager.cc:1403] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 12:09:26.322890 22312 ts_tablet_manager.cc:1434] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 12:09:26.323939 22312 tablet_bootstrap.cc:492] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:26.325757 22314 raft_consensus.cc:359] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.326432 22314 raft_consensus.cc:385] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.326737 22314 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.327555 22314 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.333763 22314 ts_tablet_manager.cc:1434] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:09:26.334919 22314 tablet_bootstrap.cc:492] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:26.338428 22312 tablet_bootstrap.cc:654] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.354574 22313 tablet_bootstrap.cc:492] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:26.355096 22313 ts_tablet_manager.cc:1403] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.125s	user 0.001s	sys 0.043s
I20260709 12:09:26.358469 22314 tablet_bootstrap.cc:654] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.358191 22313 raft_consensus.cc:359] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.358870 22313 raft_consensus.cc:385] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.359158 22313 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.361325 22312 tablet_bootstrap.cc:492] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:26.361600 22340 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.361802 22312 ts_tablet_manager.cc:1403] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.000s
I20260709 12:09:26.362286 22340 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.365646 22312 raft_consensus.cc:359] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.366602 22312 raft_consensus.cc:385] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.366515 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.367163 22312 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
W20260709 12:09:26.368685 22236 leader_election.cc:343] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.368472 22313 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.369990 22340 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:26.370386 22314 tablet_bootstrap.cc:492] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:26.370914 22313 ts_tablet_manager.cc:1434] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:09:26.372646 22314 ts_tablet_manager.cc:1403] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.014s
I20260709 12:09:26.373265 22313 tablet_bootstrap.cc:492] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:26.375283 22314 raft_consensus.cc:359] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.375954 22314 raft_consensus.cc:385] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.376230 22314 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.368039 22312 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.371744 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:26.376981 22314 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.378252 22312 ts_tablet_manager.cc:1434] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
W20260709 12:09:26.378207 22236 leader_election.cc:343] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.378955 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:26.380026 22314 ts_tablet_manager.cc:1434] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:09:26.381119 22314 tablet_bootstrap.cc:492] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:26.381577 22340 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.384799 22313 tablet_bootstrap.cc:654] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.386900 22314 tablet_bootstrap.cc:654] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.393247 22426 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.393745 22426 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.393736 22313 tablet_bootstrap.cc:492] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:26.396281 22426 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:26.396835 22313 ts_tablet_manager.cc:1403] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.002s
I20260709 12:09:26.396857 22426 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.398904 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:26.398481 22426 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.399989 22269 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:26.400947 22313 raft_consensus.cc:359] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.401676 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.402484 22123 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:26.403354 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.404229 22121 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:26.406009 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:26.407081 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:26.401755 22313 raft_consensus.cc:385] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.407714 22313 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.408210 22382 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.408666 22382 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.408586 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:26.409472 22382 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.409335 22313 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.409996 22426 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:26.410615 22426 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.411051 22426 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.411424 22426 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.413657 22313 ts_tablet_manager.cc:1434] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:09:26.416641 22313 tablet_bootstrap.cc:492] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:26.423182 22426 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.426669 22314 tablet_bootstrap.cc:492] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:26.427146 22314 ts_tablet_manager.cc:1403] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.006s
I20260709 12:09:26.428294 22312 tablet_bootstrap.cc:492] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:26.430033 22314 raft_consensus.cc:359] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.430693 22314 raft_consensus.cc:385] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.430958 22314 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.432658 22314 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:26.433741 22163 leader_election.cc:343] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.434723 22314 ts_tablet_manager.cc:1434] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:26.435408 22313 tablet_bootstrap.cc:654] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.435741 22314 tablet_bootstrap.cc:492] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:26.441383 22312 tablet_bootstrap.cc:654] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.450943 22426 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:26.453867 22369 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.459122 22369 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.463367 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:26.464184 22121 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.471623 22369 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:26.472312 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:09:26.477068 22236 leader_election.cc:343] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.477774 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:09:26.479995 22236 leader_election.cc:343] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.480763 22314 tablet_bootstrap.cc:654] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.480677 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:26.483574 22319 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.482352 22426 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.497640 22313 tablet_bootstrap.cc:492] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:26.500100 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:26.504947 22319 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.507296 22313 ts_tablet_manager.cc:1403] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.091s	user 0.026s	sys 0.015s
I20260709 12:09:26.507155 22319 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.509482 22319 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:09:26.510025 22163 leader_election.cc:343] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.510627 22313 raft_consensus.cc:359] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.511368 22313 raft_consensus.cc:385] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.511996 22313 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.511373 22426 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.512523 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:26.513391 22192 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:26.511185 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.514113 22312 tablet_bootstrap.cc:492] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:26.514281 22123 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:09:26.514638 22312 ts_tablet_manager.cc:1403] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.087s	user 0.019s	sys 0.007s
I20260709 12:09:26.512957 22313 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.515481 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:26.516358 22319 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.520308 22121 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:26.521416 22426 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:26.511360 22382 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.523082 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.523573 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:26.523769 22123 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:26.525182 22162 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:26.525722 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:26.526060 22511 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.526346 22123 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.526489 22511 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.528199 22313 ts_tablet_manager.cc:1434] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:09:26.527680 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:26.528584 22382 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:09:26.528244 22163 leader_election.cc:343] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.529561 22313 tablet_bootstrap.cc:492] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:26.530990 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:26.531651 22269 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.538803 22426 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.532886 22511 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.539880 22382 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.541059 22426 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.544240 22426 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:26.545676 22382 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:26.546676 22382 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.549431 22419 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.551009 22312 raft_consensus.cc:359] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.552603 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.553399 22118 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:26.553743 22314 tablet_bootstrap.cc:492] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:26.552953 22419 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.554246 22314 ts_tablet_manager.cc:1403] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.119s	user 0.005s	sys 0.008s
I20260709 12:09:26.551677 22312 raft_consensus.cc:385] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.555788 22162 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:26.555567 22312 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.559906 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:26.558715 22312 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.560525 22314 raft_consensus.cc:359] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.561359 22314 raft_consensus.cc:385] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.561702 22314 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
W20260709 12:09:26.561877 22163 leader_election.cc:343] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.562217 22312 ts_tablet_manager.cc:1434] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:09:26.562579 22314 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.563391 22312 tablet_bootstrap.cc:492] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:26.564601 22426 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.565102 22314 ts_tablet_manager.cc:1434] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:09:26.565155 22426 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.567296 22426 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.569708 22314 tablet_bootstrap.cc:492] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:26.583405 22369 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.584156 22369 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.591210 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.591957 22118 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:26.593730 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:26.596240 22364 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.596625 22364 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.597009 22364 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.598460 22511 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.596275 22369 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:26.606227 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:09:26.607925 22163 leader_election.cc:343] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.608443 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:26.609143 22118 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.609459 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:26.593673 22426 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.610152 22194 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:26.603240 22511 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:26.628566 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:26.629220 22121 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.630640 22021 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.632010 22269 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:26.634564 22313 tablet_bootstrap.cc:654] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.639221 22312 tablet_bootstrap.cc:654] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.642690 22319 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.643980 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:26.644979 22511 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.645115 22123 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:26.645498 22511 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:26.646359 22511 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.650218 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:26.658586 22473 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.658859 22364 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.659173 22473 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.660194 22324 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.661561 22473 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:09:26.663285 22163 leader_election.cc:343] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.667616 22118 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:26.668720 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:26.669701 22162 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:26.670632 22382 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.671144 22382 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:09:26.671273 22088 leader_election.cc:343] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.672091 22382 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.687549 22313 tablet_bootstrap.cc:492] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:26.688122 22313 ts_tablet_manager.cc:1403] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.159s	user 0.014s	sys 0.010s
I20260709 12:09:26.690610 22313 raft_consensus.cc:359] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.691130 22313 raft_consensus.cc:385] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.691356 22313 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.691980 22313 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.693595 22314 tablet_bootstrap.cc:654] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.644984 22426 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:26.701805 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:26.702189 22313 ts_tablet_manager.cc:1434] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:26.703402 22313 tablet_bootstrap.cc:492] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
W20260709 12:09:26.704087 22087 leader_election.cc:343] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.704667 22087 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:26.705469 22324 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.706919 22324 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.709731 22313 tablet_bootstrap.cc:654] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.654590 22121 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:26.716763 22364 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:26.717705 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:26.719964 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:26.750212 22123 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.739593 22312 tablet_bootstrap.cc:492] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:26.751650 22312 ts_tablet_manager.cc:1403] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.010s
I20260709 12:09:26.750349 22195 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.753612 22426 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.753782 22162 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:26.734808 22021 catalog_manager.cc:5697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.754150 22426 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.756001 22511 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.756330 22426 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:26.757304 22312 raft_consensus.cc:359] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.758006 22312 raft_consensus.cc:385] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.758270 22312 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.758194 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:26.758863 22272 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:26.759140 22312 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.759812 22313 tablet_bootstrap.cc:492] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:26.760281 22313 ts_tablet_manager.cc:1403] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.002s
I20260709 12:09:26.760725 22312 ts_tablet_manager.cc:1434] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.005s
I20260709 12:09:26.763288 22313 raft_consensus.cc:359] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.763990 22313 raft_consensus.cc:385] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.763834 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:26.764320 22313 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.764864 22382 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.765247 22382 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.765174 22313 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.765798 22382 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.756672 22511 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:26.766933 22511 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.774639 22382 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.776077 22313 ts_tablet_manager.cc:1434] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 12:09:26.777678 22314 tablet_bootstrap.cc:492] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:26.779263 22314 ts_tablet_manager.cc:1403] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.210s	user 0.008s	sys 0.005s
I20260709 12:09:26.779729 22313 tablet_bootstrap.cc:492] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:26.780573 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.782824 22312 tablet_bootstrap.cc:492] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:26.782671 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:26.783391 22272 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.783277 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:26.787307 22314 raft_consensus.cc:359] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.788062 22314 raft_consensus.cc:385] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.788367 22314 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.789120 22314 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:26.790364 22162 leader_election.cc:343] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:26.791400 22162 leader_election.cc:343] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.788076 22313 tablet_bootstrap.cc:654] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.794063 22272 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:26.781437 22382 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:26.796614 22314 ts_tablet_manager.cc:1434] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:26.801865 22195 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:26.803365 22314 tablet_bootstrap.cc:492] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:26.803844 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:26.803864 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:26.805920 22382 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.806457 22382 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:26.807341 22382 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.809126 22319 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.809712 22319 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:26.810607 22319 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.811564 22314 tablet_bootstrap.cc:654] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.799064 22123 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:26.819444 22455 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.820008 22455 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.822244 22455 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:26.824671 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.825628 22121 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:09:26.830330 22021 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.831175 22314 tablet_bootstrap.cc:492] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:26.831827 22314 ts_tablet_manager.cc:1403] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.003s
I20260709 12:09:26.832235 22021 catalog_manager.cc:5697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.834895 22314 raft_consensus.cc:359] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.835642 22314 raft_consensus.cc:385] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.835970 22314 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.836349 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:26.837164 22198 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:26.836723 22314 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.838654 22314 ts_tablet_manager.cc:1434] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:26.839422 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:26.839730 22314 tablet_bootstrap.cc:492] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:26.841012 22455 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.852375 22364 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.890151 22364 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:26.891465 22526 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:09:26.892336 22364 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:26.919589 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.920511 22121 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:26.925761 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:26.930811 22313 tablet_bootstrap.cc:492] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:26.931200 22313 ts_tablet_manager.cc:1403] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.152s	user 0.035s	sys 0.039s
I20260709 12:09:26.932044 22314 tablet_bootstrap.cc:654] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.933259 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:26.938162 22313 raft_consensus.cc:359] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.938977 22313 raft_consensus.cc:385] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.939237 22313 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.942091 22020 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:26.940217 22313 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.944818 22455 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.945657 22313 ts_tablet_manager.cc:1434] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:26.947000 22313 tablet_bootstrap.cc:492] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:26.936558 22319 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.951467 22312 tablet_bootstrap.cc:654] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.955639 22021 catalog_manager.cc:5697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.958478 22382 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.961421 22382 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.965780 22382 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:26.966428 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:26.967170 22272 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:26.968575 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:26.969630 22382 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:26.970070 22382 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.971069 22382 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:26.973531 22314 tablet_bootstrap.cc:492] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:26.974041 22314 ts_tablet_manager.cc:1403] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.005s
I20260709 12:09:26.975569 22313 tablet_bootstrap.cc:654] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.969930 22319 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.977298 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:26.978533 22123 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:26.992007 22382 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.997095 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:26.998695 22272 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.001070 22312 tablet_bootstrap.cc:492] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:27.001621 22312 ts_tablet_manager.cc:1403] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.220s	user 0.026s	sys 0.012s
I20260709 12:09:27.002940 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:27.003520 22123 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.004875 22312 raft_consensus.cc:359] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.005609 22312 raft_consensus.cc:385] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.005935 22312 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.006742 22312 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.009110 22312 ts_tablet_manager.cc:1434] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:27.010406 22312 tablet_bootstrap.cc:492] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:27.004410 22314 raft_consensus.cc:359] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:26.996165 22382 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.013537 22314 raft_consensus.cc:385] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.013952 22314 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.014609 22314 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.017508 22314 ts_tablet_manager.cc:1434] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 12:09:27.018424 22314 tablet_bootstrap.cc:492] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:27.019006 22123 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:27.031276 22313 tablet_bootstrap.cc:492] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:27.031996 22313 ts_tablet_manager.cc:1403] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.000s
I20260709 12:09:27.037667 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:27.038558 22267 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.031083 22272 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:27.046511 22312 tablet_bootstrap.cc:654] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.038630 22511 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:27.047663 22511 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:27.048530 22511 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.050352 22313 raft_consensus.cc:359] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.051424 22313 raft_consensus.cc:385] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.051740 22313 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.054270 22313 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.058851 22314 tablet_bootstrap.cc:654] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.060916 22426 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.065366 22313 ts_tablet_manager.cc:1434] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:09:27.065469 22426 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.080943 22313 tablet_bootstrap.cc:492] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:27.087572 22312 tablet_bootstrap.cc:492] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:27.088299 22312 ts_tablet_manager.cc:1403] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.005s
I20260709 12:09:27.090893 22473 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.091454 22473 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.092278 22312 raft_consensus.cc:359] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.093297 22312 raft_consensus.cc:385] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.093501 22473 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.093691 22312 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.094691 22312 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:27.096055 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:27.097231 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:27.097934 22272 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:27.097266 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:09:27.102581 22087 leader_election.cc:343] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.103684 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:27.104586 22473 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.105451 22473 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.105810 22473 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.107242 22312 ts_tablet_manager.cc:1434] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:09:27.108448 22312 tablet_bootstrap.cc:492] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:27.115567 22021 catalog_manager.cc:5697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 2, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.116890 22314 tablet_bootstrap.cc:492] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:27.117322 22314 ts_tablet_manager.cc:1403] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.009s
I20260709 12:09:27.118589 22312 tablet_bootstrap.cc:654] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.119457 22313 tablet_bootstrap.cc:654] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.122823 22473 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.129141 22313 tablet_bootstrap.cc:492] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:27.129578 22313 ts_tablet_manager.cc:1403] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.001s
I20260709 12:09:27.132428 22313 raft_consensus.cc:359] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.133095 22313 raft_consensus.cc:385] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.133340 22313 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.134021 22313 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.127430 22314 raft_consensus.cc:359] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.137248 22314 raft_consensus.cc:385] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.137521 22314 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
W20260709 12:09:27.137665 22163 consensus_peers.cc:597] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:27.138254 22314 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.140389 22314 ts_tablet_manager.cc:1434] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.001s
I20260709 12:09:27.141127 22324 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.141513 22314 tablet_bootstrap.cc:492] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:27.141642 22324 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.145236 22419 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.145921 22419 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.148222 22313 ts_tablet_manager.cc:1434] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:27.149998 22314 tablet_bootstrap.cc:654] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.151459 22312 tablet_bootstrap.cc:492] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:27.152042 22312 ts_tablet_manager.cc:1403] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.022s
I20260709 12:09:27.156266 22312 raft_consensus.cc:359] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.157135 22312 raft_consensus.cc:385] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.157429 22312 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.159938 22511 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.158313 22312 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.168531 22312 ts_tablet_manager.cc:1434] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 12:09:27.169795 22312 tablet_bootstrap.cc:492] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:27.169862 22313 tablet_bootstrap.cc:492] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:27.175817 22511 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.176636 22382 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.183593 22314 tablet_bootstrap.cc:492] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:27.183669 22313 tablet_bootstrap.cc:654] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.184242 22314 ts_tablet_manager.cc:1403] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.004s
I20260709 12:09:27.193166 22511 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.207100 22319 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.207885 22319 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.210886 22319 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:27.218017 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:27.218720 22314 raft_consensus.cc:359] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.219641 22314 raft_consensus.cc:385] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.219996 22314 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
W20260709 12:09:27.220383 22236 leader_election.cc:343] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.222888 22314 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.228143 22473 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.229869 22324 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.235769 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:27.236094 22313 tablet_bootstrap.cc:492] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:27.236671 22267 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.236832 22313 ts_tablet_manager.cc:1403] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.029s
I20260709 12:09:27.236755 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:27.240650 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:27.241545 22195 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:27.241818 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:27.242496 22198 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.243363 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:27.250239 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:27.250345 22313 raft_consensus.cc:359] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.251184 22192 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:27.251425 22313 raft_consensus.cc:385] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.251533 22419 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.251919 22313 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.252673 22087 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:27.233332 22324 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.253774 22419 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.254181 22419 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.254096 22324 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.254663 22419 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.255867 22312 tablet_bootstrap.cc:654] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.257071 22382 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.257947 22314 ts_tablet_manager.cc:1434] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.005s
I20260709 12:09:27.257567 22382 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.265918 22314 tablet_bootstrap.cc:492] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:27.258883 22324 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.259047 22544 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.273336 22511 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.297643 22313 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.294409 22544 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.320976 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:09:27.302616 22162 consensus_peers.cc:597] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:27.313287 22544 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.311528 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:27.368220 22313 ts_tablet_manager.cc:1434] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.131s	user 0.018s	sys 0.016s
I20260709 12:09:27.302307 22511 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.378123 22313 tablet_bootstrap.cc:492] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
W20260709 12:09:27.385063 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 60396.6us
I20260709 12:09:27.387669 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:27.402218 22198 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:27.403816 22314 tablet_bootstrap.cc:654] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.404338 22426 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.406677 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:27.405608 22549 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.411504 22549 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.413939 22549 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.415103 22419 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.421080 22552 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.405761 22382 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:09:27.423300 22088 leader_election.cc:343] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.423444 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:27.424292 22268 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
W20260709 12:09:27.424690 22088 leader_election.cc:343] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.427392 22511 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:09:27.424621 22543 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:09:27.404961 22426 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.448808 22544 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.462589 22267 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:27.464637 22554 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.462906 22419 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.466075 22312 tablet_bootstrap.cc:492] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:27.467239 22312 ts_tablet_manager.cc:1403] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.298s	user 0.041s	sys 0.027s
W20260709 12:09:27.468433 22087 leader_election.cc:343] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.469280 22554 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:27.472028 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46098.7us
I20260709 12:09:27.471683 22511 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 12:09:27.475713 22088 leader_election.cc:343] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.481873 22312 raft_consensus.cc:359] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.484809 22312 raft_consensus.cc:385] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.485136 22312 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.476672 22544 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.485823 22312 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.492199 22314 tablet_bootstrap.cc:492] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:27.492911 22314 ts_tablet_manager.cc:1403] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.234s	user 0.017s	sys 0.009s
I20260709 12:09:27.501048 22312 ts_tablet_manager.cc:1434] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:09:27.474742 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:27.503922 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:27.507462 22312 tablet_bootstrap.cc:492] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:27.499295 22544 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.511426 22511 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.512267 22426 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.512629 22511 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.513120 22511 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.519428 22554 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.517201 22544 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.525760 22313 tablet_bootstrap.cc:654] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.499738 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:27.533196 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:27.533665 22314 raft_consensus.cc:359] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.518951 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:27.534634 22314 raft_consensus.cc:385] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.535090 22314 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.535765 22511 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.536180 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:27.536019 22314 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.536854 22198 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.537279 22192 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:27.539036 22419 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.541683 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:27.541947 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:27.542409 22195 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.542583 22194 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:27.542788 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:27.544237 22473 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:27.544392 22163 leader_election.cc:343] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.544826 22473 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:27.545869 22473 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.546970 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:27.547657 22267 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
W20260709 12:09:27.547996 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72346.9us
I20260709 12:09:27.548717 22544 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.550459 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:27.551254 22121 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:27.554565 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:27.555258 22123 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:27.567481 22314 ts_tablet_manager.cc:1434] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 12:09:27.568526 22314 tablet_bootstrap.cc:492] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:27.568351 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:27.569895 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:27.570195 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:27.570621 22271 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.571353 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:09:27.574374 22236 leader_election.cc:343] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.574947 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:27.579160 22455 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.588732 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:27.589589 22511 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.565222 22198 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:27.603020 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:27.603809 22266 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:27.603814 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:27.606457 22382 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:27.606819 22382 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.607172 22382 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.590488 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:27.609887 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49694.3us
W20260709 12:09:27.610483 22162 leader_election.cc:343] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.612171 22162 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:09:27.610932 22088 leader_election.cc:343] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:27.616248 22088 leader_election.cc:343] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.615245 22419 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.617439 22419 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.619246 22419 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.622854 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:27.640129 22312 tablet_bootstrap.cc:654] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.736469 22313 tablet_bootstrap.cc:492] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:27.737090 22313 ts_tablet_manager.cc:1403] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.359s	user 0.021s	sys 0.047s
W20260709 12:09:27.625025 22163 leader_election.cc:343] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.668344 22553 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.630167 22419 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:27.636852 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:27.615422 22340 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.124s
I20260709 12:09:27.748029 22020 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:27.754406 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 141237us
W20260709 12:09:27.754521 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 132295us
I20260709 12:09:27.683820 22195 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
W20260709 12:09:27.762390 22162 leader_election.cc:343] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:27.763300 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 138563us
W20260709 12:09:27.763760 22162 leader_election.cc:343] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.764233 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:27.754066 22553 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.766084 22553 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.755709 22419 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.762377 22266 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.774480 22419 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.800951 22562 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.813362 22382 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.815671 22382 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.788112 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:27.855713 22087 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:27.857440 22324 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.857864 22324 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.858208 22324 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.863245 22120 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:27.870872 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:27.871801 22473 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.872304 22473 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:27.874266 22313 raft_consensus.cc:359] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.875324 22313 raft_consensus.cc:385] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.875667 22313 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.879918 22314 tablet_bootstrap.cc:654] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.879834 22087 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:09:27.856490 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 61395.3us
I20260709 12:09:27.882417 22117 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.882534 22550 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.886631 22550 raft_consensus.cc:697] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:27.887305 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:27.887946 22272 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.887585 22550 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.873242 22473 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.889360 22271 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:27.892318 22313 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.898540 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:27.902685 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:27.902833 22324 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.903385 22119 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.903611 22266 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:27.891170 22553 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.911734 22313 ts_tablet_manager.cc:1434] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.174s	user 0.007s	sys 0.002s
I20260709 12:09:27.913829 22312 tablet_bootstrap.cc:492] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:27.916919 22312 ts_tablet_manager.cc:1403] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.409s	user 0.033s	sys 0.023s
I20260709 12:09:27.905222 22455 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:09:27.919003 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:27.922842 22568 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.923466 22568 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:27.924398 22324 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.924309 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:27.920482 22313 tablet_bootstrap.cc:492] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:27.924749 22312 raft_consensus.cc:359] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.926373 22312 raft_consensus.cc:385] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.926581 22312 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.928179 22312 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.920177 22553 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.924398 22568 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.936762 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:27.937700 22116 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.923561 22419 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:27.943569 22312 ts_tablet_manager.cc:1434] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:09:27.956192 22419 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:27.915614 22087 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:27.969383 22272 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:27.970405 22313 tablet_bootstrap.cc:654] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:27.973564 22163 leader_election.cc:343] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.974776 22569 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.070s
I20260709 12:09:27.981814 22312 tablet_bootstrap.cc:492] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
W20260709 12:09:27.987933 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 70329.5us
I20260709 12:09:27.989979 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:09:27.986142 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 76196.8us
I20260709 12:09:27.996898 22553 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:27.998817 22119 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:28.031149 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:28.056830 22314 tablet_bootstrap.cc:492] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:28.057303 22314 ts_tablet_manager.cc:1403] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.489s	user 0.034s	sys 0.048s
I20260709 12:09:28.032358 22553 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:28.073177 22266 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:28.074823 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:09:28.108003 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 71196.1us
I20260709 12:09:28.123929 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:28.106016 22419 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.124868 22195 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:28.134402 22088 leader_election.cc:343] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.143762 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:28.144477 22194 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:28.154279 22266 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:09:28.154763 22116 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:28.117684 22553 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.158442 22195 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:28.160254 22162 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:28.169732 22566 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.170271 22566 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:28.171243 22271 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:28.173151 22312 tablet_bootstrap.cc:654] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.159375 22019 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.177444 22266 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.188570 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:28.171192 22566 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.193970 22419 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:28.204985 22314 raft_consensus.cc:359] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.205848 22314 raft_consensus.cc:385] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.206110 22314 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.207012 22314 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.223909 22582 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:09:28.228049 22314 ts_tablet_manager.cc:1434] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.170s	user 0.008s	sys 0.000s
I20260709 12:09:28.207417 22419 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:28.230695 22419 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.227465 22087 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:28.245002 22314 tablet_bootstrap.cc:492] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:28.250253 22544 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.250953 22544 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:28.251880 22544 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.260692 22584 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:09:28.257288 22550 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.266939 22550 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.289914 22550 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:09:28.344151 22586 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:09:28.317554 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:28.373692 22587 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:09:28.374614 22553 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:28.396863 22271 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:28.408622 22194 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:09:28.424567 22313 tablet_bootstrap.cc:492] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:28.428619 22312 tablet_bootstrap.cc:492] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:28.428980 22313 ts_tablet_manager.cc:1403] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.511s	user 0.021s	sys 0.025s
I20260709 12:09:28.429170 22312 ts_tablet_manager.cc:1403] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.458s	user 0.024s	sys 0.031s
I20260709 12:09:28.428754 22569 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.435039 22569 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.437387 22569 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:28.436976 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:28.459530 22313 raft_consensus.cc:359] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.460386 22313 raft_consensus.cc:385] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.469658 22312 raft_consensus.cc:359] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.470026 22087 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:28.470883 22312 raft_consensus.cc:385] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.473690 22312 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.474735 22312 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.460644 22313 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.482896 22314 tablet_bootstrap.cc:654] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.490818 22019 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 2, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.492089 22019 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.496347 22267 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.498658 22313 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.499684 22544 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.501117 22312 ts_tablet_manager.cc:1434] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.005s
I20260709 12:09:28.502707 22312 tablet_bootstrap.cc:492] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:28.503160 22582 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:28.511816 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:28.516433 22544 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.546519 22313 ts_tablet_manager.cc:1434] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.001s
I20260709 12:09:28.557098 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:09:28.562999 22162 leader_election.cc:343] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.542811 22419 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:28.566985 22569 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:28.580974 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:28.581750 22268 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:28.583410 22566 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:28.585460 22419 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.610972 22314 tablet_bootstrap.cc:492] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:28.611457 22312 tablet_bootstrap.cc:654] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.598663 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:28.627940 22568 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:28.628593 22568 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.629086 22568 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:28.627522 22600 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.003s
I20260709 12:09:28.646778 22582 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:28.653100 22314 ts_tablet_manager.cc:1403] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.409s	user 0.022s	sys 0.026s
I20260709 12:09:28.651427 22584 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.654480 22584 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.659201 22584 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:09:28.659538 22598 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260709 12:09:28.666684 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:28.667321 22191 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:28.656113 22577 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:09:28.678452 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:28.668668 22577 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.691972 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:28.694476 22568 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.696902 22313 tablet_bootstrap.cc:492] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:28.701225 22314 raft_consensus.cc:359] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:28.706463 22088 leader_election.cc:343] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.707187 22314 raft_consensus.cc:385] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.707791 22314 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.710131 22544 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:28.710561 22544 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.710922 22544 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.716284 22314 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.729856 22314 ts_tablet_manager.cc:1434] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 12:09:28.729522 22566 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.739073 22566 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.742192 22577 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:28.752537 22314 tablet_bootstrap.cc:492] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:28.753158 22266 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:28.753165 22121 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:28.761137 22569 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:09:28.766850 22544 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:28.768326 22163 consensus_peers.cc:597] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.769029 22561 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.774412 22313 tablet_bootstrap.cc:654] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:28.777420 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 79884.1us
I20260709 12:09:28.777237 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:28.778254 22197 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.795490 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:28.780289 22544 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:28.778754 22568 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:28.801545 22312 tablet_bootstrap.cc:492] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:28.802066 22312 ts_tablet_manager.cc:1403] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.300s	user 0.023s	sys 0.018s
W20260709 12:09:28.802843 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 100903us
I20260709 12:09:28.804759 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:28.812291 22566 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:28.811964 22312 raft_consensus.cc:359] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.812816 22312 raft_consensus.cc:385] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.813117 22312 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.813748 22312 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:28.800215 22162 leader_election.cc:343] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.778748 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:28.811853 22197 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:28.827478 22312 ts_tablet_manager.cc:1434] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 12:09:28.831393 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:28.833905 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:28.835670 22582 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.836243 22582 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:28.837430 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:28.837168 22582 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:28.841730 22163 leader_election.cc:343] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.842500 22312 tablet_bootstrap.cc:492] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:28.842310 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:28.828889 22268 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.845624 22267 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.851887 22191 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:28.853502 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:28.864233 22021 catalog_manager.cc:5697] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:28.865869 22162 leader_election.cc:343] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.870947 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:28.872872 22021 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.876951 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:28.884326 22265 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:28.885663 22324 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.880066 22595 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:28.872936 22566 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.890072 22544 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:28.893353 22473 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.878386 22021 catalog_manager.cc:5697] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 2, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.899786 22021 catalog_manager.cc:5697] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.910334 22553 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:28.916630 22314 tablet_bootstrap.cc:654] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.902820 22267 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
W20260709 12:09:28.938755 22614 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:09:28.945951 22312 tablet_bootstrap.cc:654] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:28.977902 22088 consensus_peers.cc:597] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.982471 22313 tablet_bootstrap.cc:492] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:28.982981 22313 ts_tablet_manager.cc:1403] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.286s	user 0.025s	sys 0.000s
I20260709 12:09:28.992704 22312 tablet_bootstrap.cc:492] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:28.993383 22312 ts_tablet_manager.cc:1403] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.154s	user 0.013s	sys 0.006s
I20260709 12:09:28.994544 22268 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:28.996467 22312 raft_consensus.cc:359] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:28.997323 22312 raft_consensus.cc:385] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.997422 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:28.997681 22312 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.002099 22312 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.004350 22312 ts_tablet_manager.cc:1434] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:09:29.005541 22312 tablet_bootstrap.cc:492] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:29.008195 22313 raft_consensus.cc:359] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.009960 22313 raft_consensus.cc:385] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.010236 22313 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.998915 22566 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.011933 22566 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:29.013095 22566 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.018973 22313 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.030441 22314 tablet_bootstrap.cc:492] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:29.031138 22314 ts_tablet_manager.cc:1403] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.285s	user 0.017s	sys 0.021s
I20260709 12:09:29.030323 22312 tablet_bootstrap.cc:654] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.037392 22020 catalog_manager.cc:5697] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.047075 22324 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.047703 22324 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.050169 22324 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:29.051242 22313 ts_tablet_manager.cc:1434] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.001s
I20260709 12:09:29.053568 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:29.054708 22266 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:29.055794 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:29.058405 22088 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:29.062186 22473 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.062968 22313 tablet_bootstrap.cc:492] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:29.073473 22313 tablet_bootstrap.cc:654] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.053118 22314 raft_consensus.cc:359] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.085788 22314 raft_consensus.cc:385] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.086153 22314 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.086961 22314 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.088925 22314 ts_tablet_manager.cc:1434] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.001s
I20260709 12:09:29.077436 22473 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.082978 22312 tablet_bootstrap.cc:492] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:29.075774 22021 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.090312 22314 tablet_bootstrap.cc:492] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:29.093181 22312 ts_tablet_manager.cc:1403] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.005s
I20260709 12:09:29.095435 22313 tablet_bootstrap.cc:492] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:29.096043 22313 ts_tablet_manager.cc:1403] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 12:09:29.096975 22312 raft_consensus.cc:359] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.097875 22312 raft_consensus.cc:385] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.098210 22312 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.099066 22312 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.099419 22313 raft_consensus.cc:359] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.100728 22313 raft_consensus.cc:385] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.101090 22313 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.101493 22312 ts_tablet_manager.cc:1434] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:09:29.101946 22313 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.104480 22313 ts_tablet_manager.cc:1434] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:29.105105 22312 tablet_bootstrap.cc:492] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:29.105708 22313 tablet_bootstrap.cc:492] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:29.118788 22314 tablet_bootstrap.cc:654] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.182518 22312 tablet_bootstrap.cc:654] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.186309 22313 tablet_bootstrap.cc:654] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.192028 22314 tablet_bootstrap.cc:492] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:29.192667 22314 ts_tablet_manager.cc:1403] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.103s	user 0.024s	sys 0.003s
I20260709 12:09:29.196655 22314 raft_consensus.cc:359] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.197505 22314 raft_consensus.cc:385] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.197135 22312 tablet_bootstrap.cc:492] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:29.197832 22314 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.198092 22312 ts_tablet_manager.cc:1403] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.007s
I20260709 12:09:29.198668 22314 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.200947 22314 ts_tablet_manager.cc:1434] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:29.202165 22312 raft_consensus.cc:359] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.203892 22314 tablet_bootstrap.cc:492] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:29.204321 22313 tablet_bootstrap.cc:492] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:29.204807 22312 raft_consensus.cc:385] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.205416 22312 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.204835 22313 ts_tablet_manager.cc:1403] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.018s
I20260709 12:09:29.209048 22313 raft_consensus.cc:359] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.210539 22313 raft_consensus.cc:385] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.210915 22313 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.209782 22312 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.212100 22314 tablet_bootstrap.cc:654] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.213477 22313 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.216993 22313 ts_tablet_manager.cc:1434] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:29.218094 22313 tablet_bootstrap.cc:492] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:29.214684 22312 ts_tablet_manager.cc:1434] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:09:29.219383 22312 tablet_bootstrap.cc:492] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:29.230856 22312 tablet_bootstrap.cc:654] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.239068 22314 tablet_bootstrap.cc:492] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:29.239652 22314 ts_tablet_manager.cc:1403] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.005s
I20260709 12:09:29.241660 22313 tablet_bootstrap.cc:654] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.246552 22314 raft_consensus.cc:359] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.247598 22314 raft_consensus.cc:385] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.247943 22314 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.248966 22314 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.269188 22314 ts_tablet_manager.cc:1434] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 12:09:29.270320 22314 tablet_bootstrap.cc:492] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:29.276621 22314 tablet_bootstrap.cc:654] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.288187 22314 tablet_bootstrap.cc:492] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:29.288690 22314 ts_tablet_manager.cc:1403] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:09:29.290640 22312 tablet_bootstrap.cc:492] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:29.291885 22314 raft_consensus.cc:359] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.292311 22364 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.292702 22314 raft_consensus.cc:385] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.293018 22314 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.292917 22364 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.293757 22314 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.295042 22364 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:29.296183 22314 ts_tablet_manager.cc:1434] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:29.291879 22312 ts_tablet_manager.cc:1403] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.009s
I20260709 12:09:29.300572 22312 raft_consensus.cc:359] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.301452 22312 raft_consensus.cc:385] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.301776 22312 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.302651 22312 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.304176 22566 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.304617 22312 ts_tablet_manager.cc:1434] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:29.305049 22566 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.306072 22312 tablet_bootstrap.cc:492] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:29.308387 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:29.309015 22314 tablet_bootstrap.cc:492] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:29.309116 22123 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:29.318660 22314 tablet_bootstrap.cc:654] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.318903 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:29.321429 22313 tablet_bootstrap.cc:492] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:29.321048 22195 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:29.334082 22364 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.325552 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:29.334606 22364 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.328321 22312 tablet_bootstrap.cc:654] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.326306 22569 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.328825 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:29.336570 22123 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:29.334352 22324 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:29.337520 22567 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.337945 22567 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.330309 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:29.338362 22567 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.335919 22569 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.339627 22162 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:29.340993 22569 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:29.341315 22553 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.341746 22553 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.342136 22553 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.343453 22566 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:29.337040 22364 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:29.345765 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:29.344380 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:29.350180 22553 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:29.345831 22163 leader_election.cc:343] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.352946 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:29.353472 22162 leader_election.cc:343] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:29.356024 22163 leader_election.cc:343] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.356549 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:29.357896 22604 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.358088 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:29.352495 22553 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:29.359643 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:09:29.360059 22163 leader_election.cc:343] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.361050 22313 ts_tablet_manager.cc:1403] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.143s	user 0.016s	sys 0.006s
I20260709 12:09:29.365018 22313 raft_consensus.cc:359] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.368858 22313 raft_consensus.cc:385] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.369405 22313 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.365473 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:29.371393 22123 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.365532 22567 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.368002 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:29.378376 22570 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.379070 22567 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:29.381888 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:29.383116 22121 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.388690 22313 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.393337 22312 tablet_bootstrap.cc:492] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:29.400105 22324 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:29.400481 22312 ts_tablet_manager.cc:1403] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.009s
I20260709 12:09:29.401998 22313 ts_tablet_manager.cc:1434] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:09:29.403689 22312 raft_consensus.cc:359] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.397909 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:29.407356 22567 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.407639 22191 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.407924 22567 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.406123 22123 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:29.409933 22604 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.410261 22162 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:29.408430 22121 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:29.411837 22511 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.410542 22567 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:29.412391 22511 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:29.407356 22312 raft_consensus.cc:385] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.413018 22312 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.413429 22511 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.413756 22312 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.416158 22312 ts_tablet_manager.cc:1434] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 12:09:29.417876 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:29.419034 22312 tablet_bootstrap.cc:492] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:29.421216 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:29.433488 22191 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
W20260709 12:09:29.435537 22236 leader_election.cc:343] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.442660 22313 tablet_bootstrap.cc:492] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:29.436555 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:09:29.449504 22236 leader_election.cc:343] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.450174 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:29.462702 22313 tablet_bootstrap.cc:654] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.466640 22312 tablet_bootstrap.cc:654] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.461194 22364 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.464604 22567 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.484620 22364 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.488435 22364 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.486397 22567 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:29.494135 22567 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.490808 22364 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:29.517670 22314 tablet_bootstrap.cc:492] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:29.518451 22314 ts_tablet_manager.cc:1403] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.210s	user 0.038s	sys 0.040s
I20260709 12:09:29.518256 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:29.521075 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:29.521859 22195 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:29.527411 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:29.528177 22364 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.528539 22364 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.528925 22364 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.500422 22568 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:09:29.538419 22266 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:29.545413 22236 leader_election.cc:343] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.558763 22364 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.565268 22314 raft_consensus.cc:359] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.565991 22314 raft_consensus.cc:385] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.566277 22314 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.566931 22314 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.569068 22364 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:29.569250 22021 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.574290 22312 tablet_bootstrap.cc:492] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:29.579798 22312 ts_tablet_manager.cc:1403] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.162s	user 0.026s	sys 0.013s
I20260709 12:09:29.583837 22314 ts_tablet_manager.cc:1434] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 12:09:29.584961 22314 tablet_bootstrap.cc:492] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:29.590837 22314 tablet_bootstrap.cc:654] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.595858 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:29.596359 22312 raft_consensus.cc:359] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.596668 22195 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.597566 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:29.597855 22020 catalog_manager.cc:5697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.602470 22313 tablet_bootstrap.cc:492] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:29.602994 22313 ts_tablet_manager.cc:1403] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.161s	user 0.011s	sys 0.012s
W20260709 12:09:29.604272 22236 leader_election.cc:343] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.608915 22312 raft_consensus.cc:385] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.609346 22312 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.610281 22312 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.613005 22312 ts_tablet_manager.cc:1434] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 12:09:29.613569 22313 raft_consensus.cc:359] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.614346 22313 raft_consensus.cc:385] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.614614 22313 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.615036 22324 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.615326 22313 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.615571 22324 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.617446 22313 ts_tablet_manager.cc:1434] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:29.617969 22324 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:29.618393 22313 tablet_bootstrap.cc:492] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:29.620746 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:29.621410 22198 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:29.614653 22312 tablet_bootstrap.cc:492] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:29.625746 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:29.626780 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:29.627805 22582 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.628221 22582 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.628566 22582 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:29.628815 22088 leader_election.cc:343] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.634275 22312 tablet_bootstrap.cc:654] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.637534 22582 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.648291 22582 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:29.649495 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:29.650154 22198 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.656471 22314 tablet_bootstrap.cc:492] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:29.656989 22314 ts_tablet_manager.cc:1403] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.000s
I20260709 12:09:29.659327 22198 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:29.660562 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:29.661418 22582 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.661880 22582 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:29.662679 22582 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.666663 22314 raft_consensus.cc:359] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.667343 22314 raft_consensus.cc:385] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.667601 22314 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.670159 22313 tablet_bootstrap.cc:654] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.634306 22195 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:29.675390 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:09:29.677701 22088 leader_election.cc:343] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.677363 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:29.679013 22567 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.668274 22314 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.679764 22567 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:29.681051 22567 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.682499 22314 ts_tablet_manager.cc:1434] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:09:29.683523 22314 tablet_bootstrap.cc:492] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:29.696914 22324 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.697576 22324 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.699824 22364 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.700448 22364 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.702030 22324 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:29.702991 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:29.703809 22195 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:29.705521 22087 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:29.706053 22312 tablet_bootstrap.cc:492] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:29.706550 22324 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.706779 22312 ts_tablet_manager.cc:1403] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.093s	user 0.038s	sys 0.001s
I20260709 12:09:29.707015 22324 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.707458 22324 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.722075 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:29.725862 22473 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.724447 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:29.734551 22473 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.710045 22312 raft_consensus.cc:359] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.735800 22312 raft_consensus.cc:385] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.736210 22312 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.717967 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:29.718123 22020 catalog_manager.cc:5697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.737257 22312 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.740336 22312 ts_tablet_manager.cc:1434] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.033s	user 0.012s	sys 0.001s
I20260709 12:09:29.707494 22364 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:29.741947 22473 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:29.743386 22312 tablet_bootstrap.cc:492] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:29.744246 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:29.744984 22195 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:29.746114 22087 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:29.746953 22473 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.747334 22473 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.747675 22473 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.751151 22314 tablet_bootstrap.cc:654] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:29.753506 22088 leader_election.cc:343] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.755003 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:29.758801 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:29.757443 22642 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.765367 22570 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.764375 22267 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:29.770061 22312 tablet_bootstrap.cc:654] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.765973 22570 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.783192 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:29.784631 22570 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:29.785241 22123 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:29.791798 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:29.796530 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:29.795696 22021 catalog_manager.cc:5697] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.799999 22570 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.814157 22266 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.819621 22473 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.834192 22313 tablet_bootstrap.cc:492] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:29.834686 22313 ts_tablet_manager.cc:1403] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.217s	user 0.013s	sys 0.023s
I20260709 12:09:29.802750 22324 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.847828 22324 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:29.849742 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:29.850432 22197 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:29.852234 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:29.858165 22473 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:29.844992 22570 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.863127 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:29.863822 22195 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.863852 22604 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:29.865792 22314 tablet_bootstrap.cc:492] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:29.875358 22314 ts_tablet_manager.cc:1403] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.192s	user 0.013s	sys 0.005s
I20260709 12:09:29.864475 22197 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:29.855324 22313 raft_consensus.cc:359] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.879241 22313 raft_consensus.cc:385] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.879710 22313 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.880736 22087 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:29.880813 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:29.882136 22313 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.883416 22654 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.883999 22654 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:29.884881 22313 ts_tablet_manager.cc:1434] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:09:29.886143 22313 tablet_bootstrap.cc:492] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:29.884895 22654 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.888610 22312 tablet_bootstrap.cc:492] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:29.888731 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:29.889523 22195 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
W20260709 12:09:29.889787 22088 leader_election.cc:343] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.890764 22312 ts_tablet_manager.cc:1403] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.149s	user 0.008s	sys 0.012s
I20260709 12:09:29.892506 22267 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.895879 22087 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:29.897604 22582 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.898137 22582 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:29.899959 22582 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.916963 22314 raft_consensus.cc:359] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.917804 22314 raft_consensus.cc:385] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.918073 22314 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.921583 22314 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:29.922749 22604 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:29.926407 22314 ts_tablet_manager.cc:1434] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 12:09:29.931098 22314 tablet_bootstrap.cc:492] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:29.937223 22313 tablet_bootstrap.cc:654] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.001864 22314 tablet_bootstrap.cc:654] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.006309 22312 raft_consensus.cc:359] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.007072 22312 raft_consensus.cc:385] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.007417 22312 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.008255 22312 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.019804 22312 ts_tablet_manager.cc:1434] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.001s
I20260709 12:09:30.029407 22267 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:30.038892 22473 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.039602 22473 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.047173 22473 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.056337 22018 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.052336 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:30.065640 22195 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:30.066591 22312 tablet_bootstrap.cc:492] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:30.069458 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:30.072394 22570 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:30.076588 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51325us
I20260709 12:09:30.086179 22313 tablet_bootstrap.cc:492] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:30.086858 22313 ts_tablet_manager.cc:1403] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.201s	user 0.015s	sys 0.055s
I20260709 12:09:30.088625 22473 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.089165 22473 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.089565 22473 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.090162 22313 raft_consensus.cc:359] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.090955 22313 raft_consensus.cc:385] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.091260 22313 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.091969 22313 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.093997 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:30.094486 22313 ts_tablet_manager.cc:1434] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:30.094754 22267 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:30.095544 22313 tablet_bootstrap.cc:492] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:30.104038 22312 tablet_bootstrap.cc:654] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.123839 22313 tablet_bootstrap.cc:654] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.132066 22314 tablet_bootstrap.cc:492] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:30.132941 22314 ts_tablet_manager.cc:1403] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.202s	user 0.010s	sys 0.012s
I20260709 12:09:30.136687 22314 raft_consensus.cc:359] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.140537 22314 raft_consensus.cc:385] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.141075 22314 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.142021 22314 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.126852 22473 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.142700 22665 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.144243 22313 tablet_bootstrap.cc:492] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:30.144884 22313 ts_tablet_manager.cc:1403] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.014s
W20260709 12:09:30.144609 22088 consensus_peers.cc:597] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.147553 22473 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.147770 22313 raft_consensus.cc:359] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.148602 22313 raft_consensus.cc:385] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.148981 22313 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.149629 22313 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.156524 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:30.157208 22195 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.158102 22313 ts_tablet_manager.cc:1434] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:09:30.158448 22314 ts_tablet_manager.cc:1434] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:09:30.159235 22313 tablet_bootstrap.cc:492] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:30.159389 22314 tablet_bootstrap.cc:492] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:30.157122 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:30.161049 22267 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.166231 22314 tablet_bootstrap.cc:654] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.167356 22313 tablet_bootstrap.cc:654] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.168514 22312 tablet_bootstrap.cc:492] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:30.168648 22195 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:30.169447 22312 ts_tablet_manager.cc:1403] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.146s	user 0.009s	sys 0.005s
I20260709 12:09:30.187352 22314 tablet_bootstrap.cc:492] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:30.189852 22314 ts_tablet_manager.cc:1403] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.001s
I20260709 12:09:30.185884 22664 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.190961 22664 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.191691 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:30.192826 22654 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:30.193277 22654 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:30.193910 22567 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.194092 22654 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.201447 22664 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.169003 22018 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.202138 22665 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.203718 22312 raft_consensus.cc:359] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.205957 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:30.208884 22163 leader_election.cc:343] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.209082 22312 raft_consensus.cc:385] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.210089 22312 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.210929 22312 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.202834 22665 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.224514 22312 ts_tablet_manager.cc:1434] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:09:30.225754 22312 tablet_bootstrap.cc:492] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:30.187729 22267 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:30.231732 22314 raft_consensus.cc:359] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.234539 22313 tablet_bootstrap.cc:492] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:30.235145 22313 ts_tablet_manager.cc:1403] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.012s
I20260709 12:09:30.233750 22314 raft_consensus.cc:385] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.236173 22314 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.235507 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:30.237953 22312 tablet_bootstrap.cc:654] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.238324 22665 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.239642 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:30.241375 22314 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:30.247014 22162 leader_election.cc:343] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.247566 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:30.248588 22553 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:30.250444 22313 raft_consensus.cc:359] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.251237 22313 raft_consensus.cc:385] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.251530 22313 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.252173 22313 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.256686 22313 ts_tablet_manager.cc:1434] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:09:30.257666 22313 tablet_bootstrap.cc:492] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:30.259905 22314 ts_tablet_manager.cc:1434] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.001s
I20260709 12:09:30.239593 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:30.263813 22314 tablet_bootstrap.cc:492] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:30.264202 22267 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
W20260709 12:09:30.253786 22087 leader_election.cc:343] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.267371 22313 tablet_bootstrap.cc:654] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.268040 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:30.269233 22473 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.269877 22473 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.270349 22473 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.272490 22642 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:30.279863 22313 tablet_bootstrap.cc:492] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:30.280449 22313 ts_tablet_manager.cc:1403] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.013s
I20260709 12:09:30.282977 22313 raft_consensus.cc:359] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.284135 22313 raft_consensus.cc:385] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.284482 22313 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.285539 22473 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.285858 22313 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.288030 22312 tablet_bootstrap.cc:492] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:30.289238 22312 ts_tablet_manager.cc:1403] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.001s
I20260709 12:09:30.290410 22313 ts_tablet_manager.cc:1434] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 12:09:30.292013 22313 tablet_bootstrap.cc:492] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:30.295193 22312 raft_consensus.cc:359] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.298287 22314 tablet_bootstrap.cc:654] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.298113 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:30.299141 22267 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.299141 22020 catalog_manager.cc:5697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.303097 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:30.298202 22473 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.296262 22312 raft_consensus.cc:385] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:30.305033 22087 leader_election.cc:343] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.305243 22312 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.307924 22312 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.310936 22267 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:30.314087 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:30.315645 22665 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:30.316184 22665 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:30.316636 22313 tablet_bootstrap.cc:654] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.317251 22665 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.325795 22312 ts_tablet_manager.cc:1434] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 12:09:30.327672 22312 tablet_bootstrap.cc:492] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
W20260709 12:09:30.384523 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 53122.6us
I20260709 12:09:30.400759 22123 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.404625 22314 tablet_bootstrap.cc:492] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:30.405208 22314 ts_tablet_manager.cc:1403] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.002s
I20260709 12:09:30.410806 22654 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.410445 22020 catalog_manager.cc:5697] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.424434 22314 raft_consensus.cc:359] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.425570 22314 raft_consensus.cc:385] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.425907 22314 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.427001 22681 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:30.427325 22314 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.429926 22312 tablet_bootstrap.cc:654] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.430986 22313 tablet_bootstrap.cc:492] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:30.432308 22313 ts_tablet_manager.cc:1403] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.141s	user 0.005s	sys 0.010s
I20260709 12:09:30.433808 22314 ts_tablet_manager.cc:1434] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 12:09:30.434849 22314 tablet_bootstrap.cc:492] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:30.452993 22473 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:30.459666 22088 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.460242 22314 tablet_bootstrap.cc:654] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.462939 22313 raft_consensus.cc:359] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.476318 22473 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.481128 22313 raft_consensus.cc:385] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.484011 22313 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.485821 22313 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.494220 22313 ts_tablet_manager.cc:1434] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.003s
I20260709 12:09:30.499707 22665 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.518005 22270 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.521943 22473 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.523962 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:30.524923 22195 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:30.533828 22087 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:30.537195 22665 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.537746 22665 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.538187 22665 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.538090 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:30.542382 22088 leader_election.cc:343] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.559484 22313 tablet_bootstrap.cc:492] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:30.557718 22654 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:09:30.570188 22570 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.570789 22570 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.575541 22313 tablet_bootstrap.cc:654] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.577031 22570 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:30.578014 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:09:30.597323 22236 leader_election.cc:343] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.597605 22314 tablet_bootstrap.cc:492] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:30.598269 22314 ts_tablet_manager.cc:1403] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.164s	user 0.032s	sys 0.001s
I20260709 12:09:30.598680 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:30.599753 22195 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:30.589972 22665 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.591475 22312 tablet_bootstrap.cc:492] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:30.601359 22312 ts_tablet_manager.cc:1403] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.274s	user 0.025s	sys 0.047s
I20260709 12:09:30.601506 22314 raft_consensus.cc:359] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.602340 22314 raft_consensus.cc:385] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.602695 22314 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.603518 22314 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.604429 22312 raft_consensus.cc:359] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.605851 22314 ts_tablet_manager.cc:1434] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:30.608927 22312 raft_consensus.cc:385] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.609304 22312 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.609958 22314 tablet_bootstrap.cc:492] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:30.610090 22312 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.614638 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:09:30.616307 22088 leader_election.cc:343] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.617636 22314 tablet_bootstrap.cc:654] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.617528 22604 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.619408 22312 ts_tablet_manager.cc:1434] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:30.621161 22665 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.625020 22604 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.631740 22312 tablet_bootstrap.cc:492] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:30.631848 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:30.633086 22197 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.640969 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:30.642907 22681 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.643442 22681 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.643872 22681 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.663823 22312 tablet_bootstrap.cc:654] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.664031 22604 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.670271 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:30.672443 22163 leader_election.cc:343] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.681020 22544 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:30.684645 22681 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.688145 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:30.687204 22197 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:30.698716 22313 tablet_bootstrap.cc:492] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:30.699374 22313 ts_tablet_manager.cc:1403] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.140s	user 0.021s	sys 0.029s
W20260709 12:09:30.704823 22162 leader_election.cc:343] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.706190 22681 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:30.713100 22162 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:30.715839 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:30.722414 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:30.723057 22194 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:30.725422 22236 leader_election.cc:343] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.721359 22604 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:30.730366 22642 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:09:30.719904 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 43880.2us
I20260709 12:09:30.735309 22642 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.739300 22194 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:30.742725 22313 raft_consensus.cc:359] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.748665 22313 raft_consensus.cc:385] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.749111 22313 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.749835 22313 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.751857 22314 tablet_bootstrap.cc:492] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:30.752454 22314 ts_tablet_manager.cc:1403] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.143s	user 0.023s	sys 0.004s
I20260709 12:09:30.746250 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:30.747994 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:30.744951 22642 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:30.744985 22312 tablet_bootstrap.cc:492] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:30.754771 22312 ts_tablet_manager.cc:1403] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.126s	user 0.018s	sys 0.004s
I20260709 12:09:30.757159 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:30.758200 22642 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:30.758649 22642 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:30.759764 22642 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.763556 22087 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:30.764700 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:30.765704 22681 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:30.762377 22312 raft_consensus.cc:359] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.769305 22312 raft_consensus.cc:385] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.772981 22313 ts_tablet_manager.cc:1434] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.001s
I20260709 12:09:30.775666 22313 tablet_bootstrap.cc:492] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:30.782102 22313 tablet_bootstrap.cc:654] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.784451 22324 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:30.769742 22312 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.785038 22324 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:30.785462 22312 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.786274 22324 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.787977 22312 ts_tablet_manager.cc:1434] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 12:09:30.761826 22314 raft_consensus.cc:359] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.788936 22314 raft_consensus.cc:385] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.789247 22314 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.789969 22314 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.790901 22691 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.791431 22691 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.792662 22312 tablet_bootstrap.cc:492] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:30.793569 22691 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.794587 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:30.795305 22270 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:30.796525 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:30.798859 22691 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.799281 22691 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.799667 22691 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.800074 22312 tablet_bootstrap.cc:654] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.810125 22314 ts_tablet_manager.cc:1434] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.000s
I20260709 12:09:30.814014 22020 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.815888 22314 tablet_bootstrap.cc:492] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:30.816172 22582 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.829653 22314 tablet_bootstrap.cc:654] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.841656 22313 tablet_bootstrap.cc:492] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:30.842402 22313 ts_tablet_manager.cc:1403] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.000s
I20260709 12:09:30.857012 22313 raft_consensus.cc:359] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.858295 22313 raft_consensus.cc:385] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.858634 22313 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.845721 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:30.862174 22324 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.864224 22198 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:30.859275 22313 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.871891 22568 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.872628 22568 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.882442 22313 ts_tablet_manager.cc:1434] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:09:30.901609 22568 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.902693 22313 tablet_bootstrap.cc:492] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:30.903206 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:30.903388 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:30.906292 22163 leader_election.cc:343] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:30.907186 22162 leader_election.cc:343] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.907698 22162 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:30.910163 22604 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:30.924578 22691 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.926470 22691 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.927807 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:30.928550 22270 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.929149 22020 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:30.934474 22312 tablet_bootstrap.cc:492] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:30.935030 22312 ts_tablet_manager.cc:1403] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.143s	user 0.016s	sys 0.003s
I20260709 12:09:30.936954 22270 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:30.937949 22312 raft_consensus.cc:359] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.938663 22312 raft_consensus.cc:385] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.938618 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:30.939023 22312 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.939728 22312 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.941018 22544 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.941856 22312 ts_tablet_manager.cc:1434] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:30.941754 22544 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.942801 22312 tablet_bootstrap.cc:492] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:30.944206 22582 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:30.944442 22544 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.945411 22582 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:30.951849 22314 tablet_bootstrap.cc:492] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:30.960701 22314 ts_tablet_manager.cc:1403] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.146s	user 0.024s	sys 0.009s
I20260709 12:09:30.951928 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:30.965138 22195 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:30.965957 22314 raft_consensus.cc:359] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.966938 22314 raft_consensus.cc:385] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.967248 22314 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.968027 22691 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.967993 22314 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.968616 22691 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:30.969735 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:30.970824 22314 ts_tablet_manager.cc:1434] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:09:30.975134 22270 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:30.976379 22314 tablet_bootstrap.cc:492] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:30.957065 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:30.976886 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:30.980178 22197 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.984668 22665 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.985146 22665 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.987576 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:30.985504 22665 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.985708 22691 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:30.989590 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:30.991375 22313 tablet_bootstrap.cc:654] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.952059 22582 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:30.996569 22088 leader_election.cc:343] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.979029 22544 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:31.004442 22312 tablet_bootstrap.cc:654] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.006011 22544 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.015219 22544 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:31.018088 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:31.019502 22088 leader_election.cc:343] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:31.020205 22197 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
W20260709 12:09:31.036787 22087 consensus_peers.cc:597] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:31.039930 22087 leader_election.cc:343] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:31.040383 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:31.043870 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:31.047715 22665 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.050212 22665 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:31.052577 22270 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:31.053277 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:31.053866 22265 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:31.060660 22265 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
W20260709 12:09:31.063601 22087 leader_election.cc:343] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:31.064047 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:31.063001 22088 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:09:31.068671 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:31.069191 22692 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:31.077049 22665 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:31.072216 22544 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:31.094470 22665 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:31.113071 22313 tablet_bootstrap.cc:492] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:31.118378 22313 ts_tablet_manager.cc:1403] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.220s	user 0.022s	sys 0.017s
I20260709 12:09:31.111035 22665 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.126446 22312 tablet_bootstrap.cc:492] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:31.127259 22314 tablet_bootstrap.cc:654] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.126621 22313 raft_consensus.cc:359] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.127516 22312 ts_tablet_manager.cc:1403] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.185s	user 0.015s	sys 0.031s
I20260709 12:09:31.127766 22313 raft_consensus.cc:385] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.128242 22313 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.134395 22313 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.138677 22313 ts_tablet_manager.cc:1434] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:09:31.141630 22313 tablet_bootstrap.cc:492] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:31.206918 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:09:31.236310 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49022.9us
I20260709 12:09:31.235958 22197 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:31.261466 22312 raft_consensus.cc:359] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.262669 22312 raft_consensus.cc:385] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.262914 22312 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.281253 22312 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.284690 22313 tablet_bootstrap.cc:654] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:31.330448 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 76749.4us
I20260709 12:09:31.338725 22314 tablet_bootstrap.cc:492] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:31.339365 22314 ts_tablet_manager.cc:1403] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.363s	user 0.024s	sys 0.035s
I20260709 12:09:31.337930 22582 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:31.348389 22312 ts_tablet_manager.cc:1434] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.220s	user 0.009s	sys 0.001s
I20260709 12:09:31.359428 22312 tablet_bootstrap.cc:492] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:31.349049 22582 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.370707 22582 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:31.372349 22314 raft_consensus.cc:359] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.373098 22314 raft_consensus.cc:385] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.373350 22314 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.373945 22314 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.391856 22314 ts_tablet_manager.cc:1434] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:09:31.396073 22314 tablet_bootstrap.cc:492] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:31.399214 22679 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:09:31.410916 22312 tablet_bootstrap.cc:654] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.408134 22197 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:31.416675 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:31.411849 22270 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:31.425958 22236 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.430656 22314 tablet_bootstrap.cc:654] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.440883 22710 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:31.441602 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:31.441933 22710 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.443984 22710 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:31.445958 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:31.448086 22088 leader_election.cc:343] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:31.437266 22313 tablet_bootstrap.cc:492] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:31.451752 22313 ts_tablet_manager.cc:1403] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.310s	user 0.020s	sys 0.007s
I20260709 12:09:31.443763 22020 catalog_manager.cc:5697] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:31.460348 22324 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:31.466297 22087 leader_election.cc:343] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:31.467216 22087 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:31.466133 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:31.483809 22712 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:31.466962 22691 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:09:31.477624 22313 raft_consensus.cc:359] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.490927 22313 raft_consensus.cc:385] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.491241 22313 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.495783 22313 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.499306 22312 tablet_bootstrap.cc:492] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:31.499794 22312 ts_tablet_manager.cc:1403] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.004s
I20260709 12:09:31.506206 22197 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:31.509248 22313 ts_tablet_manager.cc:1434] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260709 12:09:31.510528 22313 tablet_bootstrap.cc:492] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:31.515978 22312 raft_consensus.cc:359] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.516806 22312 raft_consensus.cc:385] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.517138 22312 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.517827 22312 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.519244 22162 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:31.520020 22312 ts_tablet_manager.cc:1434] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 12:09:31.526683 22582 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:31.537603 22314 tablet_bootstrap.cc:492] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:31.538204 22314 ts_tablet_manager.cc:1403] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.014s
I20260709 12:09:31.541471 22312 tablet_bootstrap.cc:492] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:31.559314 22314 raft_consensus.cc:359] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.560493 22314 raft_consensus.cc:385] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.561005 22314 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.562093 22314 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.564178 22708 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:31.585877 22314 ts_tablet_manager.cc:1434] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.005s
I20260709 12:09:31.589166 22314 tablet_bootstrap.cc:492] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:31.590981 22604 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:31.600023 22313 tablet_bootstrap.cc:654] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.642877 22312 tablet_bootstrap.cc:654] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.644812 22313 tablet_bootstrap.cc:492] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:31.659132 22313 ts_tablet_manager.cc:1403] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.149s	user 0.010s	sys 0.007s
I20260709 12:09:31.659163 22654 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:31.665014 22314 tablet_bootstrap.cc:654] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.666905 22313 raft_consensus.cc:359] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.668843 22019 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:31.687786 22313 raft_consensus.cc:385] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.688175 22313 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.674569 22314 tablet_bootstrap.cc:492] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:31.681000 22544 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:31.690019 22314 ts_tablet_manager.cc:1403] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.101s	user 0.008s	sys 0.005s
I20260709 12:09:31.690276 22313 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.692672 22314 raft_consensus.cc:359] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.693466 22314 raft_consensus.cc:385] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.698442 22314 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.699847 22313 ts_tablet_manager.cc:1434] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.002s
I20260709 12:09:31.699865 22314 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.708061 22314 ts_tablet_manager.cc:1434] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:09:31.709270 22314 tablet_bootstrap.cc:492] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:31.716585 22312 tablet_bootstrap.cc:492] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:31.717828 22312 ts_tablet_manager.cc:1403] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.186s	user 0.018s	sys 0.010s
I20260709 12:09:31.717917 22313 tablet_bootstrap.cc:492] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:31.722760 22314 tablet_bootstrap.cc:654] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.723361 22312 raft_consensus.cc:359] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.729239 22708 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:31.741518 22708 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.744100 22708 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:31.746810 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:31.746799 22312 raft_consensus.cc:385] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.749094 22312 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.750496 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:31.754595 22313 tablet_bootstrap.cc:654] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.755155 22087 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:31.756626 22708 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:31.763872 22314 tablet_bootstrap.cc:492] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:31.764588 22314 ts_tablet_manager.cc:1403] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.006s
I20260709 12:09:31.767794 22314 raft_consensus.cc:359] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.768826 22314 raft_consensus.cc:385] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.769299 22314 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.770125 22314 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.772337 22312 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.772114 22313 tablet_bootstrap.cc:492] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:31.773845 22313 ts_tablet_manager.cc:1403] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.002s
I20260709 12:09:31.774605 22312 ts_tablet_manager.cc:1434] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 12:09:31.777096 22313 raft_consensus.cc:359] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.779783 22313 raft_consensus.cc:385] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.780169 22313 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.781028 22313 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.783454 22313 ts_tablet_manager.cc:1434] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:31.778964 22312 tablet_bootstrap.cc:492] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:31.779382 22314 ts_tablet_manager.cc:1434] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:31.785799 22314 tablet_bootstrap.cc:492] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:31.794898 22313 tablet_bootstrap.cc:492] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:31.797821 22604 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:31.801018 22604 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.801697 22314 tablet_bootstrap.cc:654] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.804350 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:31.798069 22312 tablet_bootstrap.cc:654] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:31.805795 22162 leader_election.cc:343] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:31.811370 22313 tablet_bootstrap.cc:654] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.813700 22719 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:31.814227 22719 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.819136 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:31.820180 22312 tablet_bootstrap.cc:492] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
W20260709 12:09:31.820995 22162 leader_election.cc:343] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:31.822708 22314 tablet_bootstrap.cc:492] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:31.823546 22314 ts_tablet_manager.cc:1403] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.008s
I20260709 12:09:31.823047 22312 ts_tablet_manager.cc:1403] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.006s
I20260709 12:09:31.824803 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:31.827172 22312 raft_consensus.cc:359] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.827632 22715 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:31.831540 22715 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.833911 22715 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:09:31.828378 22163 leader_election.cc:343] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:31.835197 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:31.836097 22664 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:31.836938 22312 raft_consensus.cc:385] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.837312 22312 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.838124 22312 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.842273 22312 ts_tablet_manager.cc:1434] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 12:09:31.829970 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:31.828910 22719 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:31.830885 22314 raft_consensus.cc:359] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.869664 22312 tablet_bootstrap.cc:492] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:31.845386 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:31.872073 22116 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:31.845534 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:31.852757 22710 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:31.873214 22710 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.875604 22710 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:09:31.870409 22163 leader_election.cc:343] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:31.844570 22313 tablet_bootstrap.cc:492] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:31.876840 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:31.877095 22313 ts_tablet_manager.cc:1403] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.022s
I20260709 12:09:31.878185 22719 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:31.870127 22314 raft_consensus.cc:385] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.879070 22314 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.878571 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:31.879899 22314 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.876163 22194 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:31.882189 22313 raft_consensus.cc:359] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.880875 22265 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:31.887123 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:31.888127 22313 raft_consensus.cc:385] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.888522 22313 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.889325 22313 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.890550 22710 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:31.878515 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:31.894276 22715 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:31.894646 22715 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:31.895022 22715 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:31.884970 22314 ts_tablet_manager.cc:1434] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.004s
I20260709 12:09:31.895792 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:31.896449 22121 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:31.897204 22314 tablet_bootstrap.cc:492] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:31.893797 22710 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:31.905278 22710 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:31.892418 22313 ts_tablet_manager.cc:1434] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:09:31.908824 22313 tablet_bootstrap.cc:492] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:31.920687 22604 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:31.923049 22312 tablet_bootstrap.cc:654] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.904647 22314 tablet_bootstrap.cc:654] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.928371 22117 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:31.929495 22715 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.932163 22313 tablet_bootstrap.cc:654] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.933264 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:31.931530 22715 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:31.935843 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:31.935997 22710 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.937402 22191 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:09:31.936578 22116 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:31.939009 22314 tablet_bootstrap.cc:492] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:31.939502 22314 ts_tablet_manager.cc:1403] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.002s
I20260709 12:09:31.940450 22312 tablet_bootstrap.cc:492] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:31.941455 22312 ts_tablet_manager.cc:1403] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.005s
I20260709 12:09:31.944453 22604 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:31.944253 22312 raft_consensus.cc:359] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.945029 22604 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.947082 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:31.949173 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:31.951134 22265 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 1: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:31.951361 22314 raft_consensus.cc:359] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.951747 22604 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:31.952016 22314 raft_consensus.cc:385] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.952368 22314 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.953068 22314 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.953926 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:31.955156 22163 leader_election.cc:343] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:31.955403 22314 ts_tablet_manager.cc:1434] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:09:31.956195 22162 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:31.957033 22604 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:31.957677 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:31.958317 22121 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:31.958452 22314 tablet_bootstrap.cc:492] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:31.959548 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:31.949622 22710 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:31.960894 22604 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:31.961192 22116 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:31.961338 22604 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:31.961882 22604 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:31.962491 22313 tablet_bootstrap.cc:492] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:31.962941 22313 ts_tablet_manager.cc:1403] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 12:09:31.965581 22313 raft_consensus.cc:359] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.960026 22312 raft_consensus.cc:385] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.969017 22312 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.969758 22312 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.972172 22312 ts_tablet_manager.cc:1434] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:09:31.973809 22312 tablet_bootstrap.cc:492] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:31.974090 22664 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:31.974666 22664 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.968616 22314 tablet_bootstrap.cc:654] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:31.977806 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:09:31.979332 22163 leader_election.cc:343] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:31.977963 22313 raft_consensus.cc:385] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:31.981535 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:31.982154 22123 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:31.984663 22664 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:31.985692 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:31.986809 22568 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:31.987210 22568 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:31.987557 22568 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:31.994160 22715 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:31.980237 22313 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:31.994797 22715 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:31.999217 22312 tablet_bootstrap.cc:654] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.000335 22313 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.003084 22313 ts_tablet_manager.cc:1434] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:09:32.003520 22715 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:32.001953 22568 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.007133 22313 tablet_bootstrap.cc:492] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:31.974390 22604 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.011112 22314 tablet_bootstrap.cc:492] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:32.011124 22568 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.011706 22314 ts_tablet_manager.cc:1403] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.001s
I20260709 12:09:32.011158 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:32.012492 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:32.012805 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:32.013108 22123 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.013909 22679 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:32.014429 22679 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:32.015300 22679 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.015523 22314 raft_consensus.cc:359] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.016201 22314 raft_consensus.cc:385] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.016464 22314 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.017088 22314 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:32.017552 22163 leader_election.cc:343] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.019174 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:32.019811 22118 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:32.021348 22314 ts_tablet_manager.cc:1434] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:32.021209 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:32.021857 22191 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:32.022362 22314 tablet_bootstrap.cc:492] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:32.022600 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:09:32.024816 22163 leader_election.cc:343] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.025677 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:32.026461 22116 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.032250 22312 tablet_bootstrap.cc:492] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:32.032922 22312 ts_tablet_manager.cc:1403] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.003s
I20260709 12:09:32.025772 22123 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:32.040553 22314 tablet_bootstrap.cc:654] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.043416 22681 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:32.044004 22681 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.045578 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:32.046152 22681 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:32.048707 22568 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:32.048952 22312 raft_consensus.cc:359] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.049995 22312 raft_consensus.cc:385] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.050330 22312 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.051206 22312 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.054412 22313 tablet_bootstrap.cc:654] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.056818 22568 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:32.058897 22654 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:32.061882 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:32.063315 22654 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.063545 22118 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:32.064836 22604 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.066380 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:32.068449 22312 ts_tablet_manager.cc:1434] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
W20260709 12:09:32.068850 22087 leader_election.cc:343] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.069653 22312 tablet_bootstrap.cc:492] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:32.069940 22654 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.074357 22568 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.076303 22544 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:32.076860 22544 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.078918 22544 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.079602 22312 tablet_bootstrap.cc:654] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.080471 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:32.082034 22313 tablet_bootstrap.cc:492] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:32.086099 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:32.087323 22194 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:32.088325 22313 ts_tablet_manager.cc:1403] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.005s
I20260709 12:09:32.091941 22313 raft_consensus.cc:359] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:32.093643 22087 leader_election.cc:343] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.095125 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:32.096812 22313 raft_consensus.cc:385] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.097283 22313 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.097875 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:32.098276 22313 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.098708 22270 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:32.100718 22313 ts_tablet_manager.cc:1434] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:09:32.102131 22313 tablet_bootstrap.cc:492] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:32.102517 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:32.105636 22681 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:32.106029 22681 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:32.106364 22681 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.113889 22681 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.115772 22313 tablet_bootstrap.cc:654] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.115970 22681 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:32.116698 22116 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:32.134701 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:32.156558 22313 tablet_bootstrap.cc:492] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:32.157238 22313 ts_tablet_manager.cc:1403] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.002s
I20260709 12:09:32.151216 22604 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:32.159256 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:32.162202 22679 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:32.166059 22069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:32.170578 22313 raft_consensus.cc:359] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.174571 22313 raft_consensus.cc:385] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.177193 22313 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.178365 22313 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.172269 22710 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:32.180289 22710 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.173749 22679 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.182462 22710 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.182960 22679 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:32.186918 22313 ts_tablet_manager.cc:1434] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.006s
I20260709 12:09:32.190003 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:32.190429 22715 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:32.190856 22715 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:32.184098 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:32.191239 22715 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.175068 22604 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:09:32.193092 22162 leader_election.cc:343] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.193115 22604 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:32.196334 22163 leader_election.cc:343] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.191238 22313 tablet_bootstrap.cc:492] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:32.196885 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:32.198194 22664 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:32.187215 22019 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:32.199982 22088 leader_election.cc:343] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.203140 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:32.203893 22314 tablet_bootstrap.cc:492] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:32.204455 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:32.205037 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:32.205211 22194 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.205664 22118 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.205607 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:32.206576 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:32.207226 22197 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:32.207508 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:32.210491 22544 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:32.210961 22544 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:32.211334 22544 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.209937 22654 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:32.204598 22314 ts_tablet_manager.cc:1403] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.182s	user 0.052s	sys 0.039s
I20260709 12:09:32.225625 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:32.236063 22313 tablet_bootstrap.cc:654] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.269111 22314 raft_consensus.cc:359] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.270358 22314 raft_consensus.cc:385] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.270701 22314 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.272013 22314 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.274317 22312 tablet_bootstrap.cc:492] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:32.274806 22312 ts_tablet_manager.cc:1403] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.205s	user 0.023s	sys 0.024s
I20260709 12:09:32.259756 22641 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:32.279570 22641 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:32.285256 22641 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.291833 22715 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.297716 22715 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:32.292692 22312 raft_consensus.cc:359] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.305702 22312 raft_consensus.cc:385] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.301926 22194 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:32.304548 22314 ts_tablet_manager.cc:1434] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 12:09:32.306067 22312 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.309753 22314 tablet_bootstrap.cc:492] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:32.313654 22118 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:32.307924 22312 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:32.316660 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 92135.1us
I20260709 12:09:32.319342 22312 ts_tablet_manager.cc:1434] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 12:09:32.324934 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:32.324805 22544 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.317341 22641 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.331564 22021 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:32.333875 22312 tablet_bootstrap.cc:492] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:32.339964 22715 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:32.342294 22021 catalog_manager.cc:5697] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:32.344928 22236 leader_election.cc:343] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.342614 22715 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:32.347764 22715 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.358508 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:09:32.360283 22087 leader_election.cc:343] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.364516 22544 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.366339 22641 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:32.367056 22314 tablet_bootstrap.cc:654] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.376423 22313 tablet_bootstrap.cc:492] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:32.376583 22641 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:32.376920 22313 ts_tablet_manager.cc:1403] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.186s	user 0.027s	sys 0.009s
I20260709 12:09:32.377434 22641 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.379747 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:32.380407 22117 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.380582 22641 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:32.381817 22604 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:32.382382 22604 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.386592 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:32.387245 22118 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 0.
I20260709 12:09:32.388190 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:32.388976 22312 tablet_bootstrap.cc:654] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.389264 22117 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
W20260709 12:09:32.390951 22163 leader_election.cc:343] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.391240 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:32.391877 22191 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.393546 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:32.394452 22710 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:32.395179 22710 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:32.395514 22710 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.400529 22604 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.407933 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:32.408754 22269 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.455180 22313 raft_consensus.cc:359] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.458536 22710 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.459987 22314 tablet_bootstrap.cc:492] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:32.460530 22314 ts_tablet_manager.cc:1403] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.151s	user 0.017s	sys 0.000s
I20260709 12:09:32.468993 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:32.469632 22118 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.471800 22314 raft_consensus.cc:359] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.472482 22314 raft_consensus.cc:385] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.472761 22314 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.475122 22314 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.457435 22313 raft_consensus.cc:385] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.476589 22313 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.466161 22710 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.486778 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:32.490638 22118 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:09:32.492846 22191 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:32.481837 22269 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:32.494252 22314 ts_tablet_manager.cc:1434] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:09:32.493499 22313 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.499385 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:09:32.501050 22163 leader_election.cc:343] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.502733 22314 tablet_bootstrap.cc:492] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Bootstrap starting.
I20260709 12:09:32.504246 22719 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:32.504823 22712 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:32.505402 22712 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.507405 22712 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.508546 22313 ts_tablet_manager.cc:1434] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.131s	user 0.014s	sys 0.003s
I20260709 12:09:32.504819 22719 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:32.510681 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:32.511405 22197 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 0.
I20260709 12:09:32.511158 22719 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.512173 22313 tablet_bootstrap.cc:492] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:32.513206 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:32.514284 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:32.514824 22117 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.560266 22117 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:32.567515 22712 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:32.569454 22312 tablet_bootstrap.cc:492] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:32.570005 22312 ts_tablet_manager.cc:1403] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.236s	user 0.007s	sys 0.026s
I20260709 12:09:32.568346 22712 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.580010 22712 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.583302 22312 raft_consensus.cc:359] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.584178 22312 raft_consensus.cc:385] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.584496 22312 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.585371 22312 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.586163 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:32.587235 22197 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:32.590438 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:32.591100 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:32.591107 22195 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:32.591969 22312 ts_tablet_manager.cc:1434] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 12:09:32.597313 22544 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:32.597745 22544 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:32.598068 22544 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.597333 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:32.599402 22708 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:32.599774 22708 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:32.600100 22708 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.577780 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:32.601441 22020 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.607774 22312 tablet_bootstrap.cc:492] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:32.610428 22194 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.612838 22313 tablet_bootstrap.cc:654] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.626595 22544 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.627981 22708 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.629864 22544 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.630261 22708 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.632887 22194 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:32.635018 22314 tablet_bootstrap.cc:654] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.635955 22312 tablet_bootstrap.cc:654] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:32.641968 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53303.7us
I20260709 12:09:32.643105 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:32.643813 22191 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.644068 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:32.644907 22679 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:32.645428 22679 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:32.645848 22314 tablet_bootstrap.cc:492] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: No bootstrap required, opened a new log
I20260709 12:09:32.645694 22568 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:32.646339 22314 ts_tablet_manager.cc:1403] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.004s
I20260709 12:09:32.646234 22679 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.649063 22314 raft_consensus.cc:359] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.649832 22314 raft_consensus.cc:385] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.650192 22314 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.650985 22314 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.651935 22236 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:32.652679 22642 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:32.653115 22642 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:32.653456 22642 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.653931 22314 ts_tablet_manager.cc:1434] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:32.655325 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:32.656065 22641 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:32.658851 22312 tablet_bootstrap.cc:492] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:32.659358 22312 ts_tablet_manager.cc:1403] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.052s	user 0.005s	sys 0.005s
W20260709 12:09:32.663117 22163 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:32.663285 22191 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:32.664677 22641 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:32.664490 22642 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.665833 22641 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.667790 22642 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:32.670861 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:32.672087 22544 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:32.679564 22544 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:32.680428 22312 raft_consensus.cc:359] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.680791 22544 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.681213 22312 raft_consensus.cc:385] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:32.682121 22236 leader_election.cc:343] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.686393 22312 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.684553 22019 catalog_manager.cc:5697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:32.687384 22312 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.685340 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:32.689375 22194 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.693939 22313 tablet_bootstrap.cc:492] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:32.694481 22313 ts_tablet_manager.cc:1403] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.183s	user 0.011s	sys 0.007s
I20260709 12:09:32.699105 22313 raft_consensus.cc:359] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.700220 22313 raft_consensus.cc:385] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.700496 22313 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.701229 22313 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.702425 22710 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:32.720261 22313 ts_tablet_manager.cc:1434] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260709 12:09:32.712541 22020 catalog_manager.cc:5697] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.727319 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:32.727850 22312 ts_tablet_manager.cc:1434] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 12:09:32.729955 22708 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:32.730481 22708 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:32.731389 22708 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.736527 22312 tablet_bootstrap.cc:492] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:32.747538 22313 tablet_bootstrap.cc:492] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Bootstrap starting.
I20260709 12:09:32.751618 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:32.773186 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:32.774097 22121 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.789306 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:32.772329 22268 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:32.795104 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:32.795873 22193 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.806205 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:32.809985 22121 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:32.813939 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:32.814666 22265 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.810570 22781 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:32.816453 22781 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.821004 22019 catalog_manager.cc:5697] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:32.827368 22781 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.831277 22313 tablet_bootstrap.cc:654] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.831188 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:32.860128 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:32.860963 22271 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:32.861320 22193 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:32.860225 22268 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.865773 22265 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:32.867081 22194 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:32.869534 22312 tablet_bootstrap.cc:654] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:32.876319 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:32.878105 22780 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:32.878597 22780 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:32.879475 22780 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.874320 22020 catalog_manager.cc:5697] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:32.889083 22088 leader_election.cc:343] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:32.891572 22088 leader_election.cc:343] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:32.896867 22568 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:32.905356 22679 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:32.908346 22313 tablet_bootstrap.cc:492] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: No bootstrap required, opened a new log
I20260709 12:09:32.908465 22236 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:32.909108 22313 ts_tablet_manager.cc:1403] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent bootstrapping tablet: real 0.162s	user 0.012s	sys 0.006s
I20260709 12:09:32.909353 22679 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:32.909888 22679 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:32.910858 22679 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.914438 22313 raft_consensus.cc:359] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.918601 22719 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:32.920989 22313 raft_consensus.cc:385] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.921320 22719 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.921350 22313 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.922730 22313 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.923820 22719 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.926954 22312 tablet_bootstrap.cc:492] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:32.927467 22312 ts_tablet_manager.cc:1403] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.006s
I20260709 12:09:32.931893 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:32.932803 22313 ts_tablet_manager.cc:1434] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:09:32.931140 22641 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:32.931596 22019 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:32.934957 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:32.935787 22265 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 1: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:09:32.936966 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:32.938304 22719 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:32.945195 22312 raft_consensus.cc:359] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.945969 22312 raft_consensus.cc:385] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:32.946256 22312 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:32.946938 22312 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.948906 22088 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:09:32.950295 22781 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:32.950728 22781 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:32.951063 22781 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:32.957211 22719 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:32.965757 22163 consensus_peers.cc:597] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:32.967437 22312 ts_tablet_manager.cc:1434] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 12:09:32.969565 22312 tablet_bootstrap.cc:492] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:32.969144 22781 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:32.973809 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:32.974603 22194 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:32.973875 22020 catalog_manager.cc:5697] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:32.983731 22194 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:09:32.988039 22781 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:32.988963 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:32.992887 22781 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:32.995266 22781 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:32.996426 22781 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.003652 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:32.989224 22312 tablet_bootstrap.cc:654] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:33.007913 22568 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:33.017542 22708 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:33.021869 22708 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.071604 22708 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:33.078943 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:33.079742 22191 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 0.
I20260709 12:09:33.081625 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:33.084021 22780 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:33.084508 22780 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:33.084887 22780 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:33.106737 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 83197.8us
I20260709 12:09:33.104022 22780 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.116449 22544 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:33.117941 22780 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:33.121707 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:33.122480 22194 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:33.125116 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:33.130069 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:33.129685 22019 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 2, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:33.131536 22770 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:33.137559 22194 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:09:33.139513 22770 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:33.142020 22798 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:33.144028 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:33.146178 22780 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:33.161286 22088 leader_election.cc:343] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:33.152850 22780 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:09:33.166342 22088 leader_election.cc:343] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:33.167378 22780 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.182986 22715 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:33.203751 22312 tablet_bootstrap.cc:492] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:33.204334 22312 ts_tablet_manager.cc:1403] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.235s	user 0.017s	sys 0.001s
I20260709 12:09:33.208132 22544 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:33.222898 22312 raft_consensus.cc:359] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.223637 22312 raft_consensus.cc:385] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:33.223913 22312 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:33.229049 22312 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.237936 22019 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:33.272694 22312 ts_tablet_manager.cc:1434] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 12:09:33.276275 22312 tablet_bootstrap.cc:492] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:33.282819 22312 tablet_bootstrap.cc:654] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:33.301483 22642 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:33.328715 22796 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:33.342968 22797 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:33.345201 22544 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:33.360059 22312 tablet_bootstrap.cc:492] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:33.360358 22117 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:33.360663 22312 ts_tablet_manager.cc:1403] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.009s
I20260709 12:09:33.361395 22194 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:33.362308 22798 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:33.363693 22798 consensus_queue.cc:1243] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:09:33.367974 22642 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:33.368713 22715 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:33.369153 22715 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:33.370378 22312 raft_consensus.cc:359] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.371212 22312 raft_consensus.cc:385] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:33.371593 22312 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:33.372403 22312 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.374038 22715 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.378475 22312 ts_tablet_manager.cc:1434] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:33.379951 22715 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:33.379631 22312 tablet_bootstrap.cc:492] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Bootstrap starting.
I20260709 12:09:33.388013 22312 tablet_bootstrap.cc:654] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:33.409415 22312 tablet_bootstrap.cc:492] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: No bootstrap required, opened a new log
I20260709 12:09:33.409890 22312 ts_tablet_manager.cc:1403] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Time spent bootstrapping tablet: real 0.030s	user 0.004s	sys 0.014s
I20260709 12:09:33.412896 22312 raft_consensus.cc:359] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.413569 22312 raft_consensus.cc:385] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:33.413823 22312 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Initialized, Role: FOLLOWER
I20260709 12:09:33.414402 22312 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.416976 22312 ts_tablet_manager.cc:1434] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:33.444761 22270 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:33.450439 22271 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:09:33.451077 22271 pending_rounds.cc:85] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 0
I20260709 12:09:33.451510 22271 pending_rounds.cc:107] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:09:33.463905 22271 raft_consensus.cc:2889] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:09:33.501179 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44754.1us
I20260709 12:09:33.503134 22271 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:33.512089 22797 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:33.512646 22797 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.516760 22797 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:33.527076 22795 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:33.529807 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:33.532737 22797 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:33.533360 22797 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.534088 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:33.534886 22191 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:09:33.537834 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:33.538095 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:33.539294 22642 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:33.539700 22642 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:33.540062 22642 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:33.543020 22797 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:33.544303 22191 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:33.549248 22642 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.551499 22642 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:33.552481 22796 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:33.553313 22780 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:33.557813 22795 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:33.563001 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:33.583181 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:33.584071 22195 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 1: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:09:33.584378 22270 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:09:33.586300 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:33.591888 22792 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:33.592962 22712 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:33.593315 22712 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:33.594086 22712 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.597525 22236 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:33.598362 22797 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:33.606972 22712 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:33.609256 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:33.618201 22797 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:33.619060 22642 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:33.621199 22715 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:33.621776 22715 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:33.623962 22715 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:33.631043 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:33.631601 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:33.658908 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 12:09:33.669137 22270 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:33.673117 22236 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:33.682776 22792 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:33.689386 22642 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:33.716928 22757 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:33.755039 22817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:33.765347 22821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:33.780148 20891 server_base.cc:1061] running on GCE node
W20260709 12:09:33.782097 22824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:33.784708 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:33.785223 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:33.785526 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783598973785502 us; error 0 us; skew 500 ppm
I20260709 12:09:33.786578 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:33.805796 20891 webserver.cc:533] Webserver started at http://127.20.102.196:40059/ using document root <none> and password file <none>
I20260709 12:09:33.806851 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:33.807232 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:33.807767 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:33.809931 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-3-root/instance:
uuid: "164596fc2efa450581a5b68cad62271f"
format_stamp: "Formatted at 2026-07-09 12:09:33 on dist-test-slave-296p"
I20260709 12:09:33.819418 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:09:33.828703 22828 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:33.829972 20891 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.002s	sys 0.000s
I20260709 12:09:33.830399 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-3-root
uuid: "164596fc2efa450581a5b68cad62271f"
format_stamp: "Formatted at 2026-07-09 12:09:33 on dist-test-slave-296p"
I20260709 12:09:33.830849 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:33.858899 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:33.861162 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:33.863261 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:33.868291 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:33.868613 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:33.868984 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:33.869235 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:34.064550 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.196:42539
I20260709 12:09:34.064759 22890 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.196:42539 every 8 connection(s)
I20260709 12:09:34.160123 20891 auto_leader_rebalancer-test.cc:439] add a tserver: 164596fc2efa450581a5b68cad62271f
I20260709 12:09:34.181365 22891 heartbeater.cc:344] Connected to a master server at 127.20.102.254:38171
I20260709 12:09:34.181866 22891 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:34.182792 22891 heartbeater.cc:507] Master 127.20.102.254:38171 requested a full tablet report, sending...
I20260709 12:09:34.185662 22018 ts_manager.cc:194] Registered new tserver with Master: 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:09:34.187538 22018 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50266
I20260709 12:09:34.648998 22270 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:34.656862 22195 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.659319 22642 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:34.661455 22117 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.663878 22642 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.723532 22642 raft_consensus.cc:2955] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
W20260709 12:09:34.725296 22237 consensus_peers.cc:597] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5d4cdb3f6584a3d98a8736d0f93ddaf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.752079 22195 raft_consensus.cc:2955] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:34.757233 22121 raft_consensus.cc:2955] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:34.758834 22018 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:34.789909 22195 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:34.817981 22116 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.819764 22664 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:34.827965 22270 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.831074 22710 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:34.869320 22163 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44711cbd4d234e36807a94726a691570. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.873711 22664 raft_consensus.cc:2955] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:34.881683 22116 raft_consensus.cc:2955] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:34.889292 22266 raft_consensus.cc:2955] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:34.890445 22270 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:34.911295 22018 catalog_manager.cc:5697] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:34.919057 22195 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:34.920162 22237 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83a858eff9ef460fa5e0587bb1ea61f9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.921535 22121 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.921885 22903 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:34.925160 22903 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.952731 22797 raft_consensus.cc:2955] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:34.955036 22198 raft_consensus.cc:2955] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:34.994597 22017 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.012326 22116 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:35.037422 22198 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.038002 22270 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.048292 22757 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.049954 22902 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.052263 22664 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:09:35.052584 22088 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b5facb1c9654266b70a6d04d1e002f2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.052814 22664 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:35.054937 22664 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:35.057708 22920 ts_tablet_manager.cc:933] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:35.057646 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:35.058980 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:35.059861 22266 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 2: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:35.061934 22116 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:35.061650 22121 raft_consensus.cc:2955] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:35.063400 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:35.070426 22664 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:35.070902 22664 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:09:35.071344 22664 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.085150 22664 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:35.092706 22920 tablet_copy_client.cc:323] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.195:38085
I20260709 12:09:35.094852 22757 raft_consensus.cc:2955] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:35.172708 22664 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:35.190740 22891 heartbeater.cc:499] Master 127.20.102.254:38171 was elected leader, sending a full tablet report...
W20260709 12:09:35.194640 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 95786.4us
I20260709 12:09:35.201526 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:35.202360 22270 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 2: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:09:35.206538 22193 raft_consensus.cc:2955] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:35.222106 22282 tablet_copy_service.cc:140] P cc9b9c8894084021a0c6ddaf659d222e: Received BeginTabletCopySession request for tablet f5d4cdb3f6584a3d98a8736d0f93ddaf from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:34878)
I20260709 12:09:35.222856 22282 tablet_copy_service.cc:161] P cc9b9c8894084021a0c6ddaf659d222e: Beginning new tablet copy session on tablet f5d4cdb3f6584a3d98a8736d0f93ddaf from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:34878: session id = 164596fc2efa450581a5b68cad62271f-f5d4cdb3f6584a3d98a8736d0f93ddaf
I20260709 12:09:35.232308 22017 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:35.238608 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:35.249292 22116 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:35.231562 22282 tablet_copy_source_session.cc:215] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:35.256480 22920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d4cdb3f6584a3d98a8736d0f93ddaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.256551 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:35.261168 22266 raft_consensus.cc:2955] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:35.275480 22929 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:35.276135 22929 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:35.276788 22920 tablet_copy_client.cc:806] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.277719 22920 tablet_copy_client.cc:670] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.277071 22929 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:35.305269 22920 tablet_copy_client.cc:538] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.331326 22920 tablet_bootstrap.cc:492] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:35.337476 22021 catalog_manager.cc:5697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.386912 22932 ts_tablet_manager.cc:933] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:35.396502 22920 tablet_bootstrap.cc:492] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.397782 22920 tablet_bootstrap.cc:492] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:35.398584 22920 ts_tablet_manager.cc:1403] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.011s
I20260709 12:09:35.399555 22932 tablet_copy_client.cc:323] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.195:38085
I20260709 12:09:35.401856 22282 tablet_copy_service.cc:140] P cc9b9c8894084021a0c6ddaf659d222e: Received BeginTabletCopySession request for tablet 83a858eff9ef460fa5e0587bb1ea61f9 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:34878)
I20260709 12:09:35.402361 22282 tablet_copy_service.cc:161] P cc9b9c8894084021a0c6ddaf659d222e: Beginning new tablet copy session on tablet 83a858eff9ef460fa5e0587bb1ea61f9 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:34878: session id = 164596fc2efa450581a5b68cad62271f-83a858eff9ef460fa5e0587bb1ea61f9
I20260709 12:09:35.404476 22920 raft_consensus.cc:359] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:35.405946 22920 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:35.406718 22920 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:35.408315 22282 tablet_copy_source_session.cc:215] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:35.411921 22932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a858eff9ef460fa5e0587bb1ea61f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.439029 22937 ts_tablet_manager.cc:933] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673)
I20260709 12:09:35.450822 22936 ts_tablet_manager.cc:933] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:35.455662 22932 tablet_copy_client.cc:806] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.456496 22932 tablet_copy_client.cc:670] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.458009 22920 ts_tablet_manager.cc:1434] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.059s	user 0.015s	sys 0.016s
I20260709 12:09:35.462545 22936 tablet_copy_client.cc:323] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
I20260709 12:09:35.470568 22932 tablet_copy_client.cc:538] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.475308 22937 tablet_copy_client.cc:323] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.193:39673
I20260709 12:09:35.478286 22282 tablet_copy_service.cc:342] P cc9b9c8894084021a0c6ddaf659d222e: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-f5d4cdb3f6584a3d98a8736d0f93ddaf received from {username='slave'} at 127.0.0.1:34878
I20260709 12:09:35.479092 22282 tablet_copy_service.cc:434] P cc9b9c8894084021a0c6ddaf659d222e: ending tablet copy session 164596fc2efa450581a5b68cad62271f-f5d4cdb3f6584a3d98a8736d0f93ddaf on tablet f5d4cdb3f6584a3d98a8736d0f93ddaf with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:35.482038 22932 tablet_bootstrap.cc:492] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:35.516527 22208 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet 44711cbd4d234e36807a94726a691570 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:09:35.516944 22133 tablet_copy_service.cc:140] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Received BeginTabletCopySession request for tablet 8b5facb1c9654266b70a6d04d1e002f2 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:38186)
I20260709 12:09:35.517370 22208 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet 44711cbd4d234e36807a94726a691570 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-44711cbd4d234e36807a94726a691570
I20260709 12:09:35.517807 22133 tablet_copy_service.cc:161] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Beginning new tablet copy session on tablet 8b5facb1c9654266b70a6d04d1e002f2 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:38186: session id = 164596fc2efa450581a5b68cad62271f-8b5facb1c9654266b70a6d04d1e002f2
I20260709 12:09:35.530999 22208 tablet_copy_source_session.cc:215] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:35.536346 22903 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:35.537282 22903 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:35.541191 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:35.542337 22121 raft_consensus.cc:2410] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:09:35.556327 22936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44711cbd4d234e36807a94726a691570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.563975 22903 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:35.573315 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:35.574043 22133 tablet_copy_source_session.cc:215] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:35.584020 22932 tablet_bootstrap.cc:492] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.585140 22932 tablet_bootstrap.cc:492] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:35.585902 22932 ts_tablet_manager.cc:1403] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.104s	user 0.031s	sys 0.036s
I20260709 12:09:35.589287 22937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5facb1c9654266b70a6d04d1e002f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.589095 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:35.614149 22903 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:35.622485 22932 raft_consensus.cc:359] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:35.623489 22932 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:35.624238 22932 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:35.629845 22932 ts_tablet_manager.cc:1434] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:09:35.640329 22282 tablet_copy_service.cc:342] P cc9b9c8894084021a0c6ddaf659d222e: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-83a858eff9ef460fa5e0587bb1ea61f9 received from {username='slave'} at 127.0.0.1:34878
I20260709 12:09:35.640997 22937 tablet_copy_client.cc:806] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.641279 22282 tablet_copy_service.cc:434] P cc9b9c8894084021a0c6ddaf659d222e: ending tablet copy session 164596fc2efa450581a5b68cad62271f-83a858eff9ef460fa5e0587bb1ea61f9 on tablet 83a858eff9ef460fa5e0587bb1ea61f9 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:35.641690 22936 tablet_copy_client.cc:806] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.642304 22937 tablet_copy_client.cc:670] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.647682 22936 tablet_copy_client.cc:670] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.658075 22937 tablet_copy_client.cc:538] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.673800 22866 raft_consensus.cc:1217] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.674906 22936 tablet_copy_client.cc:538] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.728300 22936 tablet_bootstrap.cc:492] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:35.730266 22937 tablet_bootstrap.cc:492] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:35.948593 22123 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:35.976162 22866 raft_consensus.cc:1217] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:36.007390 22719 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:36.027690 22269 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.038780 22937 tablet_bootstrap.cc:492] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.099332 22719 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:36.122839 22905 raft_consensus.cc:1064] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:36.133539 22937 tablet_bootstrap.cc:492] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:36.134822 22937 ts_tablet_manager.cc:1403] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.405s	user 0.037s	sys 0.018s
I20260709 12:09:36.181766 22905 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:36.193300 22936 tablet_bootstrap.cc:492] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.197719 22936 tablet_bootstrap.cc:492] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:36.225829 22936 ts_tablet_manager.cc:1403] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.498s	user 0.052s	sys 0.033s
I20260709 12:09:36.183341 22937 raft_consensus.cc:359] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:36.228967 22937 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:36.230752 22937 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:36.276839 22866 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.279203 22903 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:09:36.286823 22194 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.290194 22943 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.303407 22937 ts_tablet_manager.cc:1434] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.159s	user 0.010s	sys 0.000s
I20260709 12:09:36.312073 22936 raft_consensus.cc:359] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:36.323285 22936 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:36.331846 22936 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:36.342301 22936 ts_tablet_manager.cc:1434] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.000s
I20260709 12:09:36.342532 22133 tablet_copy_service.cc:342] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-8b5facb1c9654266b70a6d04d1e002f2 received from {username='slave'} at 127.0.0.1:38186
I20260709 12:09:36.343046 22116 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.343466 22133 tablet_copy_service.cc:434] P ea51e825f0ab4ea2bb6c4d0e29709ca3: ending tablet copy session 164596fc2efa450581a5b68cad62271f-8b5facb1c9654266b70a6d04d1e002f2 on tablet 8b5facb1c9654266b70a6d04d1e002f2 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:36.349474 22208 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-44711cbd4d234e36807a94726a691570 received from {username='slave'} at 127.0.0.1:37260
I20260709 12:09:36.350054 22208 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-44711cbd4d234e36807a94726a691570 on tablet 44711cbd4d234e36807a94726a691570 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:36.361570 22797 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.414327 22797 raft_consensus.cc:2955] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.417924 22195 raft_consensus.cc:2955] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.441381 22866 raft_consensus.cc:2955] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.462628 22865 raft_consensus.cc:1217] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:36.483623 22123 raft_consensus.cc:2955] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.488097 22020 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.559970 22269 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:36.563570 22905 raft_consensus.cc:1064] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
W20260709 12:09:36.565789 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:36.566802 22905 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:36.583776 22866 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.586069 22195 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.585937 22797 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.587949 22798 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.595290 22903 raft_consensus.cc:2955] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.602669 22123 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.607332 22865 raft_consensus.cc:2955] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.611990 22007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5d4cdb3f6584a3d98a8736d0f93ddaf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.612473 22866 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.616562 22191 raft_consensus.cc:2955] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.608058 22797 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:09:36.625345 22021 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.626860 22943 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.637041 22195 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.650381 22866 raft_consensus.cc:1217] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:36.716660 22111 tablet_service.cc:1558] Processing DeleteTablet for tablet f5d4cdb3f6584a3d98a8736d0f93ddaf with delete_type TABLET_DATA_TOMBSTONED (TS ea51e825f0ab4ea2bb6c4d0e29709ca3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36132
I20260709 12:09:36.674188 22797 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:09:36.748711 22797 raft_consensus.cc:2955] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.750958 22865 raft_consensus.cc:2955] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.754987 22971 tablet_replica.cc:333] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:09:36.756839 22971 raft_consensus.cc:2243] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.757676 22971 raft_consensus.cc:2272] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.768230 22971 ts_tablet_manager.cc:1916] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.783442 22116 raft_consensus.cc:2955] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.792142 22017 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.819567 22971 ts_tablet_manager.cc:1929] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.821170 22971 log.cc:1199] T f5d4cdb3f6584a3d98a8736d0f93ddaf P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/wals/f5d4cdb3f6584a3d98a8736d0f93ddaf
I20260709 12:09:36.825109 22006 catalog_manager.cc:5028] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): tablet f5d4cdb3f6584a3d98a8736d0f93ddaf (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:36.824927 22270 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:36.834811 22865 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.837877 22798 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.838413 22121 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.838428 22195 raft_consensus.cc:2955] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.841315 22797 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.852876 22903 raft_consensus.cc:2955] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.855095 22865 raft_consensus.cc:2955] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.869086 22007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83a858eff9ef460fa5e0587bb1ea61f9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.894043 22017 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.907915 22180 tablet_service.cc:1558] Processing DeleteTablet for tablet 83a858eff9ef460fa5e0587bb1ea61f9 with delete_type TABLET_DATA_TOMBSTONED (TS 7d3f536360b444b1886777f4776be22c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56158
I20260709 12:09:36.929204 22116 raft_consensus.cc:2955] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:36.941707 22712 raft_consensus.cc:1064] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:36.952415 22973 tablet_replica.cc:333] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:09:36.958256 22712 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:37.012356 22865 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.013338 22195 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.014963 22269 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.016268 22945 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.018425 22945 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.026602 22945 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.038849 22973 raft_consensus.cc:2243] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:37.045217 22973 raft_consensus.cc:2272] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:37.055274 22973 ts_tablet_manager.cc:1916] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:37.061173 22952 raft_consensus.cc:2955] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.068651 22269 raft_consensus.cc:2955] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.074846 22865 raft_consensus.cc:2955] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.076411 22973 ts_tablet_manager.cc:1929] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:37.076958 22973 log.cc:1199] T 83a858eff9ef460fa5e0587bb1ea61f9 P 7d3f536360b444b1886777f4776be22c: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/wals/83a858eff9ef460fa5e0587bb1ea61f9
I20260709 12:09:37.078822 22006 catalog_manager.cc:5028] TS 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): tablet 83a858eff9ef460fa5e0587bb1ea61f9 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:37.082587 22195 raft_consensus.cc:2955] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.110420 22020 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.140084 22116 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:37.158403 22865 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.159886 22712 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:37.163939 22269 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.168293 22712 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:37.170464 22712 raft_consensus.cc:2955] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.172205 22865 raft_consensus.cc:2955] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.183720 22270 raft_consensus.cc:2955] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.185946 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b5facb1c9654266b70a6d04d1e002f2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:37.192190 22018 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.207335 22180 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b5facb1c9654266b70a6d04d1e002f2 with delete_type TABLET_DATA_TOMBSTONED (TS 7d3f536360b444b1886777f4776be22c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56158
I20260709 12:09:37.208604 22973 tablet_replica.cc:333] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:09:37.209784 22973 raft_consensus.cc:2243] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:37.210646 22973 raft_consensus.cc:2272] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:37.215536 22950 raft_consensus.cc:1064] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:37.218357 22950 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:37.225991 22973 ts_tablet_manager.cc:1916] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:37.265156 22270 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.267330 22710 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.268711 22973 ts_tablet_manager.cc:1929] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:37.269317 22973 log.cc:1199] T 8b5facb1c9654266b70a6d04d1e002f2 P 7d3f536360b444b1886777f4776be22c: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/wals/8b5facb1c9654266b70a6d04d1e002f2
I20260709 12:09:37.271559 22006 catalog_manager.cc:5028] TS 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): tablet 8b5facb1c9654266b70a6d04d1e002f2 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:37.275811 22865 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.283900 22664 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:37.318302 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51133.8us
I20260709 12:09:37.323071 22116 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.326042 22710 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.327770 22664 raft_consensus.cc:2955] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.346823 22865 raft_consensus.cc:2955] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.348625 22269 raft_consensus.cc:2955] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.368129 22017 catalog_manager.cc:5697] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.430043 22123 raft_consensus.cc:2955] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.440168 22192 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:37.453464 22865 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.455405 22950 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:37.467528 22979 raft_consensus.cc:2955] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.473618 22116 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.477578 22710 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:37.483525 22865 raft_consensus.cc:2955] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.509310 22017 catalog_manager.cc:5697] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.515061 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44711cbd4d234e36807a94726a691570 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:37.511863 22123 raft_consensus.cc:2955] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:37.529536 22258 tablet_service.cc:1558] Processing DeleteTablet for tablet 44711cbd4d234e36807a94726a691570 with delete_type TABLET_DATA_TOMBSTONED (TS cc9b9c8894084021a0c6ddaf659d222e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57876
I20260709 12:09:37.558897 22983 tablet_replica.cc:333] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:09:37.560158 22983 raft_consensus.cc:2243] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:37.561028 22983 raft_consensus.cc:2272] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:37.570989 22983 ts_tablet_manager.cc:1916] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:37.596429 22983 ts_tablet_manager.cc:1929] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:37.596956 22983 log.cc:1199] T 44711cbd4d234e36807a94726a691570 P cc9b9c8894084021a0c6ddaf659d222e: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/wals/44711cbd4d234e36807a94726a691570
I20260709 12:09:37.598809 22007 catalog_manager.cc:5028] TS cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): tablet 44711cbd4d234e36807a94726a691570 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:38.615485 22192 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:38.625084 22269 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.625731 22116 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.627611 22950 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.629859 22987 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:38.634832 22163 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44679affd4554006a2cb59b10b589a27. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.642812 22987 raft_consensus.cc:2955] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:38.663492 22192 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:38.669826 22021 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:38.675320 22269 raft_consensus.cc:2955] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:38.684333 22268 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.687021 22710 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.686664 22116 raft_consensus.cc:2955] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
W20260709 12:09:38.689158 22163 consensus_peers.cc:597] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 791f1d0e9076481dad104e8c3b503af8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.714625 22121 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.762603 22710 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.787652 22710 raft_consensus.cc:2955] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:38.796298 22270 raft_consensus.cc:2955] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:38.805439 22121 raft_consensus.cc:2955] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:38.812014 22266 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:38.816160 22021 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:38.845767 22192 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:38.849218 22237 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3728a188c254ff78ba0aff2361f13e3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.852200 22121 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.852250 22984 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.854699 22903 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.877833 22984 raft_consensus.cc:2955] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:38.879746 22191 raft_consensus.cc:2955] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:38.881413 22116 raft_consensus.cc:2955] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:38.901772 22021 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:38.911571 22116 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:38.944962 22191 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:38.945127 22088 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f0832297a8d44da9dba2792bf6c4c35. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.945322 22270 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.946556 22985 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.948953 22712 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.961018 22985 raft_consensus.cc:2955] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:38.963090 22192 raft_consensus.cc:2955] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:38.969930 22270 raft_consensus.cc:2955] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:38.980674 22018 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:39.112656 23006 ts_tablet_manager.cc:933] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:39.121598 23006 tablet_copy_client.cc:323] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
I20260709 12:09:39.127074 22208 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet 44679affd4554006a2cb59b10b589a27 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:09:39.127727 22208 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet 44679affd4554006a2cb59b10b589a27 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-44679affd4554006a2cb59b10b589a27
I20260709 12:09:39.141448 22208 tablet_copy_source_session.cc:215] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:39.145408 23006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44679affd4554006a2cb59b10b589a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:39.167685 23006 tablet_copy_client.cc:806] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:39.168381 23006 tablet_copy_client.cc:670] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:39.172593 23006 tablet_copy_client.cc:538] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:39.181862 23006 tablet_bootstrap.cc:492] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
W20260709 12:09:39.208642 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48367us
I20260709 12:09:39.227775 23006 tablet_bootstrap.cc:492] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:39.230132 23006 tablet_bootstrap.cc:492] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:39.230916 23006 ts_tablet_manager.cc:1403] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.015s
I20260709 12:09:39.234246 23006 raft_consensus.cc:359] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:39.235255 23006 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:39.235950 23006 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:39.247874 23006 ts_tablet_manager.cc:1434] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 12:09:39.261176 22208 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-44679affd4554006a2cb59b10b589a27 received from {username='slave'} at 127.0.0.1:37260
I20260709 12:09:39.261632 22208 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-44679affd4554006a2cb59b10b589a27 on tablet 44679affd4554006a2cb59b10b589a27 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:39.265026 23006 ts_tablet_manager.cc:933] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:39.270685 23006 tablet_copy_client.cc:323] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
I20260709 12:09:39.272403 22208 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet 791f1d0e9076481dad104e8c3b503af8 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:09:39.272931 22208 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet 791f1d0e9076481dad104e8c3b503af8 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-791f1d0e9076481dad104e8c3b503af8
I20260709 12:09:39.280287 22208 tablet_copy_source_session.cc:215] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:39.283658 23006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791f1d0e9076481dad104e8c3b503af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:39.315393 23006 tablet_copy_client.cc:806] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:39.316175 23006 tablet_copy_client.cc:670] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:39.321904 23006 tablet_copy_client.cc:538] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:39.336404 23006 tablet_bootstrap.cc:492] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:39.366487 23006 tablet_bootstrap.cc:492] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:39.367486 23006 tablet_bootstrap.cc:492] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:39.369092 23006 ts_tablet_manager.cc:1403] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.004s
I20260709 12:09:39.371991 23006 raft_consensus.cc:359] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:39.372853 23006 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:39.373585 23006 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:39.382920 23006 ts_tablet_manager.cc:1434] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:09:39.388213 22208 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-791f1d0e9076481dad104e8c3b503af8 received from {username='slave'} at 127.0.0.1:37260
I20260709 12:09:39.388679 22208 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-791f1d0e9076481dad104e8c3b503af8 on tablet 791f1d0e9076481dad104e8c3b503af8 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:39.407196 23006 ts_tablet_manager.cc:933] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673)
I20260709 12:09:39.410149 23006 tablet_copy_client.cc:323] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.193:39673
I20260709 12:09:39.412132 22133 tablet_copy_service.cc:140] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Received BeginTabletCopySession request for tablet 2f0832297a8d44da9dba2792bf6c4c35 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:38186)
I20260709 12:09:39.412711 22133 tablet_copy_service.cc:161] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Beginning new tablet copy session on tablet 2f0832297a8d44da9dba2792bf6c4c35 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:38186: session id = 164596fc2efa450581a5b68cad62271f-2f0832297a8d44da9dba2792bf6c4c35
I20260709 12:09:39.430063 22133 tablet_copy_source_session.cc:215] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:39.433846 23006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0832297a8d44da9dba2792bf6c4c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:39.455565 23006 tablet_copy_client.cc:806] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:39.456254 23006 tablet_copy_client.cc:670] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:39.464488 23008 ts_tablet_manager.cc:933] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:39.465184 23006 tablet_copy_client.cc:538] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:39.481281 23006 tablet_bootstrap.cc:492] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:39.493798 22865 raft_consensus.cc:1217] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.498708 23008 tablet_copy_client.cc:323] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.195:38085
I20260709 12:09:39.533037 22282 tablet_copy_service.cc:140] P cc9b9c8894084021a0c6ddaf659d222e: Received BeginTabletCopySession request for tablet f3728a188c254ff78ba0aff2361f13e3 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:34878)
I20260709 12:09:39.533663 22282 tablet_copy_service.cc:161] P cc9b9c8894084021a0c6ddaf659d222e: Beginning new tablet copy session on tablet f3728a188c254ff78ba0aff2361f13e3 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:34878: session id = 164596fc2efa450581a5b68cad62271f-f3728a188c254ff78ba0aff2361f13e3
I20260709 12:09:39.529870 23006 tablet_bootstrap.cc:492] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:39.543174 23006 tablet_bootstrap.cc:492] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:39.545217 23006 ts_tablet_manager.cc:1403] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.004s
I20260709 12:09:39.553051 23006 raft_consensus.cc:359] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:39.553982 23006 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:39.555821 23006 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:39.556274 22282 tablet_copy_source_session.cc:215] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:39.563644 23006 ts_tablet_manager.cc:1434] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:09:39.564332 23008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3728a188c254ff78ba0aff2361f13e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:39.568017 22133 tablet_copy_service.cc:342] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-2f0832297a8d44da9dba2792bf6c4c35 received from {username='slave'} at 127.0.0.1:38186
I20260709 12:09:39.568542 22133 tablet_copy_service.cc:434] P ea51e825f0ab4ea2bb6c4d0e29709ca3: ending tablet copy session 164596fc2efa450581a5b68cad62271f-2f0832297a8d44da9dba2792bf6c4c35 on tablet 2f0832297a8d44da9dba2792bf6c4c35 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:39.591210 23008 tablet_copy_client.cc:806] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:39.591805 23008 tablet_copy_client.cc:670] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:39.596086 23008 tablet_copy_client.cc:538] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:39.616886 23008 tablet_bootstrap.cc:492] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:39.655931 23008 tablet_bootstrap.cc:492] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:39.657624 23008 tablet_bootstrap.cc:492] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:39.658481 23008 ts_tablet_manager.cc:1403] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.001s
I20260709 12:09:39.666290 23008 raft_consensus.cc:359] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:39.667333 23008 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:39.668083 23008 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:39.670905 23008 ts_tablet_manager.cc:1434] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:39.676635 22282 tablet_copy_service.cc:342] P cc9b9c8894084021a0c6ddaf659d222e: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-f3728a188c254ff78ba0aff2361f13e3 received from {username='slave'} at 127.0.0.1:34878
I20260709 12:09:39.677153 22282 tablet_copy_service.cc:434] P cc9b9c8894084021a0c6ddaf659d222e: ending tablet copy session 164596fc2efa450581a5b68cad62271f-f3728a188c254ff78ba0aff2361f13e3 on tablet f3728a188c254ff78ba0aff2361f13e3 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:39.720145 22865 raft_consensus.cc:1217] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.906968 22865 raft_consensus.cc:1217] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:40.028084 22950 raft_consensus.cc:1064] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:40.036562 22950 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:40.055740 22865 raft_consensus.cc:1217] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:40.079422 22865 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.082531 22979 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.089970 22123 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.093426 22265 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.095978 22950 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.097859 22979 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.123528 22979 raft_consensus.cc:2955] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.126804 22265 raft_consensus.cc:2955] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.138265 22865 raft_consensus.cc:2955] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.141188 22123 raft_consensus.cc:2955] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.149003 22017 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.208073 22194 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:40.238907 22116 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.241449 22710 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.243538 22865 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.247710 22710 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.256881 22987 raft_consensus.cc:2955] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.267720 22121 raft_consensus.cc:2955] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.272497 22865 raft_consensus.cc:2955] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.286262 22020 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.291034 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44679affd4554006a2cb59b10b589a27 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:40.300541 22258 tablet_service.cc:1558] Processing DeleteTablet for tablet 44679affd4554006a2cb59b10b589a27 with delete_type TABLET_DATA_TOMBSTONED (TS cc9b9c8894084021a0c6ddaf659d222e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57876
I20260709 12:09:40.308627 23026 tablet_replica.cc:333] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:09:40.310019 23026 raft_consensus.cc:2243] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:40.310936 23026 raft_consensus.cc:2272] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:40.314632 23026 ts_tablet_manager.cc:1916] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:40.332556 22987 raft_consensus.cc:1064] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:40.336668 22987 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:40.341038 23026 ts_tablet_manager.cc:1929] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:40.341761 23026 log.cc:1199] T 44679affd4554006a2cb59b10b589a27 P cc9b9c8894084021a0c6ddaf659d222e: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/wals/44679affd4554006a2cb59b10b589a27
I20260709 12:09:40.344447 22007 catalog_manager.cc:5028] TS cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): tablet 44679affd4554006a2cb59b10b589a27 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:40.351089 22270 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.352882 22950 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.361546 22865 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.362794 22987 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.364228 22121 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.370458 22950 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.397899 22950 raft_consensus.cc:2955] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.400329 22866 raft_consensus.cc:2955] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.402899 22116 raft_consensus.cc:2955] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.420708 22018 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.423604 22265 raft_consensus.cc:2955] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.455449 22195 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:40.477286 22265 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.479907 22979 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.481387 22997 raft_consensus.cc:1064] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:40.482357 22866 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.484161 22997 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:40.488343 22987 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:40.497655 22710 raft_consensus.cc:2955] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.507700 22270 raft_consensus.cc:2955] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.527752 22865 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.530138 22712 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.531515 22194 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.533707 22712 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.538283 22266 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.541990 22948 raft_consensus.cc:1064] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:40.548817 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 791f1d0e9076481dad104e8c3b503af8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:40.520913 22866 raft_consensus.cc:2955] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.558801 22021 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.567297 22948 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:40.577206 22111 tablet_service.cc:1558] Processing DeleteTablet for tablet 791f1d0e9076481dad104e8c3b503af8 with delete_type TABLET_DATA_TOMBSTONED (TS ea51e825f0ab4ea2bb6c4d0e29709ca3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36132
I20260709 12:09:40.590750 23035 tablet_replica.cc:333] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:09:40.592133 23035 raft_consensus.cc:2243] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:40.596226 23035 raft_consensus.cc:2272] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:40.601513 23035 ts_tablet_manager.cc:1916] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:40.610585 22712 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.612350 22865 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.614194 22984 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.618111 22192 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.628242 22985 raft_consensus.cc:2955] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.642490 22194 raft_consensus.cc:2955] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.648088 23035 ts_tablet_manager.cc:1929] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:40.656989 23017 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.657393 23035 log.cc:1199] T 791f1d0e9076481dad104e8c3b503af8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/wals/791f1d0e9076481dad104e8c3b503af8
I20260709 12:09:40.659593 22006 catalog_manager.cc:5028] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): tablet 791f1d0e9076481dad104e8c3b503af8 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:40.663069 22116 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.663587 22865 raft_consensus.cc:2955] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.676504 23017 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.685461 22018 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.700174 22121 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:40.719410 22195 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.724969 22712 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:40.734614 22984 raft_consensus.cc:2955] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.749336 22712 raft_consensus.cc:2955] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.752995 22866 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.757256 22985 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.767002 22865 raft_consensus.cc:2955] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.768291 22866 raft_consensus.cc:2955] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.764257 22018 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.777864 22191 raft_consensus.cc:2955] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.796895 22021 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:09:40.811492 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 78623us
I20260709 12:09:40.814051 22265 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:40.816094 22123 raft_consensus.cc:2955] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.821002 22258 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f0832297a8d44da9dba2792bf6c4c35 with delete_type TABLET_DATA_TOMBSTONED (TS cc9b9c8894084021a0c6ddaf659d222e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57876
I20260709 12:09:40.823277 23026 tablet_replica.cc:333] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:09:40.824316 23026 raft_consensus.cc:2243] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:40.824812 23026 pending_rounds.cc:70] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: Trying to abort 1 pending ops.
I20260709 12:09:40.825071 23026 pending_rounds.cc:77] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305621424056987648 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } } }
I20260709 12:09:40.826359 23026 raft_consensus.cc:2917] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:09:40.826799 23026 raft_consensus.cc:2889] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:09:40.827167 23026 raft_consensus.cc:2272] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:40.827773 22194 raft_consensus.cc:2955] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.841435 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f0832297a8d44da9dba2792bf6c4c35 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:40.850855 22866 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.860451 23038 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:40.870769 23017 raft_consensus.cc:2955] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.872260 22866 raft_consensus.cc:2955] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:40.847389 23026 ts_tablet_manager.cc:1916] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:40.895680 22018 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:09:40.902277 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 110414us
I20260709 12:09:40.917661 22180 tablet_service.cc:1558] Processing DeleteTablet for tablet f3728a188c254ff78ba0aff2361f13e3 with delete_type TABLET_DATA_TOMBSTONED (TS 7d3f536360b444b1886777f4776be22c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56158
I20260709 12:09:40.937587 22007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3728a188c254ff78ba0aff2361f13e3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:40.941825 23047 tablet_replica.cc:333] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:09:40.959807 23047 raft_consensus.cc:2243] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:40.960014 23026 ts_tablet_manager.cc:1929] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:40.960666 23026 log.cc:1199] T 2f0832297a8d44da9dba2792bf6c4c35 P cc9b9c8894084021a0c6ddaf659d222e: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/wals/2f0832297a8d44da9dba2792bf6c4c35
I20260709 12:09:40.960727 23047 raft_consensus.cc:2272] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:40.962742 22007 catalog_manager.cc:5028] TS cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): tablet 2f0832297a8d44da9dba2792bf6c4c35 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
W20260709 12:09:40.964080 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 139910us
I20260709 12:09:40.967712 22123 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.969097 23047 ts_tablet_manager.cc:1916] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:40.992630 23047 ts_tablet_manager.cc:1929] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:40.993214 23047 log.cc:1199] T f3728a188c254ff78ba0aff2361f13e3 P 7d3f536360b444b1886777f4776be22c: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/wals/f3728a188c254ff78ba0aff2361f13e3
I20260709 12:09:40.997004 22006 catalog_manager.cc:5028] TS 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): tablet f3728a188c254ff78ba0aff2361f13e3 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:41.001377 23046 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:41.024356 22116 raft_consensus.cc:2955] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:41.993793 22194 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
W20260709 12:09:42.002440 22163 consensus_peers.cc:597] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f168c463b75448c945cd40fd0ad742f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:42.002526 22265 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.003913 22123 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.003952 22987 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:42.005427 22979 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.014480 22987 raft_consensus.cc:2955] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.016183 22123 raft_consensus.cc:2955] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.023442 22265 raft_consensus.cc:2955] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.035208 22194 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:42.036067 22018 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:42.060388 22268 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.063205 22987 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:42.074970 22163 consensus_peers.cc:597] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55006a12f7594727bebe695d1ffbe74f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:42.076642 22123 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.084977 22987 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.088088 23054 raft_consensus.cc:2955] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.090787 22265 raft_consensus.cc:2955] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.096138 22123 raft_consensus.cc:2955] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.112797 22116 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:42.127485 22017 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:42.140048 22088 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe7f853d79ab4bdf9a4bbdf1c2aea79e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:42.152524 22265 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.153123 22194 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.153859 23062 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.154764 23048 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.164386 23062 raft_consensus.cc:2955] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.166625 22265 raft_consensus.cc:2955] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.169853 22192 raft_consensus.cc:2955] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.188488 22116 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:42.189708 22021 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:42.202132 22088 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c6c5fdc849b4d1b8df5ffb293137964. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:42.202808 22265 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.204640 22192 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.206704 23062 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:42.208864 22985 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.229185 22192 raft_consensus.cc:2955] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.227874 23048 raft_consensus.cc:2955] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.239814 22265 raft_consensus.cc:2955] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.247531 22018 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:42.432235 23071 ts_tablet_manager.cc:933] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:42.434334 23071 tablet_copy_client.cc:323] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
I20260709 12:09:42.436136 22208 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet 8f168c463b75448c945cd40fd0ad742f from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:09:42.436757 22208 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet 8f168c463b75448c945cd40fd0ad742f from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-8f168c463b75448c945cd40fd0ad742f
I20260709 12:09:42.444156 22208 tablet_copy_source_session.cc:215] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.447685 23071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f168c463b75448c945cd40fd0ad742f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.457325 23073 ts_tablet_manager.cc:933] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:42.473522 23071 tablet_copy_client.cc:806] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.473614 23073 tablet_copy_client.cc:323] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
I20260709 12:09:42.474311 23071 tablet_copy_client.cc:670] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.476310 22208 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet 55006a12f7594727bebe695d1ffbe74f from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:09:42.476954 22208 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet 55006a12f7594727bebe695d1ffbe74f from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-55006a12f7594727bebe695d1ffbe74f
I20260709 12:09:42.479631 23071 tablet_copy_client.cc:538] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.489449 22208 tablet_copy_source_session.cc:215] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.495429 23073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55006a12f7594727bebe695d1ffbe74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.495553 23071 tablet_bootstrap.cc:492] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:42.514338 23073 tablet_copy_client.cc:806] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.516156 23073 tablet_copy_client.cc:670] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.521293 23073 tablet_copy_client.cc:538] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.539117 23071 tablet_bootstrap.cc:492] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.540093 23071 tablet_bootstrap.cc:492] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:42.544520 23073 tablet_bootstrap.cc:492] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:42.555817 23071 ts_tablet_manager.cc:1403] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.021s
I20260709 12:09:42.559258 23071 raft_consensus.cc:359] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:42.560142 23071 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:42.560858 23071 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:42.570722 23071 ts_tablet_manager.cc:1434] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 12:09:42.572657 22208 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-8f168c463b75448c945cd40fd0ad742f received from {username='slave'} at 127.0.0.1:37260
I20260709 12:09:42.579640 22208 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-8f168c463b75448c945cd40fd0ad742f on tablet 8f168c463b75448c945cd40fd0ad742f with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:42.608407 23073 tablet_bootstrap.cc:492] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.609400 23073 tablet_bootstrap.cc:492] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:42.610078 23073 ts_tablet_manager.cc:1403] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.021s
I20260709 12:09:42.612973 23073 raft_consensus.cc:359] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:42.613806 23073 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:42.614473 23073 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:42.617125 23073 ts_tablet_manager.cc:1434] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:42.619367 22208 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-55006a12f7594727bebe695d1ffbe74f received from {username='slave'} at 127.0.0.1:37260
I20260709 12:09:42.620002 22208 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-55006a12f7594727bebe695d1ffbe74f on tablet 55006a12f7594727bebe695d1ffbe74f with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:42.678455 23073 ts_tablet_manager.cc:933] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673)
I20260709 12:09:42.694056 23073 tablet_copy_client.cc:323] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.193:39673
I20260709 12:09:42.695937 22133 tablet_copy_service.cc:140] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Received BeginTabletCopySession request for tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:38186)
I20260709 12:09:42.696506 22133 tablet_copy_service.cc:161] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Beginning new tablet copy session on tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:38186: session id = 164596fc2efa450581a5b68cad62271f-fe7f853d79ab4bdf9a4bbdf1c2aea79e
I20260709 12:09:42.709328 22133 tablet_copy_source_session.cc:215] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.714454 23073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.728906 23073 tablet_copy_client.cc:806] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.729550 23073 tablet_copy_client.cc:670] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.735354 23073 tablet_copy_client.cc:538] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.745869 23073 tablet_bootstrap.cc:492] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:42.768924 23073 tablet_bootstrap.cc:492] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.770000 23073 tablet_bootstrap.cc:492] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:42.770761 23073 ts_tablet_manager.cc:1403] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 12:09:42.773617 23073 raft_consensus.cc:359] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:42.774276 23073 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:42.774852 23073 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:42.777076 23073 ts_tablet_manager.cc:1434] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:42.779202 22133 tablet_copy_service.cc:342] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-fe7f853d79ab4bdf9a4bbdf1c2aea79e received from {username='slave'} at 127.0.0.1:38186
I20260709 12:09:42.779644 22133 tablet_copy_service.cc:434] P ea51e825f0ab4ea2bb6c4d0e29709ca3: ending tablet copy session 164596fc2efa450581a5b68cad62271f-fe7f853d79ab4bdf9a4bbdf1c2aea79e on tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:42.789393 23073 ts_tablet_manager.cc:933] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673)
I20260709 12:09:42.791216 23073 tablet_copy_client.cc:323] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.193:39673
I20260709 12:09:42.792842 22133 tablet_copy_service.cc:140] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Received BeginTabletCopySession request for tablet 4c6c5fdc849b4d1b8df5ffb293137964 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:38186)
I20260709 12:09:42.793344 22133 tablet_copy_service.cc:161] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Beginning new tablet copy session on tablet 4c6c5fdc849b4d1b8df5ffb293137964 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:38186: session id = 164596fc2efa450581a5b68cad62271f-4c6c5fdc849b4d1b8df5ffb293137964
I20260709 12:09:42.798511 22133 tablet_copy_source_session.cc:215] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.801239 23073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6c5fdc849b4d1b8df5ffb293137964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.816193 23073 tablet_copy_client.cc:806] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.816738 23073 tablet_copy_client.cc:670] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.822963 23073 tablet_copy_client.cc:538] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.829886 23073 tablet_bootstrap.cc:492] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:42.846513 23073 tablet_bootstrap.cc:492] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.847131 23073 tablet_bootstrap.cc:492] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:42.847582 23073 ts_tablet_manager.cc:1403] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:09:42.849591 23073 raft_consensus.cc:359] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:42.850193 23073 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:42.850687 23073 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:42.856463 23073 ts_tablet_manager.cc:1434] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:42.866772 22133 tablet_copy_service.cc:342] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-4c6c5fdc849b4d1b8df5ffb293137964 received from {username='slave'} at 127.0.0.1:38186
I20260709 12:09:42.869007 22133 tablet_copy_service.cc:434] P ea51e825f0ab4ea2bb6c4d0e29709ca3: ending tablet copy session 164596fc2efa450581a5b68cad62271f-4c6c5fdc849b4d1b8df5ffb293137964 on tablet 4c6c5fdc849b4d1b8df5ffb293137964 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:42.962474 22866 raft_consensus.cc:1217] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:43.013556 22866 raft_consensus.cc:1217] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:43.146762 22866 raft_consensus.cc:1217] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:43.181378 22866 raft_consensus.cc:1217] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:43.582536 22987 raft_consensus.cc:1064] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:43.585350 22987 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:43.636626 23062 raft_consensus.cc:1064] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:43.639029 23062 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:43.654431 22266 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.656322 23048 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.656718 22866 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.660797 22265 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.663790 22866 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.665511 23048 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.670503 23088 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.671686 23085 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.686501 23083 raft_consensus.cc:1064] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:43.703750 23083 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:43.745491 22121 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.753911 22266 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.755048 23086 raft_consensus.cc:2955] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.757997 22987 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.764911 23096 raft_consensus.cc:2955] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.774178 22866 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.768599 22865 raft_consensus.cc:2955] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.775992 22979 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.783735 22265 raft_consensus.cc:2955] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.821046 22192 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.822968 22265 raft_consensus.cc:2955] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.827667 22021 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:43.849670 22985 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.850715 22121 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.851485 22985 raft_consensus.cc:1064] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:43.852835 22979 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.853808 22018 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.867748 22979 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.879443 22979 raft_consensus.cc:2955] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.883267 22866 raft_consensus.cc:2955] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.887745 22864 raft_consensus.cc:2955] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.895848 22985 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:09:43.907606 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 48934.3us
I20260709 12:09:43.922984 22193 raft_consensus.cc:2955] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.940026 22121 raft_consensus.cc:2955] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:09:43.941879 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 74382.6us
I20260709 12:09:43.941335 22265 raft_consensus.cc:2955] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.943682 22123 raft_consensus.cc:2955] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:43.950902 22194 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.952574 23110 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.973451 22266 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.976935 22866 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.978399 23110 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:44.006183 22193 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:44.017608 23096 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:44.038561 22864 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.042893 22268 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.078770 23086 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:44.086022 23083 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:44.114642 23096 raft_consensus.cc:2955] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.133915 22193 raft_consensus.cc:2955] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.146817 23086 raft_consensus.cc:2955] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.165472 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8f168c463b75448c945cd40fd0ad742f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:44.176261 22266 raft_consensus.cc:2955] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.182170 22020 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.176790 22865 raft_consensus.cc:2955] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.186746 22265 raft_consensus.cc:2955] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.190104 22866 raft_consensus.cc:2955] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.216172 22018 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:09:44.218997 22006 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 8f168c463b75448c945cd40fd0ad742f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:09:44.219009 22018 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.224246 22193 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:44.237804 22865 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.237888 22268 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.242900 23089 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:44.245208 22111 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f168c463b75448c945cd40fd0ad742f with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:36132
I20260709 12:09:44.253269 23089 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:44.258329 23087 raft_consensus.cc:2955] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.260984 22268 raft_consensus.cc:2955] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.265345 22123 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:44.269984 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 55006a12f7594727bebe695d1ffbe74f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:44.273809 22866 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.275552 23096 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:44.279628 22866 raft_consensus.cc:2955] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.282356 22265 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.280695 22020 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:44.287146 23110 raft_consensus.cc:2955] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.304184 23120 tablet_replica.cc:333] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:09:44.305313 23120 raft_consensus.cc:2243] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:44.305879 23097 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:44.290733 22865 raft_consensus.cc:2955] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.313105 22111 tablet_service.cc:1558] Processing DeleteTablet for tablet 55006a12f7594727bebe695d1ffbe74f with delete_type TABLET_DATA_TOMBSTONED (TS ea51e825f0ab4ea2bb6c4d0e29709ca3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36132
I20260709 12:09:44.316071 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:44.319802 23120 raft_consensus.cc:2272] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:44.320837 22268 raft_consensus.cc:2955] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.326767 23120 ts_tablet_manager.cc:1916] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:44.365468 23120 ts_tablet_manager.cc:1929] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:44.365986 23120 log.cc:1199] T 8f168c463b75448c945cd40fd0ad742f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/wals/8f168c463b75448c945cd40fd0ad742f
I20260709 12:09:44.367730 23120 tablet_replica.cc:333] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:09:44.369884 23120 raft_consensus.cc:2243] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:44.371058 22006 catalog_manager.cc:5028] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): tablet 8f168c463b75448c945cd40fd0ad742f (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:44.371387 23120 raft_consensus.cc:2272] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:44.375339 22018 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.375700 23120 ts_tablet_manager.cc:1916] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:44.383067 22123 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:44.390941 22866 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.393939 23120 ts_tablet_manager.cc:1929] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:44.394464 23120 log.cc:1199] T 55006a12f7594727bebe695d1ffbe74f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/wals/55006a12f7594727bebe695d1ffbe74f
I20260709 12:09:44.396411 23097 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:44.396854 22195 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:44.397935 22006 catalog_manager.cc:5028] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): tablet 55006a12f7594727bebe695d1ffbe74f (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:44.400753 23110 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:44.409538 22985 raft_consensus.cc:2955] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.412711 22866 raft_consensus.cc:2955] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.413218 22195 raft_consensus.cc:2955] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.414275 22180 tablet_service.cc:1558] Processing DeleteTablet for tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e with delete_type TABLET_DATA_TOMBSTONED (TS 7d3f536360b444b1886777f4776be22c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56158
I20260709 12:09:44.430905 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4c6c5fdc849b4d1b8df5ffb293137964 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:44.431052 22021 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:44.436434 23121 tablet_replica.cc:333] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:09:44.437693 23121 raft_consensus.cc:2243] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:44.438570 23121 raft_consensus.cc:2272] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:44.491098 22258 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c6c5fdc849b4d1b8df5ffb293137964 with delete_type TABLET_DATA_TOMBSTONED (TS cc9b9c8894084021a0c6ddaf659d222e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57876
I20260709 12:09:44.492362 23121 ts_tablet_manager.cc:1916] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:44.498469 23122 tablet_replica.cc:333] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:09:44.503218 23122 raft_consensus.cc:2243] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:44.504134 23122 raft_consensus.cc:2272] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:44.511458 23122 ts_tablet_manager.cc:1916] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:44.530494 23121 ts_tablet_manager.cc:1929] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:44.531141 23121 log.cc:1199] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 7d3f536360b444b1886777f4776be22c: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/wals/fe7f853d79ab4bdf9a4bbdf1c2aea79e
I20260709 12:09:44.531293 23122 ts_tablet_manager.cc:1929] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:44.531818 23122 log.cc:1199] T 4c6c5fdc849b4d1b8df5ffb293137964 P cc9b9c8894084021a0c6ddaf659d222e: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/wals/4c6c5fdc849b4d1b8df5ffb293137964
I20260709 12:09:44.532859 22006 catalog_manager.cc:5028] TS 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): tablet fe7f853d79ab4bdf9a4bbdf1c2aea79e (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:44.533556 22007 catalog_manager.cc:5028] TS cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): tablet 4c6c5fdc849b4d1b8df5ffb293137964 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:45.550876 22123 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
W20260709 12:09:45.561000 22088 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 863b392474d94720808349fe27669b5b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.561977 22195 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:45.564406 22266 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:45.564276 22985 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.567150 22985 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.574568 23110 raft_consensus.cc:2955] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.577212 22193 raft_consensus.cc:2955] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.593534 22266 raft_consensus.cc:2955] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.596689 22021 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 2 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.601660 22121 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
W20260709 12:09:45.628445 22088 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc3d186560a74d7e8c4d29066e4e3567. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.631922 22193 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.635645 23110 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:45.638633 22268 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.640096 23110 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.666931 23110 raft_consensus.cc:2955] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.675897 22191 raft_consensus.cc:2955] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.699944 22266 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:45.705039 22268 raft_consensus.cc:2955] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.715304 22020 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:45.730945 22195 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.734336 23124 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.736989 22123 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:45.738263 22237 consensus_peers.cc:597] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 54878b51479940bebc76fc9d84de64cb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.739065 23124 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.751863 23106 raft_consensus.cc:2955] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.757527 22195 raft_consensus.cc:2955] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.759518 22121 raft_consensus.cc:2955] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.775211 22191 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:45.776994 22021 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.784720 22266 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.786943 23083 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.791116 22123 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:45.791329 22163 consensus_peers.cc:597] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ea5fe59611e4539abcf87b4fd1a282c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.794548 23087 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:45.806645 23087 raft_consensus.cc:2955] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.815908 22123 raft_consensus.cc:2955] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.815775 22268 raft_consensus.cc:2955] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:45.837705 22021 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:46.155903 23145 ts_tablet_manager.cc:933] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:46.186215 23148 ts_tablet_manager.cc:933] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673)
I20260709 12:09:46.189816 23145 tablet_copy_client.cc:323] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.195:38085
I20260709 12:09:46.192741 22282 tablet_copy_service.cc:140] P cc9b9c8894084021a0c6ddaf659d222e: Received BeginTabletCopySession request for tablet 54878b51479940bebc76fc9d84de64cb from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:34878)
I20260709 12:09:46.193526 22282 tablet_copy_service.cc:161] P cc9b9c8894084021a0c6ddaf659d222e: Beginning new tablet copy session on tablet 54878b51479940bebc76fc9d84de64cb from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:34878: session id = 164596fc2efa450581a5b68cad62271f-54878b51479940bebc76fc9d84de64cb
I20260709 12:09:46.186761 23146 ts_tablet_manager.cc:933] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673)
I20260709 12:09:46.198716 23148 tablet_copy_client.cc:323] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.193:39673
I20260709 12:09:46.203563 22133 tablet_copy_service.cc:140] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Received BeginTabletCopySession request for tablet 863b392474d94720808349fe27669b5b from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:38186)
I20260709 12:09:46.204320 22133 tablet_copy_service.cc:161] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Beginning new tablet copy session on tablet 863b392474d94720808349fe27669b5b from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:38186: session id = 164596fc2efa450581a5b68cad62271f-863b392474d94720808349fe27669b5b
I20260709 12:09:46.208458 22282 tablet_copy_source_session.cc:215] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:46.271984 22133 tablet_copy_source_session.cc:215] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:46.276386 23145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54878b51479940bebc76fc9d84de64cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:46.277765 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863b392474d94720808349fe27669b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:46.277944 23146 tablet_copy_client.cc:323] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.193:39673
I20260709 12:09:46.297183 22133 tablet_copy_service.cc:140] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Received BeginTabletCopySession request for tablet fc3d186560a74d7e8c4d29066e4e3567 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:38186)
I20260709 12:09:46.298173 22133 tablet_copy_service.cc:161] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Beginning new tablet copy session on tablet fc3d186560a74d7e8c4d29066e4e3567 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:38186: session id = 164596fc2efa450581a5b68cad62271f-fc3d186560a74d7e8c4d29066e4e3567
I20260709 12:09:46.377002 23148 tablet_copy_client.cc:806] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:46.377882 23148 tablet_copy_client.cc:670] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:46.383064 23148 tablet_copy_client.cc:538] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:46.403061 23152 ts_tablet_manager.cc:933] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:46.418963 23145 tablet_copy_client.cc:806] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:46.419831 23145 tablet_copy_client.cc:670] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:46.420001 22133 tablet_copy_source_session.cc:215] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:46.427085 23148 tablet_bootstrap.cc:492] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:46.428475 23145 tablet_copy_client.cc:538] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:46.468588 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3d186560a74d7e8c4d29066e4e3567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:46.495520 23152 tablet_copy_client.cc:323] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
I20260709 12:09:46.783028 23145 tablet_bootstrap.cc:492] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:46.952365 23148 tablet_bootstrap.cc:492] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:46.953810 23148 tablet_bootstrap.cc:492] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:46.954562 23148 ts_tablet_manager.cc:1403] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.528s	user 0.044s	sys 0.028s
I20260709 12:09:46.961642 23148 raft_consensus.cc:359] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:46.963680 23148 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:46.964461 23148 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:47.055665 22208 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet 5ea5fe59611e4539abcf87b4fd1a282c from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:09:47.056479 22208 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet 5ea5fe59611e4539abcf87b4fd1a282c from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-5ea5fe59611e4539abcf87b4fd1a282c
I20260709 12:09:47.065107 23146 tablet_copy_client.cc:806] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.077942 23146 tablet_copy_client.cc:670] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.093115 23148 ts_tablet_manager.cc:1434] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.138s	user 0.010s	sys 0.021s
I20260709 12:09:47.115010 22133 tablet_copy_service.cc:342] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-863b392474d94720808349fe27669b5b received from {username='slave'} at 127.0.0.1:38186
I20260709 12:09:47.119760 22133 tablet_copy_service.cc:434] P ea51e825f0ab4ea2bb6c4d0e29709ca3: ending tablet copy session 164596fc2efa450581a5b68cad62271f-863b392474d94720808349fe27669b5b on tablet 863b392474d94720808349fe27669b5b with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:47.147893 22208 tablet_copy_source_session.cc:215] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.150226 22863 raft_consensus.cc:1217] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:09:47.155701 23145 tablet_bootstrap.cc:492] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.156800 23145 tablet_bootstrap.cc:492] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:47.157523 23145 ts_tablet_manager.cc:1403] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.375s	user 0.013s	sys 0.023s
W20260709 12:09:47.160609 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57292.6us
I20260709 12:09:47.219106 23145 raft_consensus.cc:359] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:47.220103 23145 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:47.220836 23145 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:47.224388 23145 ts_tablet_manager.cc:1434] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.002s
I20260709 12:09:47.226653 22282 tablet_copy_service.cc:342] P cc9b9c8894084021a0c6ddaf659d222e: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-54878b51479940bebc76fc9d84de64cb received from {username='slave'} at 127.0.0.1:34878
I20260709 12:09:47.227119 22282 tablet_copy_service.cc:434] P cc9b9c8894084021a0c6ddaf659d222e: ending tablet copy session 164596fc2efa450581a5b68cad62271f-54878b51479940bebc76fc9d84de64cb on tablet 54878b51479940bebc76fc9d84de64cb with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:47.248410 23152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea5fe59611e4539abcf87b4fd1a282c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.262326 23146 tablet_copy_client.cc:538] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:09:47.324016 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48163.6us
I20260709 12:09:47.326357 23146 tablet_bootstrap.cc:492] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:47.531118 23152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56950 (request call id 97) took 1219 ms. Trace:
I20260709 12:09:47.531637 23152 rpcz_store.cc:276] 0709 12:09:46.311987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.312575 (+   588us) service_pool.cc:224] Handling call
0709 12:09:46.406945 (+ 94370us) ts_tablet_manager.cc:934] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
0709 12:09:47.246620 (+839675us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:47.332452 (+ 85832us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:47.332574 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:47.514580 (+182006us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:47.529090 (+ 14510us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:47.530943 (+  1853us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:47.531021 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":5836,"tablet-copy.queue_time_us":74202,"thread_start_us":144776,"threads_started":2}
I20260709 12:09:47.533254 23152 tablet_copy_client.cc:806] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
W20260709 12:09:47.533401 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 258201us
I20260709 12:09:47.533895 23152 tablet_copy_client.cc:670] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.539486 23146 tablet_bootstrap.cc:492] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.540870 23146 tablet_bootstrap.cc:492] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:47.541611 23146 ts_tablet_manager.cc:1403] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.216s	user 0.022s	sys 0.005s
I20260709 12:09:47.545622 23146 raft_consensus.cc:359] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:47.547313 23146 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:47.548066 23146 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:47.550669 23146 ts_tablet_manager.cc:1434] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:47.600896 23170 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:09:47.601671 23170 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:47.605099 23170 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:09:47.638161 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 70518.8us
I20260709 12:09:47.659024 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.665867 23168 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:09:47.666671 23168 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:47.669293 23168 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:47.679593 23186 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:09:47.681258 23186 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:47.681901 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.685024 23186 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:47.691475 23185 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:09:47.692194 23185 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:47.697875 23185 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:09:47.699117 23185 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:09:47.700433 23185 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:47.705492 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.707253 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.721285 23185 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:47.723589 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.723662 23185 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:09:47.724891 22133 tablet_copy_service.cc:342] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-fc3d186560a74d7e8c4d29066e4e3567 received from {username='slave'} at 127.0.0.1:38186
I20260709 12:09:47.725528 23185 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:47.726158 22133 tablet_copy_service.cc:434] P ea51e825f0ab4ea2bb6c4d0e29709ca3: ending tablet copy session 164596fc2efa450581a5b68cad62271f-fc3d186560a74d7e8c4d29066e4e3567 on tablet fc3d186560a74d7e8c4d29066e4e3567 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:47.729533 22866 raft_consensus.cc:1217] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:47.730506 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:09:47.732445 23185 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:47.733428 22237 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:09:47.735126 23185 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:47.736415 23185 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:09:47.737008 23185 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:47.737476 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.743084 23185 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:47.744369 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.733317 23163 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:09:47.745326 23163 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:47.748178 23196 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:09:47.748227 23163 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:09:47.749279 23196 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:47.751242 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:09:47.752632 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.753104 23196 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:47.754914 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.763756 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:09:47.777720 23163 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:47.793186 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45029.5us
I20260709 12:09:47.797902 23185 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:09:47.799044 23185 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:47.802896 23185 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:47.803056 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.837018 23152 tablet_copy_client.cc:538] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:09:47.849516 22052 debug-util.cc:398] Leaking SignalData structure 0x7b0800067420 after lost signal to thread 20894
W20260709 12:09:47.851128 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080008ab00 after lost signal to thread 22055
W20260709 12:09:47.852702 22052 debug-util.cc:398] Leaking SignalData structure 0x7b08003195a0 after lost signal to thread 22147
W20260709 12:09:47.854137 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080021d360 after lost signal to thread 22222
W20260709 12:09:47.855475 22052 debug-util.cc:398] Leaking SignalData structure 0x7b08002dcc00 after lost signal to thread 22296
W20260709 12:09:47.857344 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080032cd20 after lost signal to thread 22890
W20260709 12:09:47.859069 22052 debug-util.cc:398] Leaking SignalData structure 0x7b0800332b60 after lost signal to thread 23140
I20260709 12:09:47.860100 23160 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:09:47.860805 23160 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:47.862934 23160 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:47.868637 23152 tablet_bootstrap.cc:492] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:47.870052 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.876344 23191 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:09:47.877350 23191 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:47.897341 23158 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:09:47.902691 23158 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:47.915005 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.916656 23124 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:09:47.917519 23124 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:47.925587 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.925869 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:47.982012 23173 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:09:47.982753 23173 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:47.985590 23124 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:47.991755 23171 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:09:47.880615 23191 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:47.996986 23124 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:09:48.004527 23158 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:48.004731 23124 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:48.015376 23173 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:48.005954 23171 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:48.022082 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:48.023444 23124 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:48.040223 23171 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:48.042047 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:09:48.044961 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:09:48.052371 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 218680us
I20260709 12:09:48.065379 23191 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:09:48.066056 23191 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:48.068084 23191 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:09:48.071209 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 66667.7us
W20260709 12:09:48.103248 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45184.4us
I20260709 12:09:48.108863 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:48.156689 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:48.159696 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:48.161321 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:48.167604 23152 tablet_bootstrap.cc:492] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:48.168263 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:48.168537 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:48.173331 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:48.174422 23152 tablet_bootstrap.cc:492] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:48.175205 23152 ts_tablet_manager.cc:1403] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.320s	user 0.062s	sys 0.067s
I20260709 12:09:48.179291 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:48.180799 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:48.181991 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:48.185814 23152 raft_consensus.cc:359] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:48.188975 23152 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:48.193606 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:48.193758 22861 raft_consensus.cc:1217] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.193872 23152 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:48.192595 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:48.190254 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:09:48.197373 23152 ts_tablet_manager.cc:1434] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 12:09:48.199059 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:48.221289 22208 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-5ea5fe59611e4539abcf87b4fd1a282c received from {username='slave'} at 127.0.0.1:37260
I20260709 12:09:48.221982 22208 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-5ea5fe59611e4539abcf87b4fd1a282c on tablet 5ea5fe59611e4539abcf87b4fd1a282c with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:48.235443 23160 raft_consensus.cc:1064] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:48.240618 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:48.242936 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:09:48.241681 23160 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:48.244530 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:09:48.258641 22088 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:48.261952 23209 raft_consensus.cc:1064] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:48.266628 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:48.268229 23199 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.269407 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:48.270244 23199 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.272969 23205 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.274763 23209 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:48.275451 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:48.276753 23181 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.284639 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:48.286795 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:48.291436 23163 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.292894 23181 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.311492 22861 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.320380 23173 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.333876 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:48.335582 23176 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.337304 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:48.338518 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:48.339282 23124 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.339470 22862 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:48.340358 23160 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.341138 23205 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.342170 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:48.342996 23160 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.344205 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:48.346150 22196 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:48.348294 23160 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.348932 23205 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.350073 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:48.351094 23160 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.359478 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:48.361307 23160 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.362617 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:48.364717 23160 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.365888 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:48.367697 23160 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.370954 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:09:48.372867 23160 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:48.377966 22189 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.380511 22120 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.384325 23209 raft_consensus.cc:2955] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.389308 22267 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:48.388366 22196 raft_consensus.cc:2955] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.399647 23160 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.403613 23160 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.408923 23205 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.415830 22862 raft_consensus.cc:2955] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.423135 22017 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.429749 22267 raft_consensus.cc:2955] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.470506 22189 raft_consensus.cc:2955] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.449658 23163 raft_consensus.cc:2955] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.477272 22120 raft_consensus.cc:2955] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.595801 22861 raft_consensus.cc:2955] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.610508 23197 raft_consensus.cc:1064] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:48.614125 23197 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:48.634495 22861 raft_consensus.cc:1217] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.644698 22861 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.646839 23198 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.649226 22268 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.659101 23203 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.667802 22189 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.671694 23203 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:48.684837 22887 debug-util.cc:398] Leaking SignalData structure 0x7b0800303060 after lost signal to thread 20894
W20260709 12:09:48.686208 22887 debug-util.cc:398] Leaking SignalData structure 0x7b0800303740 after lost signal to thread 22055
W20260709 12:09:48.687582 22887 debug-util.cc:398] Leaking SignalData structure 0x7b080031dfe0 after lost signal to thread 22147
I20260709 12:09:48.719208 22120 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:09:48.723722 22887 debug-util.cc:398] Leaking SignalData structure 0x7b0800264440 after lost signal to thread 22222
W20260709 12:09:48.725049 22887 debug-util.cc:398] Leaking SignalData structure 0x7b080029e000 after lost signal to thread 22296
W20260709 12:09:48.726308 22887 debug-util.cc:398] Leaking SignalData structure 0x7b0800115a80 after lost signal to thread 22890
I20260709 12:09:48.730593 22194 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:48.735387 23209 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:48.736894 22861 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:48.740605 23198 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:09:48.752655 23203 raft_consensus.cc:2955] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.754558 22189 raft_consensus.cc:2955] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.754848 23197 raft_consensus.cc:2955] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.720651 22018 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.773061 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 863b392474d94720808349fe27669b5b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:48.783468 22268 raft_consensus.cc:2955] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.788904 22861 raft_consensus.cc:2955] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.797319 22272 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:09:48.802923 22006 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 863b392474d94720808349fe27669b5b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:09:48.806073 22862 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.807994 23163 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.834138 22017 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New cstate: current_term: 2 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.841053 23160 raft_consensus.cc:2955] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.843799 22021 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.863932 22258 tablet_service.cc:1558] Processing DeleteTablet for tablet 863b392474d94720808349fe27669b5b with delete_type TABLET_DATA_TOMBSTONED (TS cc9b9c8894084021a0c6ddaf659d222e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57876
I20260709 12:09:48.868109 22862 raft_consensus.cc:2955] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.872802 23228 tablet_replica.cc:333] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:09:48.879812 22189 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.890548 23176 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:48.893651 22007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 54878b51479940bebc76fc9d84de64cb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:48.905316 22196 raft_consensus.cc:2955] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.913344 22861 raft_consensus.cc:2955] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.918545 22189 raft_consensus.cc:2955] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:48.920128 22021 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.921449 23228 raft_consensus.cc:2243] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:48.952438 23228 raft_consensus.cc:2272] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:48.955605 22111 tablet_service.cc:1558] Processing DeleteTablet for tablet 54878b51479940bebc76fc9d84de64cb with delete_type TABLET_DATA_TOMBSTONED (TS ea51e825f0ab4ea2bb6c4d0e29709ca3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36132
I20260709 12:09:48.965109 22116 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:48.972751 22267 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.974015 23228 ts_tablet_manager.cc:1916] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:48.974243 23203 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:49.004648 22862 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.011991 23209 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:49.063186 22272 raft_consensus.cc:2955] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.071987 22861 raft_consensus.cc:2955] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.031291 23181 raft_consensus.cc:2955] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.125201 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fc3d186560a74d7e8c4d29066e4e3567 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.125705 23229 tablet_replica.cc:333] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:09:49.127385 23229 raft_consensus.cc:2243] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.137400 22018 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.128631 23229 raft_consensus.cc:2272] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:49.141538 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 71052.6us
W20260709 12:09:49.143080 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 78338.8us
I20260709 12:09:49.157709 23229 ts_tablet_manager.cc:1916] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.184708 23228 ts_tablet_manager.cc:1929] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:09:49.186302 23228 log.cc:1199] T 863b392474d94720808349fe27669b5b P cc9b9c8894084021a0c6ddaf659d222e: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/wals/863b392474d94720808349fe27669b5b
I20260709 12:09:49.188197 22007 catalog_manager.cc:5028] TS cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): tablet 863b392474d94720808349fe27669b5b (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:49.193543 22180 tablet_service.cc:1558] Processing DeleteTablet for tablet fc3d186560a74d7e8c4d29066e4e3567 with delete_type TABLET_DATA_TOMBSTONED (TS 7d3f536360b444b1886777f4776be22c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56158
I20260709 12:09:49.200650 23231 raft_consensus.cc:1064] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:49.224399 23231 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:49.224747 23234 tablet_replica.cc:333] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:09:49.234692 23229 ts_tablet_manager.cc:1929] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.243554 23229 log.cc:1199] T 54878b51479940bebc76fc9d84de64cb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/wals/54878b51479940bebc76fc9d84de64cb
I20260709 12:09:49.244484 23234 raft_consensus.cc:2243] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.245313 23234 raft_consensus.cc:2272] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.245766 22006 catalog_manager.cc:5028] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): tablet 54878b51479940bebc76fc9d84de64cb (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:49.270128 23234 ts_tablet_manager.cc:1916] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.296845 22272 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.298384 23150 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.307355 22861 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.307781 22120 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.309336 23211 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.311509 23190 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.327858 23150 raft_consensus.cc:2955] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.328244 22862 raft_consensus.cc:2955] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.341463 23234 ts_tablet_manager.cc:1929] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.344172 23234 log.cc:1199] T fc3d186560a74d7e8c4d29066e4e3567 P 7d3f536360b444b1886777f4776be22c: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/wals/fc3d186560a74d7e8c4d29066e4e3567
I20260709 12:09:49.346501 22006 catalog_manager.cc:5028] TS 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): tablet fc3d186560a74d7e8c4d29066e4e3567 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:49.359175 22269 raft_consensus.cc:2955] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.387578 22017 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.391808 22120 raft_consensus.cc:2955] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.410909 22196 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:49.427237 22862 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.429598 22272 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.440336 23211 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.442615 23211 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:49.464892 23150 raft_consensus.cc:2955] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.476428 22269 raft_consensus.cc:2955] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.483085 22862 raft_consensus.cc:2955] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.499190 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5ea5fe59611e4539abcf87b4fd1a282c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.508540 22017 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:49.534332 22111 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ea5fe59611e4539abcf87b4fd1a282c with delete_type TABLET_DATA_TOMBSTONED (TS ea51e825f0ab4ea2bb6c4d0e29709ca3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36132
I20260709 12:09:49.535447 23229 tablet_replica.cc:333] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:09:49.536586 23229 raft_consensus.cc:2243] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.537355 23229 raft_consensus.cc:2272] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.541347 23229 ts_tablet_manager.cc:1916] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.566440 23229 ts_tablet_manager.cc:1929] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.566851 23229 log.cc:1199] T 5ea5fe59611e4539abcf87b4fd1a282c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/wals/5ea5fe59611e4539abcf87b4fd1a282c
I20260709 12:09:49.568547 22006 catalog_manager.cc:5028] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): tablet 5ea5fe59611e4539abcf87b4fd1a282c (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:50.685746 22189 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:50.693074 22272 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:50.694940 22163 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fac2244705d40569bd4a6e8161fb5e9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.695858 23211 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.698163 22123 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.701704 23211 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.716691 23190 raft_consensus.cc:2955] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:50.718182 22269 raft_consensus.cc:2955] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:50.764938 22017 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:50.767045 22123 raft_consensus.cc:2955] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:50.808964 22120 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:50.853193 22196 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.855232 23242 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.860858 22272 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:50.863232 22088 consensus_peers.cc:597] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 011db458534b4bc8876e63453a07b86b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.864348 23233 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.893061 23203 raft_consensus.cc:2955] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:50.894677 22272 raft_consensus.cc:2955] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:50.901234 22195 raft_consensus.cc:2955] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:50.923827 22269 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:50.924078 22021 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:50.938853 22237 consensus_peers.cc:597] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69f06d3e4d31493d8aa24b2983f369fe. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.947302 22196 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.962658 22123 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.967538 23239 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.997522 23239 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.010574 23230 raft_consensus.cc:2955] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:51.030747 22123 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:51.034112 22021 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.039032 22196 raft_consensus.cc:2955] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
W20260709 12:09:51.080086 22088 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 180ca53d6ccc4c27a39b8000ee3b67ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:51.080353 22189 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.083731 22269 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.084898 23242 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.086674 23233 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:51.138347 22123 raft_consensus.cc:2955] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:51.171340 23257 raft_consensus.cc:2955] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:51.177788 22269 raft_consensus.cc:2955] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:51.182957 22189 raft_consensus.cc:2955] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:51.211826 22021 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:51.398347 23263 ts_tablet_manager.cc:933] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:51.399693 23262 ts_tablet_manager.cc:933] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:51.419587 23263 tablet_copy_client.cc:323] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.195:38085
I20260709 12:09:51.421327 22282 tablet_copy_service.cc:140] P cc9b9c8894084021a0c6ddaf659d222e: Received BeginTabletCopySession request for tablet 69f06d3e4d31493d8aa24b2983f369fe from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:34878)
I20260709 12:09:51.421870 22282 tablet_copy_service.cc:161] P cc9b9c8894084021a0c6ddaf659d222e: Beginning new tablet copy session on tablet 69f06d3e4d31493d8aa24b2983f369fe from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:34878: session id = 164596fc2efa450581a5b68cad62271f-69f06d3e4d31493d8aa24b2983f369fe
I20260709 12:09:51.423655 23264 ts_tablet_manager.cc:933] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673)
I20260709 12:09:51.431171 22282 tablet_copy_source_session.cc:215] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.433851 23262 tablet_copy_client.cc:323] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
I20260709 12:09:51.443608 23263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f06d3e4d31493d8aa24b2983f369fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.445087 22208 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet 7fac2244705d40569bd4a6e8161fb5e9 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:09:51.448513 22208 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet 7fac2244705d40569bd4a6e8161fb5e9 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-7fac2244705d40569bd4a6e8161fb5e9
I20260709 12:09:51.459012 22208 tablet_copy_source_session.cc:215] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.462589 23262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fac2244705d40569bd4a6e8161fb5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.480363 23264 tablet_copy_client.cc:323] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.193:39673
I20260709 12:09:51.483520 22133 tablet_copy_service.cc:140] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Received BeginTabletCopySession request for tablet 011db458534b4bc8876e63453a07b86b from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:38186)
I20260709 12:09:51.484236 22133 tablet_copy_service.cc:161] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Beginning new tablet copy session on tablet 011db458534b4bc8876e63453a07b86b from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:38186: session id = 164596fc2efa450581a5b68cad62271f-011db458534b4bc8876e63453a07b86b
I20260709 12:09:51.506418 22133 tablet_copy_source_session.cc:215] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.518172 23264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011db458534b4bc8876e63453a07b86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.524736 23268 ts_tablet_manager.cc:933] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673)
I20260709 12:09:51.526638 23263 tablet_copy_client.cc:806] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.531836 23262 tablet_copy_client.cc:806] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.533134 23262 tablet_copy_client.cc:670] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.538717 23262 tablet_copy_client.cc:538] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.539150 23263 tablet_copy_client.cc:670] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.550210 23263 tablet_copy_client.cc:538] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.563148 23268 tablet_copy_client.cc:323] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.193:39673
I20260709 12:09:51.565284 23263 tablet_bootstrap.cc:492] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:51.566236 22133 tablet_copy_service.cc:140] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Received BeginTabletCopySession request for tablet 180ca53d6ccc4c27a39b8000ee3b67ff from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:38186)
I20260709 12:09:51.568296 22133 tablet_copy_service.cc:161] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Beginning new tablet copy session on tablet 180ca53d6ccc4c27a39b8000ee3b67ff from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:38186: session id = 164596fc2efa450581a5b68cad62271f-180ca53d6ccc4c27a39b8000ee3b67ff
I20260709 12:09:51.581466 22133 tablet_copy_source_session.cc:215] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.590874 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180ca53d6ccc4c27a39b8000ee3b67ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.605927 23264 tablet_copy_client.cc:806] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.607065 23264 tablet_copy_client.cc:670] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.615178 23264 tablet_copy_client.cc:538] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.623057 23262 tablet_bootstrap.cc:492] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:51.644846 23264 tablet_bootstrap.cc:492] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:51.669714 23268 tablet_copy_client.cc:806] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.670475 23268 tablet_copy_client.cc:670] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.675359 23268 tablet_copy_client.cc:538] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.718415 23263 tablet_bootstrap.cc:492] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.719434 23263 tablet_bootstrap.cc:492] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:51.723111 23263 ts_tablet_manager.cc:1403] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.158s	user 0.022s	sys 0.014s
I20260709 12:09:51.724012 23268 tablet_bootstrap.cc:492] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:51.758962 23262 tablet_bootstrap.cc:492] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.763535 23262 tablet_bootstrap.cc:492] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:51.763823 23263 raft_consensus.cc:359] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:51.764564 23262 ts_tablet_manager.cc:1403] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.142s	user 0.021s	sys 0.010s
I20260709 12:09:51.764880 23263 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:51.768415 23263 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:51.774425 23262 raft_consensus.cc:359] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:51.784190 23262 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:51.803263 23263 ts_tablet_manager.cc:1434] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.077s	user 0.011s	sys 0.009s
I20260709 12:09:51.801155 23262 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:51.805258 22282 tablet_copy_service.cc:342] P cc9b9c8894084021a0c6ddaf659d222e: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-69f06d3e4d31493d8aa24b2983f369fe received from {username='slave'} at 127.0.0.1:34878
I20260709 12:09:51.805714 22282 tablet_copy_service.cc:434] P cc9b9c8894084021a0c6ddaf659d222e: ending tablet copy session 164596fc2efa450581a5b68cad62271f-69f06d3e4d31493d8aa24b2983f369fe on tablet 69f06d3e4d31493d8aa24b2983f369fe with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:51.813740 23264 tablet_bootstrap.cc:492] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.817881 23264 tablet_bootstrap.cc:492] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:51.818657 23264 ts_tablet_manager.cc:1403] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.174s	user 0.030s	sys 0.011s
I20260709 12:09:51.821890 23264 raft_consensus.cc:359] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:51.829380 23264 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:51.823868 23262 ts_tablet_manager.cc:1434] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.003s
I20260709 12:09:51.846621 22208 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-7fac2244705d40569bd4a6e8161fb5e9 received from {username='slave'} at 127.0.0.1:37260
I20260709 12:09:51.847278 22208 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-7fac2244705d40569bd4a6e8161fb5e9 on tablet 7fac2244705d40569bd4a6e8161fb5e9 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:51.838995 23264 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:51.861356 23264 ts_tablet_manager.cc:1434] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:09:51.879576 23268 tablet_bootstrap.cc:492] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.880961 23268 tablet_bootstrap.cc:492] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:51.881953 23268 ts_tablet_manager.cc:1403] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.160s	user 0.020s	sys 0.028s
I20260709 12:09:51.884832 22133 tablet_copy_service.cc:342] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-011db458534b4bc8876e63453a07b86b received from {username='slave'} at 127.0.0.1:38186
I20260709 12:09:51.885385 22133 tablet_copy_service.cc:434] P ea51e825f0ab4ea2bb6c4d0e29709ca3: ending tablet copy session 164596fc2efa450581a5b68cad62271f-011db458534b4bc8876e63453a07b86b on tablet 011db458534b4bc8876e63453a07b86b with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:51.885785 23268 raft_consensus.cc:359] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:51.886863 23268 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:51.887712 23268 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:51.891853 22862 raft_consensus.cc:1217] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.899807 23268 ts_tablet_manager.cc:1434] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:09:51.902792 22133 tablet_copy_service.cc:342] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-180ca53d6ccc4c27a39b8000ee3b67ff received from {username='slave'} at 127.0.0.1:38186
I20260709 12:09:51.903277 22133 tablet_copy_service.cc:434] P ea51e825f0ab4ea2bb6c4d0e29709ca3: ending tablet copy session 164596fc2efa450581a5b68cad62271f-180ca53d6ccc4c27a39b8000ee3b67ff on tablet 180ca53d6ccc4c27a39b8000ee3b67ff with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:51.908227 22862 raft_consensus.cc:1217] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.982173 22862 raft_consensus.cc:1217] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.995082 22862 raft_consensus.cc:1217] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:52.250319 23240 raft_consensus.cc:1064] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:52.256229 23240 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:52.275192 22196 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.277228 23241 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.280246 22862 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.291971 23239 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.307507 22123 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.311097 23278 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.317669 23231 raft_consensus.cc:1064] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:52.320356 23231 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:52.362601 22267 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.361366 23278 raft_consensus.cc:2955] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.364254 23246 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.366798 22863 raft_consensus.cc:2955] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.372292 22123 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.372227 22862 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.374225 23211 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.373533 22116 raft_consensus.cc:2955] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.375670 23246 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.423491 22018 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.448997 22196 raft_consensus.cc:2955] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.477967 22123 raft_consensus.cc:2955] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.475566 23211 raft_consensus.cc:2955] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.496598 22267 raft_consensus.cc:2955] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.510421 22863 raft_consensus.cc:2955] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:09:52.568660 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 53702.5us
I20260709 12:09:52.576759 23257 raft_consensus.cc:1064] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:52.579769 23257 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:52.599748 22862 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.601468 22267 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.602788 23233 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.607370 23233 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.642119 23298 raft_consensus.cc:1064] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:52.645445 23298 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:52.658821 23233 raft_consensus.cc:2955] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:09:52.673033 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 97838.7us
W20260709 12:09:52.674214 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 96008.8us
I20260709 12:09:52.692088 22269 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:52.703866 22862 raft_consensus.cc:2955] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.709882 22017 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.711011 22861 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.712596 23285 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:09:52.730937 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56795.6us
I20260709 12:09:52.733536 23285 raft_consensus.cc:2955] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.745297 22861 raft_consensus.cc:2955] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.750317 22007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 69f06d3e4d31493d8aa24b2983f369fe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.768350 22196 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.777208 22189 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:52.781659 22018 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.792021 22267 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.803371 23233 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.801239 22265 raft_consensus.cc:2955] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.794492 22194 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.805765 23298 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.813444 22018 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.825798 22194 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.826841 22862 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.831955 23290 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.841080 22861 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.845472 23233 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.866328 22116 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:52.873548 22123 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.876796 22111 tablet_service.cc:1558] Processing DeleteTablet for tablet 69f06d3e4d31493d8aa24b2983f369fe with delete_type TABLET_DATA_TOMBSTONED (TS ea51e825f0ab4ea2bb6c4d0e29709ca3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36132
I20260709 12:09:52.887606 22189 raft_consensus.cc:2955] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.888679 23292 raft_consensus.cc:2955] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.897629 22269 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.903656 23233 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.908026 23279 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.908217 22864 raft_consensus.cc:2955] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.931444 23233 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.904011 22861 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.915642 23307 tablet_replica.cc:333] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:09:52.938308 23257 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.938854 23307 raft_consensus.cc:2243] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.941624 22196 raft_consensus.cc:2955] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.949039 23307 raft_consensus.cc:2272] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.949605 23301 raft_consensus.cc:2955] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.953255 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7fac2244705d40569bd4a6e8161fb5e9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.952327 22861 raft_consensus.cc:2955] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.965906 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 011db458534b4bc8876e63453a07b86b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.964821 22269 raft_consensus.cc:2955] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.977489 23307 ts_tablet_manager.cc:1916] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.983163 22021 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.991132 23302 raft_consensus.cc:2955] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:52.987011 22018 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:53.002118 22180 tablet_service.cc:1558] Processing DeleteTablet for tablet 011db458534b4bc8876e63453a07b86b with delete_type TABLET_DATA_TOMBSTONED (TS 7d3f536360b444b1886777f4776be22c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56158
I20260709 12:09:53.005283 22862 raft_consensus.cc:2955] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:53.054986 23290 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.057271 22258 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fac2244705d40569bd4a6e8161fb5e9 with delete_type TABLET_DATA_TOMBSTONED (TS cc9b9c8894084021a0c6ddaf659d222e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57876
I20260709 12:09:53.059347 22020 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:53.066174 22267 raft_consensus.cc:2955] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:53.080278 23309 tablet_replica.cc:333] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:09:53.082167 23309 raft_consensus.cc:2243] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.099812 23309 raft_consensus.cc:2272] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.093775 23308 tablet_replica.cc:333] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:09:53.113139 23308 raft_consensus.cc:2243] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.110399 22123 raft_consensus.cc:2955] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:53.124555 23308 raft_consensus.cc:2272] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.141084 23309 ts_tablet_manager.cc:1916] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.153208 23308 ts_tablet_manager.cc:1916] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.163009 23307 ts_tablet_manager.cc:1929] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.174191 23307 log.cc:1199] T 69f06d3e4d31493d8aa24b2983f369fe P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/wals/69f06d3e4d31493d8aa24b2983f369fe
I20260709 12:09:53.176249 22006 catalog_manager.cc:5028] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): tablet 69f06d3e4d31493d8aa24b2983f369fe (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:53.221870 23309 ts_tablet_manager.cc:1929] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.227707 23309 log.cc:1199] T 7fac2244705d40569bd4a6e8161fb5e9 P cc9b9c8894084021a0c6ddaf659d222e: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/wals/7fac2244705d40569bd4a6e8161fb5e9
I20260709 12:09:53.229423 22007 catalog_manager.cc:5028] TS cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): tablet 7fac2244705d40569bd4a6e8161fb5e9 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:53.232080 22123 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:53.258126 22861 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.260946 22192 raft_consensus.cc:2955] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:53.264644 23299 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:53.280004 23203 raft_consensus.cc:2955] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:53.286404 22861 raft_consensus.cc:2955] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:53.314857 22018 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:53.317270 22193 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.320511 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 180ca53d6ccc4c27a39b8000ee3b67ff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:53.339857 22258 tablet_service.cc:1558] Processing DeleteTablet for tablet 180ca53d6ccc4c27a39b8000ee3b67ff with delete_type TABLET_DATA_TOMBSTONED (TS cc9b9c8894084021a0c6ddaf659d222e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57876
I20260709 12:09:53.340981 23309 tablet_replica.cc:333] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:09:53.395164 23308 ts_tablet_manager.cc:1929] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.395736 23308 log.cc:1199] T 011db458534b4bc8876e63453a07b86b P 7d3f536360b444b1886777f4776be22c: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/wals/011db458534b4bc8876e63453a07b86b
I20260709 12:09:53.397933 22006 catalog_manager.cc:5028] TS 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): tablet 011db458534b4bc8876e63453a07b86b (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:53.399991 23309 raft_consensus.cc:2243] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.400905 23309 raft_consensus.cc:2272] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.404578 23309 ts_tablet_manager.cc:1916] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.419883 23309 ts_tablet_manager.cc:1929] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.420403 23309 log.cc:1199] T 180ca53d6ccc4c27a39b8000ee3b67ff P cc9b9c8894084021a0c6ddaf659d222e: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/wals/180ca53d6ccc4c27a39b8000ee3b67ff
I20260709 12:09:53.422250 22007 catalog_manager.cc:5028] TS cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): tablet 180ca53d6ccc4c27a39b8000ee3b67ff (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:09:53.428380 23203 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.440631 22192 raft_consensus.cc:2955] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:54.170646 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.459887 22116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:09:54.460906 22116 raft_consensus.cc:606] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
W20260709 12:09:54.498628 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 163930us
I20260709 12:09:54.552716 23311 raft_consensus.cc:993] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:54.553310 23311 raft_consensus.cc:1081] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:54.555312 22189 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:55838
I20260709 12:09:54.555966 22189 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.556304 22189 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.563057 22189 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:54.580476 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:54.581135 22116 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.581450 22116 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:54.582229 22116 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:54.583396 22116 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.587821 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44679affd4554006a2cb59b10b589a27"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:09:54.588464 22190 raft_consensus.cc:606] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
I20260709 12:09:54.591602 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44711cbd4d234e36807a94726a691570"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:09:54.592155 22190 raft_consensus.cc:606] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
I20260709 12:09:54.608678 22189 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:54.613493 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:54.614346 22267 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.616681 22116 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:54.621304 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:54.623626 22267 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:54.623838 23290 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.624804 23290 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:54.625804 23290 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:54.637181 22267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:09:54.637916 22267 raft_consensus.cc:606] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
I20260709 12:09:54.641175 22189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:09:54.641842 22189 raft_consensus.cc:606] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
I20260709 12:09:54.647214 22267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9255592b74304240a5fa1df814fbb726"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:09:54.647825 22267 raft_consensus.cc:606] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:09:54.650828 23291 raft_consensus.cc:993] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: : Instructing follower 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:54.651448 23291 raft_consensus.cc:1081] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Signalling peer 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:54.652691 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:54.653208 22861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44679affd4554006a2cb59b10b589a27"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:56950
I20260709 12:09:54.653862 22861 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.654223 22861 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.654618 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:54.655810 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.661890 22861 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:54.664878 22861 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:54.674507 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:54.675210 22189 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.675575 22189 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:54.676429 22189 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:54.679630 22189 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.682891 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:54.683622 22116 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.693686 22020 catalog_manager.cc:5697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.721144 22189 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:54.722759 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:09:54.719748 22116 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:54.733194 23322 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.771777 23322 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:09:54.773262 23322 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:09:54.774921 22069 auto_rebalancer.cc:629] Failed to schedule move for tablet 43c89655d0564df0b63993d88160eb8e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:09:54.782024 22190 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:54.797950 23316 raft_consensus.cc:993] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: : Instructing follower 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:54.798532 23240 raft_consensus.cc:1081] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Signalling peer 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:54.804183 22861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:56938
I20260709 12:09:54.804888 22861 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.805284 22861 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.824247 22020 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 2 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.826303 22861 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:54.830020 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:54.830380 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:54.830703 22189 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.830996 22267 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.831343 22267 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:54.832155 22267 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:54.833319 22267 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.837957 22189 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:54.839367 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:09:54.840340 23322 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.840854 23322 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:09:54.841717 23322 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:54.869973 23291 raft_consensus.cc:993] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: : Instructing follower 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:54.870674 23291 raft_consensus.cc:1081] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Signalling peer 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:54.875763 22864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44711cbd4d234e36807a94726a691570"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:56950
I20260709 12:09:54.876412 22864 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.876845 22864 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.935030 23240 raft_consensus.cc:993] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:54.935806 23240 raft_consensus.cc:1081] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:54.960994 23290 raft_consensus.cc:993] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: : Instructing follower 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:54.961803 23290 raft_consensus.cc:1081] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Signalling peer 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:54.989907 22863 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:56950
I20260709 12:09:54.990850 22863 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.991309 22863 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.017756 22198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9255592b74304240a5fa1df814fbb726"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:55836
I20260709 12:09:55.018437 22198 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.018857 22198 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.028164 22198 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:55.030347 22198 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:55.034430 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:55.035306 22265 raft_consensus.cc:3055] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.035686 22265 raft_consensus.cc:740] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:55.036669 22265 consensus_queue.cc:260] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:55.038475 22265 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.045281 22272 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.048375 22861 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:55.055361 22265 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:55.057919 22267 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:55.065775 22863 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:55.074257 22863 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:55.054361 23291 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:09:55.075681 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:55.076247 22198 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.076320 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:55.076584 22198 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:55.076879 22116 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.077316 22198 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:55.078377 22198 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.084709 22116 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:55.087563 22198 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:55.061146 22163 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:55.089141 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:55.096979 22267 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:55.102605 23322 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.103603 23322 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:09:55.100138 22020 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 2, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 2 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.107719 23328 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.107285 23322 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:55.116447 23328 raft_consensus.cc:697] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:55.118547 23328 consensus_queue.cc:237] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:55.065574 22864 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:09:55.180317 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 81948.2us
I20260709 12:09:55.186309 22864 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:55.200037 23333 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.201053 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:55.201679 22116 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.200138 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:55.206766 22190 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.207221 22190 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:55.208148 22190 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:55.209334 22190 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.212157 22123 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.213954 23324 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.218406 22116 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:55.219550 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:55.220911 23324 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.225667 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:55.226300 22116 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.234261 22116 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
W20260709 12:09:55.254500 22163 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8f422c5da2840e0b466894312ebcd44. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:55.277487 22123 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:55.277091 23332 raft_consensus.cc:2955] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:55.292022 23324 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:09:55.295344 22190 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:55.295979 23324 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:55.306583 23328 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 12:09:55.333521 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49695.7us
I20260709 12:09:55.342490 22018 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 2 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:55.354287 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 65545.2us
I20260709 12:09:55.357937 22020 catalog_manager.cc:5697] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.386907 22192 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.387053 22198 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.374485 22120 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:55.396317 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 115809us
I20260709 12:09:55.389493 23322 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:09:55.408252 22018 catalog_manager.cc:5697] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 2 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.420603 22265 raft_consensus.cc:2955] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
W20260709 12:09:55.422665 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 84151.7us
I20260709 12:09:55.392877 23343 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:09:55.446218 23291 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.458125 22116 raft_consensus.cc:2955] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
W20260709 12:09:55.496559 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47671.4us
W20260709 12:09:55.567920 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47657.5us
W20260709 12:09:55.575536 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 75458.2us
I20260709 12:09:55.589238 22265 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:55.590854 22267 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.596053 23324 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.607446 22116 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.642159 22020 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:55.651078 23340 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:55.653616 22193 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.673571 23324 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.683892 22116 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.703279 23292 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.705021 22266 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.717975 22117 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.722205 23322 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:55.753710 22198 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.762324 23340 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:55.711634 23334 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:09:55.825910 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:09:56.098074 22237 consensus_peers.cc:597] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d6f694768d144aa85616d8c7b2453f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:56.118211 22193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:09:56.119266 22193 raft_consensus.cc:606] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
W20260709 12:09:56.259215 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 103114us
I20260709 12:09:56.266062 23375 ts_tablet_manager.cc:933] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:56.309252 23375 tablet_copy_client.cc:323] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
W20260709 12:09:56.346848 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 86629.1us
I20260709 12:09:56.349677 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:09:56.351593 22192 raft_consensus.cc:606] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:56.359037 22208 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet a8f422c5da2840e0b466894312ebcd44 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:09:56.360113 22208 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet a8f422c5da2840e0b466894312ebcd44 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-a8f422c5da2840e0b466894312ebcd44
I20260709 12:09:56.375607 23334 raft_consensus.cc:993] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: : Instructing follower 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:56.380007 23381 raft_consensus.cc:1081] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Signalling peer 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:56.388949 22863 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:56950
I20260709 12:09:56.391780 22863 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.392405 22863 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:56.455016 23376 log.cc:927] Time spent T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.208s	user 0.004s	sys 0.000s
I20260709 12:09:56.467224 22208 tablet_copy_source_session.cc:215] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:56.521950 22863 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:56.562131 22117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:09:56.562896 22117 raft_consensus.cc:606] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:09:56.577530 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:56.579046 22269 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:56.586303 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 49135.8us
I20260709 12:09:56.596938 22863 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:56.610167 22268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:09:56.610903 22268 raft_consensus.cc:606] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
W20260709 12:09:56.495898 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 230799us
I20260709 12:09:56.623391 22269 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:56.628360 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:56.657409 22117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:09:56.658244 22117 raft_consensus.cc:606] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:09:56.660928 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 175593us
I20260709 12:09:56.663894 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:56.664515 22198 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.664826 22198 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:56.665810 22198 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:56.672498 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:56.673178 22198 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.674008 23390 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.676450 23390 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:09:56.679085 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:56.680490 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:56.683554 23390 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:09:56.703128 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 75044.3us
W20260709 12:09:56.706725 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51075.2us
I20260709 12:09:56.719882 23378 raft_consensus.cc:993] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:09:56.720527 23334 raft_consensus.cc:1081] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:09:56.733176 22266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45844
I20260709 12:09:56.733929 22266 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.734373 22266 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.767270 23392 ts_tablet_manager.cc:933] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:56.772428 23375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f422c5da2840e0b466894312ebcd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:56.783622 22198 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:56.781296 22266 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:56.794981 23392 tablet_copy_client.cc:323] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.195:38085
I20260709 12:09:56.814709 22266 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:56.816550 22282 tablet_copy_service.cc:140] P cc9b9c8894084021a0c6ddaf659d222e: Received BeginTabletCopySession request for tablet 8d6f694768d144aa85616d8c7b2453f0 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:34878)
I20260709 12:09:56.817414 22282 tablet_copy_service.cc:161] P cc9b9c8894084021a0c6ddaf659d222e: Beginning new tablet copy session on tablet 8d6f694768d144aa85616d8c7b2453f0 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:34878: session id = 164596fc2efa450581a5b68cad62271f-8d6f694768d144aa85616d8c7b2453f0
I20260709 12:09:56.866149 23203 raft_consensus.cc:993] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:09:56.861927 22190 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:56.868522 23386 raft_consensus.cc:1081] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:09:56.856833 22018 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 2 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:56.872219 22282 tablet_copy_source_session.cc:215] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:56.893314 22267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45860
I20260709 12:09:56.893944 22267 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.894430 22267 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.898216 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:56.898872 22120 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.899694 23392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d6f694768d144aa85616d8c7b2453f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:56.907281 23386 raft_consensus.cc:993] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:56.907939 23386 raft_consensus.cc:1081] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:56.911307 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:56.912011 22189 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.912313 22189 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:56.913062 22189 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:56.915197 22189 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.925745 22120 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:09:56.931756 22121 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.934541 23380 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:56.945945 22267 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:56.948145 22267 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:56.963769 22272 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.964705 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:56.965584 22120 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.965971 22120 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:56.962829 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:56.986658 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:56.973992 22120 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:56.988576 22194 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.989777 23380 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.001036 22194 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:09:57.006837 22194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:55838
I20260709 12:09:57.007579 22194 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.008057 22194 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:57.008294 23397 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:09:56.989379 23386 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:09:57.000560 23380 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:57.015415 22194 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:57.025022 22189 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:09:57.032876 22194 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:57.033361 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:57.037209 22189 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:57.039094 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:57.041357 22121 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.041675 22121 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:57.050426 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:57.051054 22265 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.051949 22121 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:57.056842 22121 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.057078 23351 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.057781 23351 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:57.012173 23380 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:57.058799 23351 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:57.079664 23375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56950 (request call id 229) took 1302 ms. Trace:
I20260709 12:09:57.080262 23375 rpcz_store.cc:276] 0709 12:09:55.777438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.788880 (+ 11442us) service_pool.cc:224] Handling call
0709 12:09:56.285582 (+496702us) ts_tablet_manager.cc:934] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
0709 12:09:56.770508 (+484926us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:56.984953 (+214445us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:56.991465 (+  6512us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:57.077342 (+ 85877us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:57.077674 (+   332us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:57.079470 (+  1796us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:57.079588 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":348,"tablet-copy.queue_time_us":476413,"thread_start_us":482243,"threads_started":2}
I20260709 12:09:57.083443 23375 tablet_copy_client.cc:806] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:57.084151 23375 tablet_copy_client.cc:670] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:57.086114 23316 raft_consensus.cc:993] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:57.086750 23316 raft_consensus.cc:1081] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:57.089517 23375 tablet_copy_client.cc:538] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:57.103204 23392 tablet_copy_client.cc:806] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:57.111366 22121 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:57.110092 23405 raft_consensus.cc:2955] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:57.125102 22265 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:57.126672 22266 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:57.140472 22195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:55836
I20260709 12:09:57.141237 22195 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.141626 22195 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.134357 23392 tablet_copy_client.cc:670] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:57.142940 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:57.144212 23381 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.146088 22121 raft_consensus.cc:2955] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:57.144979 23381 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:57.161507 22194 raft_consensus.cc:2955] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:57.165679 22120 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.173422 23392 tablet_copy_client.cc:538] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:57.192466 22020 catalog_manager.cc:5697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:57.197865 22190 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.199628 23340 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:57.149956 23381 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:57.203593 23405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34870 (request call id 5) took 1717 ms. Trace:
I20260709 12:09:57.184413 22120 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:09:57.204041 23405 rpcz_store.cc:276] 0709 12:09:55.485824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.490431 (+  4607us) service_pool.cc:224] Handling call
0709 12:09:55.586890 (+ 96459us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b58002702d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd1e0aa 00007fccedda0447 00007fcceddbd70a 00007fcceddbe76a 00007fcceddbd91b 00007fcceddc903c 00007fcceddc86b3 00007fccf2d88d29 00007fccec3071d4 00007fccec307162
0709 12:09:55.630849 (+ 43959us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4c002ea0c0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec08ea20 00007fccec09fa29 00007fccec065644 00007fccec08cf2d 00007fccec08cb93 00007fccedd1b1af 00007fccedd1af3e 00007fccedda0888 00007fcceddbd75c 00007fcceddbe76a 00007fcceddbd91b
0709 12:09:55.634012 (+  3163us) log.cc:844] Serialized 513 byte log entry
0709 12:09:56.417420 (+783408us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b2c000682a8. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6caa0a 00007fccec6ca693 00007fccec6ca631 00007fcceddfeb52 00007fcceddfecf5 00007fccedd3b691 00007fccedd1beaa 00007fccedd22d53 00007fccedd22cd9 00007fccedd22c69
0709 12:09:56.422941 (+  5521us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b18003438a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:09:57.203509 (+780568us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":412,"raft.queue_time_us":10444,"raft.run_cpu_time_us":3217,"raft.run_wall_time_us":272924,"spinlock_wait_cycles":164068480,"thread_start_us":493746,"threads_started":1,"wal-append.queue_time_us":594967}
I20260709 12:09:57.237201 22195 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:57.228425 22192 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:57.239156 22194 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:57.244614 23392 tablet_bootstrap.cc:492] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:57.258358 22265 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.260164 23375 tablet_bootstrap.cc:492] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:57.260310 23340 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:09:57.271694 22021 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:57.281188 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:57.281831 22120 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.286729 22195 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:57.288380 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:57.291534 22120 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:57.296188 22162 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:57.298215 23333 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.270197 23351 consensus_queue.cc:1059] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:09:57.307351 22017 catalog_manager.cc:5697] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.309773 22265 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:57.313745 22266 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.313520 23328 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:57.314110 22266 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:57.317095 22266 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:09:57.321765 22163 consensus_peers.cc:597] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4dd2e5184fad402e8f3b26ea46e3c996. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:57.325320 22120 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:57.325800 22266 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.318066 23333 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:57.327905 23333 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:57.331705 23378 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:09:57.352764 22266 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
W20260709 12:09:57.362486 23351 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
W20260709 12:09:57.461249 23416 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 12:09:57.451049 23414 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260709 12:09:57.493743 22195 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.545629 23404 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:09:57.573232 23382 raft_consensus.cc:2955] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:57.582952 22117 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.589293 23392 tablet_bootstrap.cc:492] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:09:57.594687 22020 catalog_manager.cc:5697] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:57.598852 23285 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:57.602877 22123 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.592175 23392 tablet_bootstrap.cc:492] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:57.617350 22123 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.615459 23361 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:09:57.624603 23392 ts_tablet_manager.cc:1403] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.380s	user 0.063s	sys 0.047s
I20260709 12:09:57.628409 22195 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.638576 23328 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:57.662712 22120 raft_consensus.cc:2955] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:57.674275 23285 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:09:57.672659 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 140046us
I20260709 12:09:57.796277 22266 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.835477 23392 raft_consensus.cc:359] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:57.838217 23392 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:57.839130 23392 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:57.847409 22017 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:57.851539 22117 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.889122 23428 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:09:57.918565 23392 ts_tablet_manager.cc:1434] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.293s	user 0.007s	sys 0.003s
W20260709 12:09:57.959687 23432 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260709 12:09:57.961768 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:09:57.982658 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 172652us
I20260709 12:09:57.987883 23430 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:57.982463 23375 tablet_bootstrap.cc:492] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:57.992519 23375 tablet_bootstrap.cc:492] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:58.006428 22282 tablet_copy_service.cc:342] P cc9b9c8894084021a0c6ddaf659d222e: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-8d6f694768d144aa85616d8c7b2453f0 received from {username='slave'} at 127.0.0.1:34878
I20260709 12:09:58.007124 22282 tablet_copy_service.cc:434] P cc9b9c8894084021a0c6ddaf659d222e: ending tablet copy session 164596fc2efa450581a5b68cad62271f-8d6f694768d144aa85616d8c7b2453f0 on tablet 8d6f694768d144aa85616d8c7b2453f0 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:58.009408 23375 ts_tablet_manager.cc:1403] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.750s	user 0.039s	sys 0.008s
I20260709 12:09:58.013752 23375 raft_consensus.cc:359] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:58.015370 23375 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:09:58.001356 22266 raft_consensus.cc:2955] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:58.016402 23375 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:58.069010 23375 ts_tablet_manager.cc:1434] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.003s
I20260709 12:09:58.075413 22208 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-a8f422c5da2840e0b466894312ebcd44 received from {username='slave'} at 127.0.0.1:37260
I20260709 12:09:58.075932 22208 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-a8f422c5da2840e0b466894312ebcd44 on tablet a8f422c5da2840e0b466894312ebcd44 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:58.065856 23392 ts_tablet_manager.cc:933] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:58.114105 22272 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:58.143358 22017 catalog_manager.cc:5697] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 1 to 2, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:09:58.145918 23382 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.179010 23392 tablet_copy_client.cc:323] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
I20260709 12:09:58.199513 22862 raft_consensus.cc:1217] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:58.202080 22208 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet 4dd2e5184fad402e8f3b26ea46e3c996 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:09:58.205228 22208 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet 4dd2e5184fad402e8f3b26ea46e3c996 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-4dd2e5184fad402e8f3b26ea46e3c996
I20260709 12:09:58.200486 22862 raft_consensus.cc:2955] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:09:58.255009 22266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:09:58.255733 22266 raft_consensus.cc:606] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:09:58.262925 22116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:09:58.263667 22116 raft_consensus.cc:606] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:09:58.275303 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:09:58.275919 22192 raft_consensus.cc:606] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
I20260709 12:09:58.276798 22208 tablet_copy_source_session.cc:215] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:58.280620 23392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd2e5184fad402e8f3b26ea46e3c996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:58.278966 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:09:58.286096 22192 raft_consensus.cc:606] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
I20260709 12:09:58.289132 22266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1fb787db87147b3be49bef974365af1"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:09:58.289841 22266 raft_consensus.cc:606] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:09:58.291306 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:58.293323 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:58.300025 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:58.318634 23392 tablet_copy_client.cc:806] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:58.322002 23392 tablet_copy_client.cc:670] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:58.326534 23392 tablet_copy_client.cc:538] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:58.352936 23392 tablet_bootstrap.cc:492] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:09:58.382423 23407 raft_consensus.cc:993] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:58.383033 23407 raft_consensus.cc:1081] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:58.389758 23383 raft_consensus.cc:993] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:09:58.390267 23383 raft_consensus.cc:1081] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:09:58.400949 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45860
I20260709 12:09:58.401580 22269 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.402834 22269 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.414433 23361 raft_consensus.cc:993] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:58.416635 23361 raft_consensus.cc:1081] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:09:58.430953 23440 raft_consensus.cc:993] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: : Instructing follower 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:58.431511 23440 raft_consensus.cc:1081] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Signalling peer 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:58.434159 22864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:56950
I20260709 12:09:58.434768 22864 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.435137 22864 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.454609 22198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1fb787db87147b3be49bef974365af1"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:55836
I20260709 12:09:58.455215 22198 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.455595 22198 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.455858 22269 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:58.462203 22269 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:09:58.464341 22190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:55836
I20260709 12:09:58.477787 22190 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.478257 22190 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.507210 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:58.507845 22120 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.508123 22120 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:09:58.509560 22198 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:58.519708 22198 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:58.519917 22120 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:58.520617 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:58.521407 22269 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.521704 22269 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:58.526456 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:09:58.527091 22123 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.522398 22269 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:58.529340 22269 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.532737 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:58.533409 22195 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.541024 22120 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.496887 22864 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:58.548031 22864 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:58.548695 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:58.549748 22192 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.548681 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:58.550091 22192 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:58.550524 22272 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.550958 22192 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:58.552374 22192 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.551966 22190 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:58.554423 22123 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:58.555173 22190 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:09:58.560537 22192 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:58.561756 22272 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:58.563059 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:09:58.563390 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:58.563952 22266 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.564011 23422 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.564368 22266 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:58.564555 23422 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:09:58.565260 22266 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:58.565482 23422 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:58.566421 22266 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.569413 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:09:58.570068 22864 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.576731 22269 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:58.561759 22120 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:09:58.576798 22266 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:09:58.582291 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:58.583236 23425 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.583935 23425 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:58.585075 23425 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:58.588758 22195 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:09:58.591487 22862 raft_consensus.cc:1217] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:58.592379 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:58.593379 23328 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.593556 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:09:58.594094 23328 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:58.599436 23328 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:58.600322 23361 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.602401 23361 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:09:58.603376 23361 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:09:58.683938 22017 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.688213 23404 raft_consensus.cc:1064] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:58.711050 22020 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 2 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.732028 23381 raft_consensus.cc:993] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: : Instructing follower 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:58.732576 23381 raft_consensus.cc:1081] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Signalling peer 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:09:58.734429 22863 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:56950
I20260709 12:09:58.735002 22863 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.735368 22863 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.726059 22864 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
W20260709 12:09:58.784317 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 45243.3us
W20260709 12:09:58.804132 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 78295.2us
I20260709 12:09:58.898918 23392 tablet_bootstrap.cc:492] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:58.899925 23392 tablet_bootstrap.cc:492] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:09:58.889173 22018 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.900615 23392 ts_tablet_manager.cc:1403] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.548s	user 0.037s	sys 0.007s
I20260709 12:09:58.916451 23404 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:58.923296 22863 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:58.926040 22863 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:09:58.929570 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:09:58.930183 22266 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.938584 23392 raft_consensus.cc:359] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:58.939457 23392 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
W20260709 12:09:58.904274 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 138499us
I20260709 12:09:58.978259 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:09:58.978900 22190 raft_consensus.cc:3055] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.979209 22190 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:09:58.979997 22190 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:58.981392 22190 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.940153 23392 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:09:58.989904 22272 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:58.993468 22266 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:58.995133 22831 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:09:58.995992 23458 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.996455 23458 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:09:58.997098 23422 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:59.000087 22266 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.003926 23328 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.997385 23458 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:59.017583 22193 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:59.018000 22863 raft_consensus.cc:1217] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:59.023823 23457 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:59.026854 22121 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:59.037967 23351 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:59.039206 22190 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:09:59.040928 22269 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.045670 23328 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:59.046227 22863 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:59.070726 22190 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.072431 23458 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:59.075006 23392 ts_tablet_manager.cc:1434] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.172s	user 0.008s	sys 0.000s
I20260709 12:09:59.102860 23291 raft_consensus.cc:1064] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:59.057217 23351 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:09:59.143344 22121 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.161998 22192 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.139017 23291 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:59.167197 23404 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:09:59.182651 22864 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.184412 22208 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-4dd2e5184fad402e8f3b26ea46e3c996 received from {username='slave'} at 127.0.0.1:37260
I20260709 12:09:59.200806 22208 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-4dd2e5184fad402e8f3b26ea46e3c996 on tablet 4dd2e5184fad402e8f3b26ea46e3c996 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:09:59.196764 23361 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:09:59.211004 23440 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:09:59.225546 23466 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:09:59.231787 23351 raft_consensus.cc:2955] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:59.245046 22863 raft_consensus.cc:2955] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:09:59.334187 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 209422us
I20260709 12:09:59.527817 22017 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:59.571983 22116 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.296463 22190 raft_consensus.cc:2955] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:59.612123 22265 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:59.588032 22117 raft_consensus.cc:2955] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:59.550366 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:59.622969 22198 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.625571 23393 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:59.581166 22272 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.635049 23393 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:59.643921 22117 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:59.645846 22862 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:59.710784 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56735.6us
I20260709 12:09:59.713480 23487 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:59.756790 23292 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:59.775465 23334 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.790560 23486 raft_consensus.cc:1064] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:09:59.794526 23381 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:59.807511 23486 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:09:59.807353 22021 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:09:59.829635 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 75367.1us
I20260709 12:09:59.905666 23292 raft_consensus.cc:2955] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:59.907315 22864 raft_consensus.cc:2955] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:59.920652 22265 raft_consensus.cc:2955] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:09:59.924893 22266 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:59.935916 22020 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 2 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:59.946311 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 55286.5us
I20260709 12:09:59.971556 22864 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:59.974946 23496 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:09:59.947697 23486 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:09:59.985589 23292 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:59.992377 22117 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:10:00.003480 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 106259us
I20260709 12:10:00.005596 22117 raft_consensus.cc:2955] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.009003 22265 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:00.021899 22017 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.038422 22122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:10:00.038971 22863 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:00.039259 22122 raft_consensus.cc:606] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:10:00.021982 23334 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:00.052628 23457 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:10:00.102778 22268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:10:00.103542 22268 raft_consensus.cc:606] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:10:00.112146 22189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:00.112789 22189 raft_consensus.cc:606] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
W20260709 12:10:00.120474 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72588.3us
I20260709 12:10:00.129623 22116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:10:00.130446 22116 raft_consensus.cc:606] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:00.129438 22865 raft_consensus.cc:2955] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.141848 22122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed4182733145491a94be746238e892f9"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:10:00.142586 22122 raft_consensus.cc:606] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:00.148980 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:00.153293 23292 raft_consensus.cc:993] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: : Instructing follower 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:10:00.153931 23292 raft_consensus.cc:1081] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Signalling peer 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:10:00.155853 22862 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:56950
I20260709 12:10:00.156483 22862 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.156879 22862 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.127888 23453 raft_consensus.cc:2955] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.177482 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:00.200560 22118 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:00.256243 23333 raft_consensus.cc:2955] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.281232 23491 raft_consensus.cc:993] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:10:00.281862 23491 raft_consensus.cc:1081] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:10:00.289160 22007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d6f694768d144aa85616d8c7b2453f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:00.293259 22864 raft_consensus.cc:2955] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.295856 23404 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:00.301460 23384 raft_consensus.cc:993] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:10:00.301992 23384 raft_consensus.cc:1081] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:10:00.307359 22265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed4182733145491a94be746238e892f9"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45860
I20260709 12:10:00.307946 22265 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.308339 22265 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.307648 22122 raft_consensus.cc:2955] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.315030 22272 raft_consensus.cc:2955] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.320712 22265 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:00.322649 22265 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:00.324533 22190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:55836
I20260709 12:10:00.325839 22190 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.326174 22190 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.333132 22190 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:00.334988 22190 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:00.337410 22122 raft_consensus.cc:2955] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.227135 22862 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:00.345293 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:00.346004 22117 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.347932 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:00.348500 22265 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.348820 22265 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:00.349491 22265 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:00.350725 22265 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.312764 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:00.365506 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:00.366189 22116 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.366468 22116 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:00.367421 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:00.368129 22190 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.367623 22116 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:00.369107 22116 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.375392 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:00.376070 22272 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.381052 22117 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:00.381538 22190 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:00.382408 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:00.396405 22193 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.397142 22162 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:00.398126 23334 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.345517 22862 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:00.391268 22116 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:00.403386 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:00.404960 22272 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:00.407166 22190 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:00.407011 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:00.412232 23422 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.412529 23475 raft_consensus.cc:993] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:10:00.412977 23475 raft_consensus.cc:1081] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:10:00.415648 22265 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:00.414449 23422 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:00.409998 22018 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index 3 to 4, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.417682 23422 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:00.420976 23404 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.421195 22190 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.421583 22265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45860
I20260709 12:10:00.421561 23404 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:00.422248 22265 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.424039 22265 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.423349 23404 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:00.431782 22180 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d6f694768d144aa85616d8c7b2453f0 with delete_type TABLET_DATA_TOMBSTONED (TS 7d3f536360b444b1886777f4776be22c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56158
I20260709 12:10:00.398681 23334 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:00.437522 23334 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:00.452543 22265 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:00.455528 23508 tablet_replica.cc:333] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:10:00.457018 23508 raft_consensus.cc:2243] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:00.457952 23508 raft_consensus.cc:2272] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:00.459391 22193 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:00.467198 22190 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:00.468222 22265 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:00.470757 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:00.471375 22117 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.471704 22117 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:00.474565 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:00.475193 22190 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.475978 22117 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:00.476753 22019 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.485021 23508 ts_tablet_manager.cc:1916] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:00.520668 22197 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:00.522464 22117 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.529037 22019 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 2 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.533880 22193 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:00.539287 22862 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:00.545960 22117 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:00.547600 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:00.541680 23291 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:10:00.561714 23404 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.567765 22190 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:00.577834 22864 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:00.585147 22117 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:00.571038 23404 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:00.588917 23334 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:00.592994 22272 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:00.598527 23472 raft_consensus.cc:993] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:10:00.600873 23383 raft_consensus.cc:1081] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:10:00.603860 22197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:55838
I20260709 12:10:00.604486 22197 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.605019 22197 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.605968 23404 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:00.587570 23328 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:00.620820 23292 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:00.631345 22197 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:00.641111 22197 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:00.643610 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:00.643791 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:00.644363 22865 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.647154 23486 raft_consensus.cc:2955] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.649629 23328 raft_consensus.cc:2955] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.656692 22116 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.657148 22116 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:00.656327 22020 catalog_manager.cc:5697] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.659085 22116 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:00.666442 22116 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.666198 22017 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:00.679997 22268 raft_consensus.cc:2955] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:10:00.728789 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 68744.7us
I20260709 12:10:00.729723 22865 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:00.731333 22163 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:00.732144 23485 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.732651 23485 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:00.733568 23485 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:00.737663 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a8f422c5da2840e0b466894312ebcd44 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:00.740016 22864 raft_consensus.cc:2955] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.749508 22017 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.747574 23508 ts_tablet_manager.cc:1929] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:00.755211 22122 raft_consensus.cc:2955] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.757143 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4dd2e5184fad402e8f3b26ea46e3c996 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:00.757404 23508 log.cc:1199] T 8d6f694768d144aa85616d8c7b2453f0 P 7d3f536360b444b1886777f4776be22c: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/wals/8d6f694768d144aa85616d8c7b2453f0
I20260709 12:10:00.760373 22006 catalog_manager.cc:5028] TS 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): tablet 8d6f694768d144aa85616d8c7b2453f0 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:10:00.765513 22258 tablet_service.cc:1558] Processing DeleteTablet for tablet a8f422c5da2840e0b466894312ebcd44 with delete_type TABLET_DATA_TOMBSTONED (TS cc9b9c8894084021a0c6ddaf659d222e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57876
I20260709 12:10:00.768493 22862 raft_consensus.cc:2955] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:00.752651 22116 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:00.779199 23514 tablet_replica.cc:333] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:10:00.782135 23514 raft_consensus.cc:2243] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:00.783177 23514 raft_consensus.cc:2272] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:00.789706 23514 ts_tablet_manager.cc:1916] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:00.812072 22268 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.814821 23422 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:00.815462 22017 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.822901 23514 ts_tablet_manager.cc:1929] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:00.823524 23514 log.cc:1199] T a8f422c5da2840e0b466894312ebcd44 P cc9b9c8894084021a0c6ddaf659d222e: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/wals/a8f422c5da2840e0b466894312ebcd44
I20260709 12:10:00.822446 22019 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:00.824918 22019 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index 3 to 4, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New cstate: current_term: 1 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.829263 22007 catalog_manager.cc:5028] TS cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): tablet a8f422c5da2840e0b466894312ebcd44 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:10:00.883773 22111 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dd2e5184fad402e8f3b26ea46e3c996 with delete_type TABLET_DATA_TOMBSTONED (TS ea51e825f0ab4ea2bb6c4d0e29709ca3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36132
I20260709 12:10:00.921308 22122 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.924003 23485 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:00.924714 23519 tablet_replica.cc:333] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:10:00.925930 23519 raft_consensus.cc:2243] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:00.926630 23519 raft_consensus.cc:2272] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:00.958604 22197 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.960722 23422 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:00.959429 23519 ts_tablet_manager.cc:1916] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:00.985726 22265 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.988588 23485 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:01.033285 22122 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.036422 23351 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:01.061466 22197 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.066532 23404 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:01.067938 22122 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.070505 23351 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:01.096076 23519 ts_tablet_manager.cc:1929] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:01.096604 23519 log.cc:1199] T 4dd2e5184fad402e8f3b26ea46e3c996 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/wals/4dd2e5184fad402e8f3b26ea46e3c996
I20260709 12:10:01.098683 22006 catalog_manager.cc:5028] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): tablet 4dd2e5184fad402e8f3b26ea46e3c996 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:10:01.167776 22190 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.184019 23404 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:01.268543 22862 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.288241 23486 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:01.320287 22117 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.322695 23485 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:01.566416 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:01.751485 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:01.752140 22192 raft_consensus.cc:606] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:01.755448 22269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:10:01.756147 22269 raft_consensus.cc:606] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:10:01.760152 22117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:10:01.760712 22117 raft_consensus.cc:606] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:01.762476 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:01.763808 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:01.764465 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:01.940954 23455 raft_consensus.cc:993] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:10:01.941527 23384 raft_consensus.cc:1081] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:10:01.945891 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45860
I20260709 12:10:01.946694 22269 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.947613 22269 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:02.049247 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68729.6us
W20260709 12:10:02.053582 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 98735.1us
I20260709 12:10:02.136541 22269 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:02.138653 22269 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:02.176959 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:02.177780 22118 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.178161 22118 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:02.179112 22118 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:02.180433 22118 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.198336 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:02.199059 22197 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.230315 22118 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:02.237075 23404 raft_consensus.cc:993] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:10:02.238567 23404 raft_consensus.cc:1081] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:10:02.234366 22197 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:02.254140 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:02.255048 23536 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:02.255579 23536 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:02.256465 23536 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:02.278787 22020 catalog_manager.cc:5697] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:02.283427 22192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:55836
I20260709 12:10:02.284179 22192 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.290191 22192 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.308265 22118 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:02.317203 23537 raft_consensus.cc:993] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:10:02.320850 23537 raft_consensus.cc:1081] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:10:02.300303 22192 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:02.350435 22122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:10:02.351135 22122 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.351251 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:02.351559 22122 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.351866 22269 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.352205 22269 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:02.353040 22269 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:02.354094 22269 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.364470 22122 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:02.376129 22192 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:02.379176 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:02.383353 22197 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.385542 22197 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:02.386793 22197 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:02.388027 22197 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.398137 22122 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:02.399173 22269 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:02.404156 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:02.405222 23538 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.406791 23538 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:02.408686 23538 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:02.410481 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:02.412998 22118 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.435525 22118 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:02.437160 22020 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 3, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 3 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.463567 22269 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:02.477555 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:02.478190 22269 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:02.484469 22088 consensus_peers.cc:597] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1baa23cb6635453b9a9cd5ec7e452f6a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.486122 22269 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:02.489732 22192 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:02.493806 23512 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:02.494185 22197 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:02.500499 23455 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:02.502972 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:02.503859 23455 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.504312 23455 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:02.505227 23455 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:02.569847 23542 raft_consensus.cc:2955] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:02.578333 22192 raft_consensus.cc:2955] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:02.609014 22020 catalog_manager.cc:5697] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 2 to 3, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.617472 22269 raft_consensus.cc:2955] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:02.634133 22197 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:02.679973 22118 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:02.681809 23536 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:02.687618 22269 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:02.689040 23328 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:02.694689 22163 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f1b154b48c54be6b421b01ed436bf21. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.707363 22122 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:02.709328 23537 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:02.724599 22020 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:02.751058 23328 raft_consensus.cc:2955] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:02.770828 22117 raft_consensus.cc:2955] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:02.783352 22269 raft_consensus.cc:2955] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:02.785934 22197 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:02.790342 23539 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:02.811136 22268 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
W20260709 12:10:02.821627 22237 consensus_peers.cc:597] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97ce44fb81b642f9ad6b0f0d68e82820. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.833786 22118 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:02.834887 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:02.840081 23536 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:02.823148 22018 catalog_manager.cc:5697] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 3, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.851851 22189 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:02.867034 23536 raft_consensus.cc:2955] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:02.877409 23539 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:02.882750 22118 raft_consensus.cc:2955] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:02.899320 22269 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.914301 22117 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.918378 22192 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.919445 22018 catalog_manager.cc:5697] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index -1 to 3, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:02.922823 22192 raft_consensus.cc:2955] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:02.929388 23542 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:02.945209 23563 ts_tablet_manager.cc:933] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673)
I20260709 12:10:02.952668 22268 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:02.968704 23538 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:02.969206 23542 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:03.021409 22237 consensus_peers.cc:597] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f86b841ece254f9bbfd1bd07c08f7004. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:03.029778 22197 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:03.032760 22269 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:03.034238 23537 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.044574 23563 tablet_copy_client.cc:323] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.193:39673
I20260709 12:10:03.046779 22133 tablet_copy_service.cc:140] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Received BeginTabletCopySession request for tablet 1baa23cb6635453b9a9cd5ec7e452f6a from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:38186)
I20260709 12:10:03.047377 22133 tablet_copy_service.cc:161] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Beginning new tablet copy session on tablet 1baa23cb6635453b9a9cd5ec7e452f6a from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:38186: session id = 164596fc2efa450581a5b68cad62271f-1baa23cb6635453b9a9cd5ec7e452f6a
I20260709 12:10:03.059262 22133 tablet_copy_source_session.cc:215] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:03.069013 23563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1baa23cb6635453b9a9cd5ec7e452f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:03.069787 23539 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:03.088112 23539 raft_consensus.cc:2955] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:03.090667 22197 raft_consensus.cc:2955] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:03.138103 22017 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:03.152575 22118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:10:03.153307 22118 raft_consensus.cc:606] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:03.156617 22122 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:03.182569 23384 raft_consensus.cc:993] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:10:03.183246 23384 raft_consensus.cc:1081] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:10:03.184428 22269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:10:03.189703 22265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45860
I20260709 12:10:03.202195 22265 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.202641 22265 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.192075 23404 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:03.192627 23563 tablet_copy_client.cc:806] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:03.205578 23563 tablet_copy_client.cc:670] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:03.210220 23563 tablet_copy_client.cc:538] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:03.211637 22269 raft_consensus.cc:606] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:10:03.215044 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:03.215703 22190 raft_consensus.cc:606] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:03.217463 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:03.219491 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:03.220304 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:03.215680 22265 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:03.233182 23563 tablet_bootstrap.cc:492] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:10:03.258682 22265 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:03.262543 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:03.271502 22122 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.271885 22122 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:03.272867 22122 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:03.274452 22122 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.265542 22118 raft_consensus.cc:2955] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:10:03.267621 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:03.285074 22197 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.298827 22197 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:03.304875 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:03.305864 23539 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:03.306423 23539 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:03.307557 23539 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:03.309393 23563 tablet_bootstrap.cc:492] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:03.318356 23563 tablet_bootstrap.cc:492] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:10:03.321331 23563 ts_tablet_manager.cc:1403] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.008s
I20260709 12:10:03.326265 23574 ts_tablet_manager.cc:933] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:03.330739 22122 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:03.332079 23563 raft_consensus.cc:359] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:03.333178 23572 ts_tablet_manager.cc:933] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:03.333088 23563 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:10:03.334143 23563 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:03.362655 22017 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:03.369702 23563 ts_tablet_manager.cc:1434] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:10:03.389775 22133 tablet_copy_service.cc:342] P ea51e825f0ab4ea2bb6c4d0e29709ca3: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-1baa23cb6635453b9a9cd5ec7e452f6a received from {username='slave'} at 127.0.0.1:38186
I20260709 12:10:03.390368 22133 tablet_copy_service.cc:434] P ea51e825f0ab4ea2bb6c4d0e29709ca3: ending tablet copy session 164596fc2efa450581a5b68cad62271f-1baa23cb6635453b9a9cd5ec7e452f6a on tablet 1baa23cb6635453b9a9cd5ec7e452f6a with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:10:03.398310 23574 tablet_copy_client.cc:323] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.195:38085
I20260709 12:10:03.400331 22282 tablet_copy_service.cc:140] P cc9b9c8894084021a0c6ddaf659d222e: Received BeginTabletCopySession request for tablet 97ce44fb81b642f9ad6b0f0d68e82820 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:34878)
I20260709 12:10:03.401162 23572 tablet_copy_client.cc:323] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
I20260709 12:10:03.403064 22208 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet 7f1b154b48c54be6b421b01ed436bf21 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:10:03.403611 22208 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet 7f1b154b48c54be6b421b01ed436bf21 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-7f1b154b48c54be6b421b01ed436bf21
I20260709 12:10:03.401057 22282 tablet_copy_service.cc:161] P cc9b9c8894084021a0c6ddaf659d222e: Beginning new tablet copy session on tablet 97ce44fb81b642f9ad6b0f0d68e82820 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:34878: session id = 164596fc2efa450581a5b68cad62271f-97ce44fb81b642f9ad6b0f0d68e82820
I20260709 12:10:03.423506 22282 tablet_copy_source_session.cc:215] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:03.425741 22208 tablet_copy_source_session.cc:215] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:03.427563 23574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ce44fb81b642f9ad6b0f0d68e82820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:03.438527 23572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f1b154b48c54be6b421b01ed436bf21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:03.464087 23563 ts_tablet_manager.cc:933] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:03.481745 23563 tablet_copy_client.cc:323] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.195:38085
I20260709 12:10:03.483480 22282 tablet_copy_service.cc:140] P cc9b9c8894084021a0c6ddaf659d222e: Received BeginTabletCopySession request for tablet f86b841ece254f9bbfd1bd07c08f7004 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:34878)
I20260709 12:10:03.483961 22282 tablet_copy_service.cc:161] P cc9b9c8894084021a0c6ddaf659d222e: Beginning new tablet copy session on tablet f86b841ece254f9bbfd1bd07c08f7004 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:34878: session id = 164596fc2efa450581a5b68cad62271f-f86b841ece254f9bbfd1bd07c08f7004
I20260709 12:10:03.491140 22282 tablet_copy_source_session.cc:215] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:03.495033 23563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86b841ece254f9bbfd1bd07c08f7004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:03.495416 23574 tablet_copy_client.cc:806] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:03.496290 23574 tablet_copy_client.cc:670] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:03.505447 23574 tablet_copy_client.cc:538] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:03.515874 23574 tablet_bootstrap.cc:492] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:10:03.537034 23572 tablet_copy_client.cc:806] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:03.538182 23572 tablet_copy_client.cc:670] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:03.564558 23572 tablet_copy_client.cc:538] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:03.572350 23563 tablet_copy_client.cc:806] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:03.573019 23563 tablet_copy_client.cc:670] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:03.577890 23563 tablet_copy_client.cc:538] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:03.611552 23572 tablet_bootstrap.cc:492] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:10:03.618489 23563 tablet_bootstrap.cc:492] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:10:03.636219 23560 raft_consensus.cc:993] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:10:03.636819 23560 raft_consensus.cc:1081] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:10:03.643744 22118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:10:03.644361 22118 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.644706 23574 tablet_bootstrap.cc:492] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:03.662096 23539 raft_consensus.cc:993] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:10:03.670558 23539 raft_consensus.cc:1081] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:10:03.676954 22190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:55836
I20260709 12:10:03.677634 22190 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.678316 22190 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.669783 23574 tablet_bootstrap.cc:492] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:10:03.644718 22118 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.691908 23572 tablet_bootstrap.cc:492] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:03.699229 23563 tablet_bootstrap.cc:492] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:03.700181 23563 tablet_bootstrap.cc:492] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:10:03.701393 23574 ts_tablet_manager.cc:1403] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.186s	user 0.034s	sys 0.004s
I20260709 12:10:03.705039 23574 raft_consensus.cc:359] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:03.705883 23574 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:10:03.706555 23574 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:03.709372 23574 ts_tablet_manager.cc:1434] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:10:03.703752 22118 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:03.713153 22118 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:03.708485 22190 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:03.714071 23572 tablet_bootstrap.cc:492] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:10:03.714969 23563 ts_tablet_manager.cc:1403] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.097s	user 0.022s	sys 0.001s
I20260709 12:10:03.716562 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:03.716955 23572 ts_tablet_manager.cc:1403] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.106s	user 0.016s	sys 0.010s
I20260709 12:10:03.717249 22269 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.717613 22269 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:03.718636 22282 tablet_copy_service.cc:342] P cc9b9c8894084021a0c6ddaf659d222e: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-97ce44fb81b642f9ad6b0f0d68e82820 received from {username='slave'} at 127.0.0.1:34878
I20260709 12:10:03.718394 22269 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:03.719135 22282 tablet_copy_service.cc:434] P cc9b9c8894084021a0c6ddaf659d222e: ending tablet copy session 164596fc2efa450581a5b68cad62271f-97ce44fb81b642f9ad6b0f0d68e82820 on tablet 97ce44fb81b642f9ad6b0f0d68e82820 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:10:03.719583 22269 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.721858 23572 raft_consensus.cc:359] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:03.722738 23572 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:10:03.723418 23572 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:03.728165 22862 raft_consensus.cc:1217] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:10:03.738175 23572 ts_tablet_manager.cc:1434] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:10:03.740428 22208 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-7f1b154b48c54be6b421b01ed436bf21 received from {username='slave'} at 127.0.0.1:37260
I20260709 12:10:03.741549 22208 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-7f1b154b48c54be6b421b01ed436bf21 on tablet 7f1b154b48c54be6b421b01ed436bf21 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:10:03.745980 22864 raft_consensus.cc:1217] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:10:03.747727 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:03.748364 22265 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.754885 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:03.755682 22122 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.771251 23563 raft_consensus.cc:359] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:03.776084 23563 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:10:03.775560 22190 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:03.776793 22265 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:03.779917 22269 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:03.783398 22163 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:03.789853 23538 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:03.790434 23538 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:03.791343 23538 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:03.794572 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:03.795521 23542 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:03.796037 23542 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:03.796954 23542 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:03.815987 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:03.817063 22190 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.817528 22190 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:03.818832 22190 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:03.820740 22190 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.777606 23563 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:03.829911 23563 ts_tablet_manager.cc:1434] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.001s
I20260709 12:10:03.832067 22282 tablet_copy_service.cc:342] P cc9b9c8894084021a0c6ddaf659d222e: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-f86b841ece254f9bbfd1bd07c08f7004 received from {username='slave'} at 127.0.0.1:34878
I20260709 12:10:03.832549 22282 tablet_copy_service.cc:434] P cc9b9c8894084021a0c6ddaf659d222e: ending tablet copy session 164596fc2efa450581a5b68cad62271f-f86b841ece254f9bbfd1bd07c08f7004 on tablet f86b841ece254f9bbfd1bd07c08f7004 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:10:03.847939 22190 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:03.824031 22122 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:03.870770 22018 catalog_manager.cc:5697] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 2 to 3, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:03.903373 22862 raft_consensus.cc:1217] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:10:03.912358 22862 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Advancing to term 2
I20260709 12:10:03.915917 22017 catalog_manager.cc:5697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:03.919575 22122 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.921818 22862 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.925601 23530 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.932338 23536 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.973451 22192 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.987962 23536 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:04.005059 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 155224us
I20260709 12:10:04.048334 23530 raft_consensus.cc:1064] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:10:04.050530 23530 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:04.129907 22122 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:04.136786 22862 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:04.140322 23530 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.149120 22190 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:04.149173 23404 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:10:04.201218 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 53818.7us
I20260709 12:10:04.216952 22266 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:04.231361 23530 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:04.246074 22265 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.250372 23560 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:04.259948 22121 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.264940 23530 raft_consensus.cc:1064] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:10:04.269428 23530 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:04.270888 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50777.5us
I20260709 12:10:04.273710 23560 raft_consensus.cc:1064] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:10:04.278609 23560 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:04.279070 23586 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:04.308466 23539 raft_consensus.cc:2955] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:04.312544 23538 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:04.317224 22864 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:04.319294 23536 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.332841 22121 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:04.331346 22122 raft_consensus.cc:2955] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:04.384814 22197 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:04.388286 22197 raft_consensus.cc:2955] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:04.412926 22192 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:04.373009 23404 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:10:04.478807 23351 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:04.492941 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 87602.5us
W20260709 12:10:04.586604 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 176560us
W20260709 12:10:04.897617 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 503314us
W20260709 12:10:04.940650 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 380902us
I20260709 12:10:05.400575 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:06.113813 23618 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:06.114220 23635 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:06.114897 23635 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:06.115646 23618 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:06.117992 23635 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:06.118119 23618 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:06.537038 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080032cae0 after lost signal to thread 20894
W20260709 12:10:06.780575 22162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.077s	user 0.002s	sys 0.018s
W20260709 12:10:06.956353 22162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.253s	user 0.005s	sys 0.018s
W20260709 12:10:06.956930 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 2.36916e+06us
I20260709 12:10:06.965754 23639 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:06.966547 23639 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:06.969849 23639 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:06.971242 23538 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:06.971915 23538 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:06.972963 23638 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:06.973524 23638 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:06.974565 23538 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:06.975109 23538 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:06.975589 23538 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:06.975787 23638 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:06.976019 23639 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:06.977064 23639 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:06.977638 23638 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:06.978259 23638 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:06.982275 23538 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:06.982422 23638 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:06.983049 23538 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:06.984431 23640 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:06.984848 23538 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:06.985008 23640 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:06.984521 22237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.561s	user 0.146s	sys 0.239s
I20260709 12:10:06.983040 23641 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:06.987083 22237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.564s	user 0.146s	sys 0.239s
W20260709 12:10:06.988631 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 2.57856e+06us
W20260709 12:10:06.993260 22236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.209s	user 0.041s	sys 0.043s
W20260709 12:10:06.993786 22236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.209s	user 0.042s	sys 0.044s
I20260709 12:10:06.994160 23642 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:06.994072 23641 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:06.994865 23642 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:06.983450 23639 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:06.987653 23640 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:06.997301 23642 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:06.997889 23642 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:06.998217 23538 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:06.998358 23642 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:06.999222 23643 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.000000 23643 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.000627 23642 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.001251 23642 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.001698 23642 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.001911 23641 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.003515 23642 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.003396 23643 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.006979 23642 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.007503 23642 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.014000 23642 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:07.014334 22831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.525s	user 0.018s	sys 0.019s
I20260709 12:10:07.014778 23642 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:07.014961 22831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.525s	user 0.019s	sys 0.019s
I20260709 12:10:07.015276 23643 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.015372 23642 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.015878 23643 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.017781 23642 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.018497 23642 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.018718 23643 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.019045 23642 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.019702 23643 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.021003 23645 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.021449 23642 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.022097 23642 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.021733 23645 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.022666 23642 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:07.024850 23642 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.025406 23642 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.026057 23644 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.025969 23642 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.026878 23644 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.014285 23646 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.020313 23643 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.036717 23646 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.046145 23647 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.046792 23647 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.050726 23648 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.047974 23645 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.051946 23648 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.054695 23646 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.055508 23643 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.056520 23647 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.052139 23644 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.057717 23642 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.055207 23648 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.099004 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.098320 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.100508 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.100536 22190 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:07.106341 23530 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.107620 23530 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.109499 23642 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.110699 23642 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.112380 23530 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.112622 23650 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.113520 23648 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.113739 23642 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.116168 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.117089 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.118637 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.120039 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.121165 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.121352 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.122468 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.125455 23650 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:07.127369 20896 debug-util.cc:398] Leaking SignalData structure 0x7b080000f900 after lost signal to thread 22089
I20260709 12:10:07.128904 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.129137 22196 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:07.129325 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.129711 23648 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.130424 22192 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:07.129392 22190 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:10:07.129150 22198 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
W20260709 12:10:07.128162 20896 kernel_stack_watchdog.cc:198] Thread 22089 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 1148ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:10:07.137389 23650 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.138453 23650 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.142067 23650 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.142597 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.143788 22862 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:10:07.144871 23650 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.145665 23650 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.145964 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.146641 23650 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.147125 22862 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:10:07.149868 23650 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.150074 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.151831 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.153580 22857 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:10:07.155040 23648 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.165408 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:07.165546 22237 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:07.167150 23646 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.167152 22237 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:07.167194 23644 raft_consensus.cc:1064] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:10:07.167922 23646 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.168524 23646 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.169297 22237 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:07.170111 22089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.192s	user 0.059s	sys 0.085s
W20260709 12:10:07.178722 22089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.201s	user 0.060s	sys 0.086s
I20260709 12:10:07.179311 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.173043 23642 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.193593 23642 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.183220 23538 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.184629 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.202617 23538 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.184943 23640 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.205009 23640 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.206223 23538 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.201598 23642 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.185858 23539 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.207968 23539 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.208442 23539 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.174343 23644 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.187989 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:07.188177 23641 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.212302 23641 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.212860 23640 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.213941 23643 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.214423 23643 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.214984 23643 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.215277 23641 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.173635 23530 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.216267 23530 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.216859 23530 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.194799 23646 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.224283 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:07.225334 22830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.681s	user 0.008s	sys 0.022s
W20260709 12:10:07.233395 22830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.690s	user 0.009s	sys 0.022s
I20260709 12:10:07.233796 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:07.235034 23645 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.234999 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:07.230057 22865 raft_consensus.cc:2955] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:07.236876 23649 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.236145 23645 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.237479 23649 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.237658 23645 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.238095 23649 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.240170 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:07.241353 22866 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.235430 23646 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.263746 23650 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.264590 23650 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.271144 23648 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.271922 23648 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.276530 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.278326 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.286221 23648 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.288859 23650 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.288630 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.292132 22866 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:07.295081 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.241734 23539 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:07.309767 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 74939.1us
I20260709 12:10:07.312333 23539 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.313259 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.310475 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:07.295146 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 45750.8us
I20260709 12:10:07.326400 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:07.327278 22197 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.329960 23530 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.332986 22859 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:07.333657 23653 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.334252 23653 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.334661 23653 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.344987 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.346614 23643 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.353289 23605 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.356637 23654 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.336190 23650 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.352468 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.362222 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.355504 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:07.366338 23538 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.367136 23560 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.382581 23538 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.369645 22864 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.369940 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.357283 23654 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.374166 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.376338 22857 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 2 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:07.354144 23605 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.382417 22191 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:07.394866 23648 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.395696 23648 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.393548 23650 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.399106 23648 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.400274 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:07.383085 23560 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.402122 23538 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.417681 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:07.398017 23642 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.420145 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:07.393180 22864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 347) took 2423 ms. Trace:
I20260709 12:10:07.427398 23648 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.428512 23605 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.428236 23648 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.429567 22018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 250) took 3102 ms. Trace:
I20260709 12:10:07.430470 23646 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.430008 22018 rpcz_store.cc:276] 0709 12:10:04.327254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.327454 (+   200us) service_pool.cc:224] Handling call
0709 12:10:04.995067 (+667613us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:07.429298 (+2434231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3361,"reported_tablets":1,"spinlock_wait_cycles":1529902336}
I20260709 12:10:07.430968 23646 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.431420 23646 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.433175 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:07.430666 23648 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.433791 22193 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:07.433524 23586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.659s	user 0.017s	sys 0.017s
W20260709 12:10:07.434464 23586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.694s	user 0.017s	sys 0.017s
I20260709 12:10:07.393275 23530 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.426157 22864 rpcz_store.cc:276] 0709 12:10:04.962055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.368903 (+2406848us) service_pool.cc:224] Handling call
0709 12:10:07.369344 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.384425 (+ 15081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.385163 (+   738us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:07.441614 23654 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.455566 23609 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.401504 23649 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.458850 22197 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:07.460618 22858 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 LEARNER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:07.466495 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:07.467103 22198 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.460623 22190 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:07.465941 23649 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.468080 23586 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.460883 23643 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.458832 23613 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.473618 23635 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.456377 23609 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.438855 23645 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.474017 23613 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.477926 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:07.479681 23618 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.480381 23657 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.480687 23618 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.479779 23658 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.470376 23586 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.478457 23619 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.488092 23634 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.488370 23624 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.496841 23609 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.497641 23609 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.498338 23609 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.500440 23609 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.484541 23585 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.500932 23598 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:07.501721 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.505662 22198 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:07.474419 23635 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.507527 23455 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.509056 23618 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.509032 23455 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.510331 23635 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.511759 23455 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.511761 22268 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.489194 23624 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.481483 23657 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.489156 23634 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:07.517321 23585 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.517174 23619 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.501106 23658 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.558665 23455 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.562984 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:07.563452 22193 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:07.563097 23455 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.563917 22265 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:10:07.552386 23618 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.571980 23618 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.515780 23609 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.546967 23560 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.582038 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.580648 23618 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.545707 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.564188 23635 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:07.578279 23656 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:10:07.578630 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:07.590961 22865 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.580659 23645 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.547747 23657 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.521064 23642 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.518244 23608 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.574362 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:07.597831 22268 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:07.597617 23635 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.550485 23660 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.599278 23624 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.563228 23598 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:07.601873 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080032ce00 after lost signal to thread 22055
I20260709 12:10:07.547233 23653 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.578675 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:07.609763 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:07.568729 23646 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.623440 22865 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:07.624488 23455 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.593878 23618 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.627940 22267 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.600134 23635 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:07.628415 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080008af80 after lost signal to thread 22147
W20260709 12:10:07.630564 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080008af60 after lost signal to thread 22148
I20260709 12:10:07.599712 23660 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.634753 23660 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.600189 23624 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:07.637393 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080008a720 after lost signal to thread 22222
W20260709 12:10:07.639794 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080008a700 after lost signal to thread 22223
I20260709 12:10:07.605243 23657 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.642997 22266 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.643188 23659 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.648062 23653 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.649176 23657 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.649587 22198 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.649187 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.650875 23646 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.648929 23618 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.640384 23586 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.640286 23660 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.656793 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.629243 23609 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:07.651407 23657 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.638252 23608 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.654147 23613 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:07.660122 22164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.918s	user 0.021s	sys 0.036s
I20260709 12:10:07.644721 23624 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.665988 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:07.667733 22238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.049s	user 0.033s	sys 0.034s
I20260709 12:10:07.669672 23619 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.661109 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:07.670560 23598 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.672276 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:07.674275 22164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.966s	user 0.022s	sys 0.037s
I20260709 12:10:07.673725 23613 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:07.676578 22238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.097s	user 0.034s	sys 0.035s
I20260709 12:10:07.676913 23613 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.677846 23624 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.668298 23634 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.692948 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.693791 22191 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:07.697459 23530 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.698236 23530 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.674887 23658 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.703331 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.705720 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.644374 23659 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.711323 22191 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:07.714285 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.715123 23585 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.714461 23605 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.717592 22858 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:07.719278 22235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.945s	user 0.009s	sys 0.030s
I20260709 12:10:07.720862 23605 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:07.719641 22052 debug-util.cc:398] Leaking SignalData structure 0x7b0800252560 after lost signal to thread 22296
W20260709 12:10:07.721637 22235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.950s	user 0.010s	sys 0.030s
W20260709 12:10:07.721913 22052 debug-util.cc:398] Leaking SignalData structure 0x7b0800354040 after lost signal to thread 22297
I20260709 12:10:07.723327 23605 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:07.723590 22052 debug-util.cc:398] Leaking SignalData structure 0x7b0800269120 after lost signal to thread 22890
I20260709 12:10:07.719796 23663 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.726743 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.685101 23660 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:10:07.727675 22191 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:07.734587 22265 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.729923 23660 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.704628 23613 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.731822 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.732666 23653 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.714114 23665 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.737231 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:07.727056 23663 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.737768 22264 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.738636 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:07.738768 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:07.752725 22268 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 2: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:07.707593 23530 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.744562 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.745218 23613 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.755505 23650 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.755712 23613 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.744944 23653 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.744553 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:07.720922 23609 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.746666 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.747351 23404 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.748205 23659 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.737290 22115 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:07.755060 23646 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.757397 23665 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.758940 22267 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:07.760957 23660 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.760968 23653 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.762833 23585 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.763895 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.765825 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:07.770179 22121 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:07.758229 23642 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:07.768039 23404 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.772639 23661 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:10:07.774509 22237 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:07.773331 23644 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.775228 23646 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.775640 23644 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.776288 23404 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.777498 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:07.777858 23644 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.777606 23646 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.778436 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.778815 23585 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.780300 22269 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.768258 23597 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.772815 23642 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.780300 22115 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:07.781603 23597 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.772430 23660 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.785451 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.796573 23663 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.797698 23639 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.798295 23639 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:07.798659 23639 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.800863 22198 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.802088 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.802700 22269 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:07.802888 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.803484 22195 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.803416 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.807251 23652 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:07.807193 23582 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:07.807816 23665 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.808029 23658 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:07.809170 23658 raft_consensus.cc:3055] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.809525 23658 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:07.809556 23660 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.812480 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.794008 23585 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.810885 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.815075 23652 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:07.814924 22020 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: config changed from index 2 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:07.816041 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.817669 23661 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.833981 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.834451 23661 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:07.834704 22119 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:07.818010 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.818922 23608 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.820674 22237 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:07.824862 23618 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.825009 23624 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:07.827055 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.827957 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.828791 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.806245 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:07.830726 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.835788 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.842272 22237 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:07.810853 23658 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.835877 23597 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:07.850651 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:07.843577 23404 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.857021 22118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:59826
I20260709 12:10:07.857048 23560 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.857923 22118 raft_consensus.cc:606] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:07.851464 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.852070 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:07.845305 22120 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 1.
I20260709 12:10:07.858592 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.854179 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:07.856101 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.856241 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.857779 23607 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:10:07.860308 22116 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:07.856369 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:07.861199 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.864869 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:07.865629 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:07.865988 23582 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.865724 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 220) took 3549 ms. Trace:
I20260709 12:10:07.866423 23582 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.866679 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:07.867350 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.866706 22017 rpcz_store.cc:276] 0709 12:10:04.287675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.287854 (+   179us) service_pool.cc:224] Handling call
0709 12:10:07.579314 (+3291460us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:07.836554 (+257240us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":4118038400}
I20260709 12:10:07.868060 22118 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 1.
I20260709 12:10:07.866891 23582 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.857926 23560 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.874377 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.804155 22114 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:07.857431 23653 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:07.877898 23560 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.835435 23661 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.886284 23650 consensus_queue.cc:1059] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:07.834280 23652 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.848111 23644 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:07.889535 23654 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:07.884722 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.879642 23609 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.897277 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:07.885303 23613 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:07.895488 23666 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:10:07.897221 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:07.897439 23667 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.908358 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:07.922788 23667 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.923357 23667 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.888202 23607 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.892544 23653 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:07.918112 23608 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.883796 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:07.913735 23609 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:07.920495 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:07.879293 23634 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:10:07.921108 23642 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:07.892030 23657 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:07.931735 23653 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.932785 23634 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.933334 23634 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:07.929342 23609 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:07.925493 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.924026 23640 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.875375 23659 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:07.944175 23640 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:07.934715 23634 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:07.945832 23648 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.950508 23648 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:07.950718 23586 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.922082 22115 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:07.948581 23640 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.955446 23634 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.928022 23608 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:07.954021 22238 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.102.254:38171, user_credentials={real_user=slave}} blocked reactor thread for 45107.3us
I20260709 12:10:07.951591 23648 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.955466 23659 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.973652 23659 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:07.974977 23659 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.981666 23651 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.982223 23651 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:07.983474 23651 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:07.985350 23648 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:08.020948 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.989683 22831 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:08.025192 23640 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:08.028842 23608 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:08.030411 23608 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.032003 23654 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.032532 23654 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:08.033032 23654 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:08.033902 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 152691us
I20260709 12:10:08.038323 23651 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.038619 23658 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.039594 23640 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:08.040494 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 120209us
I20260709 12:10:08.041102 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:08.039613 23659 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.047818 23661 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.047713 23582 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:08.050251 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 126902us
I20260709 12:10:08.052428 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.053299 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.054112 22269 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:08.056710 22269 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.061223 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.061520 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.061959 22266 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:08.063421 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.067078 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:08.069422 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:08.078272 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:08.060588 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.086073 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.089821 22269 raft_consensus.cc:2393] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:08.092128 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.080874 23642 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.100131 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:08.103070 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:08.104001 23542 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.104717 23542 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.105077 23542 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:08.105422 23542 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.113355 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:08.087109 23646 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.117779 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.119112 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:08.119722 22122 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:08.115543 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 70815.2us
I20260709 12:10:08.120910 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.123132 22195 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 2: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:08.128192 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.118592 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:08.127031 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.130415 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.131304 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.132689 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.133209 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.081149 23663 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:08.137707 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.116962 23634 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.141041 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.141400 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.145198 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.117825 23642 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:08.145872 22195 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:08.148468 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:08.149554 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.159096 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.164994 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.130059 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.168614 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.136572 23598 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.172941 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.173458 23647 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.145592 23634 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:08.181522 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.170732 23598 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:08.184681 23598 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.177848 23647 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:08.190368 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.190979 23647 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:08.198536 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.199692 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.199873 23582 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:08.181639 23634 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.202162 23642 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:08.208137 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.194816 23646 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:08.204316 23654 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:08.240729 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:08.241549 22196 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.258575 22122 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:08.260584 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:08.261813 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.262873 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.263832 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:08.265656 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.266770 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.269505 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.273244 22858 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.271631 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:08.267768 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:08.274755 23634 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:08.284113 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.282524 22866 raft_consensus.cc:2955] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:08.289091 23538 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:08.290160 23538 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.290484 23538 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:08.223930 23639 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:08.297078 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 153600us
I20260709 12:10:08.169741 23644 raft_consensus.cc:2955] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:08.304440 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.305368 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.305778 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.306362 22122 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:08.313962 22196 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:08.315973 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.317644 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:08.323597 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.323526 22830 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:08.290901 23542 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:08.327953 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:08.326239 22830 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:08.312881 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:08.343776 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.351902 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:08.353075 22830 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:08.357601 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:08.321127 23639 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:08.360160 22121 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.351043 23538 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:08.366443 23538 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.371093 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:08.375020 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:08.379173 23634 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:08.380800 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:08.377430 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:08.356827 23673 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.386204 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.383127 22122 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:08.388124 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.360090 23648 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.327023 23560 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:08.380165 23676 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.372643 23654 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:08.400213 22265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:10:08.401237 22121 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:08.407289 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.403723 22265 raft_consensus.cc:606] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:10:08.351742 23646 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:08.420742 22116 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:08.382910 23605 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:10:08.424901 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.428325 22122 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.433584 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.411827 23648 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.411650 23659 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.438755 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.444504 23542 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:08.444796 23560 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:08.445115 23678 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.151s	user 0.002s	sys 0.000s
I20260709 12:10:08.452263 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.452531 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.453209 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.453542 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.454140 22190 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.455541 22198 raft_consensus.cc:2955] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:08.461066 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.448421 23598 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:08.466343 22120 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:08.468461 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.440104 23659 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:08.464682 23677 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.210s	user 0.002s	sys 0.000s
I20260709 12:10:08.510744 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.518602 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:08.517633 23667 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.594s	user 0.001s	sys 0.013s
I20260709 12:10:08.510761 23659 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:08.524035 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 119732us
W20260709 12:10:08.524609 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 143908us
I20260709 12:10:08.527783 22830 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:08.530771 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:08.531101 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:08.532049 22830 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:08.544669 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:08.548197 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.545969 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:08.525974 23650 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:08.609328 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 78326.1us
I20260709 12:10:08.618590 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:08.615671 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:08.608928 23679 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.627300 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:08.627338 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 95378.4us
I20260709 12:10:08.628969 22195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:08.629601 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:08.629634 22195 raft_consensus.cc:606] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:08.530867 23667 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:08.617225 23648 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.709465 22866 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:08.634922 22830 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:08.706243 22120 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:08.707764 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.634433 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 98211.1us
I20260709 12:10:08.767091 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:08.769304 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.770910 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:08.619261 23686 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:08.765829 23681 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:10:08.793730 23686 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:08.794342 23686 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.621521 23654 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.780892 23650 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.795312 23654 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:08.795892 23654 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.693920 23687 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:08.781512 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 146719us
W20260709 12:10:08.702600 23609 consensus_meta.cc:287] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.768s	user 0.005s	sys 0.008s
I20260709 12:10:08.800998 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:08.643900 23651 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.784420 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:08.792920 23646 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:10:08.710008 23680 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:10:08.806317 22114 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.803869 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.659950 23582 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.820955 23560 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.821439 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:08.797113 23687 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:08.631301 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.782008 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:08.709177 23598 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:08.810437 22117 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:08.812443 22116 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.820519 23582 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:08.831915 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.833611 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.814705 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:08.661659 23688 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.686034 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.817842 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:08.822208 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 206580us
I20260709 12:10:08.842072 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:08.666872 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:08.632582 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:08.851455 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.852268 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:08.854867 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:08.806928 23609 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:08.802101 23693 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:08.847698 23687 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:08.842720 23651 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.837972 23582 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.862083 23692 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:08.873710 22123 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.873916 23692 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.874270 23692 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:08.866120 23605 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.875224 23609 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:08.876245 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 58546.9us
I20260709 12:10:08.877192 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:08.877326 23560 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.878240 23560 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.878401 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:08.867231 23667 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:08.881031 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 90551.4us
I20260709 12:10:08.896029 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.899279 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:08.901119 22861 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:08.901463 23538 consensus_meta.cc:287] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.000s
I20260709 12:10:08.902365 22196 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:08.868763 23673 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.906391 22863 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:08.928931 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:08.907300 23693 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.910136 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:08.911964 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:08.898039 23644 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:08.895967 22115 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.890967 23688 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.875226 23692 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:08.913300 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1273) took 1175 ms. Trace:
W20260709 12:10:08.914330 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48867.9us
I20260709 12:10:08.915114 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.969959 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:08.971649 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:08.915493 23694 raft_consensus.cc:993] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:10:08.972329 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.916512 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.933132 23693 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:08.973565 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.973539 23693 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:08.974655 23605 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.975090 23693 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.976161 23605 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.978434 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.977847 23639 raft_consensus.cc:2955] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:08.979624 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:08.981114 23694 raft_consensus.cc:1081] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:10:08.982491 23648 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.984968 23538 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:08.988363 23688 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.988796 23688 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:08.917148 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.989802 22266 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:08.989727 23688 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:08.917510 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.932919 22860 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:08.917950 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.991145 23688 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.827674 23646 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:08.918602 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.993517 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:08.919834 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:08.994174 23646 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:08.920918 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.995304 23670 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.996201 23634 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:08.996317 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 58835us
I20260709 12:10:08.996647 23634 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:08.997134 23634 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.924039 23654 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:08.928617 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.934852 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:08.994763 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 74989.5us
I20260709 12:10:08.936576 23667 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.001446 22865 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.002665 22163 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.006038 23607 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.006114 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:09.007889 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:08.969456 22123 rpcz_store.cc:276] 0709 12:10:07.738171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.871610 (+133439us) service_pool.cc:224] Handling call
0709 12:10:07.877034 (+  5424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:08.874227 (+997193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:08.913060 (+ 38833us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400254ed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:08.913218 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291716480}
I20260709 12:10:09.019706 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:09.021365 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:09.025724 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:09.027330 23642 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:09.031903 23642 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.034782 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:09.035238 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:09.036185 23642 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:09.036361 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:09.024576 22087 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:08.976709 23605 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:09.058669 23642 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:09.060196 23642 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:09.060938 23646 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:09.062407 22119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:10:09.063107 23696 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:09.063333 22119 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:09.063841 22119 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.063663 23696 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.047241 23582 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.065512 23646 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:09.065915 23582 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.066607 23646 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.066956 23646 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:09.067791 23646 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.051812 23667 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.070365 23696 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:09.070248 23605 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.069151 23644 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:09.071072 23654 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.071480 23644 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:09.074249 23659 consensus_meta.cc:287] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:10:09.074631 23659 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.075851 23644 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:08.984565 23686 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.079038 23686 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.069111 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:09.081216 22864 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:09.043145 23697 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:10:09.082989 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:09.070586 23692 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.093926 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:09.095892 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:09.096405 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:09.095921 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:09.097788 23673 consensus_queue.cc:1059] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:09.098938 23673 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:09.099280 23673 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:09.081400 23646 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.101295 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:09.076689 23659 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.107439 23686 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:09.118160 22265 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.104168 23634 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.092080 23642 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:09.121292 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.100257 23673 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.122653 23654 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.139165 23654 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.125393 23644 consensus_queue.cc:1059] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:10:09.127914 23659 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.127842 23694 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:09.125190 23699 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:09.135140 23582 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:09.153980 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:09.156584 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:09.157117 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:09.128167 23642 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.156046 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:09.128762 23686 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.162099 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:09.162385 22194 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.166646 22117 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:09.167810 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:09.173461 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:09.174396 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:09.165524 22121 raft_consensus.cc:2955] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:09.154217 23673 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.182404 22270 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.196584 22192 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:09.164155 23699 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.203048 23699 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.164498 23700 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:09.208491 23670 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:09.209338 23670 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:09.215116 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.217458 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:09.205557 23702 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:10:09.230404 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:09.151785 23694 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.234661 23694 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.238193 23696 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.238415 23686 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.238742 23696 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:09.239915 23696 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:09.242971 22236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.541s (SENT) [suppressed 3 similar messages]
I20260709 12:10:09.212740 23560 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.245559 22020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 232) took 1843 ms. Trace:
I20260709 12:10:09.270290 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:09.271781 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.272828 22114 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:09.274741 23703 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260709 12:10:09.276336 23696 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.247555 23634 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.178392 23582 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.250941 23654 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.206329 23700 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.259456 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:09.265220 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:09.269030 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.260541 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:09.283427 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:09.288661 22018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 134) took 1459 ms. Trace:
I20260709 12:10:09.291947 22265 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:09.292081 22018 rpcz_store.cc:276] 0709 12:10:07.828972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.829157 (+   185us) service_pool.cc:224] Handling call
0709 12:10:09.288553 (+1459396us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:10:09.293911 22831 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:09.295639 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:09.295718 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.296375 22192 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
W20260709 12:10:09.298846 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.299455 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.300851 23688 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:09.310256 22269 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:09.318090 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:09.314028 22865 raft_consensus.cc:2955] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:09.329974 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.232210 23670 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:09.331988 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.335752 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.336964 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.338097 23542 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.301595 23654 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.302170 23634 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.338722 23658 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.348075 23642 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:09.309861 22017 catalog_manager.cc:5697] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 3 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:09.354640 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 192787us
I20260709 12:10:09.357008 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.331498 23598 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.270491 22020 rpcz_store.cc:276] 0709 12:10:07.426003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.428001 (+  1998us) service_pool.cc:224] Handling call
0709 12:10:09.245422 (+1817421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:08.040266 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:08.042063 (+  1797us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:08.042134 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:10:08.042173 (+    39us) tablet.cc:662] Decoding operations
0709 12:10:08.118317 (+ 76144us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:08.135599 (+ 17282us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:08.144302 (+  8703us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:08.210974 (+ 66672us) tablet.cc:701] Row locks acquired
0709 12:10:08.232938 (+ 21964us) write_op.cc:260] PREPARE: finished
0709 12:10:08.255170 (+ 22232us) write_op.cc:270] Start()
0709 12:10:08.259628 (+  4458us) write_op.cc:276] Timestamp: P: 1783599008252367 usec, L: 0
0709 12:10:08.259668 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:10:08.282355 (+ 22687us) log.cc:844] Serialized 603 byte log entry
0709 12:10:09.032085 (+749730us) op_driver.cc:464] REPLICATION: finished
0709 12:10:09.167817 (+135732us) write_op.cc:301] APPLY: starting
0709 12:10:09.167978 (+   161us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:09.180129 (+ 12151us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:09.181949 (+  1820us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:09.182262 (+   313us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:09.182510 (+   248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:09.182571 (+    61us) write_op.cc:312] APPLY: finished
0709 12:10:09.182862 (+   291us) log.cc:844] Serialized 23 byte log entry
0709 12:10:09.183062 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.183154 (+    92us) write_op.cc:454] Released schema lock
0709 12:10:09.183221 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:09.183640 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.183674 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66917,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":102975,"apply.run_cpu_time_us":2373,"apply.run_wall_time_us":33455,"num_ops":1,"prepare.queue_time_us":206050,"prepare.run_cpu_time_us":16840,"prepare.run_wall_time_us":301017,"raft.queue_time_us":186047,"raft.run_cpu_time_us":8674,"raft.run_wall_time_us":52437,"replication_time_us":772264,"thread_start_us":202827,"threads_started":4,"wal-append.queue_time_us":139252}]]}
I20260709 12:10:09.354657 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.342171 23667 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.339071 23609 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.364570 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:09.368897 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.286348 22119 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.355667 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:09.370230 22017 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.301410 23688 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.356938 23654 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.356058 23542 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.395351 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:09.395742 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:09.401510 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46947.2us
I20260709 12:10:09.368988 23651 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.416877 22017 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 2 to 3, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 3 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:09.416141 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 173203us
I20260709 12:10:09.419902 22017 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 2 to 3, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 3 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:09.423959 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 54642.5us
I20260709 12:10:09.423398 22017 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.425540 22017 catalog_manager.cc:5697] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 2 to 3, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 3 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:09.402691 23608 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.422267 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.431805 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.424665 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.418689 23654 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.434814 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.442750 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.446978 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:09.427433 23651 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:09.440351 22115 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.443006 23634 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.441689 23538 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.469372 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.443049 23609 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.453580 23667 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.427445 23716 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:10:09.463866 23608 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.494458 23608 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:09.494930 23608 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.471215 23709 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.497212 23709 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.498509 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:09.499519 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:09.467442 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50320.4us
I20260709 12:10:09.482666 22119 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:09.483310 23538 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.507537 22189 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.508528 23597 raft_consensus.cc:993] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:10:09.502049 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:09.500638 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:09.476388 23582 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:09.493341 23700 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.505214 23646 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.523080 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:09.505795 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:09.525247 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:09.507066 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:09.508407 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:09.510037 22198 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.527294 23646 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.510362 22193 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:09.527936 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:09.502736 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:09.514602 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:09.529122 22190 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.516191 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:09.517721 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:09.503386 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.512141 22267 raft_consensus.cc:2955] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:09.500627 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:09.520941 23652 raft_consensus.cc:1081] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:10:09.511595 23688 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.529443 22190 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:09.530740 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:09.532747 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57031.7us
I20260709 12:10:09.497573 23709 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:09.533872 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:09.534296 22189 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:09.535496 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:09.515640 23703 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:09.542421 22162 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.531616 23667 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.536573 23719 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.537429 23658 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.541308 23634 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.553040 23538 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.555877 22190 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.565467 23709 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.570658 22190 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.572484 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.573812 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.575121 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.537981 23717 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:09.569677 23651 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.587073 23704 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.585772 23609 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.591730 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.602236 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:09.604321 23709 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.604351 22163 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:09.576342 23658 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:09.606359 23699 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.588708 23694 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.594247 22859 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:09.599124 23688 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.600803 23607 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.630924 22190 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
W20260709 12:10:09.691493 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 154428us
I20260709 12:10:09.698153 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:09.702447 23654 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.681696 23652 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.707154 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:09.711611 22190 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.711054 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.696918 23538 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:10:09.722311 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 194428us
I20260709 12:10:09.713115 23717 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.735496 22190 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:09.725423 23646 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:09.685629 23658 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.745872 23538 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.741063 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:09.715986 23652 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.740082 23646 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.763356 23687 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.758564 23717 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:09.768090 23654 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:09.798938 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 265396us
I20260709 12:10:09.801644 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.803123 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.807065 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:09.805156 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44362us
I20260709 12:10:09.810827 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:09.808858 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.815407 23717 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.800083 23687 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:09.821964 23609 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.806814 23667 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.807976 23598 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.827090 23609 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:09.832782 23640 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.814253 23724 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.780342 23723 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:10:09.842676 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:09.840066 23640 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.846431 23723 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:09.846972 23608 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.846561 23640 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:09.847791 23647 raft_consensus.cc:2955] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:09.842955 23719 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.867136 23663 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.867604 23663 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:09.868471 23663 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:09.869673 23663 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:09.870230 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.863569 23598 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.871695 23598 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.862072 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:09.865859 23719 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:09.891194 23696 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:09.884932 23609 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.906805 23719 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.939883 23608 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:09.942445 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:09.949204 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:09.956019 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:09.962591 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:09.963837 22264 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 2: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:09.966879 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:09.971575 23538 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:09.949605 23652 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:09.908569 23696 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:09.874491 23687 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:09.984747 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:09.986212 22270 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.994525 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.002349 23605 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:10.003132 23605 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.007819 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.011899 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:10.012916 22860 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:10.013628 23696 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.015190 23582 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.017184 22163 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.009896 23605 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:10.029990 23609 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.038323 23582 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.040306 23605 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:10.044245 23605 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.050685 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:10.054102 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 61923.1us
I20260709 12:10:10.073901 23538 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:10.074645 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:10.055151 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 86218.5us
W20260709 12:10:10.076339 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.078763 22237 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:10.082080 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.085700 23700 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.087090 22865 raft_consensus.cc:2955] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:10.091077 22272 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:10.095176 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.058527 22270 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:10.063390 23582 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:10.072961 23605 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:10.129642 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:10.136651 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 294071us
I20260709 12:10:10.142584 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.146297 22088 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.136372 23700 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:10.157840 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 327392us
I20260709 12:10:10.129254 23739 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.158672 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:10.164695 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.167253 22272 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.146814 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:10.147243 23609 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.169391 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.153487 23608 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.175724 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.177990 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:10.146981 23694 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:10:10.132303 23582 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.179769 22118 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.153363 23607 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:10.193884 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.163479 23739 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.183488 23605 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.163290 23700 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.190153 23609 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.176422 23651 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 12:10:10.220651 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:10.222747 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46634.1us
I20260709 12:10:10.226783 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.229177 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:10.229952 22864 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.201841 23739 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.211088 22115 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.188580 23607 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.257223 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:10.230664 23708 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.230126 23719 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.251626 23658 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.206677 23740 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:10.209954 23724 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:10:10.253779 23663 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:10.355633 23719 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:10.357132 23598 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.361681 22864 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:10.208360 23738 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:10:10.362308 22118 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:10.369338 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.364701 23709 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:10.372714 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.373881 22123 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:10.370959 23709 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:10.375375 23737 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:10:10.377025 23693 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.377363 23709 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:10.380048 23700 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:10.377600 23693 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.381567 23582 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:10.381906 23651 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.382520 23651 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.382951 23693 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:10.357164 22115 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.380458 23675 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.391642 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:10.390659 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.391729 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.389319 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.392671 22123 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:10.398805 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:10.405478 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.406466 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.366803 23658 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.421185 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:10.422469 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.423153 22118 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:10.397635 23598 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:10.409235 23708 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.411264 23582 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.401710 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.432106 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.433627 22122 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:10.413184 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:10.421376 23651 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:10.427760 23750 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:10:10.420885 23751 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:10.427757 23752 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.443578 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.464897 22859 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:10.467095 22119 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:10.467360 22266 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:10.435645 23709 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:10.471498 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.433997 23708 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.475601 23752 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.476940 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.477814 23752 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.480453 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.452821 23727 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.482187 23538 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.486392 23727 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.447084 23751 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.488684 23751 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:10.489526 23607 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:10.488606 23727 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:10.491460 23719 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.493376 23745 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.493753 23745 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:10.494594 23745 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.497035 23658 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:10.485327 23718 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:10.499850 23718 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.501941 23718 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:10.503629 23708 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:10.492044 23719 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:10.505153 23688 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.505535 23688 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:10.505772 23719 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.506944 23719 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.506412 23688 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.508234 23688 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.485633 23663 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.492991 23598 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.514654 23739 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.516976 23739 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:10.482355 23651 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:10:10.523933 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.524533 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:10.525828 22163 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.526378 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.525295 22859 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:10.527426 23605 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.528090 23605 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.529153 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:10.530977 23605 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:10.545425 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 63336.2us
I20260709 12:10:10.548722 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.549947 22269 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:10.550928 22163 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:10.557101 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.561919 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.554531 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:10.621533 23538 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:10.622645 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 60827.3us
I20260709 12:10:10.630748 23651 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:10.631461 23651 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:10.623085 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.626986 23607 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.634130 23607 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:10.634601 23607 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.634696 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.637950 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:10.638164 23752 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:10.544833 23709 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.642422 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:10.655483 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.660638 23734 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:10.661309 23734 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.645079 23651 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:10.662653 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.664456 23736 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.665786 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.666597 23736 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.664563 23734 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:10.668267 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.639169 23642 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.669467 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.669754 23642 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.670240 23736 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.672763 23663 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:10.673317 23663 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.621409 23652 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:10:10.674885 23652 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.675365 23663 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:10.675374 23652 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:10.676959 23652 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.678254 23652 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.678337 23696 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.655202 23740 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.654312 22859 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:10.681361 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.690541 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.484503 23758 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.142s
I20260709 12:10:10.695712 23718 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.696816 23718 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.697254 23718 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.698876 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.699343 23752 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:10.699671 23597 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.701372 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.702113 23752 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.703701 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.704816 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.706938 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.708617 23644 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.709342 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.711799 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.712069 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.716512 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:10.718076 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.719712 22269 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.719954 23651 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.720325 23651 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.720659 23651 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.720938 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.721783 23659 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:10.723253 23659 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.724758 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:10.725119 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.726512 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.726768 23634 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.719766 22114 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.730657 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.736107 22269 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:10.741194 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.742090 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.743250 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:10.728462 23740 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.746315 22119 raft_consensus.cc:2955] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:10.749130 22271 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:10.749980 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.703452 23642 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.760551 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.761524 22114 raft_consensus.cc:2393] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:10.732963 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:10.769110 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.779667 22191 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.780747 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:10.782799 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:10.781277 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:10.784237 22192 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 2: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:10.781500 22197 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:10.793076 22122 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:10.796959 22196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:55836
I20260709 12:10:10.797662 22196 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:10.783515 22194 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:10.728339 23597 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.798064 22196 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.807646 22193 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.809147 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.809687 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:10.810341 22865 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:10.811148 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:10.705721 23752 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 12:10:10.763293 23608 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.814330 22196 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.766557 23650 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:10.812885 22118 raft_consensus.cc:2955] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:10.822947 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:10.826830 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 96732.9us
I20260709 12:10:10.799204 23740 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.828449 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.834245 22195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:10.834859 22195 raft_consensus.cc:606] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.835193 22195 raft_consensus.cc:614] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:10.836681 23608 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:10.838899 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:10.839847 22191 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.840623 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:10.842689 22195 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 4. Ops: []
I20260709 12:10:10.844321 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:10.845959 22197 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:10.816731 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:10.853456 22196 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:10.857419 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:10.824249 23734 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.868498 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:10.841995 23663 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:10.871258 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:10.929101 22270 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.929587 22270 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:10.930563 22270 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.862515 22193 raft_consensus.cc:2955] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:10.931945 22270 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.939774 23607 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.856299 23608 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.949702 22189 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:10.852321 23634 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.865068 23736 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:10:10.848838 23650 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.858265 23640 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.943053 23717 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:10.976414 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:10.941313 23751 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.975248 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.872648 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:10.865564 22115 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:10.853449 23740 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:10.942059 23738 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:10:11.004300 23740 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:11.005689 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:11.006424 22859 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:11.007845 23745 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.007771 22237 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:11.009001 23740 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.009454 23740 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.009827 23740 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.011292 23607 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:10.999382 23717 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.014777 23650 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:11.016034 23717 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:11.016376 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:10.947674 23663 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:10.961277 23608 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:11.019001 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43923.3us
I20260709 12:10:11.030613 22162 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:10.995604 23709 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.018828 22857 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.029531 23694 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.982435 23718 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.026465 23644 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.988394 23640 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:11.038865 23607 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.062271 22189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "575c887e89834da7b6e222b41a19b692"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:11.063063 22189 raft_consensus.cc:606] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:11.044795 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 97238.3us
I20260709 12:10:10.997996 23751 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:11.065371 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:11.044162 22270 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:11.066205 22118 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:10:11.069172 22198 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:11.071691 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:11.048610 23694 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:11.064360 23607 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:11.143770 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 72149.6us
I20260709 12:10:11.045164 23709 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:11.152563 23693 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.153692 23693 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:11.156993 23693 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:11.157692 23693 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.158397 23693 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.161278 23693 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:11.138566 23694 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.136301 23774 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.147809 23607 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:11.186124 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 54452.2us
W20260709 12:10:11.191548 23762 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:10:11.191762 23765 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:10:11.188702 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 134870us
I20260709 12:10:11.200315 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:11.202564 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:11.202585 22193 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:11.196935 23767 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:10:11.229089 23764 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 12:10:11.241698 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 96045.3us
I20260709 12:10:11.209614 23774 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.246670 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:11.247295 22196 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:11.249313 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:11.346662 23782 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.347229 23782 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.347618 23782 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.248724 23608 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:11.354591 23783 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.365120 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:11.365911 22272 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:11.368537 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 221) took 2289 ms. Trace:
I20260709 12:10:11.365126 23774 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:11.361330 22018 catalog_manager.cc:5697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:11.400453 23709 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:11.402465 22272 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.391248 22018 catalog_manager.cc:5697] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index 3 to 4, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:11.352375 23718 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:11.344833 23605 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:11.423247 23771 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:10:11.384037 23640 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:11.410660 23751 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:11.422142 23605 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:11.445169 23605 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.453292 23783 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.463912 23607 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:11.436069 23769 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 12:10:11.472939 23542 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:11.475057 23651 consensus_meta.cc:287] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.754s	user 0.009s	sys 0.004s
I20260709 12:10:11.481540 23542 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.469609 23740 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.492280 23780 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.497941 23740 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:11.519698 23751 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:11.489948 23651 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:11.528680 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.491226 22857 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:11.521351 23751 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:11.543702 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:11.547993 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:11.549968 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:11.552469 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:11.554086 23607 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:11.554311 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:11.554090 22860 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:11.557842 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:11.537292 23542 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:11.577585 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.369230 22017 rpcz_store.cc:276] 0709 12:10:09.079149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.079298 (+   149us) service_pool.cc:224] Handling call
0709 12:10:09.106233 (+ 26935us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:11.368414 (+2262181us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.741867 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.824132 (+ 82265us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.824177 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:10:09.824201 (+    24us) tablet.cc:662] Decoding operations
0709 12:10:09.825188 (+   987us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.825257 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.825288 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:09.825851 (+   563us) tablet.cc:701] Row locks acquired
0709 12:10:09.825872 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:09.826040 (+   168us) write_op.cc:270] Start()
0709 12:10:09.826178 (+   138us) write_op.cc:276] Timestamp: P: 1783599009825989 usec, L: 0
0709 12:10:09.826206 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.827011 (+   805us) log.cc:844] Serialized 2539 byte log entry
0709 12:10:10.353585 (+526574us) op_driver.cc:464] REPLICATION: finished
0709 12:10:10.461614 (+108029us) write_op.cc:301] APPLY: starting
0709 12:10:10.461689 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:10.461893 (+   204us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:10.462031 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:10.463054 (+  1023us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:10.463300 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:10:10.463365 (+    65us) write_op.cc:312] APPLY: finished
0709 12:10:10.463641 (+   276us) log.cc:844] Serialized 53 byte log entry
0709 12:10:10.463828 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.463937 (+   109us) write_op.cc:454] Released schema lock
0709 12:10:10.463972 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:10.464315 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.464340 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":93880,"reported_tablets":10,"spinlock_wait_cycles":8163200,"child_traces":[["op",{"apply.queue_time_us":107788,"apply.run_cpu_time_us":2659,"apply.run_wall_time_us":2666,"num_ops":6,"prepare.queue_time_us":173258,"prepare.run_cpu_time_us":4495,"prepare.run_wall_time_us":103596,"replication_time_us":527220,"thread_start_us":236402,"threads_started":2}]]}
I20260709 12:10:11.589963 23727 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:11.579869 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:11.621618 23774 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:11.622432 23751 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:11.622515 23774 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.625522 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:11.627483 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.562819 23663 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:11.642999 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:11.637238 22189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1fb787db87147b3be49bef974365af1"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:11.647047 22189 raft_consensus.cc:606] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:11.645491 23688 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.639171 23774 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:11.669257 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:11.675057 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:11.676156 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:11.675058 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:11.679296 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:11.681982 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:11.683360 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:11.691021 22862 raft_consensus.cc:2368] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4.
I20260709 12:10:11.691761 22863 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:11.693090 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:11.699219 22267 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:11.676836 22266 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:11.663506 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:11.714771 22163 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:11.731258 23772 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:11.732067 23772 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:11.738335 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 49201us
I20260709 12:10:11.740180 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:11.744717 23778 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:11.745649 23778 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:11.751271 23775 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.467s	user 0.004s	sys 0.001s
I20260709 12:10:11.737954 23582 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:11.755147 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:11.759665 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:11.764008 22163 leader_election.cc:400] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4.
I20260709 12:10:11.714109 23659 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:11.768036 22163 leader_election.cc:403] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:11.776728 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:11.667798 23688 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:11.771646 23756 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.766355 23774 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:11.753219 23582 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:11.783218 22237 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:11.789381 22194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.012s	sys 0.016s
W20260709 12:10:11.796954 22194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.012s	sys 0.016s
I20260709 12:10:11.789625 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:11.790227 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:11.798846 22862 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.782683 23783 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.795823 22830 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:11.806423 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:11.786301 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:11.753316 23608 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.757516 23764 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:11.766067 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:11.794167 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:11.793264 22192 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.010s	sys 0.025s
I20260709 12:10:11.817278 23776 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.818487 23766 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:11.816493 22192 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.011s	sys 0.025s
I20260709 12:10:11.801318 23718 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.791992 23651 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:11.792116 23667 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:11.800797 23663 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:11.827996 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 62049.3us
I20260709 12:10:11.782734 23659 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:11.839560 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53336us
I20260709 12:10:11.823750 23751 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:11.796085 22857 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:11.828697 23772 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:11.832974 23786 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.796298 23774 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.858007 23781 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.858901 23781 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:11.862576 23776 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:11.840590 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:11.822791 23764 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.847235 23716 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.803337 23756 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:11.882067 22086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.028s	sys 0.059s
W20260709 12:10:11.882434 22086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.028s	sys 0.059s
I20260709 12:10:11.836786 23667 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:11.846338 23663 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:10:11.847662 22193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.018s	sys 0.042s
I20260709 12:10:11.829107 23718 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:11.889206 22162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.007s	sys 0.052s
I20260709 12:10:11.890602 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:11.891273 22193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.018s	sys 0.042s
W20260709 12:10:11.892102 22122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.014s	sys 0.028s
I20260709 12:10:11.866325 23786 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:11.869879 23651 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:11.894258 22162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.007s	sys 0.053s
I20260709 12:10:11.831197 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:11.846338 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1378) took 1006 ms. Trace:
I20260709 12:10:11.882673 22119 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.866879 23751 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:11.896750 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 694250us
I20260709 12:10:11.863399 23776 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:11.924886 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:11.912869 22122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.015s	sys 0.028s
W20260709 12:10:11.924273 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:11.924036 22272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.022s
W20260709 12:10:11.931474 22272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.000s	sys 0.023s
I20260709 12:10:11.910848 22192 rpcz_store.cc:276] 0709 12:10:10.840261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.840597 (+   336us) service_pool.cc:224] Handling call
0709 12:10:10.840922 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.841252 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.841281 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:10.841785 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.046427 (+204642us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:11.821282 (+774855us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.844576 (+ 23294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.844656 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.844698 (+    42us) raft_consensus.cc:1685] finished
0709 12:10:11.844714 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.846261 (+  1547us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":191562,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":87,"raft.queue_time_us":26624,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":12964,"thread_start_us":875016,"threads_started":2,"wal-append.queue_time_us":178594}
I20260709 12:10:11.892357 23766 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:11.892674 23778 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:11.896374 23786 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.894616 23788 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.894651 23609 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.854419 23724 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:11.895836 23718 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:11.941462 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 110372us
W20260709 12:10:11.919976 23650 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.014s	sys 0.027s
I20260709 12:10:11.871536 23582 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:11.949388 23609 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:11.956696 23650 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.015s	sys 0.028s
W20260709 12:10:11.930135 22115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.021s	sys 0.042s
I20260709 12:10:11.953476 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:11.952394 23785 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:11.961570 22117 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.962157 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:11.963023 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:11.896175 23651 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.969731 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:11.951728 23694 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.004s
I20260709 12:10:11.975649 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:11.970121 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:11.978178 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:11.958771 23727 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:11.961103 22115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.021s	sys 0.042s
I20260709 12:10:11.949752 23717 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:11.991715 22117 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:11.998862 22192 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:12.000191 22190 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:12.000836 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:12.001449 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:12.001204 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:11.966818 23688 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.047835 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:12.048836 22198 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:12.052706 22862 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:11.956840 23724 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.001456 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:12.007336 23781 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.079154 23794 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.072800 23609 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.083278 22162 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:11.976714 23694 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.096326 23756 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:11.946175 23766 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:12.039817 23727 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.099808 23764 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:11.961046 23788 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:12.097062 22114 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:12.031488 23793 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:10:12.114392 22119 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:12.122205 23776 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.124712 23724 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.124747 23751 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.131457 23774 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:12.133119 23605 consensus_meta.cc:287] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.004s
I20260709 12:10:12.133611 23605 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.136507 22192 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.141151 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:12.142627 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:12.147028 23667 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.147511 23798 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.006088 23717 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.098969 23781 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.156390 22116 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
W20260709 12:10:12.114959 23782 consensus_meta.cc:287] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.767s	user 0.008s	sys 0.005s
I20260709 12:10:12.107612 23659 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:12.109004 23727 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:12.180667 23766 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.005342 23663 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:11.997359 23785 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.101384 23794 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:12.223796 23694 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.183774 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:12.231732 23651 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:12.242673 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:12.243681 22119 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 2: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:12.168174 23727 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.251104 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:12.259446 23634 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:12.260301 23634 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:12.170600 23788 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:12.217362 23605 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.237421 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:12.272122 23787 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:12.273197 23787 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.262885 23608 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:12.275161 23608 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.148123 23798 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.281040 23538 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:12.282339 23608 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.285347 23538 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.288558 23538 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.282008 23694 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:12.288985 23605 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:12.277740 23793 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:12.292296 23605 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.263303 23640 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.290314 23708 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:12.291591 23634 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:12.289484 23694 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.301658 23790 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:12.164525 23782 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:12.297307 23708 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.295876 23640 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.310318 23640 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.313153 23717 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.305048 23693 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:12.308320 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:12.314369 22123 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.318183 23607 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:12.292752 23793 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.318629 23756 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:12.336316 23605 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.318094 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:12.338323 23756 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.339375 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:12.321161 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.313870 23693 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.329358 23700 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.342799 23693 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.342689 23700 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.344220 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:12.323547 23788 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:12.344592 23709 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:12.345618 23781 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:12.279762 22114 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:12.350267 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:12.350446 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:12.351994 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:12.302675 23790 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:12.282333 23794 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:12.235615 23815 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.237s
W20260709 12:10:12.953610 22121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.000s	sys 0.015s
W20260709 12:10:12.442554 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.017050 22121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.002s	sys 0.016s
W20260709 12:10:12.665009 22831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.062s	sys 0.082s
I20260709 12:10:12.439687 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:12.505935 22123 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:13.011813 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:12.734059 22830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.018s	sys 0.024s
W20260709 12:10:12.566201 22122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.027s	sys 0.012s
I20260709 12:10:13.018289 22265 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:12.576828 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:13.049616 22830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.018s	sys 0.029s
I20260709 12:10:12.578506 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:12.750936 22829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.008s	sys 0.004s
I20260709 12:10:12.435667 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:13.017580 22268 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:13.051327 22272 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:12.319538 23785 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:12.834947 22087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.048s	sys 0.080s
I20260709 12:10:13.044345 22267 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
W20260709 12:10:12.506093 22193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.052s	sys 0.066s
W20260709 12:10:13.054020 22193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.064s	sys 0.095s
W20260709 12:10:13.054212 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.046301 22831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.066s	sys 0.111s
W20260709 12:10:13.050026 22122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.030s	sys 0.019s
W20260709 12:10:13.051219 22829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.009s	sys 0.012s
I20260709 12:10:13.058548 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:13.059247 22267 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
W20260709 12:10:12.533412 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.046784 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:13.061061 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:13.061697 22862 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:10:13.044947 22116 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
W20260709 12:10:13.053546 22087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.051s	sys 0.090s
W20260709 12:10:13.060562 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 716396us
W20260709 12:10:13.063129 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 1.06964e+06us
I20260709 12:10:12.436928 23694 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:13.056684 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1378) took 1064 ms. Trace:
W20260709 12:10:12.796802 23718 consensus_meta.cc:287] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.834s	user 0.011s	sys 0.004s
I20260709 12:10:13.064996 22123 rpcz_store.cc:276] 0709 12:10:11.981115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.989576 (+  8461us) service_pool.cc:224] Handling call
0709 12:10:12.308071 (+318495us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:13.045380 (+737309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31176960}
I20260709 12:10:13.065950 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:12.458577 23791 raft_consensus.cc:993] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
W20260709 12:10:12.918270 22115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.004s	sys 0.011s
I20260709 12:10:12.540163 23740 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.355674 23605 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:13.076109 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:12.568480 23582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.010s	sys 0.030s
W20260709 12:10:12.546088 23768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.021s	sys 0.097s
W20260709 12:10:12.508993 23650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.010s	sys 0.028s
W20260709 12:10:12.485455 23786 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 12:10:12.353602 23783 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4.
I20260709 12:10:13.077303 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:13.090459 22123 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:13.057500 23788 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.078702 23718 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.095057 22191 raft_consensus.cc:2368] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
I20260709 12:10:13.095914 22196 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:13.096036 23718 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:12.733973 23773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.010s	sys 0.005s
W20260709 12:10:13.096802 23773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.330s	user 0.013s	sys 0.007s
I20260709 12:10:12.709165 23727 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.077589 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:13.078567 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:12.460068 23708 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:13.018152 23799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.005s	sys 0.012s
I20260709 12:10:13.074823 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:12.459570 23782 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.579771 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:12.587673 23787 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.585745 23756 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.458678 23696 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:12.441725 23778 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:12.361194 23688 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:13.018340 23793 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:12.360978 23758 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:13.077354 22115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.009s	sys 0.011s
I20260709 12:10:12.373183 23607 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.058144 23709 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.097776 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:13.096529 23694 raft_consensus.cc:1081] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
W20260709 12:10:13.583554 22864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.004s	sys 0.007s
W20260709 12:10:13.614399 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 535934us
I20260709 12:10:13.097095 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:13.615302 22118 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.617156 22270 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:13.126655 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:13.178618 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:13.591933 22238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.003s	sys 0.005s
I20260709 12:10:13.098387 22267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:10:13.169482 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:13.104131 22863 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:13.185432 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:13.629328 22198 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
W20260709 12:10:13.085901 23582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.012s	sys 0.038s
W20260709 12:10:13.592943 22121 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.009s
W20260709 12:10:13.639920 22121 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.000s	sys 0.009s
I20260709 12:10:13.641247 22162 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:13.087462 23640 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.000s
I20260709 12:10:13.178925 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:13.657998 22192 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
W20260709 12:10:13.628420 22238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.004s	sys 0.006s
I20260709 12:10:13.080555 23823 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.627104 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1400) took 1041 ms. Trace:
W20260709 12:10:13.639474 23799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.012s	sys 0.014s
I20260709 12:10:13.689961 23822 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.690866 23822 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.691836 23708 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:13.692461 23708 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:13.655194 22163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.026s	sys 0.007s
W20260709 12:10:13.693974 22163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.027s	sys 0.007s
W20260709 12:10:13.694388 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 614786us
W20260709 12:10:13.592957 22829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.003s	sys 0.009s
W20260709 12:10:13.655975 22237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.000s	sys 0.020s
W20260709 12:10:13.695566 22829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.003s	sys 0.009s
W20260709 12:10:13.695724 22237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.000s	sys 0.020s
I20260709 12:10:13.085948 23785 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:13.584883 23663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.273s	user 0.021s	sys 0.010s
W20260709 12:10:13.097956 23650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.012s	sys 0.040s
W20260709 12:10:13.526255 23819 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 12:10:13.630200 22267 raft_consensus.cc:606] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
W20260709 12:10:13.151139 23768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.026s	sys 0.140s
I20260709 12:10:13.618981 22116 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:13.724685 22267 raft_consensus.cc:614] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:13.168459 23718 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:13.236761 23816 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:13.640389 23688 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.665485 22270 rpcz_store.cc:276] 0709 12:10:12.586269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.049163 (+462894us) service_pool.cc:224] Handling call
0709 12:10:13.627033 (+577870us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:13.525327 23794 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:13.162504 23806 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:13.256222 23700 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:13.052860 23781 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.512391 23788 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:13.652611 23696 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.213065 23798 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:13.692914 23708 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.186801 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:13.611845 23790 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:13.639158 23814 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:13.705608 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:13.784235 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 78783.2us
I20260709 12:10:13.651377 23756 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:13.708285 22087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.018s
I20260709 12:10:13.085249 23740 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.787760 23709 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.788559 23832 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:13.788825 23727 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:13.789018 23824 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.789467 23740 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:13.789182 23832 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.790050 23740 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:13.790557 23740 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.791749 23832 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:13.792336 23832 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:13.668704 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:13.725894 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:13.793200 22858 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:13.793540 23696 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.726845 23815 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:13.792538 23740 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:13.733340 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.794404 23815 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:13.795306 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.727560 23793 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:13.797019 23793 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.798009 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:13.798802 22271 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:13.798998 23793 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:13.087641 23605 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.798029 23740 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:13.800506 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:13.800570 23740 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.801290 22269 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.801492 23605 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.802309 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:13.802807 23740 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.803896 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:13.701638 23835 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:13.088913 23786 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:13.785655 22087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.014s	sys 0.018s
I20260709 12:10:13.652735 23758 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.786190 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 1371) took 1283 ms. Trace:
W20260709 12:10:13.725248 22119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 1370) took 1232 ms (client timeout 1622 ms). Trace:
I20260709 12:10:13.849357 23696 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:13.849910 22195 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:13.850028 23696 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:13.850572 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 124805us
I20260709 12:10:13.786696 23822 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:13.787482 22191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1387) took 1787 ms (client timeout 2108 ms). Trace:
I20260709 12:10:13.850871 23781 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.803333 23740 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:13.789713 23824 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.737367 23787 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:13.792979 23756 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.859108 22117 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:13.665831 23640 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.726773 23598 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:13.793095 23832 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.804713 22266 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 1.
I20260709 12:10:13.651978 23778 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:13.710323 23663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.390s	user 0.022s	sys 0.010s
I20260709 12:10:13.727783 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:13.709791 22118 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
W20260709 12:10:13.823491 22830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.028s	sys 0.054s
W20260709 12:10:13.836472 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51267.5us
W20260709 12:10:13.877897 22830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.029s	sys 0.064s
W20260709 12:10:13.877907 22118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 1358) took 1620 ms (client timeout 2095 ms). Trace:
W20260709 12:10:13.878301 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 632287us
W20260709 12:10:13.853127 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 766596us
I20260709 12:10:13.879755 22116 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:13.881026 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:13.882134 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:13.776432 23826 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:13.776919 23582 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.730048 23807 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:13.851292 22191 rpcz_store.cc:269] 0709 12:10:12.000297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.000591 (+   294us) service_pool.cc:224] Handling call
0709 12:10:13.787240 (+1786649us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001f45d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:13.787397 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2514530688}
I20260709 12:10:13.851405 23822 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:13.709707 23823 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:13.796489 23815 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.875667 23696 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:13.787613 23827 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.718101 23607 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.876370 23824 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:13.885664 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:13.854408 23798 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.896675 22269 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:13.957695 23823 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.791781 23688 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.905997 23839 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.850941 23758 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.892004 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:13.960327 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 68402.9us
I20260709 12:10:13.852581 23790 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:13.851722 22114 rpcz_store.cc:276] 0709 12:10:12.502948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.098000 (+595052us) service_pool.cc:224] Handling call
0709 12:10:13.786099 (+688099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:13.709105 23785 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:13.878412 22118 rpcz_store.cc:269] 0709 12:10:12.257449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.074557 (+817108us) service_pool.cc:224] Handling call
0709 12:10:13.877850 (+803293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:13.784284 23794 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.784107 23816 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.964212 23839 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.960851 23827 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.979247 23839 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.979728 23839 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.980813 23756 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.964402 22269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:10:13.907003 23838 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:13.982288 22269 raft_consensus.cc:606] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
I20260709 12:10:13.982621 23838 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.983999 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:13.876425 23786 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:13.948874 23828 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:13.985884 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:13.985351 23828 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.986717 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:13.851799 23740 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.988850 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:13.876425 23814 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.990242 23794 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.990666 23740 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.779402 23830 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:13.992168 23814 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.897281 23582 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:13.991780 23830 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.992959 23582 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.944866 23822 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.995404 23822 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.983263 23785 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.981086 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:13.876693 23787 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.910537 23663 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:13.782495 23718 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.960632 23823 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:13.966034 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:13.945091 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 61376.5us
I20260709 12:10:13.896148 23788 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 12:10:13.907188 23727 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:10:13.783700 23806 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:13.878942 23598 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:13.940151 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58077.7us
I20260709 12:10:13.905675 23835 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:14.186156 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.188228 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1376) took 2207 ms. Trace:
I20260709 12:10:14.210758 22189 raft_consensus.cc:2368] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3.
W20260709 12:10:13.948536 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 96318.1us
I20260709 12:10:14.210935 22123 rpcz_store.cc:276] 0709 12:10:11.980500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.091209 (+1110709us) service_pool.cc:224] Handling call
0709 12:10:14.187254 (+1096045us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:14.187467 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.187789 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.187827 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.187885 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:14.187928 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.188003 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.188131 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80405760}
W20260709 12:10:13.849442 22119 rpcz_store.cc:269] 0709 12:10:12.473668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.547499 (+ 73831us) service_pool.cc:224] Handling call
0709 12:10:13.706052 (+1158553us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:14.165354 22236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.007s	sys 0.007s
W20260709 12:10:14.017993 23819 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:14.023715 23816 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:14.187333 23787 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:13.956284 23831 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:13.949018 23807 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:14.132288 23582 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:14.213961 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:14.234572 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:14.209642 22116 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:14.211467 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37260 (request call id 211) took 1033 ms. Trace:
W20260709 12:10:13.944432 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 65519.7us
I20260709 12:10:14.236250 22123 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.237550 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:14.230871 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:14.238725 22865 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:14.160727 22237 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:14.231848 22236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.010s	sys 0.007s
I20260709 12:10:14.236538 22197 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.190480 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:14.220873 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:14.196228 23805 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.561s	user 0.002s	sys 0.024s
W20260709 12:10:14.197326 23808 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.054s	user 0.000s	sys 0.012s
W20260709 12:10:14.201737 23818 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.113s	user 0.003s	sys 0.008s
I20260709 12:10:14.267788 23783 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.189177 23708 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:14.268618 23783 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:14.269179 23598 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:14.269907 23847 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.270300 23835 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:14.270478 23708 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:14.270983 23783 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:14.273203 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1377) took 2292 ms. Trace:
W20260709 12:10:14.101241 23809 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.183s	user 0.005s	sys 0.010s
I20260709 12:10:13.977531 23640 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:14.196063 23815 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:14.276532 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.276396 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.240042 22163 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:14.279165 22118 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:14.282346 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:14.250245 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 89698.9us
I20260709 12:10:14.237738 22189 rpcz_store.cc:276] 0709 12:10:13.177666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.185339 (+  7673us) service_pool.cc:224] Handling call
0709 12:10:14.185970 (+1000631us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b5800196598. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9de9c 00007fcceac9da5b 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:14.211377 (+ 25407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8402560}
I20260709 12:10:14.102877 23827 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:14.276006 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.024420 23837 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:13.995934 23830 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:14.017019 23663 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.970748 23778 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:14.279363 22116 rpcz_store.cc:276] 0709 12:10:11.980828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.272356 (+2291528us) service_pool.cc:224] Handling call
0709 12:10:14.272680 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.272872 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.272900 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.272949 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:14.272987 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.273043 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.273144 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:14.172430 22859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 389) took 1112 ms. Trace:
I20260709 12:10:13.911121 23826 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:14.315928 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:14.025939 23740 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:14.280418 23787 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:13.968112 23832 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:14.270527 23847 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:10:14.315515 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 75589.9us
I20260709 12:10:14.034914 23828 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:14.278714 23696 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:14.346426 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:14.346803 23696 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:14.315500 23807 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:14.347461 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 200) took 3115 ms. Trace:
I20260709 12:10:14.347909 23787 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:14.016947 23838 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:14.350178 23787 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:14.351904 23803 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 1.717s	user 0.014s	sys 0.024s
I20260709 12:10:14.352075 23826 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:14.353106 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37260 (request call id 208) took 1184 ms. Trace:
I20260709 12:10:14.316056 23815 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:14.353741 22195 rpcz_store.cc:276] 0709 12:10:13.168947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.169146 (+   199us) service_pool.cc:224] Handling call
0709 12:10:14.352943 (+1183797us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001bf3d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:14.353050 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508100480}
I20260709 12:10:14.347923 22193 rpcz_store.cc:276] 0709 12:10:11.231720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.231835 (+   115us) service_pool.cc:224] Handling call
0709 12:10:11.232267 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.894683 (+662416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.894723 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.903181 (+  8458us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.054557 (+1151376us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:13.054622 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.054720 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.100540 (+1045820us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:14.347111 (+246571us) raft_consensus.cc:1685] finished
0709 12:10:14.347136 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.347369 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17367,"raft.queue_time_us":138153,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":357744896,"thread_start_us":1754535,"threads_started":2,"wal-append.queue_time_us":814913}
I20260709 12:10:14.355304 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.355513 23815 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:14.355684 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.356264 22860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 385) took 2757 ms. Trace:
I20260709 12:10:14.314939 23837 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:14.331203 23663 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:14.332437 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.273308 23823 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.233187 23831 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:14.335170 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:14.338140 22197 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:14.308923 23814 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:14.344395 23582 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:14.200070 23822 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:13.985432 23790 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:14.149899 23839 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:14.345731 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:14.346120 23718 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:14.347136 22857 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:10:14.339630 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:14.326977 22123 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:14.356573 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:14.405400 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 191889us
W20260709 12:10:14.419576 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 136242us
I20260709 12:10:14.385758 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.498217 23806 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:14.545020 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37260 (request call id 215) took 1362 ms. Trace:
I20260709 12:10:14.546208 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.338012 23740 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:14.317763 23783 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.549013 23740 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:14.549147 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.500813 23696 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:14.550684 22088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.787s (SENT) [suppressed 4 similar messages]
I20260709 12:10:14.551313 23837 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:14.317993 22859 rpcz_store.cc:276] 0709 12:10:13.060304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.065599 (+  5295us) service_pool.cc:224] Handling call
0709 12:10:14.171312 (+1105713us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b5800003c98. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9de9c 00007fcceac9da5b 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:14.171611 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.171886 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.171931 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.171990 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:14.172035 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.172113 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.172306 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6338304}
I20260709 12:10:14.424602 23847 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:14.552279 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:14.553474 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.568567 22193 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:14.556433 22118 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:14.571156 23822 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:14.556922 23785 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.573017 23785 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:14.559620 23837 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:14.559719 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:14.543514 22195 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:14.581836 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 216) took 1335 ms. Trace:
I20260709 12:10:14.583595 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:14.584223 22864 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
W20260709 12:10:14.559500 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.559199 22198 raft_consensus.cc:2368] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4.
I20260709 12:10:14.568575 22123 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:14.546602 22197 rpcz_store.cc:276] 0709 12:10:13.182600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.245490 (+ 62890us) service_pool.cc:224] Handling call
0709 12:10:14.234420 (+988930us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800196598. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:14.544885 (+310465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24298240}
I20260709 12:10:14.558898 23696 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:14.585773 23787 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.590971 23787 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:14.586638 23837 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:14.591506 23787 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.558573 23718 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.592396 23718 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.592609 23807 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:14.593123 23718 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.593473 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:14.593235 23807 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:14.594642 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:14.595397 23807 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:14.595667 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:14.554359 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 214735us
I20260709 12:10:14.597429 22088 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:14.597931 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:14.598821 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:14.601271 22163 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:14.591326 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.602207 22197 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
W20260709 12:10:14.596658 23812 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.838s	user 0.011s	sys 0.017s
I20260709 12:10:14.582257 22190 rpcz_store.cc:276] 0709 12:10:13.246136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.656167 (+410031us) service_pool.cc:224] Handling call
0709 12:10:13.656494 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.979244 (+322750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.979280 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:13.979326 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:13.979355 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.581610 (+602255us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54003b56d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:14.581658 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.581779 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741704448}
I20260709 12:10:14.606390 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.618289 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:14.618563 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:14.619024 22269 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:14.619059 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:14.619428 22266 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:14.619800 22272 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:14.620265 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:14.621016 22267 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:14.622143 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:14.622932 22268 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:14.620277 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:14.626911 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 351301us
I20260709 12:10:14.560114 23823 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:14.584707 23806 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:14.629529 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.560529 23831 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.637104 22191 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:14.631560 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.633014 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.593159 23837 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:14.563092 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:14.560367 23814 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:14.639837 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.601588 23807 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:14.590971 23696 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:14.603318 23796 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.646411 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.710052 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:14.963737 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1380) took 2982 ms. Trace:
W20260709 12:10:14.929916 22196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37260 (request call id 207) took 3100 ms (client timeout 1689 ms). Trace:
I20260709 12:10:15.014748 22193 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
W20260709 12:10:14.718575 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.656720 22190 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 2: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:14.610953 23830 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:14.855212 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:14.658936 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:14.641938 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:14.998742 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:14.668334 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.799466 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:15.026924 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:14.606952 23783 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.028506 22118 rpcz_store.cc:276] 0709 12:10:11.981684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.962859 (+2981175us) service_pool.cc:224] Handling call
0709 12:10:14.963214 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.963433 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.963459 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.963499 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:14.963525 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.963574 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.963679 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.262612 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1353) took 3258 ms. Trace:
I20260709 12:10:15.263188 22118 rpcz_store.cc:276] 0709 12:10:12.004166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.261487 (+3257321us) service_pool.cc:224] Handling call
0709 12:10:15.261882 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.262129 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.262171 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.262236 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:15.262285 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.262362 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.262532 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:14.910578 23821 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.820s	user 0.010s	sys 0.002s
W20260709 12:10:15.027884 22196 rpcz_store.cc:269] 0709 12:10:11.789037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.789254 (+   217us) service_pool.cc:224] Handling call
0709 12:10:14.889415 (+3100161us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54001be9d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:14.889594 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2970057472}
W20260709 12:10:15.227519 23847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.013s	sys 0.034s
I20260709 12:10:14.674904 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:15.046324 23830 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:14.963860 23839 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:14.632174 23836 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.796391 23826 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.658252 23806 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:14.909360 23810 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 2.122s	user 0.009s	sys 0.026s
I20260709 12:10:14.915102 23740 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:15.026671 23798 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:14.961333 23663 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:14.703460 23743 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.962170 22114 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:14.683043 23804 log.cc:927] Time spent T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 2.177s	user 0.011s	sys 0.022s
I20260709 12:10:15.023326 23807 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:15.278752 23836 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:15.094619 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:14.658428 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.079622 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:15.246567 22197 raft_consensus.cc:2393] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:15.017932 23796 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:15.106941 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 79145.8us
I20260709 12:10:14.658776 23822 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.250783 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:14.704478 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:14.636490 23823 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.657927 23582 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:14.772923 23811 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.983s	user 0.008s	sys 0.008s
W20260709 12:10:15.007920 23791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.850s	user 0.011s	sys 0.010s
I20260709 12:10:14.658106 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:15.337142 23796 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:14.735028 23820 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 1.561s	user 0.005s	sys 0.016s
I20260709 12:10:15.131501 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.241652 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:15.363448 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 118039us
I20260709 12:10:15.256095 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1352) took 3259 ms. Trace:
I20260709 12:10:15.276690 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 210) took 2091 ms. Trace:
I20260709 12:10:14.552757 22860 rpcz_store.cc:276] 0709 12:10:11.598973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.599563 (+   590us) service_pool.cc:224] Handling call
0709 12:10:11.600042 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.600496 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.600546 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.650532 (+ 49986us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.004376 (+353844us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:12.029075 (+ 24699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.038483 (+  9408us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.195587 (+2157104us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:14.334398 (+138811us) raft_consensus.cc:1685] finished
0709 12:10:14.338730 (+  4332us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.356168 (+ 17438us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":517,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":341919104,"thread_start_us":229971,"threads_started":1,"wal-append.queue_time_us":908851}
I20260709 12:10:15.246393 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 1385) took 1003 ms. Trace:
I20260709 12:10:15.364619 22194 rpcz_store.cc:276] 0709 12:10:13.175659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.185272 (+  9613us) service_pool.cc:224] Handling call
0709 12:10:13.732149 (+546877us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b5800196598. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9de9c 00007fcceac9da5b 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:13.732363 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.277861 (+545498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.277890 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.277928 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:14.277965 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.266650 (+988685us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54000fb4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:15.266704 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.266832 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257295360}
W20260709 12:10:15.275261 23847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.013s	sys 0.035s
I20260709 12:10:15.270529 23783 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:15.315320 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.294091 23740 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.378095 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:15.371745 22119 rpcz_store.cc:276] 0709 12:10:14.239028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.562405 (+323377us) service_pool.cc:224] Handling call
0709 12:10:15.172002 (+609597us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.378787 22861 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:15.362982 22271 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.379843 23740 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:15.322023 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1368) took 4350 ms. Trace:
I20260709 12:10:15.380479 22122 rpcz_store.cc:276] 0709 12:10:10.945161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.945355 (+   194us) service_pool.cc:224] Handling call
0709 12:10:10.979710 (+ 34355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.931209 (+951499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.931258 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.941115 (+  9857us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.067938 (+1126823us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:13.067977 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.133595 (+1065618us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400327154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:14.133646 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.888404 (+754758us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:15.295374 (+406970us) raft_consensus.cc:1685] finished
0709 12:10:15.295403 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.295566 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":209567,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":109,"spinlock_wait_cycles":672787072,"thread_start_us":1907304,"threads_started":2,"wal-append.queue_time_us":757369}
I20260709 12:10:15.374991 23851 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:10:15.384945 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1360) took 3126 ms. Trace:
I20260709 12:10:14.995431 23817 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:15.385696 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:15.385886 23817 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:15.388424 23817 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:15.322530 23718 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.003s
W20260709 12:10:15.336020 22117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 1355) took 3284 ms (client timeout 1675 ms). Trace:
I20260709 12:10:15.337548 22272 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:15.393355 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.345530 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1345) took 3372 ms. Trace:
W20260709 12:10:15.392212 22117 rpcz_store.cc:269] 0709 12:10:12.038013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.142317 (+104304us) service_pool.cc:224] Handling call
0709 12:10:15.322235 (+3179918us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400129dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:15.322363 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3946039040}
I20260709 12:10:15.395958 23807 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.396380 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1362) took 3137 ms. Trace:
I20260709 12:10:15.396716 22117 rpcz_store.cc:276] 0709 12:10:12.258632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.395624 (+3136992us) service_pool.cc:224] Handling call
0709 12:10:15.395893 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.396054 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.396085 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.396135 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:15.396164 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.396237 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.396332 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.342468 23822 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.341164 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1379) took 3358 ms. Trace:
I20260709 12:10:14.863792 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1370) took 3748 ms. Trace:
I20260709 12:10:15.340020 22859 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.319839 23663 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.336818 23815 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.353024 23791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.233s	user 0.015s	sys 0.015s
W20260709 12:10:15.364961 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 509790us
I20260709 12:10:15.438966 22830 leader_election.cc:400] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3.
I20260709 12:10:15.439532 22830 leader_election.cc:403] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:15.295023 23798 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.364574 22116 rpcz_store.cc:276] 0709 12:10:11.996842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.254808 (+3257966us) service_pool.cc:224] Handling call
0709 12:10:15.255624 (+   816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.255800 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.255822 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.255862 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.255890 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.255938 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.256030 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.394335 23814 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:15.368291 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1371) took 4125 ms. Trace:
I20260709 12:10:15.368728 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:15.370491 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:15.443885 22862 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:15.372752 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.369590 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:15.375907 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.445119 22863 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:15.446615 23851 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.447201 23851 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.443606 22120 rpcz_store.cc:276] 0709 12:10:11.243393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.243581 (+   188us) service_pool.cc:224] Handling call
0709 12:10:11.243943 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.661877 (+417934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.662873 (+   996us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.707201 (+ 44328us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.987609 (+280408us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:11.987645 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.987722 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.682269 (+2694547us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:15.361261 (+678992us) raft_consensus.cc:1685] finished
0709 12:10:15.361284 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.368202 (+  6918us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":224192,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":7405,"spinlock_wait_cycles":330939264,"thread_start_us":640286,"threads_started":2,"wal-append.queue_time_us":756600}
I20260709 12:10:15.450098 23798 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.453987 23785 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:15.455710 22859 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:15.455919 23663 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:15.456472 23663 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.457062 23663 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.459421 23663 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:15.460333 23740 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:15.442181 23815 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.462196 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:15.463038 23740 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.377756 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:15.377815 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:15.464026 22866 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:15.385015 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:15.327399 22189 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:15.444676 22268 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:15.389070 22857 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:10:15.379866 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:15.398519 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1365) took 3052 ms. Trace:
I20260709 12:10:15.393951 22272 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:10:15.326813 23836 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.364373 23696 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:15.394342 22121 rpcz_store.cc:276] 0709 12:10:11.972850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.989981 (+ 17131us) service_pool.cc:224] Handling call
0709 12:10:12.330802 (+340821us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:12.331078 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.347366 (+ 16288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.347404 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.360299 (+ 12895us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.049932 (+689633us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:13.640297 (+590365us) log.cc:844] Serialized 14 byte log entry
0709 12:10:13.723619 (+ 83322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.723731 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.909789 (+1186058us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:15.345216 (+435427us) raft_consensus.cc:1685] finished
0709 12:10:15.345250 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.345442 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98850,"prepare.queue_time_us":561747,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":110130,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":57057,"spinlock_wait_cycles":191556480,"thread_start_us":1220893,"threads_started":2,"wal-append.queue_time_us":729750}
I20260709 12:10:15.509431 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1377) took 1851 ms. Trace:
I20260709 12:10:15.509788 22121 rpcz_store.cc:276] 0709 12:10:13.658133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.508611 (+1850478us) service_pool.cc:224] Handling call
0709 12:10:15.508945 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.509111 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.509136 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.509180 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.509211 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.509261 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.509376 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.395002 23817 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.366434 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:15.434844 23821 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:15.444298 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:15.436722 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:15.447589 23858 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:10:15.460969 23862 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3.
I20260709 12:10:15.463110 23815 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.346143 23582 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:15.287108 23826 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.465322 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1373) took 2672 ms. Trace:
I20260709 12:10:15.377526 23783 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.344215 23856 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:15.460973 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1366) took 3114 ms. Trace:
I20260709 12:10:15.440894 22830 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:15.488145 22117 rpcz_store.cc:276] 0709 12:10:12.346591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.397738 (+3051147us) service_pool.cc:224] Handling call
0709 12:10:15.398040 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.398191 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.398228 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.398271 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.398313 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.398377 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.398470 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.489723 22861 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:15.385524 22119 rpcz_store.cc:276] 0709 12:10:12.258052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.379162 (+3121110us) service_pool.cc:224] Handling call
0709 12:10:15.384372 (+  5210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.384558 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.384599 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.384644 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.384680 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.384739 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.384885 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.488999 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:15.493086 23831 consensus_meta.cc:287] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.835s	user 0.008s	sys 0.004s
I20260709 12:10:15.571345 22117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "575c887e89834da7b6e222b41a19b692"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44372
W20260709 12:10:15.571120 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 130333us
I20260709 12:10:15.572158 22117 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:15.432845 22114 rpcz_store.cc:276] 0709 12:10:11.981404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.961545 (+2980141us) service_pool.cc:224] Handling call
0709 12:10:14.961948 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.320073 (+358125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.339776 (+ 19703us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.507382 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.439138 23861 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.513358 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1378) took 1851 ms. Trace:
I20260709 12:10:15.439599 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:15.627835 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:15.662025 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:15.563324 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 179931us
W20260709 12:10:15.562500 22235 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45844 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:15.567058 22116 rpcz_store.cc:276] 0709 12:10:12.346884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.441906 (+3095022us) service_pool.cc:224] Handling call
0709 12:10:15.460457 (+ 18551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.460638 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.460665 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.460708 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.460735 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.460811 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.460914 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.566797 22122 rpcz_store.cc:276] 0709 12:10:12.793298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.464516 (+2671218us) service_pool.cc:224] Handling call
0709 12:10:15.464878 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.465045 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.465072 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.465110 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:15.465137 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.465185 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.465271 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.561829 22270 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:15.665720 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1586) took 1009 ms. Trace:
I20260709 12:10:15.666083 22270 rpcz_store.cc:276] 0709 12:10:14.656305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.352904 (+696599us) service_pool.cc:224] Handling call
0709 12:10:15.665661 (+312757us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.666800 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:15.561056 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47314.2us
I20260709 12:10:15.571151 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.572573 22117 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.668522 22265 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:15.669704 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.670481 22265 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:15.507061 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.571079 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:15.562742 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 763331us
I20260709 12:10:15.671696 22266 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:15.672147 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:15.572594 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:15.642351 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.673190 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1414) took 1035 ms. Trace:
I20260709 12:10:15.652933 22121 rpcz_store.cc:276] 0709 12:10:13.662468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.510552 (+1848084us) service_pool.cc:224] Handling call
0709 12:10:15.512911 (+  2359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.513065 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.513094 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.513132 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:15.513158 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.513203 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.513308 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.673592 22268 rpcz_store.cc:276] 0709 12:10:14.637521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.572333 (+934812us) service_pool.cc:224] Handling call
0709 12:10:15.673125 (+100792us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.674700 22121 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:15.675258 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1383) took 1688 ms. Trace:
I20260709 12:10:15.667068 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.431319 23718 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:15.672384 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1578) took 1040 ms. Trace:
I20260709 12:10:15.675637 22121 rpcz_store.cc:276] 0709 12:10:13.986961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.674028 (+1687067us) service_pool.cc:224] Handling call
0709 12:10:15.674341 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.675027 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.675203 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.679603 22269 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:15.673574 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1580) took 1040 ms. Trace:
I20260709 12:10:15.686416 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:15.687310 22163 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:15.710837 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:15.709390 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1577) took 1077 ms. Trace:
I20260709 12:10:15.708415 22266 rpcz_store.cc:276] 0709 12:10:14.632270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.570770 (+938500us) service_pool.cc:224] Handling call
0709 12:10:15.672314 (+101544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.577733 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.691267 22162 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:15.713361 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:15.708678 22272 rpcz_store.cc:276] 0709 12:10:14.632885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.506771 (+873886us) service_pool.cc:224] Handling call
0709 12:10:15.673517 (+166746us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.682060 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1382) took 1695 ms. Trace:
I20260709 12:10:15.715937 22116 rpcz_store.cc:276] 0709 12:10:13.986718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.673212 (+1686494us) service_pool.cc:224] Handling call
0709 12:10:15.681535 (+  8323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.681703 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.681725 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.681784 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:15.681814 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.681876 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.682003 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.711608 22269 rpcz_store.cc:276] 0709 12:10:14.631818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.507016 (+875198us) service_pool.cc:224] Handling call
0709 12:10:15.709307 (+202291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.712759 22267 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:10:15.682053 22858 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:15.715284 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1372) took 3010 ms. Trace:
I20260709 12:10:15.712729 22117 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.682976 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.726480 22265 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:15.727456 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1587) took 1069 ms. Trace:
I20260709 12:10:15.726842 22120 rpcz_store.cc:276] 0709 12:10:12.704902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.449708 (+2744806us) service_pool.cc:224] Handling call
0709 12:10:15.450063 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.666941 (+216878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.666967 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.667008 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.667035 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.715064 (+ 48029us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54003ad9d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:15.715104 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.715232 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7796,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":31043,"spinlock_wait_cycles":498054016}
I20260709 12:10:15.652086 23861 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.734722 22120 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.729182 22265 rpcz_store.cc:276] 0709 12:10:14.657861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.682700 (+1024839us) service_pool.cc:224] Handling call
0709 12:10:15.727372 (+ 44672us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:15.735489 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 44341us
I20260709 12:10:15.723259 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1585) took 1069 ms. Trace:
I20260709 12:10:15.712153 23859 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.715974 23791 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:15.570278 23817 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:15.717473 23838 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.730818 23870 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:15.577672 23831 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:15.732322 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45134.9us
I20260709 12:10:15.713937 23824 raft_consensus.cc:2764] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:10:15.718058 23867 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:15.768538 23831 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.733218 23827 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:15.769038 23867 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.770423 23827 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:15.734009 22117 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.770607 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 116) took 1462 ms. Trace:
I20260709 12:10:15.771279 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:44372 (request call id 1380) took 1893 ms. Trace:
I20260709 12:10:15.734373 22236 leader_election.cc:400] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
I20260709 12:10:15.771659 23867 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.771996 22236 leader_election.cc:403] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:15.772279 23791 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:15.773743 23791 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.778124 23827 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:15.779315 23827 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.780797 23827 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.782534 23718 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:15.785112 23817 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.735486 23830 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.771790 22117 rpcz_store.cc:276] 0709 12:10:13.877867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.571203 (+1693336us) service_pool.cc:224] Handling call
0709 12:10:15.771175 (+199972us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":183}
I20260709 12:10:15.787384 23826 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.789003 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 120) took 1447 ms. Trace:
I20260709 12:10:15.752861 23851 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:15.789474 22117 rpcz_store.cc:276] 0709 12:10:14.341913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.787362 (+1445449us) service_pool.cc:224] Handling call
0709 12:10:15.787778 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.787986 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.788014 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.788060 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.788092 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.788149 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.788938 (+   789us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.771438 22114 rpcz_store.cc:276] 0709 12:10:14.308652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.729698 (+1421046us) service_pool.cc:224] Handling call
0709 12:10:15.763026 (+ 33328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.770142 (+  7116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.770190 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.770261 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.770301 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.770363 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.770520 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.735555 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1389) took 1416 ms. Trace:
I20260709 12:10:15.736133 23861 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.723477 22263 raft_consensus.cc:2410] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:15.665082 22235 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45844 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1424)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1418)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1598)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1600)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1421)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1590)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1569)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1570)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1571)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1572)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1574)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1575)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1579)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1420)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 141)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1423)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1426)
I20260709 12:10:15.673542 23798 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.566982 23807 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:15.682430 23806 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.740237 22857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 399) took 1162 ms. Trace:
I20260709 12:10:15.742141 23849 raft_consensus.cc:993] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: : Instructing follower 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:10:15.569916 23582 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.744745 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.745414 23815 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.745608 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:15.748762 23865 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.749199 23822 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.750308 23790 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.714704 23663 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.751371 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1577) took 1170 ms. Trace:
I20260709 12:10:15.560114 23860 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.681787 23872 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.753522 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1388) took 1439 ms. Trace:
I20260709 12:10:15.737825 22267 rpcz_store.cc:276] 0709 12:10:14.653498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.577296 (+923798us) service_pool.cc:224] Handling call
0709 12:10:15.723204 (+145908us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:15.751816 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 179219us
I20260709 12:10:15.711799 23740 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:10:15.764504 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:15.764619 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1381) took 1778 ms. Trace:
I20260709 12:10:15.762200 23870 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:15.577986 23856 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:15.766345 22271 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:15.733017 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:15.797326 22120 rpcz_store.cc:276] 0709 12:10:14.319732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.734274 (+1414542us) service_pool.cc:224] Handling call
0709 12:10:15.734550 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.735323 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.735502 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.896657 22861 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:15.435036 22115 rpcz_store.cc:276] 0709 12:10:11.065241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.067305 (+  2064us) service_pool.cc:224] Handling call
0709 12:10:11.163655 (+ 96350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.031225 (+867570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.035687 (+  4462us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.183218 (+147531us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b2c00058398. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:10:12.183751 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.651213 (+1467462us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:13.785515 (+134302us) log.cc:844] Serialized 14 byte log entry
0709 12:10:14.634824 (+849309us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5400048920. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd3d733 00007fcceddc2dbf 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c
0709 12:10:14.641790 (+  6966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.704910 (+ 63120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.711143 (+  6233us) raft_consensus.cc:1685] finished
0709 12:10:14.728611 (+ 17468us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.796611 (+ 68000us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33156,"prepare.queue_time_us":106804,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":267285,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":4067,"spinlock_wait_cycles":87424000,"thread_start_us":2228880,"threads_started":2,"wal-append.queue_time_us":903781,"wal-append.run_cpu_time_us":26536,"wal-append.run_wall_time_us":2134332}
I20260709 12:10:15.832962 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1573) took 1202 ms. Trace:
W20260709 12:10:15.833529 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50442.6us
W20260709 12:10:15.824838 23787 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.233s	user 0.015s	sys 0.000s
I20260709 12:10:15.823658 23867 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.849200 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 103691us
I20260709 12:10:15.890671 22116 rpcz_store.cc:276] 0709 12:10:14.314127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.726809 (+1412682us) service_pool.cc:224] Handling call
0709 12:10:15.753209 (+ 26400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.753329 (+   120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.753345 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.753374 (+    29us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.753391 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.753421 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.753485 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.890443 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:15.856025 22193 rpcz_store.cc:276] 0709 12:10:14.580730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.086878 (+506148us) service_pool.cc:224] Handling call
0709 12:10:15.240950 (+154072us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.330993 (+ 90043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.331022 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.345942 (+ 14920us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.562011 (+216069us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:15.562054 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.562115 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.751171 (+189056us) raft_consensus.cc:1685] finished
0709 12:10:15.751188 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.751317 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131639,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":55401,"thread_start_us":276327,"threads_started":2,"wal-append.queue_time_us":389505}
W20260709 12:10:15.892367 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 127984us
W20260709 12:10:15.893487 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43775.8us
I20260709 12:10:15.895852 23798 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.894359 23870 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.852129 23826 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.904978 22860 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:15.842669 23807 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:15.907505 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1407) took 1280 ms. Trace:
I20260709 12:10:15.908279 23783 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.890158 23872 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:15.902261 22263 rpcz_store.cc:276] 0709 12:10:14.630627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.392573 (+761946us) service_pool.cc:224] Handling call
0709 12:10:15.832878 (+440305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.890550 22119 rpcz_store.cc:276] 0709 12:10:13.986454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.664280 (+1677826us) service_pool.cc:224] Handling call
0709 12:10:15.725412 (+ 61132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.753053 (+ 27641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.754428 (+  1375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.761422 (+  6994us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:15.764299 (+  2877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.764392 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.764542 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:15.913503 23796 consensus_meta.cc:287] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.003s
I20260709 12:10:15.890468 23865 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:15.856287 23863 raft_consensus.cc:1081] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Signalling peer 164596fc2efa450581a5b68cad62271f to start an election
I20260709 12:10:15.824091 23823 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.921159 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:15.897248 23824 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
I20260709 12:10:15.931565 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:15.903141 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:15.917644 23787 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:15.908294 23856 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.856001 23815 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:15.835443 22857 rpcz_store.cc:276] 0709 12:10:14.578115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.584471 (+  6356us) service_pool.cc:224] Handling call
0709 12:10:15.739987 (+1155516us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54006cb454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:15.740134 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260993408}
I20260709 12:10:15.951856 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:15.928004 23798 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:15.950659 23872 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.001076 23796 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:15.932384 23860 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:15.938937 23880 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.098328 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.514808 22268 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
W20260709 12:10:16.515460 22268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1596) took 1262 ms (client timeout 1661 ms). Trace:
W20260709 12:10:16.515862 22268 rpcz_store.cc:269] 0709 12:10:15.253575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.097940 (+844365us) service_pool.cc:224] Handling call
0709 12:10:16.515375 (+417435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.517001 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.517714 22268 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:16.518208 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1600) took 1263 ms. Trace:
I20260709 12:10:16.518574 22268 rpcz_store.cc:276] 0709 12:10:15.254797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.516633 (+1261836us) service_pool.cc:224] Handling call
0709 12:10:16.518155 (+  1522us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.519569 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.520439 22018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 251) took 7219 ms. Trace:
I20260709 12:10:16.024068 23783 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:16.030376 23807 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:16.054639 23836 consensus_meta.cc:287] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 12:10:16.526429 23836 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:16.529047 23836 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:16.062422 23582 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:16.531275 23582 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:15.932713 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:15.938122 23790 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:16.015558 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 94517.2us
W20260709 12:10:16.080478 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 148987us
I20260709 12:10:16.664927 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:16.665763 22122 raft_consensus.cc:2368] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5.
I20260709 12:10:16.012033 22191 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:16.013032 22195 raft_consensus.cc:2368] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3.
I20260709 12:10:16.669951 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:16.670090 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:16.670967 22122 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:16.671078 22115 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 1.
I20260709 12:10:16.078450 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:16.759526 22272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1594) took 1635 ms (client timeout 1784 ms). Trace:
W20260709 12:10:16.759984 22272 rpcz_store.cc:269] 0709 12:10:15.124763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.956186 (+831423us) service_pool.cc:224] Handling call
0709 12:10:16.759447 (+803261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.940346 22271 rpcz_store.cc:276] 0709 12:10:14.618971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.627971 (+  9000us) service_pool.cc:224] Handling call
0709 12:10:15.899710 (+1271739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.794893 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:16.795753 22271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1603) took 1512 ms (client timeout 1959 ms). Trace:
W20260709 12:10:16.796123 22271 rpcz_store.cc:269] 0709 12:10:15.283219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.794597 (+1511378us) service_pool.cc:224] Handling call
0709 12:10:16.795697 (+  1100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.011221 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:16.157613 23882 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:10:16.413503 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 496128us
I20260709 12:10:16.520452 22268 raft_consensus.cc:2410] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:16.798549 22263 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
W20260709 12:10:16.799131 22268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1601) took 1544 ms (client timeout 1905 ms). Trace:
I20260709 12:10:16.525130 22264 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:16.799734 23783 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:16.799165 22263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1599) took 1544 ms (client timeout 1787 ms). Trace:
I20260709 12:10:16.549137 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:16.800873 22263 rpcz_store.cc:269] 0709 12:10:15.254473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.966943 (+712470us) service_pool.cc:224] Handling call
0709 12:10:16.799104 (+832161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.801110 22265 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
W20260709 12:10:16.801887 22265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1418) took 1977 ms (client timeout 2153 ms). Trace:
W20260709 12:10:16.557768 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.802223 22265 rpcz_store.cc:269] 0709 12:10:14.824384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.548690 (+1724306us) service_pool.cc:224] Handling call
0709 12:10:16.801829 (+253139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.649833 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.803289 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:16.803604 22270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1422) took 1532 ms (client timeout 1822 ms). Trace:
I20260709 12:10:16.582185 22123 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:16.803972 23582 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:16.656654 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.804442 23582 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:16.804955 22269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1416) took 2073 ms (client timeout 2150 ms). Trace:
W20260709 12:10:16.805323 22269 rpcz_store.cc:269] 0709 12:10:14.731555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.656273 (+1924718us) service_pool.cc:224] Handling call
0709 12:10:16.804895 (+148622us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:16.805848 22123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 114) took 2534 ms (client timeout 2237 ms). Trace:
W20260709 12:10:16.806310 22123 rpcz_store.cc:269] 0709 12:10:14.271621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.595448 (+323827us) service_pool.cc:224] Handling call
0709 12:10:16.805642 (+2210194us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54002adad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:16.805787 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4566730112}
I20260709 12:10:16.807780 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:16.808319 22123 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
I20260709 12:10:16.803225 22020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 135) took 7340 ms. Trace:
W20260709 12:10:16.658236 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 725618us
I20260709 12:10:16.808836 22020 rpcz_store.cc:276] 0709 12:10:09.462638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.462829 (+   191us) service_pool.cc:224] Handling call
0709 12:10:16.803153 (+7340324us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":5}
I20260709 12:10:16.805408 23582 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:16.810899 23582 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.813056 22118 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.815500 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1359) took 4557 ms. Trace:
I20260709 12:10:16.815851 22118 rpcz_store.cc:276] 0709 12:10:12.257763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.264515 (+3006752us) service_pool.cc:224] Handling call
0709 12:10:16.812872 (+1548357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.813460 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.815301 (+  1841us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54002adad0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:16.815440 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3558566784}
I20260709 12:10:16.071990 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1591) took 1417 ms. Trace:
I20260709 12:10:16.817898 22192 rpcz_store.cc:276] 0709 12:10:14.654990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.257260 (+602270us) service_pool.cc:224] Handling call
0709 12:10:15.257653 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.494329 (+236676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.494374 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.566478 (+ 72104us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.885069 (+318591us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.885125 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.885232 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.071638 (+186406us) raft_consensus.cc:1685] finished
0709 12:10:16.071669 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.071907 (+   238us) inbound_call.cc:177] Queueing success response
0709 12:10:16.444727 (+372820us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b48000ce358. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf2cebaa1 00007fccf2ce2b37 00007fccf2ce29ca 00007fccf2dda26f 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508 00007fccf2dee488 00007fccf2dee443 00007fccf2ded6ec 00007fccf1d17a96
Metrics: {"raft.queue_time_us":139629,"raft.run_cpu_time_us":16611,"raft.run_wall_time_us":1047229,"spinlock_wait_cycles":3207552,"thread_start_us":397260,"threads_started":2,"wal-append.queue_time_us":238358}
I20260709 12:10:16.819859 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:16.671648 22195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1583) took 2089 ms (client timeout 2132 ms). Trace:
W20260709 12:10:16.820976 22195 rpcz_store.cc:269] 0709 12:10:14.582236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.641621 (+ 59385us) service_pool.cc:224] Handling call
0709 12:10:16.671421 (+2029800us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54001beed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:16.671584 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680390912}
I20260709 12:10:16.673334 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:16.679373 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:16.822124 22114 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:16.823024 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:16.824246 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:16.672300 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:16.824816 22120 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.825517 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:16.826152 22116 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.673879 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:16.151803 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:16.828751 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:16.829380 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:16.829975 22865 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.829905 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:16.830741 22117 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.676997 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:16.833153 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 156247us
I20260709 12:10:16.823108 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:16.834085 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:16.834700 22114 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:16.834933 23859 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.835318 23859 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:16.835433 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:16.835691 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:16.836400 22114 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.114131 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:16.840943 23791 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.841387 23791 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:16.841990 23791 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.841336 22861 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
W20260709 12:10:16.844436 22162 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:55836 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:16.658303 23790 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:16.107558 23860 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.836350 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:16.850688 23854 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:16.458309 23857 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.022s	user 0.007s	sys 0.000s
W20260709 12:10:16.647622 22860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 360) took 1273 ms (client timeout 1662 ms). Trace:
I20260709 12:10:16.154759 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:16.111863 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:16.858925 22864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 364) took 1367 ms (client timeout 1627 ms). Trace:
W20260709 12:10:16.859297 22864 rpcz_store.cc:269] 0709 12:10:15.492067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.111414 (+619347us) service_pool.cc:224] Handling call
0709 12:10:16.858863 (+747449us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:16.856190 22860 rpcz_store.cc:269] 0709 12:10:15.374508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.377481 (+  2973us) service_pool.cc:224] Handling call
0709 12:10:16.647326 (+1269845us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54006702d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:16.647519 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009915136}
I20260709 12:10:16.859648 22114 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:16.128091 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:16.115818 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:16.127123 23787 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:16.162405 23796 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:16.099349 23798 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.094075 23806 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.586432 23823 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:16.010147 23718 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:16.175657 23815 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:15.941286 23826 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:16.136500 23861 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:16.112222 23865 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:15.925650 23867 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:16.658844 23868 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.182128 23872 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:16.128858 23880 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:16.181599 23870 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:16.673115 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:16.668457 22830 connection.cc:256] RPC call timeout handler was delayed by -2.6432159429998592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2237s for a response
I20260709 12:10:16.844763 22162 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:55836 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1600)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1598)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1611)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1408)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1415)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1416)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1420)
I20260709 12:10:16.804065 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 144) took 1560 ms. Trace:
I20260709 12:10:16.868443 22117 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:16.877630 22120 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:16.907255 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:16.908283 22116 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:16.888981 22863 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.699883 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:16.715111 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:16.716674 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.717444 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.718721 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.720752 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.721796 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.890280 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.916610 22197 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:16.722003 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.917145 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1430) took 1063 ms. Trace:
I20260709 12:10:16.917503 22196 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:16.917476 22269 rpcz_store.cc:276] 0709 12:10:15.853730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.889972 (+1036242us) service_pool.cc:224] Handling call
0709 12:10:16.917094 (+ 27122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.727880 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.918443 22190 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 1.
W20260709 12:10:16.893829 22830 connection.cc:256] RPC call timeout handler was delayed by -2.19365767599993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 12:10:16.919306 22830 connection.cc:256] RPC call timeout handler was delayed by -2.0019576759998472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 12:10:16.919629 22830 connection.cc:256] RPC call timeout handler was delayed by -1.9254576759999509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 12:10:16.919941 22830 connection.cc:256] RPC call timeout handler was delayed by -1.8858576759998869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 12:10:16.761415 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:16.921782 22272 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.159267 22831 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:16.765872 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:16.781900 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.939625 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.942567 22267 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:10:16.943058 22269 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:16.525702 22018 rpcz_store.cc:276] 0709 12:10:09.300703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.327451 (+ 26748us) service_pool.cc:224] Handling call
0709 12:10:16.520329 (+7192878us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:12.231862 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:12.239489 (+  7627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:12.239536 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:10:12.239560 (+    24us) tablet.cc:662] Decoding operations
0709 12:10:12.240168 (+   608us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:12.240248 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:12.240282 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:12.240582 (+   300us) tablet.cc:701] Row locks acquired
0709 12:10:12.240597 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:10:12.240823 (+   226us) write_op.cc:270] Start()
0709 12:10:12.240977 (+   154us) write_op.cc:276] Timestamp: P: 1783599012240731 usec, L: 0
0709 12:10:12.240998 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:10:12.245643 (+  4645us) log.cc:844] Serialized 994 byte log entry
0709 12:10:14.734023 (+2488380us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:15.562260 (+828237us) op_driver.cc:464] REPLICATION: finished
0709 12:10:15.900162 (+337902us) write_op.cc:301] APPLY: starting
0709 12:10:15.900271 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:15.900417 (+   146us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:15.900449 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:15.904735 (+  4286us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:15.904933 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:15.904984 (+    51us) write_op.cc:312] APPLY: finished
0709 12:10:15.905216 (+   232us) log.cc:844] Serialized 29 byte log entry
0709 12:10:15.905446 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:15.905532 (+    86us) write_op.cc:454] Released schema lock
0709 12:10:15.905579 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:15.905939 (+   360us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:15.905967 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":640164,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":337629,"apply.run_cpu_time_us":2431,"apply.run_wall_time_us":5761,"num_ops":2,"prepare.queue_time_us":717104,"prepare.run_cpu_time_us":31762,"prepare.run_wall_time_us":1529452,"raft.queue_time_us":183154,"raft.run_cpu_time_us":89101,"raft.run_wall_time_us":286215,"replication_time_us":3321098,"spinlock_wait_cycles":59228928,"thread_start_us":2301511,"threads_started":4,"wal-append.queue_time_us":831658}]]}
I20260709 12:10:16.669194 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:16.804111 22270 rpcz_store.cc:269] 0709 12:10:15.270901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.096439 (+825538us) service_pool.cc:224] Handling call
0709 12:10:16.803536 (+707097us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.914583 22121 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:16.151322 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:16.835729 23859 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.152508 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:16.962410 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.837416 23582 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.963174 22197 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:16.963362 22194 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 1.
I20260709 12:10:16.964005 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.965214 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.966360 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.967388 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.968410 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:16.853132 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.888350 23880 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:16.969651 22195 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:16.970888 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:16.799539 22268 rpcz_store.cc:269] 0709 12:10:15.255095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.519271 (+1264176us) service_pool.cc:224] Handling call
0709 12:10:16.799064 (+279793us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.973153 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:16.974112 22268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 143) took 1731 ms (client timeout 2181 ms). Trace:
W20260709 12:10:16.974617 22268 rpcz_store.cc:269] 0709 12:10:15.242938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.972849 (+1729911us) service_pool.cc:224] Handling call
0709 12:10:16.974047 (+  1198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.854782 22019 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 2 to 3, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:16.974393 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.976966 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:16.976861 22019 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:16.964598 22197 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
W20260709 12:10:16.905946 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.899641 23827 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:16.986424 23827 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:16.891098 22122 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 1.
I20260709 12:10:16.904058 22265 rpcz_store.cc:276] 0709 12:10:15.243246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.803034 (+1559788us) service_pool.cc:224] Handling call
0709 12:10:16.804010 (+   976us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.989552 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.990172 22265 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
W20260709 12:10:16.990597 22265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1425) took 1699 ms (client timeout 2157 ms). Trace:
I20260709 12:10:16.990782 22830 leader_election.cc:400] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5.
W20260709 12:10:16.990968 22265 rpcz_store.cc:269] 0709 12:10:15.291181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.989309 (+1698128us) service_pool.cc:224] Handling call
0709 12:10:16.990547 (+  1238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.877573 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:16.992432 22830 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:16.754683 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1589) took 2145 ms. Trace:
I20260709 12:10:16.993515 23807 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.993897 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:16.914870 22198 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:16.994552 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:16.868621 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:16.995178 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.914583 22193 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 1.
I20260709 12:10:16.902531 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.995776 23582 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.889417 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:16.899663 22162 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:55838 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1600)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1598)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1611)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1408)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1412)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1415)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1416)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1420)
I20260709 12:10:16.913586 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:16.996277 23582 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:16.997146 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 83611.4us
I20260709 12:10:16.998188 22088 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:16.998562 23582 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:16.998971 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:16.913149 22865 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
W20260709 12:10:16.800078 22264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1592) took 1892 ms (client timeout 2132 ms). Trace:
W20260709 12:10:17.000293 22264 rpcz_store.cc:269] 0709 12:10:14.933491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.893185 (+959694us) service_pool.cc:224] Handling call
0709 12:10:16.800001 (+906816us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.884169 23868 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.001077 23868 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.001327 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.002014 22264 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:16.944422 22269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1604) took 1502 ms (client timeout 1972 ms). Trace:
W20260709 12:10:17.003109 22269 rpcz_store.cc:269] 0709 12:10:15.441783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.939298 (+1497515us) service_pool.cc:224] Handling call
0709 12:10:16.944365 (+  5067us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:16.945183 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 785966us
I20260709 12:10:17.003803 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:17.004487 22118 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:16.884969 22006 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f1b154b48c54be6b421b01ed436bf21 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7d3f536360b444b1886777f4776be22c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:16.870185 23806 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:10:17.012200 22006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 127519us
I20260709 12:10:16.802222 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.013329 23806 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:17.013993 22263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 146) took 1759 ms (client timeout 1992 ms). Trace:
I20260709 12:10:16.886937 23872 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:16.871575 23718 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:16.868305 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:16.948638 22266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1424) took 1662 ms (client timeout 1648 ms). Trace:
I20260709 12:10:16.891499 23798 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:17.016908 22266 rpcz_store.cc:269] 0709 12:10:15.285980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.765538 (+1479558us) service_pool.cc:224] Handling call
0709 12:10:16.948565 (+183027us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.018004 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.018749 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1607) took 1101 ms. Trace:
I20260709 12:10:17.019052 22266 rpcz_store.cc:276] 0709 12:10:15.917642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.017736 (+1100094us) service_pool.cc:224] Handling call
0709 12:10:17.018688 (+   952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.860743 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:16.868997 23790 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:16.911933 23823 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.899515 23863 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:16.875733 23861 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:16.952070 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.027786 22270 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
W20260709 12:10:17.028352 22270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1606) took 1569 ms (client timeout 1957 ms). Trace:
W20260709 12:10:17.028687 22270 rpcz_store.cc:269] 0709 12:10:15.458670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.944196 (+1485526us) service_pool.cc:224] Handling call
0709 12:10:17.028292 (+ 84096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.890762 23870 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:16.893741 23860 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:17.036036 23863 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:17.037460 23860 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:16.926630 23788 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.038355 23788 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:17.038779 23788 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.039922 22864 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.948006 23830 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.042404 23830 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:17.042968 23830 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:17.043620 22271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 145) took 1792 ms (client timeout 2124 ms). Trace:
I20260709 12:10:16.959757 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:17.044322 22271 rpcz_store.cc:269] 0709 12:10:15.251628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.867844 (+1616216us) service_pool.cc:224] Handling call
0709 12:10:17.043521 (+175677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.044852 22190 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:10:17.045893 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.046191 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.874097 23826 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:17.014554 22263 rpcz_store.cc:269] 0709 12:10:15.254606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.801906 (+1547300us) service_pool.cc:224] Handling call
0709 12:10:17.013925 (+212019us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.048007 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.961330 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:16.984926 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.049170 22196 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:10:16.985448 22272 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:17.049921 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:17.050236 22272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1428) took 1687 ms (client timeout 1858 ms). Trace:
W20260709 12:10:17.050568 22272 rpcz_store.cc:269] 0709 12:10:15.363108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.761107 (+1397999us) service_pool.cc:224] Handling call
0709 12:10:17.050174 (+289067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.050956 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:17.051443 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.051610 23798 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:17.051980 22272 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:16.994024 23807 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:17.020087 23718 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.052670 23807 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.995323 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:17.053929 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 58674us
I20260709 12:10:17.016566 23582 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:16.943207 22267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1602) took 1665 ms (client timeout 1955 ms). Trace:
I20260709 12:10:16.996246 22192 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:17.077705 23582 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:17.078214 23582 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.078744 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:17.079430 22192 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.872411 23815 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.080854 23815 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:17.082186 22120 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:17.077745 22267 rpcz_store.cc:269] 0709 12:10:15.277844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.781654 (+1503810us) service_pool.cc:224] Handling call
0709 12:10:16.943144 (+161490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.993639 22191 rpcz_store.cc:276] 0709 12:10:14.609698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.256164 (+646466us) service_pool.cc:224] Handling call
0709 12:10:15.256478 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.676361 (+1419883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.754374 (+ 78013us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54000fc3d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:16.754615 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1736719744}
I20260709 12:10:16.874177 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:16.861234 23837 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:10:16.996294 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.049775 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.008284 23856 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.004997 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:17.009634 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.009855 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:17.010908 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.911746 23865 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.019127 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:17.091686 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 81888.6us
I20260709 12:10:17.092080 22197 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:16.883436 23867 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:17.022882 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:17.103509 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 183643us
I20260709 12:10:17.103796 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.105070 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.105885 22191 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:17.023802 22118 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:17.025378 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.014948 23796 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.029381 23790 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.035300 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.115425 22270 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.029577 23823 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:17.046731 22271 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:17.049616 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:16.916033 22189 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:17.140465 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.016453 23854 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:16.999853 23827 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:17.061506 23872 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.067056 23824 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:17.021234 23783 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:10:17.088116 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.151808 23863 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:17.152556 23783 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.152979 23783 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:17.152930 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.153450 23823 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:17.154176 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.007460 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:17.088303 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.155469 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1590) took 2417 ms. Trace:
I20260709 12:10:17.155810 22269 rpcz_store.cc:276] 0709 12:10:14.737876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.014871 (+2276995us) service_pool.cc:224] Handling call
0709 12:10:17.155402 (+140531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.092572 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:17.092907 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.093420 22265 raft_consensus.cc:2368] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4.
I20260709 12:10:17.094247 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:17.094965 22268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1608) took 1177 ms (client timeout 1522 ms). Trace:
I20260709 12:10:17.115060 23790 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:17.156754 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.160357 22269 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.160506 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.161178 22271 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.161504 23788 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:17.129065 22192 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:17.106858 23798 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:17.137398 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 132471us
I20260709 12:10:17.132830 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:17.233098 22197 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.135597 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.159222 23861 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.113758 23860 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.113286 23867 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.150763 22198 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 2: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:17.154007 23783 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:17.159893 23790 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.121956 22196 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:17.117909 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.106686 23865 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:17.246495 22194 raft_consensus.cc:2393] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:17.247529 23865 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:17.149780 23854 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:17.248485 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.249557 23854 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:17.162746 23872 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:17.250242 23872 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.251708 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.150238 22263 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:17.253696 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.242079 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.194216 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:17.158869 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.259989 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:17.260095 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 66035.9us
W20260709 12:10:17.158077 22265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1605) took 1700 ms (client timeout 2032 ms). Trace:
W20260709 12:10:17.157401 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 64914.1us
I20260709 12:10:17.261459 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:17.262441 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 157070us
I20260709 12:10:17.262539 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:17.165031 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 157646us
I20260709 12:10:17.260958 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:17.256199 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.264971 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:17.159022 22268 rpcz_store.cc:269] 0709 12:10:15.917936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.010516 (+1092580us) service_pool.cc:224] Handling call
0709 12:10:17.094895 (+ 84379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.267259 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.267875 22268 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 1.
I20260709 12:10:17.268896 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.157667 22272 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.209731 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:17.133294 23815 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:17.218343 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 161682us
I20260709 12:10:17.223593 22269 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:17.275278 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.276036 22269 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.235351 22831 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:17.134122 23791 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:17.237195 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.239073 22123 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.239197 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.239948 23900 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:17.249686 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.252619 22198 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 2: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:17.287405 22087 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:55838 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:17.297243 22194 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:17.297736 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.265592 22196 raft_consensus.cc:2376] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2. Re-sending same reply.
I20260709 12:10:17.278520 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:17.298141 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:17.260692 22265 rpcz_store.cc:269] 0709 12:10:15.457998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.991960 (+1533962us) service_pool.cc:224] Handling call
0709 12:10:17.158001 (+166041us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:17.299299 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 300365us
I20260709 12:10:17.299984 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.300724 22265 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:17.279698 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44455.2us
I20260709 12:10:17.301318 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.301679 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:17.284098 22197 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:17.159600 23824 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:17.287076 22192 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:17.285548 22270 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:17.238214 23867 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:17.236006 23861 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:17.235491 23798 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:17.318890 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:17.319224 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:17.320017 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:17.295182 22272 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:17.299062 22830 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:17.314677 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.302153 22268 raft_consensus.cc:2376] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4. Re-sending same reply.
I20260709 12:10:17.321347 22267 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.317521 22266 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:17.322069 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.235954 23860 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:17.276845 23823 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:17.337301 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.322955 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:17.295923 23880 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.325670 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.345544 22865 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:17.346565 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.310880 23870 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.305979 22163 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:17.321806 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.313182 23856 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.350391 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.325151 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.330557 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.351927 22861 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:17.332237 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.319868 23861 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.333066 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.354530 22270 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 1.
I20260709 12:10:17.336099 23909 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.339591 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:17.339998 23783 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.342644 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:17.369867 22196 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:17.329166 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.299190 23865 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:17.267645 23854 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.318076 23867 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.352435 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.355343 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.383208 22270 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:17.383855 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:17.384229 22270 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.315481 23900 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:17.389776 22270 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:17.360738 22267 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:17.364081 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.328795 23863 raft_consensus.cc:2764] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:17.338104 23817 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.337033 23860 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.365661 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:10:17.437192 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 71617.5us
I20260709 12:10:17.437412 23806 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.437906 23806 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:17.438285 23806 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.376726 22831 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:17.349251 23870 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.377496 23859 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:17.377923 23798 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:17.348402 23901 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.362643 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.438161 22830 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:17.459740 23903 raft_consensus.cc:2955] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:10:17.569514 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 305863us
I20260709 12:10:17.370798 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:17.589550 22192 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.434863 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.436436 23817 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:17.595891 23817 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.533285 23860 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:17.572103 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:17.573269 23865 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:17.446885 23895 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.229s	user 0.005s	sys 0.000s
I20260709 12:10:17.349640 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.389930 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.435323 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.356460 22269 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
W20260709 12:10:17.656946 23917 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
I20260709 12:10:17.417558 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.381814 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:17.363217 23815 raft_consensus.cc:2764] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:10:17.323762 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.568471 22189 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:17.358011 22864 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:17.373088 23880 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.455369 23901 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:17.353987 23856 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:17.444506 23870 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.363164 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.518321 23791 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:17.427493 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:17.364892 23909 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:17.440075 23912 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:10:17.533113 23914 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:17.448840 23913 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.528662 23872 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:17.526978 23868 consensus_meta.cc:287] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.009s
I20260709 12:10:17.445003 23823 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:17.535626 23916 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.527870 23830 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:17.572629 22087 leader_election.cc:336] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.558s (SENT)
W20260709 12:10:17.585740 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 208851us
W20260709 12:10:17.366297 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45154.7us
I20260709 12:10:17.530234 23806 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:17.607440 23865 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:17.612222 23837 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:17.613171 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.612128 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.630501 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:17.612077 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.640332 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:17.643808 23860 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:17.620319 23790 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:17.990280 23718 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.861s	user 0.015s	sys 0.015s
W20260709 12:10:18.037992 23582 consensus_meta.cc:287] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.831s	user 0.013s	sys 0.016s
I20260709 12:10:18.047912 22858 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:18.047665 23582 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.048661 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1407) took 1220 ms. Trace:
W20260709 12:10:17.827116 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 205264us
I20260709 12:10:18.049608 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 416) took 1176 ms. Trace:
I20260709 12:10:18.049696 22190 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:18.049387 22193 rpcz_store.cc:276] 0709 12:10:16.827838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.153945 (+326107us) service_pool.cc:224] Handling call
0709 12:10:18.048184 (+894239us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54001beed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.048410 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046086016}
I20260709 12:10:18.050384 22858 rpcz_store.cc:276] 0709 12:10:16.872967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.873935 (+   968us) service_pool.cc:224] Handling call
0709 12:10:18.049326 (+1175391us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400840b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.049511 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199437056}
I20260709 12:10:18.051519 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1392) took 1227 ms. Trace:
I20260709 12:10:18.051667 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:18.051889 23790 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:18.043316 23854 consensus_meta.cc:287] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.664s	user 0.001s	sys 0.021s
I20260709 12:10:17.622073 23859 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:18.051987 22190 rpcz_store.cc:276] 0709 12:10:16.824105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.045869 (+221764us) service_pool.cc:224] Handling call
0709 12:10:18.051283 (+1005414us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000fb4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.051451 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304777984}
I20260709 12:10:18.052713 22193 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:17.769393 22192 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:18.048905 23919 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:17.680907 22266 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.061007 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1624) took 1056 ms. Trace:
I20260709 12:10:18.061640 22193 rpcz_store.cc:276] 0709 12:10:16.999170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.051284 (+1052114us) service_pool.cc:224] Handling call
0709 12:10:18.055511 (+  4227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.663640 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1574) took 3032 ms. Trace:
W20260709 12:10:17.936920 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 627277us
W20260709 12:10:17.692591 22293 debug-util.cc:398] Leaking SignalData structure 0x7b08001df5a0 after lost signal to thread 20894
I20260709 12:10:18.062978 22269 rpcz_store.cc:276] 0709 12:10:14.630956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.658002 (+3027046us) service_pool.cc:224] Handling call
0709 12:10:17.659053 (+  1051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.662712 (+  3659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:17.662759 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:17.662875 (+   116us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:17.662960 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.663072 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.663316 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.061463 23718 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:18.068137 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1571) took 3438 ms. Trace:
I20260709 12:10:18.068596 22266 rpcz_store.cc:276] 0709 12:10:14.630147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.647486 (+3017339us) service_pool.cc:224] Handling call
0709 12:10:17.648294 (+   808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.066105 (+417811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.068057 (+  1952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.070401 23718 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:18.070878 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1575) took 3439 ms. Trace:
I20260709 12:10:18.071869 22195 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 2: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:18.073424 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1399) took 1247 ms. Trace:
I20260709 12:10:18.073733 22861 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:18.073920 22195 rpcz_store.cc:276] 0709 12:10:16.825869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.259734 (+433865us) service_pool.cc:224] Handling call
0709 12:10:18.073129 (+813395us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54001090d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.073352 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864306432}
I20260709 12:10:18.076808 22859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:56938
W20260709 12:10:18.078133 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 380575us
I20260709 12:10:18.079473 22857 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:18.079830 23900 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:18.081307 22268 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.081939 23582 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:18.082052 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1579) took 3449 ms. Trace:
I20260709 12:10:18.082679 23854 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:17.934249 20896 debug-util.cc:398] Leaking SignalData structure 0x7b080000f380 after lost signal to thread 22831
I20260709 12:10:17.689594 22263 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.085851 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1611) took 1242 ms. Trace:
I20260709 12:10:18.071468 22266 rpcz_store.cc:276] 0709 12:10:14.631228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.069647 (+3438419us) service_pool.cc:224] Handling call
0709 12:10:18.070139 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.070497 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.070525 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.070586 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:18.070621 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.070706 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.070811 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.082432 22268 rpcz_store.cc:276] 0709 12:10:14.632549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.080028 (+3447479us) service_pool.cc:224] Handling call
0709 12:10:18.080759 (+   731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.081794 (+  1035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.081999 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:18.086732 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 514459us
I20260709 12:10:18.088419 22192 rpcz_store.cc:276] 0709 12:10:16.843257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.353381 (+510124us) service_pool.cc:224] Handling call
0709 12:10:18.062797 (+709416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.088030 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1623) took 1068 ms. Trace:
I20260709 12:10:18.070716 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:17.657392 23788 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:17.934031 23824 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:18.091071 22196 rpcz_store.cc:276] 0709 12:10:16.998919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.629938 (+631019us) service_pool.cc:224] Handling call
0709 12:10:18.066909 (+436971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.097941 23830 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:18.100059 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 142) took 2857 ms. Trace:
W20260709 12:10:18.101011 23807 consensus_meta.cc:287] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 1.024s	user 0.016s	sys 0.005s
I20260709 12:10:18.101897 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1584) took 3448 ms. Trace:
I20260709 12:10:18.101624 23807 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.102690 23806 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:18.103053 22293 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9ae0 after lost signal to thread 22055
I20260709 12:10:18.102365 22269 rpcz_store.cc:276] 0709 12:10:14.653153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.100694 (+3447541us) service_pool.cc:224] Handling call
0709 12:10:18.101189 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.101549 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.101579 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.101649 (+    70us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:18.101706 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.101756 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.101846 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.100481 22270 rpcz_store.cc:276] 0709 12:10:15.242692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.098691 (+2855999us) service_pool.cc:224] Handling call
0709 12:10:18.099269 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.099587 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.099617 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.099692 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:18.099733 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.099793 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.099907 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.106415 22861 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.047992 23868 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:17.688644 23817 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.097941 23880 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:18.111819 23837 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:18.135120 22293 debug-util.cc:398] Leaking SignalData structure 0x7b0800148d20 after lost signal to thread 22147
I20260709 12:10:18.109370 23901 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.125068 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1400) took 1298 ms. Trace:
I20260709 12:10:18.126618 23823 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:18.127744 22271 consensus_meta.cc:287] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.819s	user 0.006s	sys 0.018s
I20260709 12:10:18.129317 22114 raft_consensus.cc:2393] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:18.129173 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:18.129756 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:18.131502 23912 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:18.140223 23837 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:18.132939 23856 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.133381 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:18.134292 22264 consensus_meta.cc:287] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.132s	user 0.015s	sys 0.004s
W20260709 12:10:18.134944 22265 consensus_meta.cc:287] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.822s	user 0.004s	sys 0.016s
I20260709 12:10:18.121291 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:18.137002 23880 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.137409 23868 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:18.120632 23824 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:18.189179 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 46608.4us
I20260709 12:10:18.171953 22271 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:18.190250 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1440) took 1278 ms. Trace:
I20260709 12:10:18.190725 22271 rpcz_store.cc:276] 0709 12:10:16.911442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.160245 (+248803us) service_pool.cc:224] Handling call
0709 12:10:18.190173 (+1029928us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:18.150547 23903 consensus_meta.cc:287] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.565s	user 0.014s	sys 0.003s
I20260709 12:10:18.156102 22192 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:18.095361 23909 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.156983 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:18.125161 23913 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:18.156994 23807 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:18.181407 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48375.7us
I20260709 12:10:18.161221 23916 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:18.161942 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:18.162204 22293 debug-util.cc:398] Leaking SignalData structure 0x7b08001db540 after lost signal to thread 22148
I20260709 12:10:18.163316 22863 raft_consensus.cc:2393] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 2: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:18.165226 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1420) took 3035 ms. Trace:
I20260709 12:10:18.202275 22266 rpcz_store.cc:276] 0709 12:10:15.130385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.164060 (+3033675us) service_pool.cc:224] Handling call
0709 12:10:18.164506 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.164867 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.164894 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.164955 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:18.164983 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.165035 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.165172 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.145196 22197 rpcz_store.cc:276] 0709 12:10:16.826113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.338539 (+512426us) service_pool.cc:224] Handling call
0709 12:10:18.123299 (+784760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.189705 23824 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:18.149210 23783 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.775s	user 0.013s	sys 0.009s
I20260709 12:10:18.209364 22190 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:18.167199 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 141) took 2924 ms. Trace:
I20260709 12:10:18.210093 22268 rpcz_store.cc:276] 0709 12:10:15.242411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.166080 (+2923669us) service_pool.cc:224] Handling call
0709 12:10:18.166545 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.166890 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.166917 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.166958 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:18.166984 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.167039 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.167145 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.170848 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:18.175163 22196 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.205399 23837 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:18.207008 23913 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:18.207775 22270 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.181695 23788 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.196290 22267 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.197518 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1410) took 1368 ms. Trace:
W20260709 12:10:18.182933 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53894.4us
I20260709 12:10:18.198746 22191 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:18.183023 22865 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.182608 22265 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
W20260709 12:10:18.183220 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 744960us
I20260709 12:10:18.230672 22861 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:18.262015 22192 rpcz_store.cc:276] 0709 12:10:16.828558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.107805 (+1279247us) service_pool.cc:224] Handling call
0709 12:10:18.155594 (+ 47789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.197246 (+ 41652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.197429 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.226392 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1411) took 1397 ms. Trace:
I20260709 12:10:18.188548 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1570) took 3558 ms. Trace:
I20260709 12:10:18.264564 22263 rpcz_store.cc:276] 0709 12:10:14.629883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.643069 (+3013186us) service_pool.cc:224] Handling call
0709 12:10:17.671802 (+ 28733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.092991 (+421189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.188380 (+ 95389us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b540026d4d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.188481 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36488960}
I20260709 12:10:18.182060 23914 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:18.265758 23788 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:18.182827 23582 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:18.266242 23788 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:18.173053 23867 consensus_meta.cc:287] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.753s	user 0.020s	sys 0.004s
I20260709 12:10:18.267248 23867 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:18.267822 22192 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:18.268744 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1413) took 1439 ms. Trace:
I20260709 12:10:18.269433 23914 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:18.187929 23912 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.270757 23912 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:18.271654 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 70180.2us
I20260709 12:10:18.272343 23867 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:18.198236 23880 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.273241 23582 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:18.192762 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1423) took 2910 ms. Trace:
I20260709 12:10:18.275218 23880 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:18.275645 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1625) took 1276 ms. Trace:
I20260709 12:10:18.187803 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 131) took 1502 ms. Trace:
I20260709 12:10:18.276093 22190 rpcz_store.cc:276] 0709 12:10:16.999407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.089940 (+1090533us) service_pool.cc:224] Handling call
0709 12:10:18.275460 (+185520us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b54001423d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.275583 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79783168}
I20260709 12:10:18.276258 22114 rpcz_store.cc:276] 0709 12:10:16.695740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.860438 (+164698us) service_pool.cc:224] Handling call
0709 12:10:18.187558 (+1327120us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002c1ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.187692 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534270336}
I20260709 12:10:18.176899 23863 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.278236 23863 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:18.279421 23863 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.281006 22193 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:18.195514 23870 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.281677 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1626) took 1282 ms. Trace:
I20260709 12:10:18.282069 22193 rpcz_store.cc:276] 0709 12:10:16.999690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.161575 (+1161885us) service_pool.cc:224] Handling call
0709 12:10:18.281581 (+120006us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.275260 22271 rpcz_store.cc:276] 0709 12:10:15.282588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.191738 (+2909150us) service_pool.cc:224] Handling call
0709 12:10:18.192123 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.192454 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.192487 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.192527 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:18.192561 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.192614 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.192712 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.283274 23870 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:18.196310 23901 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.285459 22858 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.285929 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1426) took 2950 ms. Trace:
I20260709 12:10:18.286351 22271 rpcz_store.cc:276] 0709 12:10:15.336096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.284668 (+2948572us) service_pool.cc:224] Handling call
0709 12:10:18.285174 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.285523 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.285559 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.285633 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:18.285671 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.285729 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.285871 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.289809 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1572) took 3659 ms. Trace:
I20260709 12:10:18.290211 22267 rpcz_store.cc:276] 0709 12:10:14.630374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.647658 (+3017284us) service_pool.cc:224] Handling call
0709 12:10:18.196010 (+548352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.288849 (+ 92839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.289577 (+   728us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54000eb350. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.289718 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352214272}
I20260709 12:10:18.208079 23856 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.291663 23909 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:18.294523 22269 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.264243 22196 rpcz_store.cc:276] 0709 12:10:16.828896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.108267 (+1279371us) service_pool.cc:224] Handling call
0709 12:10:18.174590 (+ 66323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.225938 (+ 51348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.226298 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.273309 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:18.269147 22192 rpcz_store.cc:276] 0709 12:10:16.829410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.266977 (+1437567us) service_pool.cc:224] Handling call
0709 12:10:18.267442 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:18.268214 (+   772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.268564 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.278097 22190 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.283942 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1416) took 1453 ms. Trace:
I20260709 12:10:18.169134 23817 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:18.181061 23861 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.809s	user 0.011s	sys 0.010s
I20260709 12:10:18.298871 22193 rpcz_store.cc:276] 0709 12:10:16.830157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.282853 (+1452696us) service_pool.cc:224] Handling call
0709 12:10:18.283308 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.283581 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.283612 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.283672 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:18.283705 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.283763 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.283887 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.174217 22860 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:18.168077 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1395) took 1343 ms. Trace:
I20260709 12:10:18.174247 22866 raft_consensus.cc:2955] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:10:18.263661 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 166850us
I20260709 12:10:18.295656 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:18.303773 22189 rpcz_store.cc:276] 0709 12:10:16.824883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.140066 (+315183us) service_pool.cc:224] Handling call
0709 12:10:18.167871 (+1027805us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54003b56d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.168023 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979238144}
I20260709 12:10:18.301082 22270 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:18.302861 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1449) took 1151 ms. Trace:
I20260709 12:10:18.210675 23824 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:18.303287 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1415) took 1470 ms. Trace:
I20260709 12:10:18.306664 22265 rpcz_store.cc:276] 0709 12:10:17.151470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.299675 (+148205us) service_pool.cc:224] Handling call
0709 12:10:18.300273 (+1000598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.310068 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1412) took 1480 ms. Trace:
I20260709 12:10:18.260324 22859 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:18.182008 22264 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:18.314347 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:18.246973 23919 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:18.185545 23872 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:18.310726 22197 rpcz_store.cc:276] 0709 12:10:16.829181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.301285 (+1472104us) service_pool.cc:224] Handling call
0709 12:10:18.309228 (+  7943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.309540 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.309578 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.309687 (+   109us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:18.309737 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.309816 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.309967 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:18.310220 22293 debug-util.cc:398] Leaking SignalData structure 0x7b0800141e80 after lost signal to thread 22222
I20260709 12:10:18.311069 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:18.314208 22195 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:18.310204 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1433) took 2455 ms. Trace:
I20260709 12:10:18.321413 22265 rpcz_store.cc:276] 0709 12:10:15.854590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.309101 (+2454511us) service_pool.cc:224] Handling call
0709 12:10:18.309528 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.309860 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.309887 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.309932 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:18.309964 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.310021 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.310134 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.260818 23916 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:18.316087 22264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1421) took 3060 ms (client timeout 2448 ms). Trace:
I20260709 12:10:18.341665 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1431) took 2487 ms. Trace:
I20260709 12:10:18.311573 23861 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:18.311204 22191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1599) took 1478 ms (client timeout 1954 ms). Trace:
W20260709 12:10:18.342763 22191 rpcz_store.cc:269] 0709 12:10:16.832454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.106512 (+274058us) service_pool.cc:224] Handling call
0709 12:10:18.310953 (+1204441us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400177d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.311130 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865406336}
I20260709 12:10:18.343757 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1409) took 1515 ms. Trace:
I20260709 12:10:18.344159 22198 rpcz_store.cc:276] 0709 12:10:16.828326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.297496 (+469170us) service_pool.cc:224] Handling call
0709 12:10:18.343328 (+1045832us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540011b554. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.343554 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338448128}
I20260709 12:10:18.345474 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56158 (request call id 77) took 1275 ms. Trace:
I20260709 12:10:18.345877 22191 rpcz_store.cc:276] 0709 12:10:17.070436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.343770 (+1273334us) service_pool.cc:224] Handling call
0709 12:10:18.345362 (+  1592us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.346084 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1618) took 1348 ms. Trace:
I20260709 12:10:18.346216 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1419) took 1515 ms. Trace:
I20260709 12:10:18.346946 22193 rpcz_store.cc:276] 0709 12:10:16.830922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.307793 (+1476871us) service_pool.cc:224] Handling call
0709 12:10:18.345515 (+ 37722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.345791 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.345827 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.345883 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:18.345925 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.345995 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.346123 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.323974 23783 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:18.315167 22859 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.324831 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1595) took 3071 ms. Trace:
I20260709 12:10:18.330145 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1569) took 3700 ms. Trace:
W20260709 12:10:18.336512 22293 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6860 after lost signal to thread 22296
I20260709 12:10:18.339756 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:10:18.362550 22293 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6880 after lost signal to thread 22297
I20260709 12:10:18.325251 22864 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.319589 23863 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.341557 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1432) took 2487 ms. Trace:
W20260709 12:10:18.347833 22006 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f1b154b48c54be6b421b01ed436bf21 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7d3f536360b444b1886777f4776be22c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:10:18.342175 22264 rpcz_store.cc:269] 0709 12:10:15.255607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.001072 (+1745465us) service_pool.cc:224] Handling call
0709 12:10:18.315935 (+1314863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.346519 22194 rpcz_store.cc:276] 0709 12:10:16.997607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.297890 (+300283us) service_pool.cc:224] Handling call
0709 12:10:18.345758 (+1047868us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000fbed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.345909 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338068224}
I20260709 12:10:18.349957 22863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 373) took 1023 ms. Trace:
I20260709 12:10:18.351099 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1408) took 1523 ms. Trace:
I20260709 12:10:18.363245 22268 rpcz_store.cc:276] 0709 12:10:15.854314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.303039 (+2448725us) service_pool.cc:224] Handling call
0709 12:10:18.340816 (+ 37777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.341087 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.341128 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.341184 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:18.341227 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.341301 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.341459 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.364835 22195 rpcz_store.cc:276] 0709 12:10:16.828078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.183412 (+1355334us) service_pool.cc:224] Handling call
0709 12:10:18.311728 (+128316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:18.329381 (+ 17653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.350846 (+ 21465us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400177d50. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.351020 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294003584}
I20260709 12:10:18.352010 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1434) took 1500 ms. Trace:
I20260709 12:10:18.351828 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:18.353366 22189 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.355336 23922 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:18.371855 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47148.8us
I20260709 12:10:18.372129 23922 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:18.372520 23922 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:18.372952 23903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:57876 (request call id 73) took 6963 ms. Trace:
I20260709 12:10:18.373448 23922 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:18.374079 23861 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:18.313716 22190 rpcz_store.cc:276] 0709 12:10:16.829918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.277346 (+1447428us) service_pool.cc:224] Handling call
0709 12:10:18.277784 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.299596 (+ 21812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.299867 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.381841 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1420) took 1550 ms. Trace:
I20260709 12:10:18.300628 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:18.341854 23909 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:18.368988 23783 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:18.374781 22196 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.361758 22269 rpcz_store.cc:276] 0709 12:10:15.253151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.183817 (+2930666us) service_pool.cc:224] Handling call
0709 12:10:18.263468 (+ 79651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.300634 (+ 37166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.324553 (+ 23919us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b54001509d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.324707 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181977984}
I20260709 12:10:18.300724 23901 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:18.366181 22863 rpcz_store.cc:276] 0709 12:10:17.326427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.328935 (+  2508us) service_pool.cc:224] Handling call
0709 12:10:18.325574 (+996639us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b54006702d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.349808 (+ 24234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1821894400}
I20260709 12:10:18.390214 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1429) took 2534 ms. Trace:
I20260709 12:10:18.390424 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:18.390724 22267 rpcz_store.cc:276] 0709 12:10:15.853364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.291164 (+2437800us) service_pool.cc:224] Handling call
0709 12:10:18.297164 (+  6000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.383778 (+ 86614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.383812 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.386935 (+  3123us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:18.386977 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.387044 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.387182 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.391453 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:18.366324 22266 rpcz_store.cc:276] 0709 12:10:16.851765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.331032 (+1479267us) service_pool.cc:224] Handling call
0709 12:10:18.351314 (+ 20282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.351672 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.351699 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.351739 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:18.351789 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.351840 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.351939 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.303256 23912 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:18.374588 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:18.382736 22189 rpcz_store.cc:276] 0709 12:10:16.831168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.305978 (+1474810us) service_pool.cc:224] Handling call
0709 12:10:18.353092 (+ 47114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.367160 (+ 14068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.381775 (+ 14615us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.342406 22271 rpcz_store.cc:276] 0709 12:10:15.854030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.307123 (+2453093us) service_pool.cc:224] Handling call
0709 12:10:18.341090 (+ 33967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.341316 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.341349 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.341400 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:18.341430 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.341485 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.341602 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.375905 23870 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.394562 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1418) took 1564 ms. Trace:
I20260709 12:10:18.395529 22192 rpcz_store.cc:276] 0709 12:10:16.830616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.301316 (+1470700us) service_pool.cc:224] Handling call
0709 12:10:18.375426 (+ 74110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.394229 (+ 18803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.394270 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.394314 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:18.394340 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.394401 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.394504 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.362424 22272 rpcz_store.cc:276] 0709 12:10:14.629543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.596985 (+2967442us) service_pool.cc:224] Handling call
0709 12:10:17.597837 (+   852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.598356 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:17.831295 (+232939us) log.cc:844] Serialized 14 byte log entry
0709 12:10:18.329583 (+498288us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.329652 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:18.329705 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.329789 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.329940 (+   151us) inbound_call.cc:177] Queueing success response
0709 12:10:18.354766 (+ 24826us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
Metrics: {"mutex_wait_us":13986,"prepare.queue_time_us":448271,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":30012,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":146,"spinlock_wait_cycles":4728576,"thread_start_us":552666,"threads_started":2,"wal-append.queue_time_us":457644}
I20260709 12:10:18.392688 23867 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.402251 23867 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:18.402750 23867 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.403661 22267 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.404516 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1435) took 1552 ms. Trace:
I20260709 12:10:18.404945 22267 rpcz_store.cc:276] 0709 12:10:16.852103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.397685 (+1545582us) service_pool.cc:224] Handling call
0709 12:10:18.403337 (+  5652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.404177 (+   840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.404428 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.405385 23783 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:18.406840 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 154) took 1078 ms. Trace:
I20260709 12:10:18.408141 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:18.408536 23919 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.411823 23856 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:18.413225 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:18.413921 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1444) took 1465 ms. Trace:
I20260709 12:10:18.414242 22266 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:18.412441 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 69722.6us
I20260709 12:10:18.415242 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:18.416630 22197 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.393107 23880 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.416886 22267 rpcz_store.cc:276] 0709 12:10:17.328955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.405790 (+1076835us) service_pool.cc:224] Handling call
0709 12:10:18.406161 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.406469 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.406499 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.406538 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:18.406569 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.406646 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.406774 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.433888 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1441) took 1513 ms. Trace:
I20260709 12:10:18.435386 22266 rpcz_store.cc:276] 0709 12:10:16.920958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.392557 (+1471599us) service_pool.cc:224] Handling call
0709 12:10:18.413840 (+ 21283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.433089 (+ 19249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.433823 (+   734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.434675 22269 rpcz_store.cc:276] 0709 12:10:16.948856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.412690 (+1463834us) service_pool.cc:224] Handling call
0709 12:10:18.413227 (+   537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.413541 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.413566 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.413622 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:18.413651 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.413727 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.413831 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920}
I20260709 12:10:18.437806 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 227) took 1382 ms. Trace:
I20260709 12:10:18.397421 23817 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:18.448694 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 76026.3us
I20260709 12:10:18.438308 22197 rpcz_store.cc:276] 0709 12:10:17.055596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.375092 (+1319496us) service_pool.cc:224] Handling call
0709 12:10:18.416444 (+ 41352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.437559 (+ 21115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.437750 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.441989 23922 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.442521 22270 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:18.443835 23824 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:18.445595 23935 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:18.446344 23912 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:18.447306 23928 consensus_queue.cc:1059] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:18.447981 23909 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:18.440033 23788 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:18.449517 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53687.2us
I20260709 12:10:18.400254 23823 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.458102 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1417) took 1627 ms. Trace:
I20260709 12:10:18.373353 23903 rpcz_store.cc:276] 0709 12:10:11.400381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.400542 (+   161us) service_pool.cc:224] Handling call
0709 12:10:11.409027 (+  8485us) log.cc:844] Serialized 508 byte log entry
0709 12:10:12.318633 (+909606us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b180026aca0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceac4fc0a 00007fccf438f219 00007fcceacd7a40 00007fcceacd24e4 00007fcceacd2455 00007fccedd1bb0b 00007fccedda0b63 00007fcceddc8752 00007fcceddc09fa
0709 12:10:18.356923 (+6038290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":280876,"raft.queue_time_us":390359,"raft.run_cpu_time_us":1570,"raft.run_wall_time_us":90018,"spinlock_wait_cycles":3577600,"thread_start_us":522427,"threads_started":1,"wal-append.queue_time_us":626117,"wal-append.run_cpu_time_us":2536,"wal-append.run_wall_time_us":1104610}
I20260709 12:10:18.459342 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1448) took 1308 ms. Trace:
I20260709 12:10:18.461514 22196 rpcz_store.cc:276] 0709 12:10:16.830370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.297642 (+1467272us) service_pool.cc:224] Handling call
0709 12:10:18.348992 (+ 51350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.388885 (+ 39893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.455543 (+ 66658us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b54002369d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:18.458041 (+  2498us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58813312}
I20260709 12:10:18.462512 22123 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.463335 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:18.466527 22272 rpcz_store.cc:276] 0709 12:10:17.151186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.416121 (+1264935us) service_pool.cc:224] Handling call
0709 12:10:18.458707 (+ 42586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.458974 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.459001 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.459062 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:18.459116 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.459176 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.459285 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.463838 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:18.468317 22116 raft_consensus.cc:2410] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:18.468474 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55481.9us
I20260709 12:10:18.468854 22859 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.470494 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:18.464988 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:18.493049 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:18.465509 23824 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:18.471042 22857 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 3. Ops: []
I20260709 12:10:18.466176 23823 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:18.471884 22197 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:18.472285 23935 raft_consensus.cc:3055] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:18.464743 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:18.476339 23928 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:18.477043 22293 debug-util.cc:398] Leaking SignalData structure 0x7b08003721c0 after lost signal to thread 22890
I20260709 12:10:18.481845 23913 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:18.434069 23870 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:18.482863 23880 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:18.460376 23817 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.456987 23909 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:18.485992 23927 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:18.486466 23788 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:18.486819 23868 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:18.487596 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:18.489503 22192 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:18.490000 22007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1baa23cb6635453b9a9cd5ec7e452f6a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:18.490448 22189 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.491048 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:18.498117 22195 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4.
I20260709 12:10:18.470606 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:18.504470 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1443) took 1574 ms. Trace:
I20260709 12:10:18.508404 22193 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.497586 23824 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:18.508728 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:18.518078 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:18.517407 22123 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:18.517180 23870 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:18.514732 22271 rpcz_store.cc:276] 0709 12:10:16.929763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.394529 (+1464766us) service_pool.cc:224] Handling call
0709 12:10:18.413227 (+ 18698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:18.413541 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.413566 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:18.414107 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 12:10:18.439290 (+ 25183us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:18.439331 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.439401 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:18.504240 (+ 64839us) raft_consensus.cc:1685] finished
0709 12:10:18.504260 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.504397 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22400,"thread_start_us":24725,"threads_started":1,"wal-append.queue_time_us":21500}
I20260709 12:10:18.497941 23823 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.519906 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:18.570209 22196 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.571610 23880 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.572331 23817 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:18.519321 22861 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.498353 23913 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:18.511303 23909 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.497756 23935 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:18.497991 23928 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:10:18.575392 22007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 85586.4us
I20260709 12:10:18.572346 22190 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.512907 23856 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.512667 22114 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 1.
W20260709 12:10:18.597457 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 110046us
W20260709 12:10:18.601361 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 130952us
I20260709 12:10:18.584303 23872 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.605240 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:18.607617 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:18.608702 23582 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:18.606194 22017 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 2 to 3, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:18.613188 23815 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.613675 23815 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:18.614068 23815 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.615036 23935 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.616436 23935 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.618983 22190 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:18.630882 23582 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:18.631946 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:18.632689 22271 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:18.633051 22271 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:18.634034 22271 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.635159 22271 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:10:18.637192 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 166696us
I20260709 12:10:18.638041 22163 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:18.638782 22857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 361) took 1306 ms. Trace:
I20260709 12:10:18.639302 22857 rpcz_store.cc:276] 0709 12:10:17.332497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.080395 (+747898us) service_pool.cc:224] Handling call
0709 12:10:18.349505 (+269110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.499643 (+150138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.637582 (+137939us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54006702d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:18.638522 (+   940us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54006702d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:18.638711 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896490112}
I20260709 12:10:18.639837 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:18.632146 23913 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.641597 23909 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:18.651165 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43667.4us
I20260709 12:10:18.656872 23718 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:18.657274 22189 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.628564 23817 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:18.673301 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:18.621304 23824 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.709427 22863 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.724472 22118 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.725185 22194 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.605046 23916 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.719514 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:18.732151 23854 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:18.732419 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 70696.4us
I20260709 12:10:18.733417 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:18.718312 23817 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:18.734992 23817 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:18.737515 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 74280.2us
I20260709 12:10:18.741487 22190 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:18.749017 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 109635us
I20260709 12:10:18.665144 23788 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.752240 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:18.754391 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 155839us
I20260709 12:10:18.754551 23582 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:18.774501 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:18.741442 23919 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.802596 22197 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:18.776633 23901 consensus_queue.cc:1059] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:18.751858 23718 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.823328 23783 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.752857 23867 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.801972 23927 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:10:18.801458 23863 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 12:10:18.877357 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44607.4us
I20260709 12:10:18.842392 23854 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:18.888780 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:18.891867 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 113601us
I20260709 12:10:18.839605 23807 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:10:18.895323 22197 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 2: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:18.895989 22193 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:18.912498 22271 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
W20260709 12:10:18.915329 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 113876us
I20260709 12:10:18.919986 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:18.920643 22197 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.877754 23928 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:18.921865 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:18.861327 23827 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.242s
I20260709 12:10:18.879102 23783 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:18.932925 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:18.953030 22830 leader_election.cc:400] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4.
I20260709 12:10:18.954753 22830 leader_election.cc:403] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:10:18.956228 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.956461 23928 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.936409 23909 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:18.962116 23868 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.962598 23868 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:18.963024 23868 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.919548 23824 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:18.972247 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 48736.5us
I20260709 12:10:18.937395 23927 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:18.984537 23940 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:10:18.988128 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:18.995265 22830 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:18.995345 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:18.996542 22193 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 2: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:18.983067 23927 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:18.985829 23856 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:18.994113 23916 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:19.009370 22196 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:19.013504 23718 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:19.014250 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.025368 23854 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.033160 23783 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:19.034013 23922 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.012s
I20260709 12:10:19.037916 23718 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:19.023764 23817 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.014729 23867 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:19.015270 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:19.019035 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:19.046629 22197 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:19.046682 22189 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:19.047444 23916 consensus_queue.cc:1059] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:19.056378 23790 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:19.059619 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:19.067786 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.074903 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.079325 22859 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:19.083496 23872 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:19.089991 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 575504us
W20260709 12:10:19.156718 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 131907us
W20260709 12:10:19.096601 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.100523 23880 raft_consensus.cc:3055] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:19.095681 23913 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:19.157702 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.162817 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.163929 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:19.165108 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:19.166072 22267 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:19.166581 22189 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:19.160310 22866 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:19.045776 23856 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.171277 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.172441 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:19.173092 22197 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:19.017663 23955 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.179083 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:19.180516 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.181540 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.178423 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:19.171828 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 156683us
I20260709 12:10:19.185428 22196 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:19.160010 23823 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.004s
I20260709 12:10:19.197242 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:19.199347 22019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 233) took 8676 ms. Trace:
I20260709 12:10:19.179780 22271 raft_consensus.cc:2376] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4. Re-sending same reply.
I20260709 12:10:19.150916 23790 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:19.201543 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.202687 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.203470 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.206483 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:19.204449 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:19.203306 22194 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
W20260709 12:10:19.197803 22236 leader_election.cc:336] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.554s (SENT)
I20260709 12:10:19.142059 23863 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:10:19.212464 22196 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 3. Ops: []
I20260709 12:10:19.145618 23868 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.214167 22270 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:19.202462 23815 consensus_meta.cc:287] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.008s
I20260709 12:10:19.217249 22195 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:19.177937 22189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:19.221271 22197 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:19.234581 22267 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:19.180598 23807 raft_consensus.cc:2764] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:10:19.212977 22198 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4.
I20260709 12:10:19.215622 23790 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.225581 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.225293 22017 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 2 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:10:19.226809 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 231617us
I20260709 12:10:19.227803 22088 leader_election.cc:400] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4.
I20260709 12:10:19.282375 22088 leader_election.cc:403] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:19.162422 23880 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:19.282094 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:19.284700 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.284886 22189 raft_consensus.cc:606] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
I20260709 12:10:19.286733 22189 raft_consensus.cc:614] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:19.209247 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:19.177706 22859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:56938 (request call id 360) took 1835 ms. Trace:
I20260709 12:10:19.235569 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.194666 23867 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:19.279554 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 93600.8us
I20260709 12:10:19.131206 23865 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.307475 23865 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.309836 23865 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:19.293612 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:19.317050 23901 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:19.317629 23901 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:19.317989 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:19.318526 23901 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.293234 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.321933 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.322669 22196 raft_consensus.cc:2393] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:19.323339 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.324350 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.228060 23927 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.326508 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:19.293956 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.290344 22859 rpcz_store.cc:276] 0709 12:10:17.332195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.076557 (+744362us) service_pool.cc:224] Handling call
0709 12:10:18.473821 (+397264us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54006702d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddb9a3d 00007fccf2d89cd0 00007fccec30e254 00007fccec30e1e2 00007fccec30e111 00007fccec30e08c 00007fccec30d342 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:19.079138 (+605317us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b4c0020be80. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec08ea20 00007fccec09fa29 00007fccec0a013f 00007fccec0642ab 00007fccec091f3c 00007fccec0923fe 00007fccec31f88b 00007fccedd1e495 00007fccedd6f30f 00007fcceddb9a55 00007fccf2d89cd0
0709 12:10:19.161281 (+ 82143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550192768}
I20260709 12:10:19.329703 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.330874 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.294608 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.333259 22194 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:19.236477 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:19.302783 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.303339 23867 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:19.304499 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:19.302819 23817 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:19.208205 23823 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.291348 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.277765 23815 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.289775 23958 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:19.315376 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.318938 22830 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:10:19.352247 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 154117us
I20260709 12:10:19.353063 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:19.300853 23960 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.301498 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.199817 22019 rpcz_store.cc:276] 0709 12:10:10.522598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.522802 (+   204us) service_pool.cc:224] Handling call
0709 12:10:19.199053 (+8676251us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:17.254453 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:17.296061 (+ 41608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:17.306756 (+ 10695us) write_op.cc:435] Acquired schema lock
0709 12:10:17.316352 (+  9596us) tablet.cc:662] Decoding operations
0709 12:10:17.380953 (+ 64601us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:17.414295 (+ 33342us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:17.418382 (+  4087us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:17.442106 (+ 23724us) tablet.cc:701] Row locks acquired
0709 12:10:17.446061 (+  3955us) write_op.cc:260] PREPARE: finished
0709 12:10:17.459880 (+ 13819us) write_op.cc:270] Start()
0709 12:10:17.460008 (+   128us) write_op.cc:276] Timestamp: P: 1783599017459812 usec, L: 0
0709 12:10:17.460031 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:10:17.487346 (+ 27315us) log.cc:844] Serialized 930 byte log entry
0709 12:10:18.180495 (+693149us) op_driver.cc:464] REPLICATION: finished
0709 12:10:18.414629 (+234134us) write_op.cc:301] APPLY: starting
0709 12:10:18.414776 (+   147us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:18.414992 (+   216us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:18.455324 (+ 40332us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:18.468267 (+ 12943us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:18.468579 (+   312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:18.468641 (+    62us) write_op.cc:312] APPLY: finished
0709 12:10:18.469021 (+   380us) log.cc:844] Serialized 29 byte log entry
0709 12:10:18.469295 (+   274us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:18.469484 (+   189us) write_op.cc:454] Released schema lock
0709 12:10:18.469548 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:18.470031 (+   483us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:18.470072 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":931278,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":233705,"apply.run_cpu_time_us":3767,"apply.run_wall_time_us":55420,"num_ops":2,"prepare.queue_time_us":233626,"prepare.run_cpu_time_us":10131,"prepare.run_wall_time_us":280735,"raft.queue_time_us":521073,"raft.run_cpu_time_us":44920,"raft.run_wall_time_us":184351,"replication_time_us":720210,"thread_start_us":864565,"threads_started":4,"wal-append.queue_time_us":48439}]]}
I20260709 12:10:19.335770 22196 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 2: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:19.356233 22191 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:19.339699 23807 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.362051 22190 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:19.339860 23867 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:19.367280 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:19.341297 22017 catalog_manager.cc:5697] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 2 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:19.351635 23817 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:19.353907 23958 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:10:19.358767 22006 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f1b154b48c54be6b421b01ed436bf21 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7d3f536360b444b1886777f4776be22c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:10:19.408187 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 210390us
W20260709 12:10:19.414762 22236 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.591s (SENT)
I20260709 12:10:19.359364 23928 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.369518 23909 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:19.419149 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 52115.2us
I20260709 12:10:19.410162 23868 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:19.412909 23863 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.361689 23788 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4.
W20260709 12:10:19.424605 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 120192us
I20260709 12:10:19.404034 22017 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:10:19.417690 22006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58973us
I20260709 12:10:19.408252 23790 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:19.365913 23903 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.423568 23914 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.320606 23880 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.370225 23960 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.425052 23964 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:19.453505 22163 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:19.426586 23817 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:10:19.482195 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.485077 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:19.460952 23954 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:19.416402 23856 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.426004 23963 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:19.470046 22236 leader_election.cc:336] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.701s (SENT)
W20260709 12:10:19.488373 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 132996us
I20260709 12:10:19.423915 23928 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.427624 23807 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:10:19.498325 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:19.454929 23863 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.491917 23815 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:19.492832 23788 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:19.494392 23964 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:19.493973 23954 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:19.510349 22189 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:19.496950 23963 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:19.513521 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 89612.3us
I20260709 12:10:19.515256 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:19.514612 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:19.523334 22863 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:19.501271 23914 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.504688 23823 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:19.505909 23868 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:19.549256 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:19.528331 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:19.538744 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:19.542255 22264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:10:19.549881 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:19.550732 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 80710.2us
I20260709 12:10:19.542786 23967 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:19.515028 23966 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.545261 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:19.514058 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:19.532819 23919 consensus_meta.cc:287] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.004s
I20260709 12:10:19.554476 23967 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:19.537655 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:19.528172 23963 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:19.576068 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.600019 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.600224 22189 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:19.584482 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:10:19.568420 23935 consensus_meta.cc:287] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.938s	user 0.011s	sys 0.015s
I20260709 12:10:19.613441 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:19.528757 23788 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.560122 23868 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:19.614089 22859 raft_consensus.cc:2393] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 2: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:10:19.614322 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 75676.1us
I20260709 12:10:19.614789 22118 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:19.565667 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:19.565029 23909 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:19.615872 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:19.616154 23954 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.618919 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:19.620163 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:19.620553 22122 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:19.623196 22864 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:19.669067 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 119985us
I20260709 12:10:19.620209 22120 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:19.569044 23919 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.625167 23827 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:19.671511 23827 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:19.672745 23827 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.674156 23827 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.676986 22866 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:19.626144 22115 raft_consensus.cc:1240] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:19.626333 23927 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.618899 22116 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:19.627979 23957 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:19.629812 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:19.630693 23969 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 12:10:19.630903 23955 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4.
I20260709 12:10:19.631286 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:19.631755 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 117432us
I20260709 12:10:19.632091 23963 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.632746 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:19.634222 23788 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:19.636616 23964 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.640026 22189 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:19.645390 23967 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.653988 23815 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:19.557045 23958 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.655572 22191 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:19.656380 23960 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:19.657814 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:19.617645 22865 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:19.693229 22190 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:19.685096 22264 raft_consensus.cc:606] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
W20260709 12:10:19.694535 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 70402.3us
W20260709 12:10:19.699328 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.699640 23788 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:19.703534 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:19.705973 22123 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:19.690912 23922 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.711511 23880 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.711833 23966 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:19.687649 23916 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:10:19.706832 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:19.708585 23913 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:19.714629 23955 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.708983 23863 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:19.715090 23955 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.709426 23824 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:19.715505 23955 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.710229 23935 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.715752 23868 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.718421 22236 leader_election.cc:400] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4.
I20260709 12:10:19.718778 22236 leader_election.cc:403] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:19.720293 23958 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.724869 22123 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:19.720391 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:19.733671 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1fb787db87147b3be49bef974365af1"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:19.734359 22190 raft_consensus.cc:606] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:19.735390 23963 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:19.735456 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 45341.2us
I20260709 12:10:19.736040 22264 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:19.736582 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:19.737603 23967 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.737649 23582 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.739705 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:19.742789 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 67618.7us
W20260709 12:10:19.743569 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.611740 23817 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:19.749465 22162 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:19.751055 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:19.753106 22123 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:19.692473 23947 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:10:19.754355 22123 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:19.764437 22163 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:19.765038 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:19.780552 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.752267 23815 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:19.704592 23960 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:10:19.750849 23582 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:10:19.753648 23856 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:19.776450 23922 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:19.727313 23903 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:10:19.784952 23870 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.771847 23928 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:19.791769 23827 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:19.810987 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 90662us
W20260709 12:10:19.809065 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 74398.8us
I20260709 12:10:19.787827 23815 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:19.802764 23922 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.771595 23865 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:10:19.802579 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:19.806588 23914 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.801836 23913 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.798013 23807 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:10:19.815198 23827 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:19.823693 23914 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:19.837990 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 104105us
I20260709 12:10:19.811890 22123 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.881774 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:19.825956 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:10:19.882736 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.828190 23978 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:10:19.888482 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 62638.6us
I20260709 12:10:19.837312 23986 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.832976 23718 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.897662 23986 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:19.827625 23867 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.898116 23986 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.884967 23903 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:19.838328 23914 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.834892 23909 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:19.890003 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 136274us
I20260709 12:10:19.862690 23827 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.826524 23975 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:19.837905 23935 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:19.890117 22830 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.553s (SENT) [suppressed 98 similar messages]
I20260709 12:10:19.826736 23980 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.902446 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:19.923825 22193 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.907486 22197 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:19.891893 23868 raft_consensus.cc:2764] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:10:19.921741 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.887506 23865 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:19.923699 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 158730us
W20260709 12:10:19.905715 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 154511us
W20260709 12:10:19.930162 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.931100 23909 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:19.933183 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.933983 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.934777 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.935606 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:19.955514 22236 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.745s (SENT)
I20260709 12:10:19.936385 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.940721 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.942245 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.942981 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.944185 23867 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:19.957854 22120 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 2: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:19.919027 23975 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:19.945739 23935 consensus_queue.cc:1059] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:19.947932 22269 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:19.948390 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.953132 22193 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:19.946992 22861 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:19.955976 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:19.944845 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:19.958680 22122 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:19.963475 23983 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.963903 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.964241 22116 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:19.964144 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.968870 22163 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:19.971840 22121 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:19.972546 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 82485us
I20260709 12:10:19.976002 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.982338 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.983834 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.971495 23827 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:19.986093 22116 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:19.988883 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.987046 23950 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:10:19.987763 23982 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:19.986716 23977 consensus_queue.cc:1059] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
W20260709 12:10:19.991361 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46646.7us
I20260709 12:10:19.955848 23865 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:19.994095 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:19.988304 22115 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:19.972930 23718 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:19.929513 23815 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.003021 22117 raft_consensus.cc:2393] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:19.993464 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:20.012336 22236 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.767s (SENT)
I20260709 12:10:20.013352 22116 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:19.996908 22119 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:20.012810 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:20.016057 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.019047 22121 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:20.019163 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:20.020088 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:20.020191 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 58910us
I20260709 12:10:20.020843 22121 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 2: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:20.021041 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:20.021721 23987 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:20.021944 22121 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:20.022112 23987 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:20.023110 23987 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.024163 23950 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:20.024698 23950 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:20.025077 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.025624 23950 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.026753 23950 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.989905 23867 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.994239 23824 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:20.018638 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.024397 23987 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.016410 23985 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.976430 23955 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.036055 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.028203 22197 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:20.035948 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.041503 22116 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:20.042711 22866 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:20.046226 22121 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:20.049341 22116 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.052124 22116 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.029254 23824 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:20.058579 22117 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:20.058961 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46016.2us
I20260709 12:10:20.016682 23854 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 12:10:20.047736 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 71545.7us
I20260709 12:10:20.036243 23985 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:20.040627 23880 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:20.063412 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 73129.2us
I20260709 12:10:20.040227 23982 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:20.082068 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.093578 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.070340 23985 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:20.095607 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 74667.4us
I20260709 12:10:20.090343 23718 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:20.090278 22263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:10:20.078630 23880 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:20.074781 23935 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:20.127590 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:20.100649 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.122888 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.033174 23975 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.069561 23947 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:20.102661 23854 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:20.128648 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:20.135470 22121 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4.
I20260709 12:10:20.133100 23958 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:20.102624 22115 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.130631 22119 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 2: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:20.127291 22263 raft_consensus.cc:606] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:10:20.155481 22197 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:20.153419 23954 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.177517 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.146759 23718 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 12:10:20.178992 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 85869.9us
I20260709 12:10:20.136102 23903 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.144986 23854 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:20.196069 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:20.177582 23991 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:10:20.200241 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 97115.1us
I20260709 12:10:20.201157 24000 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:20.205348 23913 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:20.206018 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 58230.5us
I20260709 12:10:20.134807 23823 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:10:20.157337 22263 raft_consensus.cc:614] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:20.136566 23935 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.246382 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:20.255661 22236 leader_election.cc:336] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.815s (SENT)
I20260709 12:10:20.256181 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:20.178706 23582 consensus_queue.cc:1059] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
W20260709 12:10:20.257524 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.255944 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.209028 23865 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:20.146720 23824 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.191212 23927 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:10:20.268240 22121 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:20.239846 23987 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.245940 24004 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.282680 22123 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.253947 23880 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.285359 23998 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.286479 23989 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:20.286901 23989 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:20.211179 23903 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.320892 23982 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.280438 23987 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.321504 23982 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.323928 23987 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:20.277087 23913 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.324998 23955 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:20.325146 23913 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.327322 23913 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:20.327800 23913 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.310148 23854 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.288883 22119 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:20.329782 23865 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:20.330143 23865 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:20.330531 23854 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.331012 23865 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.332129 23815 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:20.332321 23865 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.287664 23989 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.288249 24004 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.333518 23989 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:20.273072 23993 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:20.335476 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.328219 23913 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.279202 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.311597 23824 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:20.320928 23988 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.158s	user 0.000s	sys 0.002s
I20260709 12:10:20.345587 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:20.324580 23987 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:20.355444 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.357527 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 148635us
W20260709 12:10:20.357702 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.337970 23947 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:20.334760 23982 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:20.312486 24000 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:20.365829 22193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:20.375219 22193 raft_consensus.cc:606] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:20.367823 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58509.9us
I20260709 12:10:20.374163 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:20.383451 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.380580 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 124929us
I20260709 12:10:20.389127 23913 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:20.360314 23903 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:20.348961 23993 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:20.398314 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.414410 23993 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:20.404558 24004 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:20.420734 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 53060.4us
I20260709 12:10:20.404223 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:20.379717 24011 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:20.424759 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47588.4us
I20260709 12:10:20.422863 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:20.420150 22115 raft_consensus.cc:2410] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:20.392505 23997 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:20.373910 23947 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:20.437496 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.438228 23993 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.439077 24000 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.442342 23947 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:20.425966 23903 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:20.446638 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.443856 23980 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4.
W20260709 12:10:20.447557 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.444622 23996 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.250s	user 0.000s	sys 0.002s
I20260709 12:10:20.457695 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:20.457029 23903 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:20.475668 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.485414 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.486007 23984 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:10:20.456312 23997 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:20.501989 23975 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:20.515770 22861 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.516888 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.517010 24006 raft_consensus.cc:3055] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:20.517578 24006 raft_consensus.cc:740] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:20.517683 22115 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:20.518672 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.518776 24006 consensus_queue.cc:260] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.519887 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.520265 24006 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.520514 22115 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:20.521589 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:20.523725 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.502189 23966 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:20.502658 23997 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.529182 24008 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:20.507128 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.482532 23870 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:20.533946 23870 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:20.486637 22860 consensus_meta.cc:287] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.001s
I20260709 12:10:20.501082 22118 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
W20260709 12:10:20.509449 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 51812us
I20260709 12:10:20.511058 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.511300 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:20.512123 22271 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:20.541848 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:20.512724 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.542732 22861 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:20.513350 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.514997 23998 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.546778 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:20.547430 22121 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:20.526135 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:20.548454 22193 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.488842 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:20.530588 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.531956 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:20.550107 22865 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:20.533450 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:20.528177 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:20.535868 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.529677 24008 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:20.554471 22115 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:20.545765 23968 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:20.565826 22858 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:20.539256 23986 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.637s	user 0.013s	sys 0.000s
I20260709 12:10:20.547446 22862 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:20.522763 23935 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:20.567754 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 79028.5us
I20260709 12:10:20.509220 23977 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:10:20.570288 23903 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:20.572201 24012 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:20.574095 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:20.527987 23966 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:20.574982 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.598461 22864 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:20.598775 22116 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:20.577770 22236 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.920s (SENT)
I20260709 12:10:20.579226 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.577054 22237 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:20.588003 22087 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:20.569229 23790 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.599169 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:20.590338 22193 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
W20260709 12:10:20.587252 23914 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.666s	user 0.013s	sys 0.000s
W20260709 12:10:20.591964 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 52180.3us
I20260709 12:10:20.541229 22860 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
W20260709 12:10:20.600467 22236 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.948s (SENT)
I20260709 12:10:20.608505 22237 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:20.608858 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:20.545949 23870 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.573853 22859 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:20.575835 24008 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.541065 24004 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:10:20.606272 22198 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:20.606820 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:20.606350 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:20.616233 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:20.616438 22237 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:20.597509 22119 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:20.616430 22192 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:20.595227 23863 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:20.622752 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:20.597316 23928 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:20.597640 23998 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.624614 22121 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:20.628270 22189 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:20.629599 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:20.629791 23947 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:20.634083 23947 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:20.634478 23947 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:20.635048 23983 consensus_meta.cc:287] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.008s
I20260709 12:10:20.610790 23903 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:20.595090 23788 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:10:20.637522 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:20.639991 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:20.632911 22197 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:20.640828 22193 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:20.635094 22270 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:20.639230 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.611151 23935 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.590445 23986 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.647053 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:20.627908 23980 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.626250 23815 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:20.626893 23863 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:20.656006 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:20.656905 22194 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 1.
I20260709 12:10:20.630609 23928 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:20.611687 23914 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.641424 23903 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.635614 23913 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.643237 23983 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.690873 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:20.693266 22087 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:20.663431 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:20.729176 22267 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.669348 22198 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:20.696709 22122 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.705557 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:20.733887 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:10:20.687106 23922 consensus_meta.cc:287] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.863s	user 0.015s	sys 0.000s
I20260709 12:10:20.718340 22115 raft_consensus.cc:2393] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:20.663820 24014 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:20.686514 23950 consensus_meta.cc:287] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.659s	user 0.015s	sys 0.000s
I20260709 12:10:20.719801 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.668169 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:20.740293 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47062.3us
I20260709 12:10:20.745857 22192 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 1. Current term is 3. Ops: []
I20260709 12:10:20.739177 23966 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.747538 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:20.655378 23980 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:20.695528 23985 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.006s
I20260709 12:10:20.761128 22270 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:20.642097 23998 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.739897 22236 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:20.808580 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 117079us
W20260709 12:10:20.810350 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 70595.2us
I20260709 12:10:20.692519 23903 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.769320 22118 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:20.719650 23863 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.772951 24002 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.773294 22264 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:20.739487 24004 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:20.755175 23788 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.774477 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.778141 23914 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:20.783596 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.802136 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 139349us
I20260709 12:10:20.740576 23854 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:10:20.828840 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:20.818018 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:20.820134 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.762046 23922 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.823647 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.806955 23980 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.816655 23983 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:20.837527 23863 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:20.837755 23979 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:20.838004 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.838831 23823 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:20.856961 22118 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 2: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:10:20.858032 22236 leader_election.cc:336] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.674s (SENT)
I20260709 12:10:20.858215 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:20.858588 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:20.841756 24019 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:20.842006 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:20.843253 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.832319 22114 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:20.863519 22117 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:20.844588 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.850390 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:20.855046 22267 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:20.815899 23909 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:20.855556 23928 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.860097 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:20.860702 23989 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:20.861464 23823 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:20.860569 23979 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:20.824864 24004 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.825659 23966 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.869993 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.832890 23986 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:20.833724 23788 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:20.851698 23983 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.813639 23985 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.824095 23827 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 12:10:20.925154 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 74823.4us
I20260709 12:10:20.926990 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:20.888623 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.828596 23984 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 12:10:20.890561 24020 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:10:20.923990 23880 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:20.892930 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.887336 23935 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:20.926141 23996 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:20.920516 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.952543 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.866892 23718 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.867512 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:20.947220 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.887830 22115 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
W20260709 12:10:20.962285 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.890723 23968 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:20.916412 24004 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:20.924937 23954 consensus_meta.cc:287] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.730s	user 0.008s	sys 0.005s
I20260709 12:10:20.953528 22195 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.928622 24026 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.955179 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.925101 23983 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.956983 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:20.956357 23854 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.961010 23788 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:20.965103 23718 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:20.994670 23718 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:20.965912 23868 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:20.966866 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:20.969372 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.970516 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.971405 22193 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:10:20.972373 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.997166 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.996184 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:20.973769 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.954886 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:20.982728 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 93808.8us
I20260709 12:10:20.949873 24024 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:10:20.989629 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:20.964031 23880 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:20.955843 23928 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:21.014396 24027 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:20.952723 23914 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:10:21.017001 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:21.018793 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 69848.6us
I20260709 12:10:21.019552 23947 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:21.025139 22236 leader_election.cc:336] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.998s (SENT)
I20260709 12:10:21.039707 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.017030 23718 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.029518 23994 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.029863 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.025138 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.037093 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:20.995417 23868 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:21.039736 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.002437 22857 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:21.041778 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:21.014947 22860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 383) took 1496 ms (client timeout 1696 ms). Trace:
W20260709 12:10:21.046120 23824 consensus_meta.cc:287] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.002s
I20260709 12:10:21.044508 22115 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 2: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:21.050311 22121 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4.
I20260709 12:10:21.002249 23823 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:21.051906 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1401) took 1112 ms. Trace:
I20260709 12:10:21.049504 23922 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:21.052238 23985 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:21.102308 22270 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:21.010798 23935 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:10:21.106077 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:21.043416 23975 consensus_meta.cc:287] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.002s
I20260709 12:10:21.106701 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:21.063298 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.066951 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.048614 23994 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:21.087545 22118 raft_consensus.cc:2410] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:21.082384 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:21.081023 24002 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.050721 23582 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:21.093703 23903 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.087857 23868 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:21.101938 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47519.5us
W20260709 12:10:21.102463 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 77378.2us
I20260709 12:10:21.100267 22122 rpcz_store.cc:276] 0709 12:10:19.939065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.026932 (+ 87867us) service_pool.cc:224] Handling call
0709 12:10:20.027213 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.737225 (+710012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.051677 (+314452us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b540025fb54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:21.051840 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539132672}
I20260709 12:10:20.994120 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:21.050530 23998 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:21.130899 22117 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.052238 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:21.095372 24004 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:21.131191 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:21.137668 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:21.139663 22236 leader_election.cc:336] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.000s (SENT)
I20260709 12:10:21.140861 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:21.129595 23955 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.009s	sys 0.013s
I20260709 12:10:21.145061 22116 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:21.150280 22236 leader_election.cc:336] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.011s (SENT)
I20260709 12:10:21.150725 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.146457 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.153401 22123 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:21.154062 22116 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:21.136596 23984 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:21.161056 22119 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:21.061707 22860 rpcz_store.cc:269] 0709 12:10:19.518205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.521102 (+  2897us) service_pool.cc:224] Handling call
0709 12:10:21.014746 (+1493644us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400591d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:21.014870 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441856256}
W20260709 12:10:21.156823 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 102573us
W20260709 12:10:21.156800 22236 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.012s (SENT)
I20260709 12:10:21.163909 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:21.165084 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.165328 22265 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:21.165645 22236 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.071s (SENT)
I20260709 12:10:21.165918 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.167294 23998 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:21.154637 23914 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:10:21.166088 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:21.143812 23955 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.009s	sys 0.013s
I20260709 12:10:21.171787 23824 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.142720 23975 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:21.175093 23817 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.185189 23817 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.186040 23947 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:21.156275 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.170732 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:21.181488 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.183652 22123 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:21.191085 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.185320 24013 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.169909 23868 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.171245 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.161406 23984 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:21.209259 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:21.209960 23984 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:21.198184 22267 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:21.197717 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:21.156926 23935 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.211673 22865 raft_consensus.cc:2410] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:21.212128 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:21.202536 23817 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:21.203899 22115 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.215291 22115 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.204722 24004 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:21.218617 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:21.211678 22268 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:21.135557 23880 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.203002 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.205370 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:21.204583 22266 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:21.206425 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:21.207398 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:21.229199 22123 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:21.206077 22264 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:21.170046 24024 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.233364 23903 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:21.235119 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.236366 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.237443 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.238397 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.239151 22122 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4.
I20260709 12:10:21.239856 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.241267 22122 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:21.242479 22122 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:21.242702 23990 consensus_queue.cc:1059] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:21.243400 22122 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.163394 24002 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.208982 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:10:21.256068 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.233302 22117 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:21.198948 23994 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.203034 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:21.261123 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.241815 23985 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:21.208058 23975 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:21.244745 22122 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:21.207532 24013 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:21.245329 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.274552 22116 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.248591 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:21.242748 24000 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:10:21.244379 23922 raft_consensus.cc:3055] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:21.241271 23854 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:21.201818 23983 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.264119 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:21.281424 22193 raft_consensus.cc:2376] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4. Re-sending same reply.
I20260709 12:10:21.275421 22190 raft_consensus.cc:2376] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2. Re-sending same reply.
I20260709 12:10:21.279412 23817 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.284019 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:21.286824 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:21.289528 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:21.291567 22190 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:21.295004 22830 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:21.296197 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.298401 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:21.299086 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:21.300662 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:21.302356 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:21.303745 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.243989 23990 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:10:21.306509 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.315104 22196 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.317420 22123 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:21.317903 22123 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:21.320125 23903 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:21.320547 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 154919us
I20260709 12:10:21.321040 23955 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:21.320647 23903 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:21.322690 22236 leader_election.cc:336] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.119s (SENT)
I20260709 12:10:21.322911 23903 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:21.323094 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.324318 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.325477 23958 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.319856 24013 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:21.327142 23983 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:21.292953 23817 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.352538 22189 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:21.280964 23922 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:21.330837 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.305116 24008 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.679s	user 0.008s	sys 0.004s
I20260709 12:10:21.331863 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:21.332624 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:21.323179 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.369210 22193 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
W20260709 12:10:21.374090 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.376451 22190 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:21.381786 22194 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
W20260709 12:10:21.382746 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.381855 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 104276us
I20260709 12:10:21.316612 22264 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:21.389703 22830 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:21.376626 24029 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:10:21.319962 23913 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:21.397424 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 74771us
I20260709 12:10:21.391829 22123 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.400382 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:21.402072 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:21.414788 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:21.415813 22196 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:21.415913 22236 leader_election.cc:336] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.137s (SENT)
I20260709 12:10:21.416822 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.415913 22194 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.417114 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:21.357002 24031 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:21.419413 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:21.421077 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.422459 22237 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:21.422683 22120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1415) took 1479 ms (client timeout 1768 ms). Trace:
I20260709 12:10:21.382331 23985 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:21.382893 24024 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:21.423058 22120 rpcz_store.cc:269] 0709 12:10:19.943300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.967878 (+ 24578us) service_pool.cc:224] Handling call
0709 12:10:20.638225 (+670347us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:21.419261 (+781036us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9de9c 00007fcceac9da5b 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:21.422618 (+  3357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8248064}
I20260709 12:10:21.385821 23983 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.378906 23975 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:21.398550 22114 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:21.429876 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:21.432420 22866 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.430258 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:21.433727 22865 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.436267 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:21.438542 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48935.6us
I20260709 12:10:21.412123 23903 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.443434 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.449061 22194 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:21.433209 22197 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
W20260709 12:10:21.451231 22236 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.146s (SENT)
I20260709 12:10:21.451727 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.384240 24008 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.461252 22830 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.397676 23955 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:10:21.464690 22196 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
W20260709 12:10:21.465346 22236 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.186s (SENT)
I20260709 12:10:21.469889 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.470304 22830 leader_election.cc:400] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4.
I20260709 12:10:21.434027 23824 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:21.433607 24004 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:21.478219 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.466923 23913 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:21.455253 24036 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
I20260709 12:10:21.473260 24031 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.451959 23975 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.430953 24024 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:21.518491 22866 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:21.473590 22118 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:21.451231 23958 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.456041 23903 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:21.491377 23927 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:21.492515 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 222) took 9162 ms. Trace:
I20260709 12:10:21.467602 23863 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.435284 23985 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:21.509766 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 44449us
W20260709 12:10:21.547019 22236 leader_election.cc:336] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.215s (SENT)
I20260709 12:10:21.547472 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:21.492558 24043 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:10:21.472635 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 201066us
W20260709 12:10:21.471683 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 48406us
I20260709 12:10:21.526463 22237 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:21.453239 23922 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:21.518654 22270 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.535864 22118 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:21.511086 24004 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.549153 23863 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.562062 23863 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:21.562530 24004 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:21.563809 22857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 380) took 2064 ms (client timeout 2153 ms). Trace:
I20260709 12:10:21.564577 24008 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:21.557459 24049 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:21.566572 22123 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.567152 23927 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.567709 23927 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:21.568815 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.569224 23817 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:21.569715 23927 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:21.570016 22162 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.572291 23718 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.574055 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:21.574337 22006 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f1b154b48c54be6b421b01ed436bf21 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7d3f536360b444b1886777f4776be22c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:21.574712 22272 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:21.558441 23824 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.576853 23868 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.577322 23868 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:21.578258 23868 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:21.564304 22857 rpcz_store.cc:269] 0709 12:10:19.499041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.501102 (+  2061us) service_pool.cc:224] Handling call
0709 12:10:21.563609 (+2062507us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54005deb54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:21.563734 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3196194176}
I20260709 12:10:21.581414 22196 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:21.581961 23985 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:21.586916 22831 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:21.587896 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.591663 22116 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:21.589123 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:21.597298 22163 leader_election.cc:336] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Timed out: RequestConsensusVote RPC to 127.20.102.196:42539 timed out after 2.153s (SENT)
I20260709 12:10:21.601303 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:21.551921 24010 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.610766 22116 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:21.611428 22198 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:21.537599 22017 rpcz_store.cc:276] 0709 12:10:12.329956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.330162 (+   206us) service_pool.cc:224] Handling call
0709 12:10:14.174363 (+1844201us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:21.492400 (+7318037us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:19.616894 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:19.619306 (+  2412us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:19.619362 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:10:19.619387 (+    25us) tablet.cc:662] Decoding operations
0709 12:10:19.620172 (+   785us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:19.620271 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:19.620306 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:19.668619 (+ 48313us) tablet.cc:701] Row locks acquired
0709 12:10:19.692062 (+ 23443us) write_op.cc:260] PREPARE: finished
0709 12:10:19.703653 (+ 11591us) write_op.cc:270] Start()
0709 12:10:19.703852 (+   199us) write_op.cc:276] Timestamp: P: 1783599019703567 usec, L: 0
0709 12:10:19.703874 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:19.761891 (+ 58017us) log.cc:844] Serialized 1767 byte log entry
0709 12:10:20.485324 (+723433us) op_driver.cc:464] REPLICATION: finished
0709 12:10:20.600244 (+114920us) write_op.cc:301] APPLY: starting
0709 12:10:20.609191 (+  8947us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:20.642975 (+ 33784us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:20.667950 (+ 24975us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:20.685428 (+ 17478us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:20.685652 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:20.685707 (+    55us) write_op.cc:312] APPLY: finished
0709 12:10:20.685959 (+   252us) log.cc:844] Serialized 41 byte log entry
0709 12:10:20.686210 (+   251us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.686332 (+   122us) write_op.cc:454] Released schema lock
0709 12:10:20.686386 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:20.686811 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.686843 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":610898,"reported_tablets":12,"spinlock_wait_cycles":3138601344,"child_traces":[["op",{"apply.queue_time_us":114664,"apply.run_cpu_time_us":3499,"apply.run_wall_time_us":86532,"num_ops":4,"prepare.queue_time_us":99877,"prepare.run_cpu_time_us":18893,"prepare.run_wall_time_us":320080,"raft.queue_time_us":59031,"raft.run_cpu_time_us":51328,"raft.run_wall_time_us":105958,"replication_time_us":781276,"thread_start_us":268192,"threads_started":4,"wal-append.queue_time_us":203372}]]}
I20260709 12:10:21.616961 24030 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:21.557960 23986 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:21.589383 23935 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:21.627490 22198 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.629293 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:21.602572 23980 consensus_meta.cc:287] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.740s	user 0.007s	sys 0.008s
I20260709 12:10:21.602312 24008 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:21.630816 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 189835us
I20260709 12:10:21.597932 23788 raft_consensus.cc:2764] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:10:21.618965 22123 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:21.613368 23927 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.649163 23927 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.649624 23927 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.650156 22865 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:21.615828 24009 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:21.646404 24045 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:10:21.622380 23854 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:10:21.652590 23980 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.678347 22196 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:21.665799 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.667893 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 79921.7us
I20260709 12:10:21.663890 22087 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:21.687616 23975 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:21.688521 23928 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.002s
I20260709 12:10:21.632377 23986 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:21.744962 22238 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.102.254:38171, user_credentials={real_user=slave}} blocked reactor thread for 56132.1us
W20260709 12:10:21.745746 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.746249 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.746497 23975 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:21.745626 22122 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:21.622495 23998 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:10:21.651793 23935 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:21.637269 23880 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:10:21.750375 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 63003.4us
I20260709 12:10:21.682019 23922 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:21.758478 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:21.762879 22865 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:10:21.762936 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 236569us
W20260709 12:10:21.764473 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 178792us
I20260709 12:10:21.766361 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:21.752276 23815 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:10:21.688726 24030 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:21.768093 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.775230 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:21.769121 23966 consensus_meta.cc:287] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.846s	user 0.010s	sys 0.003s
W20260709 12:10:21.781229 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.786868 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:21.788215 22267 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:21.789104 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:21.795809 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:21.754884 24008 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 12:10:21.776998 22236 leader_election.cc:336] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.768s (SENT)
I20260709 12:10:21.801658 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.801930 22194 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:10:21.802656 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.760579 23582 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:10:21.764611 23854 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:10:21.796054 22198 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:21.779067 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:21.759821 23880 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.782923 23718 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.822536 23718 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.822983 23718 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.814777 23935 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.829118 24053 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:21.774020 24009 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.817451 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:21.833570 24024 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:21.837800 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:21.838512 22198 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
W20260709 12:10:21.839299 24040 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.336s	user 0.000s	sys 0.003s
I20260709 12:10:21.808350 23807 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:21.817993 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.818086 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:10:21.845978 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.846417 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.773684 24052 raft_consensus.cc:2764] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:21.821141 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:21.821653 24004 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.774215 24013 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:21.785048 23980 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:21.828387 23927 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.787868 24047 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:21.811612 24055 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:21.846832 22236 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.237s (SENT)
I20260709 12:10:21.855101 22865 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.906136 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:21.907238 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:21.855620 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 168981us
I20260709 12:10:21.908620 22861 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:21.908936 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.909595 22123 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.909901 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:21.910725 22116 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.787873 24000 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:10:21.793466 23957 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:21.870074 22194 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:21.885397 23947 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.787631 23990 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.891563 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:21.839872 23966 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.779320 24030 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:21.916662 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 69847.5us
W20260709 12:10:21.962460 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.964190 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:21.965245 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:21.966589 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:21.925449 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:21.981408 22117 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:21.981516 22123 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:21.925676 22116 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:21.857324 23807 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.843344 23718 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:21.933748 23986 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:21.936959 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.938993 23927 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:21.939914 23880 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:21.940541 22859 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:21.940560 24063 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.925441 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:21.942526 23582 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.027429 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:21.943813 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:21.955538 22863 raft_consensus.cc:2393] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:22.029147 22266 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.965425 22264 raft_consensus.cc:2368] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3.
I20260709 12:10:21.923028 24004 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:21.990851 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.992588 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.958748 23985 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:22.001163 23966 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.962348 23947 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:21.959792 24055 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:22.005796 23913 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
W20260709 12:10:22.007788 23984 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.797s	user 0.001s	sys 0.011s
W20260709 12:10:22.045509 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 84618.2us
I20260709 12:10:21.913841 23980 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.013293 22198 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.023808 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:21.842633 24009 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:21.919963 22865 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:22.030357 22866 raft_consensus.cc:2410] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:22.035156 24071 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:22.041734 22269 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:21.915633 24047 raft_consensus.cc:697] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:22.052618 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:21.966589 24068 consensus_queue.cc:1059] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:10:22.049358 24024 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:22.050210 23947 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:22.048686 22858 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:22.052021 24071 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.065073 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:22.065194 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.069708 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.047540 23913 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.070343 22270 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:22.052698 24047 consensus_queue.cc:237] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.040187 23979 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.082973 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:22.083464 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.080729 22189 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:22.084355 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:22.081511 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.085662 22269 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.041677 23582 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.067384 24065 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:22.085714 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:22.045768 23985 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.065737 24024 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.087352 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.055722 23984 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.104877 23582 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:22.105962 23718 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:22.108021 23815 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:22.088279 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1440) took 1561 ms. Trace:
I20260709 12:10:22.095355 22118 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:22.034612 24063 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.086371 23927 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:22.139070 22266 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
W20260709 12:10:22.142872 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.142079 22831 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:22.116950 23979 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.174593 22269 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:22.177337 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.178063 22269 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.177114 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1442) took 1660 ms. Trace:
I20260709 12:10:22.180142 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.154567 23880 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.180941 22266 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.150406 24030 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:22.179706 22121 rpcz_store.cc:276] 0709 12:10:20.516285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.135943 (+619658us) service_pool.cc:224] Handling call
0709 12:10:21.145880 (+  9937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.273882 (+128002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.273933 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.273977 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:21.274018 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.176870 (+902852us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400152a54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:22.176916 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.177036 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293894528}
W20260709 12:10:22.183943 24073 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:10:22.184891 24074 raft_consensus.cc:476] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:22.193019 22121 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.193632 22121 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:22.199978 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 115877us
I20260709 12:10:22.117364 24065 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.200920 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:22.196365 22121 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.203868 22121 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.114785 22119 rpcz_store.cc:276] 0709 12:10:20.515774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.778497 (+262723us) service_pool.cc:224] Handling call
0709 12:10:20.778871 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.161585 (+382714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.065287 (+903702us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400311fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:22.076923 (+ 11636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817094912}
W20260709 12:10:22.205237 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.192905 23807 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:22.193256 23913 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:22.192165 23880 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:22.202095 23966 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:22.197106 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.212394 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:22.213598 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:22.226841 22269 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
W20260709 12:10:22.227949 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.229382 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:22.230777 23807 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.231395 23807 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.231825 23807 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.219441 24068 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:22.215461 23913 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:22.243762 24076 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:10:22.246039 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.246537 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:22.247244 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.248356 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.250423 23913 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:22.212814 24009 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:22.254083 22263 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.227917 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.255542 22269 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.220943 24074 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.218223 24079 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.266860 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.267735 22264 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
W20260709 12:10:22.267840 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.277057 22116 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:22.278517 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:22.282648 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.268705 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.263902 24068 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:22.270099 24024 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:22.288756 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:22.291327 22269 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
W20260709 12:10:22.302938 24048 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.700s	user 0.000s	sys 0.002s
I20260709 12:10:22.305305 22268 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.305650 23823 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.309424 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.321455 22266 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:22.274581 24074 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:22.316424 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.287021 24030 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.314870 23984 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:22.333611 24065 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:22.335880 22268 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:22.312970 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:22.338433 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:22.339795 23975 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.343446 22236 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:22.321966 24084 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:10:22.341426 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.345643 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.342610 23913 raft_consensus.cc:2764] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:22.327414 23983 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.349649 22270 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.311774 22860 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
W20260709 12:10:22.361057 24077 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:22.354435 24079 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:22.361605 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:22.362917 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:22.364035 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:22.365258 22860 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:22.351330 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.373708 22269 raft_consensus.cc:2368] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4.
I20260709 12:10:22.375942 22865 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:22.376384 22865 pending_rounds.cc:85] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Aborting all ops after (but not including) 5
I20260709 12:10:22.366957 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:22.368396 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1447) took 1676 ms. Trace:
I20260709 12:10:22.369840 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 179) took 1152 ms. Trace:
I20260709 12:10:22.349129 22266 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
W20260709 12:10:22.381258 22265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1474) took 1757 ms (client timeout 1716 ms). Trace:
I20260709 12:10:22.377368 22863 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:22.386433 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.421564 22267 rpcz_store.cc:276] 0709 12:10:21.218042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.218280 (+   238us) service_pool.cc:224] Handling call
0709 12:10:22.369660 (+1151380us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400055854. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:22.369773 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307903872}
I20260709 12:10:22.422163 22269 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
W20260709 12:10:22.421968 22265 rpcz_store.cc:269] 0709 12:10:20.623869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.638531 (+ 14662us) service_pool.cc:224] Handling call
0709 12:10:21.137421 (+498890us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b5800180398. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:22.381041 (+1243620us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b540029d6d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:22.381174 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58902656}
I20260709 12:10:22.393779 22270 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
W20260709 12:10:22.378919 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.385679 22237 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:22.276074 23880 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.471938 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:22.476347 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.380066 23870 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:22.444286 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.478544 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.479214 22266 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.478842 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.480023 22270 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:22.376644 22865 pending_rounds.cc:107] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:22.481353 22865 raft_consensus.cc:2889] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:22.344063 24058 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:22.488134 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 67459.8us
W20260709 12:10:22.490502 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 104932us
I20260709 12:10:22.491693 22237 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:22.485564 22831 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:22.427417 22163 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:22.375553 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:22.498363 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 155971us
I20260709 12:10:22.501752 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.502553 22269 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:22.506215 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.343663 24030 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.349575 23985 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:22.499936 24058 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.503616 23980 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.378309 23966 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.514341 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:22.360630 23807 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.379185 23983 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:22.533454 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.551718 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.552003 22265 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:22.552425 22270 raft_consensus.cc:2368] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4.
I20260709 12:10:22.420631 22114 rpcz_store.cc:276] 0709 12:10:20.692303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.145285 (+452982us) service_pool.cc:224] Handling call
0709 12:10:21.184165 (+ 38880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.435583 (+251418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.368097 (+932514us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400215f54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:22.368322 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334994688}
I20260709 12:10:22.527426 22121 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.507203 23863 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.553237 22862 raft_consensus.cc:2376] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3. Re-sending same reply.
W20260709 12:10:22.547505 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 269104us
I20260709 12:10:22.507259 23957 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.545152 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1445) took 1926 ms. Trace:
I20260709 12:10:22.555603 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:22.519961 23928 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:22.554606 23980 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:22.507164 23922 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.559609 22195 rpcz_store.cc:276] 0709 12:10:20.593636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.593755 (+   119us) service_pool.cc:224] Handling call
0709 12:10:20.606953 (+ 13198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.985285 (+378332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.519840 (+1534555us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54003b5bd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:22.520057 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796394240}
I20260709 12:10:22.362298 24079 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.520321 22860 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:22.546288 24058 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.570696 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.574949 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.575493 22270 raft_consensus.cc:1813] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
W20260709 12:10:22.560037 23909 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:10:22.554844 23863 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.575567 22265 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.576180 22270 raft_consensus.cc:2410] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:22.507946 23947 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:10:22.578627 23980 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.572304 23790 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.559257 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:22.561524 23966 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:22.559549 23957 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.572351 24063 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:22.588840 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.587622 23863 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.378096 24074 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.571487 23922 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.573165 22088 leader_election.cc:400] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3.
I20260709 12:10:22.597476 22266 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:22.604115 22265 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:22.645006 22088 leader_election.cc:403] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:22.608093 22858 raft_consensus.cc:1813] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
I20260709 12:10:22.611155 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:22.611320 23957 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.591332 22269 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
W20260709 12:10:22.618772 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.625190 24031 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.569898 23928 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.612931 23790 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:22.632462 22019 catalog_manager.cc:5697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 4, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.650755 22270 raft_consensus.cc:2410] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:22.658752 22269 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.664676 22019 catalog_manager.cc:5697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.667596 23790 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.670367 23975 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.671535 22019 catalog_manager.cc:5697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.673305 22019 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 4, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:22.675585 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1485) took 1467 ms. Trace:
I20260709 12:10:22.683185 22019 catalog_manager.cc:5697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.567117 24068 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:22.685959 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 112924us
I20260709 12:10:22.687036 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:22.649770 23922 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.682853 22271 rpcz_store.cc:276] 0709 12:10:21.196624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.196751 (+   127us) service_pool.cc:224] Handling call
0709 12:10:21.203883 (+  7132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.251642 (+ 47759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.251679 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.252294 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.283334 (+ 31040us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:21.283385 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.640356 (+1356971us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b5400083c54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:22.640412 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.640462 (+    50us) raft_consensus.cc:1685] finished
0709 12:10:22.640473 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.663463 (+ 22990us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2473,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":147,"spinlock_wait_cycles":108723456,"thread_start_us":30460,"threads_started":1,"wal-append.queue_time_us":25922,"wal-append.run_cpu_time_us":1897,"wal-append.run_wall_time_us":1001904}
I20260709 12:10:22.689631 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.690847 22269 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
W20260709 12:10:22.691033 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.691744 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1455) took 1407 ms. Trace:
I20260709 12:10:22.692241 22120 rpcz_store.cc:276] 0709 12:10:21.284387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.425988 (+141601us) service_pool.cc:224] Handling call
0709 12:10:21.439509 (+ 13521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.439807 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.439839 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.389090 (+949251us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b2c00058398. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:10:22.474988 (+ 85898us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.515272 (+ 40284us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:22.515308 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.515371 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.671981 (+156610us) raft_consensus.cc:1685] finished
0709 12:10:22.672006 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.691661 (+ 19655us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4168,"raft.queue_time_us":85790,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":2678,"spinlock_wait_cycles":6009600,"thread_start_us":37007,"threads_started":1,"wal-append.queue_time_us":105061}
I20260709 12:10:22.695784 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:22.691162 22019 catalog_manager.cc:5697] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 4, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.696748 22270 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:22.688797 22858 raft_consensus.cc:2368] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4.
I20260709 12:10:22.702284 23807 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:22.712296 24006 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.659510 24031 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:22.662966 24049 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:22.662415 24047 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3.
I20260709 12:10:22.724162 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:22.697515 22019 catalog_manager.cc:5697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 4, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.717361 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:22.726171 22019 catalog_manager.cc:5697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.727303 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:22.728369 22019 catalog_manager.cc:5697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 3, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 3 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.729789 22271 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:22.731688 22019 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 3, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 3 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.692382 23975 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.746171 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:22.748471 24106 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.748800 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:22.749315 24106 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.750101 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:22.751925 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:22.753206 24106 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.755394 22265 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.761170 24107 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.761668 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:22.755952 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 232953us
I20260709 12:10:22.711790 23966 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:22.771943 24094 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 12:10:22.773464 24097 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:10:22.772480 22269 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:22.776283 22006 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f1b154b48c54be6b421b01ed436bf21 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7d3f536360b444b1886777f4776be22c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:22.777875 23928 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:22.783844 23979 consensus_meta.cc:287] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.001s
W20260709 12:10:22.784699 22263 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.001s
I20260709 12:10:22.785725 22263 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:22.788923 23913 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.789788 23913 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:22.791903 24095 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:10:22.734277 24004 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.760936 22019 catalog_manager.cc:5697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:22.801079 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77038.6us
I20260709 12:10:22.762516 24085 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.800259 22264 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:22.806384 22019 catalog_manager.cc:5697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 4, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.712980 24006 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.685010 23983 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.804977 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:22.813973 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:22.816013 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:22.817058 23975 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.809625 24107 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.818207 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:22.764576 24088 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.820102 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:22.830304 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:22.831080 22116 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.831019 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:22.831687 22121 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:22.811115 24065 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.765476 24049 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.843868 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:22.842757 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.844981 22120 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4.
I20260709 12:10:22.846583 22116 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:22.847839 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:22.826575 24047 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.852026 22163 leader_election.cc:400] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4.
I20260709 12:10:22.852454 22163 leader_election.cc:403] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:22.837922 23984 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:22.842348 24074 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.863513 23788 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.865422 23868 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:22.910089 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 148489us
I20260709 12:10:22.919124 22265 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:22.849824 23990 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.856966 24013 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.920490 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1495) took 1334 ms. Trace:
I20260709 12:10:22.921535 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:22.930501 23922 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.861124 23984 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:22.935604 22272 rpcz_store.cc:276] 0709 12:10:21.586149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.586345 (+   196us) service_pool.cc:224] Handling call
0709 12:10:21.620736 (+ 34391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.621010 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:22.639035 (+1018025us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b180026ab80. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fccf17ba3c7 00007fcceddcc9a7 00007fccedddc0bf
0709 12:10:22.639266 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.919952 (+280686us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.920034 (+    82us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:22.920104 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.920209 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.920403 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36959,"prepare.queue_time_us":58321,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":4567,"raft.queue_time_us":38130,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":9416,"spinlock_wait_cycles":5553408,"thread_start_us":351101,"threads_started":3,"wal-append.queue_time_us":187043}
I20260709 12:10:22.848886 24065 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.919287 23998 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.921435 23947 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.948848 24049 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:22.949647 24049 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:22.950170 24049 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.952224 24049 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:22.910018 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:22.953119 22114 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:22.911494 24074 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:22.961578 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 114476us
I20260709 12:10:22.961647 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:22.965924 24107 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.966866 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:22.967877 23979 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.967974 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:22.968328 23979 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:22.968724 23979 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.969094 24004 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.969514 22236 leader_election.cc:400] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4.
I20260709 12:10:22.969871 24004 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:22.971242 24004 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.954712 24074 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.911178 23788 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:22.945719 23984 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.938423 23983 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.845640 24088 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:22.985492 24101 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:10:22.945827 24013 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:23.005842 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.005887 24065 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:22.920112 24047 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:22.966163 23928 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:22.986680 24107 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:22.973394 23863 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.974858 23957 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:22.976760 24102 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:10:23.033811 23788 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:23.094302 23870 consensus_meta.cc:287] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.002s
I20260709 12:10:23.127660 23815 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:23.131179 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.135022 23815 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:23.146679 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.147329 23880 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.103956 23788 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.149447 23815 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:23.149984 23788 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.149595 24088 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:23.158066 23957 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:23.148087 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 178762us
I20260709 12:10:23.155254 23870 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:23.155403 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:23.159073 24107 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.159592 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:23.159876 22865 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.161218 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:23.162786 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:23.132794 24013 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:23.131012 24108 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:10:23.164848 22088 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:23.164026 23815 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:10:23.168625 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.127938 24111 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:23.171096 22865 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:23.173283 22237 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:23.163894 23870 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.162804 24088 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.154007 23863 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:23.152668 23788 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:23.154577 24065 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.179001 22088 leader_election.cc:400] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4.
I20260709 12:10:23.183307 22088 leader_election.cc:403] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:23.187974 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.176580 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:23.193574 22264 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:23.194540 23870 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:23.194789 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:23.195101 24110 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:23.195436 22264 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:23.195662 24110 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.196343 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:23.196978 23990 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:23.197805 24110 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:23.198452 23983 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:23.198997 24086 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:23.199581 24112 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:10:23.199877 24086 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.200919 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.202754 24086 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:23.199004 23983 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:23.197495 23990 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.205157 23983 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.172003 24102 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.209651 22864 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.206638 23990 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:23.217582 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.181422 24079 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:23.220965 22116 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:23.220860 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:23.209692 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:23.187860 23815 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:23.223322 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:23.149675 23880 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.228243 22193 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:23.223228 22122 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:23.218482 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.229648 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:23.229908 22117 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:23.230719 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.231232 22117 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:23.232149 22117 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.233440 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.246206 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:23.248085 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:23.248713 22116 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.248905 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1503) took 1236 ms. Trace:
I20260709 12:10:23.249398 22266 rpcz_store.cc:276] 0709 12:10:22.012289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.656921 (+644632us) service_pool.cc:224] Handling call
0709 12:10:22.657290 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.742993 (+ 85703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.743026 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.765316 (+ 22290us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.845058 (+ 79742us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:22.845103 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.845178 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.248627 (+403449us) raft_consensus.cc:1685] finished
0709 12:10:23.248653 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.248834 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31661,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":21190,"thread_start_us":157059,"threads_started":2,"wal-append.queue_time_us":183794}
I20260709 12:10:23.219444 24102 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.229338 23788 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:23.254482 23815 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.254530 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:23.258664 22193 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:23.221881 23922 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:23.260043 23788 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:23.261974 22264 raft_consensus.cc:2410] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:23.226238 24115 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.175568 24111 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.188658 24065 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.277380 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:23.274353 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:23.241317 24113 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4.
I20260709 12:10:23.247936 23975 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.287966 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:23.289541 22116 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:23.251798 24079 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:23.291682 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:23.291921 22088 leader_election.cc:400] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4.
I20260709 12:10:23.263813 23998 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4.
W20260709 12:10:23.277069 24058 consensus_meta.cc:287] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.685s	user 0.005s	sys 0.007s
I20260709 12:10:23.293668 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:23.296895 22088 leader_election.cc:403] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:23.309314 22191 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.297221 22192 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:23.260747 24102 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.275247 23788 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.304159 23984 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.305145 24068 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.305733 24113 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.289651 24088 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:23.315912 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:23.332499 22864 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:23.262962 23958 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:10:23.273947 23957 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:10:23.335538 22194 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:23.339286 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:23.286864 24115 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.342489 23958 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:23.343359 24115 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:23.339962 22189 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:23.362476 22118 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:10:23.362967 22118 pending_rounds.cc:85] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 4
I20260709 12:10:23.363236 22118 pending_rounds.cc:107] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:10:23.363519 22118 raft_consensus.cc:2889] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:23.300474 23975 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.350353 24068 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4.
W20260709 12:10:23.391192 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 113876us
I20260709 12:10:23.378482 22191 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:23.322781 24058 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.439584 24058 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:23.356796 24088 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:23.453991 24088 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.384702 24004 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.445127 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:23.338147 24113 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.449350 24079 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:23.482506 22163 leader_election.cc:336] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Timed out: RequestConsensusVote RPC to 127.20.102.196:42539 timed out after 1.696s (SENT)
I20260709 12:10:23.506228 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:23.487865 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 174344us
W20260709 12:10:23.498965 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.501783 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56769us
I20260709 12:10:23.361644 24049 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:10:23.666316 24111 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:23.617878 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.692934 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.556396 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.616427 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 108378us
I20260709 12:10:23.505857 23958 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:23.566207 24116 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
W20260709 12:10:23.527659 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 45215.2us
W20260709 12:10:23.519595 24121 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:10:23.651710 24065 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:23.519891 24013 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.680526 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1657) took 2055 ms. Trace:
I20260709 12:10:23.715838 22196 rpcz_store.cc:276] 0709 12:10:21.625498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.625674 (+   176us) service_pool.cc:224] Handling call
0709 12:10:21.651551 (+ 25877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.678841 (+ 27290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.675176 (+1996335us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b54001be9d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:23.680449 (+  5273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60709760}
I20260709 12:10:23.633685 23975 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:23.514410 24004 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.715485 24024 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.721846 24024 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.722584 24004 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:23.565953 24120 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:10:23.705473 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:23.636134 23979 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.667s	user 0.007s	sys 0.003s
I20260709 12:10:23.527885 24074 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:23.597169 23880 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:23.618695 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.712633 23958 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:23.537456 24055 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:23.629740 23984 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:23.702526 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1473) took 1606 ms. Trace:
I20260709 12:10:23.703887 24115 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:23.736445 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:23.518831 23868 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.755005 22857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 400) took 1988 ms. Trace:
I20260709 12:10:23.714013 24113 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:23.714298 24126 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:23.759449 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 117247us
I20260709 12:10:23.767298 22120 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.709617 23815 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 12:10:23.764247 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51404us
I20260709 12:10:23.764497 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:23.750860 24074 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:23.769356 24004 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.727806 24102 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.742231 23979 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.757514 24024 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:23.767776 23975 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.814507 22266 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:23.767902 24055 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:23.765167 24136 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:23.790246 23984 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:23.766749 23868 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.765848 24115 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.811491 22264 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.807629 24068 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.812740 23975 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:23.808956 23880 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:23.801041 24004 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:23.831629 24135 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.158s	user 0.000s	sys 0.002s
W20260709 12:10:23.831808 24129 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:10:23.832391 24128 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 12:10:23.835434 22263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1483) took 2639 ms (client timeout 2471 ms). Trace:
I20260709 12:10:23.837353 23903 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:23.840425 22863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 426) took 1793 ms. Trace:
W20260709 12:10:23.841632 24131 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:10:23.845111 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:23.845737 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1641) took 1613 ms. Trace:
I20260709 12:10:23.823912 23958 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:23.887678 22263 rpcz_store.cc:269] 0709 12:10:21.195890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.199006 (+  3116us) service_pool.cc:224] Handling call
0709 12:10:22.253937 (+1054931us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b5400286a20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc5e18 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:23.835203 (+1581266us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54003c91d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:23.835325 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1222328448}
I20260709 12:10:23.912159 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:23.905732 23903 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.913237 23903 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:23.847451 24133 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:10:23.848146 24068 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:23.917960 23903 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:23.917977 24115 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:23.919274 24115 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:23.919591 24068 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:23.919842 24115 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.849982 23788 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.759584 22119 rpcz_store.cc:276] 0709 12:10:22.095745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.241561 (+145816us) service_pool.cc:224] Handling call
0709 12:10:22.256001 (+ 14440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.265492 (+  9491us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:22.273591 (+  8099us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.541730 (+1268139us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b1800287e00. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fcceddba060 00007fcceddcc716 00007fccedddd287 00007fccedddd208
0709 12:10:23.702007 (+160277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.702092 (+    85us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:23.702166 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.702266 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.702450 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2089,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":14387,"spinlock_wait_cycles":41470080,"thread_start_us":160063,"threads_started":1}
I20260709 12:10:23.824822 24141 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:23.783125 24126 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.922335 22263 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:23.857465 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:23.819216 23984 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.879797 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.880195 24145 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:23.885536 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1463) took 1830 ms. Trace:
I20260709 12:10:23.886445 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.884497 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.927174 22116 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:23.888183 24008 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.890214 22863 rpcz_store.cc:276] 0709 12:10:22.046891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.047105 (+   214us) service_pool.cc:224] Handling call
0709 12:10:22.377072 (+329967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.475649 (+ 98577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.840177 (+1364528us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540030f050. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:23.840346 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754636672}
I20260709 12:10:23.859825 24024 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.927167 22123 rpcz_store.cc:276] 0709 12:10:22.055616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.062888 (+  7272us) service_pool.cc:224] Handling call
0709 12:10:22.063220 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.063565 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.063593 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.067939 (+  4346us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.535570 (+1467631us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b480027c0d8. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf2cebaa1 00007fccf2ce2b37 00007fccf2ce29ca 00007fccf2dda26f 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508 00007fccf2dee488 00007fccf2dee443 00007fccf2ded6ec 00007fccf1d17a96
0709 12:10:23.839548 (+303978us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b18002da780. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:10:23.883137 (+ 43589us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:23.883194 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.883300 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.885333 (+  2033us) raft_consensus.cc:1685] finished
0709 12:10:23.885349 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.885483 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1764,"raft.run_cpu_time_us":4110,"raft.run_wall_time_us":1470463,"spinlock_wait_cycles":30187648,"thread_start_us":43324,"threads_started":1,"wal-append.queue_time_us":1795567}
I20260709 12:10:23.885715 24058 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:10:23.931113 24024 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.931744 23868 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:23.932098 24058 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:23.923261 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:23.932531 24104 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.013s	user 0.005s	sys 0.000s
W20260709 12:10:23.939644 24096 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.103s	user 0.001s	sys 0.001s
I20260709 12:10:23.929476 23984 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.868428 24013 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.941334 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.942005 22116 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:23.942808 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:23.942941 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.825179 24074 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.764008 22857 rpcz_store.cc:276] 0709 12:10:21.766518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.774291 (+  7773us) service_pool.cc:224] Handling call
0709 12:10:22.420756 (+646465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.492303 (+ 71547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.504900 (+ 12597us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.507594 (+  2694us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:22.520286 (+ 12692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.545533 (+ 25247us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.751583 (+1206050us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400800a50. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:23.754876 (+  3293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328632704}
I20260709 12:10:23.905748 22265 rpcz_store.cc:276] 0709 12:10:22.232049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.760277 (+528228us) service_pool.cc:224] Handling call
0709 12:10:22.760630 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.919823 (+159193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.845448 (+925625us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540029d6d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:23.845666 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364035328}
I20260709 12:10:23.907157 24149 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.909904 24004 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:23.876209 24065 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.915239 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.875953 24111 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:23.888554 23998 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.819867 24055 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.885439 24070 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:23.869937 23975 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.889235 23815 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:23.932554 24058 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:23.941108 24013 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:23.905385 22266 raft_consensus.cc:2368] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3.
W20260709 12:10:23.995796 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 134554us
I20260709 12:10:23.950856 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:23.996694 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 139344us
I20260709 12:10:24.094007 22189 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:24.032589 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.120365 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:24.098176 22194 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:24.003574 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:24.098371 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.023679 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:24.122280 22195 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:23.972085 22862 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 392) took 2135 ms (client timeout 1696 ms). Trace:
I20260709 12:10:24.022567 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:24.123847 22191 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.121359 22117 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:24.098847 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:24.083202 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.093998 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.122040 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:24.134078 22122 raft_consensus.cc:2410] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:24.137778 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:24.138613 22117 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:24.139628 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:24.141804 22116 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:24.142072 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:24.123337 22862 rpcz_store.cc:269] 0709 12:10:21.810457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.810632 (+   175us) service_pool.cc:224] Handling call
0709 12:10:22.366803 (+556171us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800003c98. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:23.945674 (+1578871us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400591d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:23.945806 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340789504}
I20260709 12:10:23.922358 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:24.158701 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:24.161425 22122 raft_consensus.cc:1813] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
I20260709 12:10:24.161895 22122 raft_consensus.cc:2368] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4.
I20260709 12:10:24.162761 22117 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:24.163664 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.167018 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:24.164935 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44647.3us
I20260709 12:10:23.944083 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:23.963112 23979 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:23.993084 22263 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:24.097615 24115 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:24.096531 24024 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:24.166435 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:24.165880 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:24.165661 22190 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:24.094458 23994 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.168491 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:24.076731 24136 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:24.049783 23903 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.169677 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.170146 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:24.094260 24126 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:24.165714 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.103695 24124 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.174973 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.176291 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.169327 22114 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.172601 22191 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:24.180563 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:24.195165 22122 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:24.128990 24070 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:24.180827 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:23.946326 24008 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:24.192015 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.198355 24155 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.922377 24141 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:24.198920 24155 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:24.149586 24065 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:24.199970 24008 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:24.200736 22196 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:24.201086 24155 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:24.202330 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.140815 23998 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:24.140375 24111 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:24.205406 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.205530 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:24.209641 22117 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:24.211719 24159 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:24.212298 24159 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:24.192173 24024 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.141356 24149 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:24.177461 24144 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:10:24.233618 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 161) took 2144 ms. Trace:
W20260709 12:10:24.232324 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 63998.3us
I20260709 12:10:24.188844 23984 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:24.194954 24058 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:24.195832 23903 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:24.219849 24031 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:24.193740 23958 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:10:24.224402 24024 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.236953 22118 rpcz_store.cc:276] 0709 12:10:22.078423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.115884 (+ 37461us) service_pool.cc:224] Handling call
0709 12:10:22.116213 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.364280 (+1248067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.222112 (+857832us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002ae4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:24.222381 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2854463744}
I20260709 12:10:24.208376 24136 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:24.217883 24008 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:10:24.202123 24124 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:24.264678 22118 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:24.441496 22118 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:24.442440 22118 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:24.443403 22118 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.283326 22189 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:24.293027 22117 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:24.447187 22120 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:24.496309 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.515246 22195 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:24.517069 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.518611 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.528679 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.452756 22830 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:24.546846 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 94219.9us
I20260709 12:10:24.548138 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:10:24.597388 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.379158 24152 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:10:24.235872 24157 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:24.285130 24031 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.286468 22264 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:24.277215 24024 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.246474 24146 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.264577 23986 raft_consensus.cc:3055] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:24.285989 24065 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:24.383466 23998 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:24.306205 24154 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.499059 24013 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:24.440516 24160 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:24.627688 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 434753us
I20260709 12:10:24.384554 24111 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:24.444648 24002 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:10:24.636482 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 88484.8us
I20260709 12:10:24.637017 24169 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:24.638003 22866 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 421) took 2835 ms (client timeout 2892 ms). Trace:
I20260709 12:10:24.638067 22122 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:24.640188 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.609792 24158 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:24.653307 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:24.653244 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:24.654470 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:24.652645 22866 rpcz_store.cc:269] 0709 12:10:21.802627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.802968 (+   341us) service_pool.cc:224] Handling call
0709 12:10:24.637780 (+2834812us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400570154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:24.637937 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453148544}
I20260709 12:10:24.630404 23986 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:24.661556 24165 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.633729 24055 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:24.671173 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:24.671490 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 76102.2us
I20260709 12:10:24.672187 22195 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:24.673489 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.657088 24146 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.652155 24154 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.249974 24159 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:24.683625 22195 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:24.664628 24070 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:24.686443 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.687453 22195 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:24.669811 24169 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.657970 24002 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:24.668133 24158 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:24.628095 24157 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:24.896018 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 223067us
W20260709 12:10:24.953173 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 300054us
W20260709 12:10:24.840318 22163 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.716s (SENT)
W20260709 12:10:24.983309 22087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.029s (SENT) [suppressed 21 similar messages]
I20260709 12:10:25.013563 22163 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:24.809939 22268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1630) took 2604 ms (client timeout 1799 ms). Trace:
W20260709 12:10:25.014372 22268 rpcz_store.cc:269] 0709 12:10:22.205745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.248141 (+ 42396us) service_pool.cc:224] Handling call
0709 12:10:24.809639 (+2561498us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b5400226fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:24.809836 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115296512}
I20260709 12:10:24.899477 22118 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:10:25.015647 22118 pending_rounds.cc:85] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 1
I20260709 12:10:24.810668 22272 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:25.016067 22118 pending_rounds.cc:107] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:25.016491 22118 raft_consensus.cc:2889] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:25.017532 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1469) took 1109 ms. Trace:
I20260709 12:10:25.017957 22118 rpcz_store.cc:276] 0709 12:10:23.908075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.264060 (+355985us) service_pool.cc:224] Handling call
0709 12:10:24.264556 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.017205 (+752649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.017463 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.770430 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:25.020047 22267 raft_consensus.cc:2393] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:24.808714 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:25.021658 22194 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:24.734813 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.962129 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:25.036422 22195 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.038275 22195 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:25.038617 22194 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:24.744361 22115 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:25.050335 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:24.682010 24154 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.679437 24146 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.686304 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:25.057977 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.911499 23947 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:24.685498 23957 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:25.092926 22191 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:25.111415 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1663) took 1010 ms. Trace:
I20260709 12:10:25.111721 22197 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:25.111925 22191 rpcz_store.cc:276] 0709 12:10:24.100591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.037565 (+936974us) service_pool.cc:224] Handling call
0709 12:10:25.092600 (+ 55035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.111039 (+ 18439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.111335 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:25.011381 22859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 401) took 3236 ms (client timeout 3268 ms). Trace:
I20260709 12:10:24.723069 24065 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.114248 22191 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:24.691336 23903 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:24.762259 23984 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:25.146431 22197 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.013068 24013 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 12:10:25.142505 24174 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.110359 23957 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.116223 22264 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.151620 24071 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.097267 23790 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.079779 24124 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:25.190964 22197 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:10:25.169826 22236 connection.cc:256] RPC call timeout handler was delayed by -1.0349343649997991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260709 12:10:24.685962 24165 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:25.142665 23903 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.143625 24171 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:25.174391 24174 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:24.745265 23986 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.182143 23957 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.121726 23947 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.201315 24071 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.220927 24141 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:25.238804 24157 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:25.240602 24002 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:25.217631 24156 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.459s	user 0.002s	sys 0.000s
I20260709 12:10:25.247611 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1662) took 1147 ms. Trace:
I20260709 12:10:25.320669 22189 rpcz_store.cc:276] 0709 12:10:24.100327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.132014 (+ 31687us) service_pool.cc:224] Handling call
0709 12:10:25.247312 (+1115298us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b54003b5bd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:25.247510 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211297536}
W20260709 12:10:25.250837 22114 consensus_meta.cc:287] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.040s	user 0.012s	sys 0.000s
I20260709 12:10:25.255704 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 146) took 4156 ms. Trace:
I20260709 12:10:25.301888 23863 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:25.328519 22088 leader_election.cc:400] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3.
W20260709 12:10:25.258303 23975 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.100s	user 0.010s	sys 0.003s
I20260709 12:10:25.259729 23913 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:25.264721 24006 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:25.257229 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1479) took 1369 ms. Trace:
W20260709 12:10:25.121766 22859 rpcz_store.cc:269] 0709 12:10:21.767878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.770618 (+  2740us) service_pool.cc:224] Handling call
0709 12:10:24.883696 (+3113078us) spinlock_profiling.cc:243] Waited 95.9 ms on lock 0x7b54002f8fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:25.003822 (+120126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220489984}
I20260709 12:10:25.202672 23790 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:25.348016 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.281575 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1648) took 2109 ms. Trace:
I20260709 12:10:25.348664 22272 rpcz_store.cc:276] 0709 12:10:23.172346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.172497 (+   151us) service_pool.cc:224] Handling call
0709 12:10:24.810138 (+1637641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.016317 (+206179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.281235 (+264918us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400226fd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:25.281450 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3745611136}
I20260709 12:10:25.302817 23903 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.305409 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 167) took 2089 ms. Trace:
I20260709 12:10:25.308019 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1684) took 1095 ms. Trace:
I20260709 12:10:25.353040 22197 rpcz_store.cc:276] 0709 12:10:24.212841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.147548 (+934707us) service_pool.cc:224] Handling call
0709 12:10:25.190601 (+ 43053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.307621 (+117020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.307937 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:25.275476 24024 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
I20260709 12:10:25.312216 23986 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:25.327569 24002 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:25.287351 23788 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:25.277174 24130 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.518s	user 0.000s	sys 0.005s
I20260709 12:10:25.033413 24169 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.325855 23909 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:25.305343 23979 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.382666 23979 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.383296 24165 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:25.257177 24158 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.329777 22118 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.386056 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:25.386452 24058 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.380089 23909 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:25.330991 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 289629us
I20260709 12:10:25.331346 22088 leader_election.cc:403] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:10:25.392082 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 63785.8us
I20260709 12:10:25.393461 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:25.394397 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1668) took 1229 ms. Trace:
I20260709 12:10:25.394723 22198 rpcz_store.cc:276] 0709 12:10:24.164622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.393054 (+1228432us) service_pool.cc:224] Handling call
0709 12:10:25.394334 (+  1280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.395458 24006 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:25.397046 24006 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:25.305696 24107 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:25.302753 24171 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.335474 22122 rpcz_store.cc:276] 0709 12:10:23.887538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.196033 (+308495us) service_pool.cc:224] Handling call
0709 12:10:24.196330 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.653329 (+456999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.256943 (+603614us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54003ad4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:25.257156 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015082240}
I20260709 12:10:25.336139 22120 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:25.336855 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:25.344933 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 311361us
I20260709 12:10:25.404692 22123 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
W20260709 12:10:25.347388 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 334234us
W20260709 12:10:25.406824 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.402773 24075 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:10:25.357877 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1512) took 1215 ms. Trace:
I20260709 12:10:25.408919 22266 rpcz_store.cc:276] 0709 12:10:24.143235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.238369 (+ 95134us) service_pool.cc:224] Handling call
0709 12:10:24.238665 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.238877 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:24.678730 (+439853us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.357454 (+678724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.357517 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:25.357579 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.357666 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.357812 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":479872,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":146288,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":1094816,"threads_started":3,"wal-append.queue_time_us":533840}
I20260709 12:10:25.411756 22266 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.359184 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1513) took 1215 ms. Trace:
I20260709 12:10:25.351451 22121 rpcz_store.cc:276] 0709 12:10:23.216437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.216552 (+   115us) service_pool.cc:224] Handling call
0709 12:10:23.216899 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.365117 (+148218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.365160 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.365678 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.610460 (+244782us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:23.673358 (+ 62898us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.675868 (+  2510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.280143 (+1604275us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54002558d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:25.280215 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.287500 (+  7285us) raft_consensus.cc:1685] finished
0709 12:10:25.305100 (+ 17600us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.305326 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13734,"prepare.queue_time_us":62848,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":21075,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":39672,"spinlock_wait_cycles":308220160,"thread_start_us":203588,"threads_started":2,"wal-append.queue_time_us":251663,"wal-append.run_cpu_time_us":3256,"wal-append.run_wall_time_us":1123647}
W20260709 12:10:25.315790 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.324337 24157 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:25.333390 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 493087us
I20260709 12:10:25.326709 22115 rpcz_store.cc:276] 0709 12:10:21.099644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.217183 (+117539us) service_pool.cc:224] Handling call
0709 12:10:21.217755 (+   572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.053637 (+3835882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.255306 (+201669us) spinlock_profiling.cc:243] Waited 3.47 s on lock 0x7b54002c10d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:25.255605 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7970538368}
I20260709 12:10:25.335407 23975 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:25.334794 24141 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.421159 24141 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.334563 23863 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:25.323156 22114 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:25.423388 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 1475) took 1542 ms. Trace:
I20260709 12:10:25.423637 23863 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:25.423794 22114 rpcz_store.cc:276] 0709 12:10:23.880799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.880973 (+   174us) service_pool.cc:224] Handling call
0709 12:10:25.423317 (+1542344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.081420 24149 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.412988 22271 rpcz_store.cc:276] 0709 12:10:24.143489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.859666 (+716177us) service_pool.cc:224] Handling call
0709 12:10:24.963231 (+103565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.963580 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:25.026610 (+ 63030us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.358833 (+332223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.358891 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:25.358939 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.359017 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.359123 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4929,"prepare.queue_time_us":76793,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":1127,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"thread_start_us":317806,"threads_started":1}
I20260709 12:10:25.412482 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1517) took 1267 ms. Trace:
I20260709 12:10:25.430790 22266 rpcz_store.cc:276] 0709 12:10:24.144567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.411100 (+1266533us) service_pool.cc:224] Handling call
0709 12:10:25.411507 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.412197 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.412413 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.432296 24083 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3.
I20260709 12:10:25.428083 22162 leader_election.cc:400] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4.
I20260709 12:10:25.437083 23947 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.408485 24158 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.376189 24024 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.424801 24047 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 12:10:25.487566 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.477953 24030 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:25.441242 23909 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:25.418093 24107 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.427096 23984 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:10:25.490859 23984 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.491340 23984 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:25.381826 24002 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:25.430425 24157 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:25.499294 24171 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.500691 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1658) took 1534 ms. Trace:
W20260709 12:10:25.495710 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 76511.5us
I20260709 12:10:25.501240 22270 rpcz_store.cc:276] 0709 12:10:23.966564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.966755 (+   191us) service_pool.cc:224] Handling call
0709 12:10:23.993268 (+ 26513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.993759 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.993801 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.994417 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 12:10:24.175344 (+180927us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:24.175389 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.175459 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.797314 (+621855us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:25.492959 (+695645us) raft_consensus.cc:1685] finished
0709 12:10:25.492992 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.500606 (+  7614us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9599,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":11844,"spinlock_wait_cycles":19150592,"thread_start_us":180517,"threads_started":1,"wal-append.queue_time_us":218876}
I20260709 12:10:25.516822 24002 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:25.486596 24146 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:25.518559 22864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 403) took 3714 ms (client timeout 1859 ms). Trace:
W20260709 12:10:25.521660 22864 rpcz_store.cc:269] 0709 12:10:21.804631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.804839 (+   208us) service_pool.cc:224] Handling call
0709 12:10:25.518352 (+3713513us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54006b0154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:25.518477 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3137134720}
I20260709 12:10:25.522773 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1521) took 1349 ms. Trace:
I20260709 12:10:25.523239 22270 rpcz_store.cc:276] 0709 12:10:24.173181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.521475 (+1348294us) service_pool.cc:224] Handling call
0709 12:10:25.522251 (+   776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.522445 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.522472 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.522516 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:25.522548 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.522600 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.522714 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.526196 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1522) took 1350 ms. Trace:
I20260709 12:10:25.452155 24158 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:25.526684 22270 rpcz_store.cc:276] 0709 12:10:24.175615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.524163 (+1348548us) service_pool.cc:224] Handling call
0709 12:10:25.524481 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.524661 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.524688 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.524731 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:25.524763 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.525976 (+  1213us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.526129 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.452270 24102 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.534538 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 192) took 1026 ms. Trace:
I20260709 12:10:25.490862 24107 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.535069 22270 rpcz_store.cc:276] 0709 12:10:24.508130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.533689 (+1025559us) service_pool.cc:224] Handling call
0709 12:10:25.534014 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.534193 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.534220 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.534265 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.534298 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.534363 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.534482 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.515074 23903 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.557399 24075 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.532382 24174 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:25.562537 24075 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.577576 24006 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:25.581894 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 76991.5us
I20260709 12:10:25.625030 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:25.631779 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:25.660240 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:25.660416 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:25.662063 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:25.662238 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:25.663375 24008 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.664040 24008 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.681056 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:25.565771 24031 consensus_meta.cc:287] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.938s	user 0.011s	sys 0.002s
I20260709 12:10:25.698104 22121 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:25.717142 22237 leader_election.cc:336] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Timed out: RequestConsensusVote RPC to 127.20.102.196:42539 timed out after 1.859s (SENT)
I20260709 12:10:25.549034 23984 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.580665 23790 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.666818 24106 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.723191 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:25.779776 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:25.679116 24171 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:25.780917 22120 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:25.722033 23984 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.747659 23788 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:25.722167 24008 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.720891 23957 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.795943 24075 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.724722 24106 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:25.783217 24013 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.907642 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:57876 (request call id 76) took 3563 ms. Trace:
I20260709 12:10:25.913223 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:25.914976 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:25.915863 22197 raft_consensus.cc:2410] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:25.916707 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:25.908352 22269 rpcz_store.cc:276] 0709 12:10:22.344205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.776626 (+432421us) service_pool.cc:224] Handling call
0709 12:10:25.907248 (+3130622us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b540036bd54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc8735 00007fcceddc09fa 00007fccf2d884c9 00007fccec304c54 00007fccec304be2 00007fccec304b11 00007fccec304a8c 00007fccec303d42 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:25.907507 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":943264640}
I20260709 12:10:25.918051 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:25.919157 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:25.920647 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:25.920763 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:25.921415 22198 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:25.924597 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:25.925457 22197 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:25.927340 24106 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:25.783488 23986 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
W20260709 12:10:25.809224 22264 consensus_meta.cc:287] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 12:10:25.932895 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:25.957077 24109 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 2.546s	user 0.016s	sys 0.025s
I20260709 12:10:25.957398 24024 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:25.966391 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:25.967747 22198 raft_consensus.cc:2410] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:25.791126 24171 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:25.923516 23957 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:25.958395 24158 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:25.981531 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:25.933750 22264 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:25.922931 24013 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.001938 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:26.012650 23980 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:26.013260 23980 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:26.014436 23980 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:26.015120 24141 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:26.015664 23980 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:25.993103 22266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.004s	sys 0.030s
I20260709 12:10:25.972285 24157 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:26.056468 24146 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:26.061837 24154 consensus_meta.cc:287] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.004s
I20260709 12:10:26.068397 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:26.062489 24154 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:25.999179 22264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 191) took 1490 ms (client timeout 1958 ms). Trace:
W20260709 12:10:26.041096 22266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.005s	sys 0.030s
W20260709 12:10:26.107337 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.110069 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1519) took 1949 ms. Trace:
W20260709 12:10:26.114296 22831 connection.cc:256] RPC call timeout handler was delayed by -1.6071400240000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 12:10:26.112416 22120 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.113480 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:26.084267 22191 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:26.116351 22831 connection.cc:256] RPC call timeout handler was delayed by -1.456493552999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
W20260709 12:10:26.117223 22831 connection.cc:256] RPC call timeout handler was delayed by -1.1738935529999708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2535s for a response
I20260709 12:10:26.119750 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:26.120853 22861 raft_consensus.cc:2393] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:26.122661 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:26.123886 22862 raft_consensus.cc:2410] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:26.129249 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:26.131383 24171 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:26.146899 22263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.029s	sys 0.086s
W20260709 12:10:26.148857 22263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.030s	sys 0.086s
W20260709 12:10:26.150332 22268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.071s	user 0.016s	sys 0.037s
W20260709 12:10:26.150960 22268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.016s	sys 0.038s
W20260709 12:10:26.152007 24163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.046s	sys 0.064s
W20260709 12:10:26.150272 23880 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.000s	sys 0.001s
W20260709 12:10:26.153668 23880 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.001s	sys 0.001s
W20260709 12:10:26.149535 22267 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.019s	sys 0.034s
W20260709 12:10:26.157222 22267 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.019s	sys 0.034s
I20260709 12:10:26.151938 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1514) took 2008 ms. Trace:
I20260709 12:10:26.158517 22268 rpcz_store.cc:276] 0709 12:10:24.143838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.040155 (+896317us) service_pool.cc:224] Handling call
0709 12:10:25.040481 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.040733 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:25.078976 (+ 38243us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.151474 (+1072498us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.151546 (+    72us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.151599 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.151678 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.151865 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":99992,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":3449,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":157,"thread_start_us":1072056,"threads_started":1}
I20260709 12:10:26.194164 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:26.061861 23975 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:26.196146 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:26.199674 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:26.200382 22198 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:26.201311 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:26.193944 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:26.203305 22863 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:26.204018 22193 raft_consensus.cc:2410] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:26.136739 24169 consensus_meta.cc:287] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
W20260709 12:10:26.206674 22238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.265s	user 0.024s	sys 0.028s
I20260709 12:10:26.212911 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:26.212687 22238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.271s	user 0.024s	sys 0.028s
W20260709 12:10:26.218111 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.138636 24166 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.213800 22198 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:26.220347 22198 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:26.138545 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:26.140576 24031 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.222226 22198 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:26.151638 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1510) took 2009 ms. Trace:
W20260709 12:10:26.109459 22264 rpcz_store.cc:269] 0709 12:10:24.507699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.668035 (+160336us) service_pool.cc:224] Handling call
0709 12:10:25.997659 (+1329624us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:26.298875 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:26.299674 22268 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 1.
I20260709 12:10:26.199294 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:26.310632 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:26.311749 22268 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 1.
I20260709 12:10:26.272324 22831 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:26.303392 22269 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:26.152990 24163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.047s	sys 0.064s
I20260709 12:10:26.320760 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:26.269713 22119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.132s	user 0.016s	sys 0.039s
I20260709 12:10:26.222592 24169 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.282714 22263 rpcz_store.cc:276] 0709 12:10:24.142325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.228639 (+ 86314us) service_pool.cc:224] Handling call
0709 12:10:24.283031 (+ 54392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.347021 (+ 63990us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:24.680954 (+333933us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.150295 (+1469341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.151234 (+   939us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.151306 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.151406 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.151570 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":525781,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":285,"raft.queue_time_us":43010,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58,"thread_start_us":1677661,"threads_started":3,"wal-append.queue_time_us":714326}
I20260709 12:10:26.327999 24189 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.332226 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:26.333436 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:26.339166 22829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.499s	user 0.078s	sys 0.143s
W20260709 12:10:26.351867 22829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.512s	user 0.079s	sys 0.144s
I20260709 12:10:26.351886 22265 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:26.354384 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:26.324478 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52250.4us
I20260709 12:10:26.297008 24157 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.326985 23823 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.356856 22831 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:26.322603 24185 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.347335 22119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.225s	user 0.017s	sys 0.044s
I20260709 12:10:26.328419 23980 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.337090 24159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.129s	user 0.006s	sys 0.035s
W20260709 12:10:26.364176 22272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.010s	sys 0.004s
W20260709 12:10:26.360241 22830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.001s	sys 0.013s
I20260709 12:10:26.361603 22862 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:26.364500 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:26.269114 24184 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 12:10:26.283406 24166 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.369326 22866 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:26.384024 22830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.001s	sys 0.013s
I20260709 12:10:26.309526 24031 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.360006 24189 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:26.373700 24191 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:10:26.377130 24182 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.378986 24169 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:26.383494 24159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.007s	sys 0.036s
I20260709 12:10:26.379940 24154 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:26.359200 24136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.021s	sys 0.027s
W20260709 12:10:26.361694 24079 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.008s	sys 0.007s
W20260709 12:10:26.381464 22271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.000s	sys 0.015s
W20260709 12:10:26.381057 22858 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.094s	user 0.011s	sys 0.006s
W20260709 12:10:26.404247 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 985808us
I20260709 12:10:26.385360 22863 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 2: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:10:26.383774 22272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.011s	sys 0.005s
I20260709 12:10:26.364089 24157 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:26.383383 24155 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.663s	user 0.013s	sys 0.095s
I20260709 12:10:26.367362 23823 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:26.417842 22271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.000s	sys 0.015s
I20260709 12:10:26.405956 24013 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:26.423872 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1518) took 2279 ms. Trace:
W20260709 12:10:26.413676 24136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.022s	sys 0.028s
I20260709 12:10:26.367825 24185 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.381932 23980 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.432837 24157 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:26.418506 22858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.011s	sys 0.006s
W20260709 12:10:26.422816 24155 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.731s	user 0.013s	sys 0.096s
I20260709 12:10:26.436491 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:26.433032 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:26.437822 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1480) took 2548 ms. Trace:
W20260709 12:10:26.419943 24079 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.008s	sys 0.007s
I20260709 12:10:26.438637 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1468) took 2490 ms. Trace:
W20260709 12:10:26.439405 23984 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.647s	user 0.004s	sys 0.005s
I20260709 12:10:26.439354 22194 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:26.418850 23957 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.443581 22196 rpcz_store.cc:276] 0709 12:10:23.948709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.948857 (+   148us) service_pool.cc:224] Handling call
0709 12:10:23.993040 (+ 44183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.201172 (+208132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.438356 (+2237184us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400177d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:26.438552 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477042432}
I20260709 12:10:26.424005 24182 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.449172 22269 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:26.449404 22121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.002s	sys 0.020s
W20260709 12:10:26.449733 22121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.002s	sys 0.020s
I20260709 12:10:26.426256 22271 rpcz_store.cc:276] 0709 12:10:24.144906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.430397 (+1285491us) service_pool.cc:224] Handling call
0709 12:10:25.437272 (+  6875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.437554 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:25.458023 (+ 20469us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.423428 (+965405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.423488 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:26.423538 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.423609 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.423814 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":847,"prepare.queue_time_us":21292,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":12826,"raft.queue_time_us":1369,"thread_start_us":964957,"threads_started":1}
I20260709 12:10:26.441977 22117 rpcz_store.cc:276] 0709 12:10:23.889743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.210376 (+320633us) service_pool.cc:224] Handling call
0709 12:10:24.210742 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.497273 (+286531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.437538 (+1940265us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b5400327b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:26.437755 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188268800}
I20260709 12:10:26.447118 23958 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.448177 24185 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:26.455332 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:26.455927 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:26.457285 22196 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:26.410806 24174 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.006s	sys 0.014s
W20260709 12:10:26.468346 22087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.014s	sys 0.009s
W20260709 12:10:26.468839 22087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.015s	sys 0.009s
W20260709 12:10:26.469234 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 726728us
I20260709 12:10:26.470932 22269 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:26.470841 22196 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:26.473796 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:26.475250 22161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.789s	user 0.034s	sys 0.020s
W20260709 12:10:26.475819 22122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.021s	sys 0.019s
W20260709 12:10:26.476372 22122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.021s	sys 0.019s
I20260709 12:10:26.476598 22196 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:26.448997 24182 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:26.475749 22115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.005s	sys 0.018s
I20260709 12:10:26.483085 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:26.475756 22161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.789s	user 0.034s	sys 0.020s
W20260709 12:10:26.475549 24174 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.006s	sys 0.015s
I20260709 12:10:26.485585 22196 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:26.447139 23957 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.480155 24169 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.485893 22115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.005s	sys 0.019s
I20260709 12:10:26.490778 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:26.491804 22114 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.007s	sys 0.037s
I20260709 12:10:26.497133 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:26.510166 22087 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:26.570281 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60187.3us
I20260709 12:10:26.573413 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:26.511421 22118 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.023s	sys 0.029s
I20260709 12:10:26.482447 24182 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.481752 24136 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:10:26.481554 23984 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:10:26.605404 24083 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.606161 24083 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:26.556582 24184 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:26.606650 24083 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.607061 24184 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:26.511252 22114 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.007s	sys 0.037s
W20260709 12:10:26.569162 22007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f86b841ece254f9bbfd1bd07c08f7004 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:26.479270 24079 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:10:26.609647 24184 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:26.611059 24192 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:10:26.613489 24189 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:26.487404 24126 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:10:26.614444 24126 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.614912 24126 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:26.615798 24126 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:26.584321 23975 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.562948 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:26.617460 22863 raft_consensus.cc:2368] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:10:26.617272 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:26.618916 24136 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.619405 24136 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:26.619832 24136 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.621205 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1468) took 2713 ms. Trace:
I20260709 12:10:26.621713 22119 rpcz_store.cc:276] 0709 12:10:23.907819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.231947 (+324128us) service_pool.cc:224] Handling call
0709 12:10:24.362755 (+130808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.598693 (+235938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.603903 (+  5210us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.964286 (+360383us) log.cc:844] Serialized 508 byte log entry
0709 12:10:26.403076 (+1438790us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:26.406283 (+  3207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.410415 (+  4132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.620865 (+210450us) raft_consensus.cc:1685] finished
0709 12:10:26.620897 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.621128 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1251607,"threads_started":1,"wal-append.queue_time_us":1417146}
I20260709 12:10:26.598507 23957 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:26.623513 23957 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:26.624379 23979 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:26.624089 23957 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.603250 24193 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.626422 24193 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:26.627239 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56158 (request call id 84) took 1614 ms. Trace:
I20260709 12:10:26.627674 22189 rpcz_store.cc:276] 0709 12:10:25.012722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.327448 (+314726us) service_pool.cc:224] Handling call
0709 12:10:26.626928 (+1299480us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54002364d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc8735 00007fcceddc09fa 00007fccf2d884c9 00007fccec304c54 00007fccec304be2 00007fccec304b11 00007fccec304a8c 00007fccec303d42 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:26.627131 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357821824}
I20260709 12:10:26.557487 24185 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:26.628993 24185 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:26.629603 23957 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:26.630323 23957 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.574344 22118 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.024s	sys 0.029s
I20260709 12:10:26.508095 24169 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.605485 24146 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.600139 23980 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:26.631438 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:26.645865 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:26.583618 24171 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.643580 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:26.114418 22266 rpcz_store.cc:276] 0709 12:10:24.160885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.431878 (+1270993us) service_pool.cc:224] Handling call
0709 12:10:25.432304 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.432588 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:25.441165 (+  8577us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.109358 (+668193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.109452 (+    94us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:26.109531 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.109643 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.109984 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7633,"prepare.queue_time_us":5651,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2589,"raft.queue_time_us":4469,"thread_start_us":667699,"threads_started":1}
I20260709 12:10:26.628221 24136 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.631080 24126 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.656441 23958 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.643771 24193 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:26.638027 24146 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:26.671083 22192 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:26.661520 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1515) took 2517 ms. Trace:
W20260709 12:10:26.683892 22190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1471) took 2720 ms (client timeout 1718 ms). Trace:
W20260709 12:10:26.684566 22190 rpcz_store.cc:269] 0709 12:10:23.950097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.950533 (+   436us) service_pool.cc:224] Handling call
0709 12:10:26.670004 (+2719471us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b5400109fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:26.670184 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104285440}
I20260709 12:10:26.684257 22267 rpcz_store.cc:276] 0709 12:10:24.144091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.044100 (+900009us) service_pool.cc:224] Handling call
0709 12:10:25.079595 (+ 35495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.079896 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:26.157817 (+1077921us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.660937 (+503120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.661026 (+    89us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.661105 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.661226 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.661433 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69955,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":4335,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3341,"thread_start_us":1535936,"threads_started":2}
I20260709 12:10:26.692315 24083 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.645642 24079 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:10:26.637418 23957 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.647795 23984 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 12:10:26.701251 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.689255 23880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.032s
W20260709 12:10:26.732951 23880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.014s	sys 0.033s
I20260709 12:10:26.719862 24181 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.734747 24181 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.735523 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 408) took 3956 ms. Trace:
I20260709 12:10:26.736114 22858 rpcz_store.cc:276] 0709 12:10:22.779216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.779394 (+   178us) service_pool.cc:224] Handling call
0709 12:10:22.780002 (+   608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.780401 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.780432 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.278793 (+2498361us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4c0044cdc0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec08ea20 00007fccec09fa29 00007fccec065644 00007fccec08cf2d 00007fccec08cb93 00007fcceddbd18b 00007fcceddbdcb5 00007fcceddbf004 00007fcceddbe729 00007fcceddc3d96 00007fcceddb8adb
0709 12:10:25.286850 (+  8057us) log.cc:844] Serialized 508 byte log entry
0709 12:10:26.445468 (+1158618us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:26.446899 (+  1431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.447530 (+   631us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.735110 (+287580us) raft_consensus.cc:1685] finished
0709 12:10:26.735135 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.735421 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29118208,"thread_start_us":1152941,"threads_started":1,"wal-append.queue_time_us":1397373}
I20260709 12:10:26.739118 24146 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:26.656752 24171 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.743063 24171 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:26.727599 24031 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:26.721782 24185 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:26.723193 23922 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:26.744755 23922 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:26.745690 23922 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:26.746134 23975 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.747004 23922 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.747182 23975 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:26.665374 24199 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:10:26.749506 24181 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:26.750207 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1671) took 2581 ms. Trace:
I20260709 12:10:26.750778 22194 rpcz_store.cc:276] 0709 12:10:24.168711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.039954 (+871243us) service_pool.cc:224] Handling call
0709 12:10:26.438967 (+1399013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.445321 (+  6354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.749895 (+304574us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400177d50. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:26.750110 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3216617856}
I20260709 12:10:26.754335 24083 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:26.755074 24083 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.755537 24083 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:26.761672 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:26.763195 24171 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.763583 24183 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:26.763674 24171 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:26.764603 24183 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.764674 24171 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.727569 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1516) took 2583 ms. Trace:
I20260709 12:10:26.764981 24169 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:26.765488 22272 rpcz_store.cc:276] 0709 12:10:24.144318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.349984 (+1205666us) service_pool.cc:224] Handling call
0709 12:10:25.350405 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.362579 (+ 12174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.362628 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.379499 (+ 16871us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.418932 (+1039433us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:26.418976 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.419069 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.727291 (+308222us) raft_consensus.cc:1685] finished
0709 12:10:26.727319 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.727495 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7022,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":16447,"thread_start_us":994298,"threads_started":1,"wal-append.queue_time_us":1255816}
I20260709 12:10:26.728873 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1672) took 2559 ms. Trace:
I20260709 12:10:26.767331 22192 rpcz_store.cc:276] 0709 12:10:24.168966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.042908 (+873942us) service_pool.cc:224] Handling call
0709 12:10:26.670614 (+1627706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.682867 (+ 12253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.728632 (+ 45765us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400109fd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:26.728804 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3742433664}
I20260709 12:10:26.763698 24184 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:26.768795 24184 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:26.769135 24184 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:26.770027 24184 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:26.771694 24184 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.765074 24183 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:26.773823 24183 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:26.775193 24183 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.724985 24159 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.713654 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 280) took 2584 ms. Trace:
I20260709 12:10:26.782378 22195 rpcz_store.cc:276] 0709 12:10:24.129530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.039164 (+909634us) service_pool.cc:224] Handling call
0709 12:10:25.079482 (+ 40318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.192683 (+113201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.192732 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.192811 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:25.192858 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.713301 (+1520443us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001bf3d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:26.713371 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.713571 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259705728}
I20260709 12:10:26.747951 23975 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:26.804716 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.792444 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:26.813120 24166 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:26.708845 24196 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:10:26.790349 24004 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:26.769289 23823 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:26.826174 23975 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:26.846328 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1680) took 2652 ms. Trace:
I20260709 12:10:26.852365 22191 rpcz_store.cc:276] 0709 12:10:24.193450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.129996 (+936546us) service_pool.cc:224] Handling call
0709 12:10:25.130371 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.115857 (+985486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.845921 (+730064us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b5400109ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:26.846233 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193069952}
I20260709 12:10:25.263857 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:26.846894 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.838793 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 46460.3us
W20260709 12:10:26.849809 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.854851 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:26.826881 24185 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:26.860235 22831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.009s	sys 0.029s
W20260709 12:10:26.871685 22831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.009s	sys 0.029s
W20260709 12:10:26.873306 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 516560us
I20260709 12:10:26.825810 24004 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:26.862437 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:26.878530 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:26.884398 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:26.809096 24159 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:26.924104 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:26.898006 24176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.748s	user 0.005s	sys 0.022s
I20260709 12:10:26.866175 24185 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:26.869609 24006 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.967489 22272 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:26.967952 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44665.2us
I20260709 12:10:26.870079 24151 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.969519 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.002645 22266 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:26.970182 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.003887 22863 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:26.965533 23979 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:10:27.006639 24151 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:27.007242 24151 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.009929 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1497) took 1289 ms. Trace:
I20260709 12:10:27.010437 22115 rpcz_store.cc:276] 0709 12:10:25.720482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.730387 (+  9905us) service_pool.cc:224] Handling call
0709 12:10:25.730847 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.731296 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.731331 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.731931 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.560497 (+828566us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.565454 (+  4957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.584990 (+ 19536us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.009654 (+424664us) raft_consensus.cc:1685] finished
0709 12:10:27.009690 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.009858 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4160,"raft.queue_time_us":1312,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3935,"thread_start_us":776075,"threads_started":1,"wal-append.queue_time_us":1119169}
I20260709 12:10:27.013437 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:26.969657 24189 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.014195 22270 raft_consensus.cc:2376] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3. Re-sending same reply.
I20260709 12:10:27.014386 24189 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:27.015010 24189 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.016722 24159 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:26.974273 22269 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:26.896358 24167 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.897459 24166 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:27.046572 24166 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.047384 24166 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:27.051523 24208 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:27.057664 22263 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:27.059511 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:27.064090 24004 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:27.065037 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.065829 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.065937 24146 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.066550 22857 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:27.067478 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.068362 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.069582 22864 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:27.069780 24157 raft_consensus.cc:2955] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:26.899605 23980 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:10:27.071811 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1687) took 1265 ms. Trace:
I20260709 12:10:27.072228 22193 rpcz_store.cc:276] 0709 12:10:25.806328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.214153 (+407825us) service_pool.cc:224] Handling call
0709 12:10:26.214531 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.229161 (+ 14630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.229201 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.268641 (+ 39440us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.644879 (+376238us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:26.644921 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.644985 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.071569 (+426584us) raft_consensus.cc:1685] finished
0709 12:10:27.071594 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.071749 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14059,"raft.queue_time_us":14264,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":3435,"thread_start_us":300891,"threads_started":1,"wal-append.queue_time_us":646475}
I20260709 12:10:27.073163 22267 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:26.982894 24176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.823s	user 0.005s	sys 0.023s
W20260709 12:10:27.080600 22866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.009s	sys 0.018s
W20260709 12:10:27.082551 22866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.009s	sys 0.018s
I20260709 12:10:27.076588 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1502) took 1326 ms. Trace:
W20260709 12:10:27.077186 22198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.002s	sys 0.036s
I20260709 12:10:26.972239 24031 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.900673 24124 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:10:27.060645 22263 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:27.076444 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51628.4us
I20260709 12:10:27.110499 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:27.086184 22198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.002s	sys 0.036s
I20260709 12:10:26.900038 24193 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 12:10:26.980545 24083 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:26.985347 24185 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.075269 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:27.112367 22272 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:27.125149 22268 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.111238 22266 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:27.021473 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.073628 24167 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.130414 22863 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:27.134233 22122 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.021s	sys 0.015s
W20260709 12:10:27.135649 22122 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.021s	sys 0.015s
I20260709 12:10:27.104218 24031 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:27.139169 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1498) took 1402 ms. Trace:
I20260709 12:10:27.023773 24006 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:27.131881 24136 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:27.113507 24004 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:27.138114 24155 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.014s	sys 0.030s
I20260709 12:10:27.132970 24167 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.157219 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:27.160115 22863 raft_consensus.cc:2376] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4. Re-sending same reply.
I20260709 12:10:27.160566 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.161214 22270 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:27.147912 24031 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.142577 22122 rpcz_store.cc:276] 0709 12:10:25.737218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.737398 (+   180us) service_pool.cc:224] Handling call
0709 12:10:25.737881 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.741536 (+  3655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.741575 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.742098 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.478202 (+736104us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:27.137629 (+659427us) log.cc:844] Serialized 14 byte log entry
0709 12:10:27.138829 (+  1200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.138917 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.138962 (+    45us) raft_consensus.cc:1685] finished
0709 12:10:27.138973 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.139108 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4063,"prepare.queue_time_us":524307,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":6555,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":40287,"thread_start_us":1381885,"threads_started":2,"wal-append.queue_time_us":1113504}
I20260709 12:10:27.163228 22268 raft_consensus.cc:2410] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:27.161594 24155 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.014s	sys 0.031s
W20260709 12:10:27.179466 24182 consensus_meta.cc:287] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 12:10:27.180086 24182 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:27.182083 24126 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 12:10:27.186307 24006 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:27.189996 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.152415 23957 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:27.193149 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.193354 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.210835 22863 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:27.194841 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:27.179517 24212 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:10:27.194103 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.214310 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.223161 22861 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:27.215386 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.215570 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.153853 24004 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:27.226307 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:27.227042 22121 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.006s	sys 0.049s
I20260709 12:10:27.219987 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:27.227381 22121 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.006s	sys 0.049s
I20260709 12:10:27.227905 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.228847 22865 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:27.227280 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.230016 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1496) took 1517 ms. Trace:
I20260709 12:10:27.230367 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.230808 22862 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:27.231302 22266 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:27.223305 22863 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:10:27.197077 22114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.009s	sys 0.038s
I20260709 12:10:27.085074 22118 rpcz_store.cc:276] 0709 12:10:25.750495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.798209 (+ 47714us) service_pool.cc:224] Handling call
0709 12:10:25.798882 (+   673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.799120 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:26.631888 (+832768us) log.cc:844] Serialized 14 byte log entry
0709 12:10:27.076208 (+444320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:27.076276 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:27.076331 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.076400 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.076512 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":960,"prepare.queue_time_us":1096798,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":121,"spinlock_wait_cycles":108672,"thread_start_us":1184162,"threads_started":2}
I20260709 12:10:27.230031 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.227792 22268 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:27.236883 22830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.022s	sys 0.039s
W20260709 12:10:27.237406 22830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.022s	sys 0.039s
W20260709 12:10:27.235132 22087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.024s	sys 0.032s
I20260709 12:10:27.238903 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:27.241039 22087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.024s	sys 0.032s
I20260709 12:10:27.244696 22862 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:10:27.243808 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 799189us
I20260709 12:10:27.225596 22859 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.252828 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.248021 24085 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.235484 22114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.009s	sys 0.038s
I20260709 12:10:27.249233 22270 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:27.230427 22121 rpcz_store.cc:276] 0709 12:10:25.712917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.713111 (+   194us) service_pool.cc:224] Handling call
0709 12:10:25.713560 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.733552 (+ 19992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.733600 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.734169 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.450076 (+715907us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:27.229349 (+779273us) log.cc:844] Serialized 14 byte log entry
0709 12:10:27.229673 (+   324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.229759 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.229803 (+    44us) raft_consensus.cc:1685] finished
0709 12:10:27.229819 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.229955 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19483,"prepare.queue_time_us":521823,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":16595,"raft.queue_time_us":27565,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":3729,"thread_start_us":1409235,"threads_started":2,"wal-append.queue_time_us":1178990}
I20260709 12:10:27.195963 24185 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:27.254837 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:27.258436 22235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.019s	sys 0.055s
W20260709 12:10:27.261857 22235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.019s	sys 0.055s
I20260709 12:10:27.268359 22268 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:27.236567 24144 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:27.259882 22089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.017s	sys 0.030s
I20260709 12:10:27.275375 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:10:27.247668 24174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.004s	sys 0.055s
W20260709 12:10:27.272840 22189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.021s	sys 0.027s
W20260709 12:10:27.257149 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.275805 22089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.017s	sys 0.030s
I20260709 12:10:27.277225 23979 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.277369 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.312515 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.277894 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:27.278254 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.278527 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.313445 22266 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.278908 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:27.271061 22196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.011s	sys 0.036s
W20260709 12:10:27.314172 22196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.011s	sys 0.036s
I20260709 12:10:27.244506 23957 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.304751 22189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.021s	sys 0.027s
I20260709 12:10:27.306834 22862 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:27.316188 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.307524 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.309420 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:27.317184 22865 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:27.314234 22272 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
W20260709 12:10:27.319600 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.320901 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47306.2us
I20260709 12:10:27.324879 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:27.325140 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.327263 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:27.257421 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:27.318310 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:27.269851 23980 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.339726 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.274806 24193 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.345798 22086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.006s	sys 0.022s
W20260709 12:10:27.354059 22086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.006s	sys 0.022s
I20260709 12:10:27.328545 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:27.330878 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:27.333806 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:27.339416 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:27.355371 22193 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:27.356336 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:27.357381 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:27.358448 22190 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:27.329417 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.346931 22191 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 12:10:27.359351 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:27.360623 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:27.361398 22191 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:27.362473 24030 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:10:27.362779 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.363616 22858 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:27.314832 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:27.347325 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.365109 22270 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:27.365185 23980 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:27.366055 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.366720 22270 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:27.367555 23980 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:27.368214 22264 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:27.345899 22197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.012s	sys 0.015s
W20260709 12:10:27.369083 22197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.012s	sys 0.015s
I20260709 12:10:27.367585 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:27.369768 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:27.370230 22270 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.371184 22267 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:27.371855 24215 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:27.372126 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.373538 24215 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:27.374116 24215 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:27.375142 24215 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:27.377044 22267 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:27.378384 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:27.304553 24174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.004s	sys 0.056s
I20260709 12:10:27.379103 22267 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:27.402657 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.403676 22267 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:27.379118 22193 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:27.360168 22190 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:27.404533 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.405900 22267 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
W20260709 12:10:27.345850 22088 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.013s	sys 0.014s
I20260709 12:10:27.382702 22270 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:27.407341 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:27.408237 22270 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:27.409106 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.410277 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:27.410918 22270 raft_consensus.cc:2376] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3. Re-sending same reply.
W20260709 12:10:27.412099 22088 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.013s	sys 0.014s
W20260709 12:10:27.413046 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 623356us
W20260709 12:10:27.415838 22088 connection.cc:256] RPC call timeout handler was delayed by -1.2307631629998923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
W20260709 12:10:27.420018 22088 connection.cc:256] RPC call timeout handler was delayed by -1.137766160999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 12:10:27.421403 22088 connection.cc:256] RPC call timeout handler was delayed by -1.1318989789999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
I20260709 12:10:27.423417 24146 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:27.425596 24146 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:27.431461 24126 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.432066 24126 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:27.382037 24193 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:27.437686 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.438432 22269 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:27.439334 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.445003 23975 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.448097 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:27.448647 22866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 433) took 1035 ms. Trace:
I20260709 12:10:27.448892 22115 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.449079 22866 rpcz_store.cc:276] 0709 12:10:26.413686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.413872 (+   186us) service_pool.cc:224] Handling call
0709 12:10:26.433724 (+ 19852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.434112 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.434139 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.434573 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.084676 (+650103us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:27.084721 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.084811 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.448367 (+363556us) raft_consensus.cc:1685] finished
0709 12:10:27.448390 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.448580 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":1247,"thread_start_us":638343,"threads_started":1,"wal-append.queue_time_us":1005798}
I20260709 12:10:27.344147 24181 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.454725 24181 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.455199 24181 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.323419 23979 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:27.326313 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:27.476330 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 90069.6us
W20260709 12:10:27.481215 22088 connection.cc:256] RPC call timeout handler was delayed by -1.1174989789999472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 12:10:27.452910 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.484910 22269 raft_consensus.cc:2410] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:10:27.343863 24079 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.506412 24079 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:27.506737 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 281) took 1087 ms. Trace:
I20260709 12:10:27.324599 23957 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:27.510574 23957 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:27.511297 22861 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:27.515690 24171 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.001s
I20260709 12:10:27.521145 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:27.343693 24206 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.499765 23868 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:27.344259 24081 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:27.502612 22264 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:27.270527 24085 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:27.427825 24151 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:27.967772 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:27.623309 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 144878us
I20260709 12:10:27.908977 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1708) took 1276 ms. Trace:
I20260709 12:10:28.095340 22119 raft_consensus.cc:1813] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
W20260709 12:10:27.878458 22237 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.047s	sys 0.091s
W20260709 12:10:28.097347 22237 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.128s	user 0.047s	sys 0.100s
I20260709 12:10:27.530879 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:27.787258 22163 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.009s	sys 0.010s
I20260709 12:10:28.098165 22120 raft_consensus.cc:2410] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:28.097371 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.530411 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:28.101282 22268 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
W20260709 12:10:28.098410 22163 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.009s	sys 0.011s
W20260709 12:10:28.102334 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 991069us
W20260709 12:10:27.822501 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 504201us
I20260709 12:10:27.586979 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:28.097802 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 1.16255e+06us
W20260709 12:10:28.106715 22237 connection.cc:256] RPC call timeout handler was delayed by -1.0572917360000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 12:10:28.107442 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.507344 22198 rpcz_store.cc:276] 0709 12:10:26.419567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.419788 (+   221us) service_pool.cc:224] Handling call
0709 12:10:26.420209 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.425109 (+  4900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.425140 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.435328 (+ 10188us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.111552 (+676224us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:27.137230 (+ 25678us) log.cc:844] Serialized 14 byte log entry
0709 12:10:27.137523 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.137609 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.506409 (+368800us) raft_consensus.cc:1685] finished
0709 12:10:27.506444 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.506652 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":411,"prepare.queue_time_us":25455,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":8990,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":10314,"thread_start_us":675017,"threads_started":1,"wal-append.queue_time_us":942708}
I20260709 12:10:28.098489 22119 raft_consensus.cc:2410] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:28.091995 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:28.092192 22266 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.778s	user 0.009s	sys 0.000s
I20260709 12:10:28.109009 22270 raft_consensus.cc:1813] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
I20260709 12:10:28.109289 22266 raft_consensus.cc:2410] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:28.109859 22270 raft_consensus.cc:2410] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:28.094074 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:28.092324 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.524511 22122 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:28.110740 22267 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:28.096093 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:27.927731 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1710) took 1294 ms. Trace:
I20260709 12:10:28.111085 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:28.111797 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:28.095544 22196 rpcz_store.cc:276] 0709 12:10:26.632829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.632946 (+   117us) service_pool.cc:224] Handling call
0709 12:10:26.637708 (+  4762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.638672 (+   964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.638727 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.639461 (+   734us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.314671 (+675210us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:27.314743 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.314834 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.908677 (+593843us) raft_consensus.cc:1685] finished
0709 12:10:27.908702 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.908897 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6260,"raft.queue_time_us":1566,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":3966,"thread_start_us":625131,"threads_started":1,"wal-append.queue_time_us":1242262}
I20260709 12:10:28.111631 22197 rpcz_store.cc:276] 0709 12:10:26.633413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.650813 (+ 17400us) service_pool.cc:224] Handling call
0709 12:10:26.651161 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.662942 (+ 11781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.662985 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.668574 (+  5589us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.369449 (+700875us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:27.369493 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.369566 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.927467 (+557901us) raft_consensus.cc:1685] finished
0709 12:10:27.927492 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.927656 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12052,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":3519,"thread_start_us":661140,"threads_started":1,"wal-append.queue_time_us":1236178}
I20260709 12:10:28.112740 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:27.508510 24079 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.163723 22121 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:28.162539 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 54198.8us
I20260709 12:10:28.129748 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:28.167423 22236 connection.cc:256] RPC call timeout handler was delayed by -2.5592634679999264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 12:10:28.170558 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:28.171443 22269 raft_consensus.cc:2410] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:28.172706 22236 connection.cc:256] RPC call timeout handler was delayed by -2.3650600729999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2539s for a response
W20260709 12:10:28.173457 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.152235 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.115893 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:28.174108 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:28.170105 22268 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.175562 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:28.112463 22267 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
W20260709 12:10:27.944617 24031 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.749s	user 0.006s	sys 0.004s
W20260709 12:10:27.940164 24167 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.762s	user 0.006s	sys 0.002s
I20260709 12:10:27.558440 22860 raft_consensus.cc:2393] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:10:28.035715 24157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.006s
W20260709 12:10:27.856199 24184 consensus_meta.cc:287] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.084s	user 0.011s	sys 0.006s
W20260709 12:10:27.682422 24189 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.000s
W20260709 12:10:27.946424 22859 consensus_meta.cc:287] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.000s
I20260709 12:10:28.094419 24074 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:27.516481 24171 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:27.797115 24219 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.621114 23922 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:28.200250 22268 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:27.791500 24182 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.188880 24079 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:28.187466 24083 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.201164 24157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.007s	sys 0.016s
I20260709 12:10:27.912333 24181 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:27.585544 24166 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.172073 24206 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:28.203297 24185 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:28.193496 24031 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.205472 24180 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:28.162693 24081 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:28.210157 24079 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:28.195019 24167 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:28.205706 24189 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:28.234035 24193 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:28.231931 24083 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:28.236742 24126 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.209744 24219 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.258984 24171 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.261598 24167 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:28.240933 24185 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 12:10:28.320546 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 224271us
W20260709 12:10:28.333717 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.337368 22088 connection.cc:256] RPC call timeout handler was delayed by -1.0522661610000341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 12:10:28.338660 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.339759 22019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 252) took 8314 ms. Trace:
I20260709 12:10:28.343979 22088 leader_election.cc:400] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
W20260709 12:10:27.952646 22115 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.000s
I20260709 12:10:27.465291 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1500) took 1724 ms. Trace:
I20260709 12:10:28.351663 22088 leader_election.cc:403] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:28.352016 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:28.351517 22115 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:28.179790 22118 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:28.355545 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 183) took 1038 ms. Trace:
I20260709 12:10:28.356094 22115 rpcz_store.cc:276] 0709 12:10:27.317311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.339748 (+ 22437us) service_pool.cc:224] Handling call
0709 12:10:28.355397 (+1015649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.351477 22114 rpcz_store.cc:276] 0709 12:10:25.740698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.741856 (+  1158us) service_pool.cc:224] Handling call
0709 12:10:25.798755 (+ 56899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.799011 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:26.609219 (+810208us) log.cc:844] Serialized 14 byte log entry
0709 12:10:27.317351 (+708132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:27.322461 (+  5110us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:27.341832 (+ 19371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.352074 (+ 10242us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.395662 (+ 43588us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3072,"prepare.queue_time_us":1070752,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":39761,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9672,"spinlock_wait_cycles":58752,"thread_start_us":1461536,"threads_started":2,"wal-append.queue_time_us":1324354}
I20260709 12:10:28.355600 22117 raft_consensus.cc:2393] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:28.357928 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:28.354429 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:28.363559 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:28.364725 22123 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:28.358938 22119 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:28.359975 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:28.366844 22120 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
W20260709 12:10:28.191120 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59057.6us
I20260709 12:10:28.369498 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1715) took 1041 ms. Trace:
I20260709 12:10:28.370015 22192 rpcz_store.cc:276] 0709 12:10:27.327533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.327667 (+   134us) service_pool.cc:224] Handling call
0709 12:10:27.364415 (+ 36748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.364755 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.364804 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.365240 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.517842 (+152602us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b48000ce358. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf2cebaa1 00007fccf2ce2b37 00007fccf2ce29ca 00007fccf2dda26f 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508 00007fccf2dee488 00007fccf2dee443 00007fccf2ded6ec 00007fccf1d17a96
0709 12:10:27.696403 (+178561us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:27.696468 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.696569 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.368560 (+671991us) raft_consensus.cc:1685] finished
0709 12:10:28.368608 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.369118 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1019,"raft.run_cpu_time_us":1642,"raft.run_wall_time_us":152273,"spinlock_wait_cycles":184578944,"thread_start_us":330725,"threads_started":1,"wal-append.queue_time_us":890763}
W20260709 12:10:28.371923 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.376425 22191 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.378309 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 291) took 1038 ms. Trace:
I20260709 12:10:28.378722 22191 rpcz_store.cc:276] 0709 12:10:27.340067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.362083 (+ 22016us) service_pool.cc:224] Handling call
0709 12:10:27.364313 (+  2230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.377130 (+1012817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.377952 (+   822us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000fcdd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:28.378242 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326196096}
W20260709 12:10:28.176868 22236 connection.cc:256] RPC call timeout handler was delayed by -1.8814357459998519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
W20260709 12:10:28.393143 22236 connection.cc:256] RPC call timeout handler was delayed by -1.7033343390000937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2429s for a response
W20260709 12:10:28.393865 22236 connection.cc:256] RPC call timeout handler was delayed by -1.7033343390000937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2429s for a response
W20260709 12:10:28.394345 22236 connection.cc:256] RPC call timeout handler was delayed by -1.4011458989998573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2979s for a response
W20260709 12:10:28.395008 22236 connection.cc:256] RPC call timeout handler was delayed by -1.2391480520000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 12:10:28.395514 22236 connection.cc:256] RPC call timeout handler was delayed by -1.0582480519999535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
I20260709 12:10:28.348378 22019 rpcz_store.cc:276] 0709 12:10:20.025351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.032541 (+  7190us) service_pool.cc:224] Handling call
0709 12:10:28.339367 (+8306826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:23.306122 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:23.306748 (+   626us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:23.306790 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:10:23.306807 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:23.627952 (+321145us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:23.630023 (+  2071us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:23.630070 (+    47us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:10:23.631590 (+  1520us) tablet.cc:701] Row locks acquired
0709 12:10:23.631611 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:23.631827 (+   216us) write_op.cc:270] Start()
0709 12:10:23.631994 (+   167us) write_op.cc:276] Timestamp: P: 1783599023631757 usec, L: 0
0709 12:10:23.632018 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:23.698085 (+ 66067us) log.cc:844] Serialized 4842 byte log entry
0709 12:10:24.221724 (+523639us) op_driver.cc:464] REPLICATION: finished
0709 12:10:24.675357 (+453633us) write_op.cc:301] APPLY: starting
0709 12:10:24.677277 (+  1920us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:24.995315 (+318038us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:25.009555 (+ 14240us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:25.138970 (+129415us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:25.148697 (+  9727us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:10:25.148888 (+   191us) write_op.cc:312] APPLY: finished
0709 12:10:25.149342 (+   454us) log.cc:844] Serialized 89 byte log entry
0709 12:10:25.149538 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:25.149719 (+   181us) write_op.cc:454] Released schema lock
0709 12:10:25.149794 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:25.150223 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:25.150259 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1240,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":423847,"apply.run_cpu_time_us":5651,"apply.run_wall_time_us":490694,"num_ops":12,"prepare.queue_time_us":318407,"prepare.run_cpu_time_us":53884,"prepare.run_wall_time_us":521320,"raft.queue_time_us":304799,"raft.run_cpu_time_us":38071,"raft.run_wall_time_us":363283,"replication_time_us":589566,"spinlock_wait_cycles":54528,"thread_start_us":719837,"threads_started":4,"wal-append.queue_time_us":183419,"wal-append.run_cpu_time_us":12638,"wal-append.run_wall_time_us":2245617}]]}
I20260709 12:10:28.400138 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:28.205946 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:28.438490 24113 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.438558 24184 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:28.439275 24113 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.439697 24113 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.439644 24184 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.200821 22860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 421) took 1009 ms. Trace:
I20260709 12:10:28.239748 24004 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:28.450486 22265 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:28.451710 22271 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:28.452912 24206 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.210742 23922 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:27.587198 22263 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:28.452260 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1547) took 1168 ms. Trace:
W20260709 12:10:28.462446 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 62553.2us
I20260709 12:10:28.463882 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:28.464761 24219 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.460711 22264 rpcz_store.cc:276] 0709 12:10:27.283631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.449681 (+1166050us) service_pool.cc:224] Handling call
0709 12:10:28.450773 (+  1092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.451477 (+   704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.451518 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.451589 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.451652 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.451750 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.451940 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.467335 24166 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.469579 24079 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:28.473026 22864 raft_consensus.cc:2368] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
I20260709 12:10:28.474021 23975 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.474907 23975 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:28.475894 22864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 416) took 1286 ms (client timeout 1529 ms). Trace:
I20260709 12:10:28.479547 24083 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.480298 22859 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:28.481813 24151 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:28.485402 24031 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.488977 22860 rpcz_store.cc:276] 0709 12:10:27.191116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.209475 (+ 18359us) service_pool.cc:224] Handling call
0709 12:10:28.200710 (+991235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.491526 24181 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.464347 24081 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:28.493239 22864 rpcz_store.cc:269] 0709 12:10:27.189537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.189672 (+   135us) service_pool.cc:224] Handling call
0709 12:10:28.475601 (+1285929us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54004d3854. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:28.475810 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2784537856}
W20260709 12:10:28.500269 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 125174us
I20260709 12:10:28.465059 23868 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.246518 24180 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.531608 24206 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.560734 24232 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.561048 23868 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:28.561998 23922 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.563995 24252 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:28.555393 22859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 418) took 1363 ms. Trace:
I20260709 12:10:28.578754 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 201) took 1314 ms. Trace:
I20260709 12:10:28.579375 22263 rpcz_store.cc:276] 0709 12:10:27.223848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.225825 (+  1977us) service_pool.cc:224] Handling call
0709 12:10:28.534979 (+1309154us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:28.581216 22265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1664) took 1602 ms (client timeout 1636 ms). Trace:
I20260709 12:10:28.581346 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:28.581771 22265 rpcz_store.cc:269] 0709 12:10:26.978698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.978899 (+   201us) service_pool.cc:224] Handling call
0709 12:10:28.580835 (+1601936us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400083c54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:28.581131 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3108797824}
W20260709 12:10:28.584347 22271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1663) took 1606 ms (client timeout 1883 ms). Trace:
W20260709 12:10:28.585031 22271 rpcz_store.cc:269] 0709 12:10:26.978095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.978298 (+   203us) service_pool.cc:224] Handling call
0709 12:10:28.583950 (+1605652us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000ea454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:28.584248 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3117166464}
I20260709 12:10:28.586894 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:28.588085 22271 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:28.593575 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 1.25679e+06us
I20260709 12:10:28.593778 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:28.583161 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:28.596248 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 132642us
I20260709 12:10:28.564852 24146 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.598866 22269 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:28.597069 22265 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.597849 22272 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:28.575043 24193 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.596678 24006 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:28.658588 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 407140us
I20260709 12:10:28.662559 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:28.663578 24146 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.576092 24167 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.170s
I20260709 12:10:28.572566 24225 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.208s
I20260709 12:10:28.564842 24252 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.583161 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:28.600629 24184 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.601495 24031 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.596999 24228 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.573966 22859 rpcz_store.cc:276] 0709 12:10:27.190202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.194356 (+  4154us) service_pool.cc:224] Handling call
0709 12:10:27.213308 (+ 18952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.522380 (+1309072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.553170 (+ 30790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.603247 23975 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:28.679013 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 324818us
I20260709 12:10:28.682463 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:28.684424 24157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:57876 (request call id 75) took 7137 ms. Trace:
I20260709 12:10:28.597095 24085 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.668740 23868 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.572712 24227 consensus_queue.cc:1059] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.208s
W20260709 12:10:28.685681 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.687173 23979 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:28.599501 24180 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.596251 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:28.723246 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 127205us
I20260709 12:10:28.599594 24079 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.676759 24006 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:10:28.731295 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 49257.5us
I20260709 12:10:28.731835 24215 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.732389 24215 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:28.732795 24215 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.745101 24184 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.745774 24184 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:28.745958 24074 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.007s
I20260709 12:10:28.746251 24184 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.746955 22116 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:28.747344 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:28.747776 24115 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.748255 24115 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:28.748908 24006 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.749087 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:28.750519 22237 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:28.752348 24254 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:28.753670 22271 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:28.755317 24254 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:28.755893 24228 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.758404 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:28.759126 24228 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.770120 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:28.771401 23868 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.771924 23868 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.771783 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:28.772491 23868 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.775641 23975 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:28.776212 23975 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:28.777794 23979 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:28.778677 23979 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:28.779358 24115 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.781611 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1543) took 1498 ms. Trace:
I20260709 12:10:28.712354 24157 rpcz_store.cc:276] 0709 12:10:21.516398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.516562 (+   164us) service_pool.cc:224] Handling call
0709 12:10:21.598126 (+ 81564us) log.cc:844] Serialized 508 byte log entry
0709 12:10:28.632479 (+7034353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15952,"raft.queue_time_us":1105,"raft.run_cpu_time_us":1609,"raft.run_wall_time_us":56446,"thread_start_us":46706,"threads_started":1,"wal-append.queue_time_us":197170,"wal-append.run_cpu_time_us":1871,"wal-append.run_wall_time_us":1001896}
I20260709 12:10:28.782162 22270 rpcz_store.cc:276] 0709 12:10:27.282542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.193448 (+910906us) service_pool.cc:224] Handling call
0709 12:10:28.195193 (+  1745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.708909 (+513716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.712427 (+  3518us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.712475 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:28.712513 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.722463 (+  9950us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.781341 (+ 58878us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55209,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":3653,"thread_start_us":352451,"threads_started":1}
I20260709 12:10:28.656720 24181 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:10:28.784742 24189 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:28.785532 22265 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:28.721817 24193 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:10:28.786161 22007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 97ce44fb81b642f9ad6b0f0d68e82820 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:10:28.786648 22116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1477) took 4846 ms (client timeout 2429 ms). Trace:
I20260709 12:10:28.721091 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:28.787289 22116 rpcz_store.cc:269] 0709 12:10:23.940717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.142671 (+201954us) service_pool.cc:224] Handling call
0709 12:10:28.786333 (+4643662us) spinlock_profiling.cc:243] Waited 4.58 s on lock 0x7b54002c06d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:28.786517 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10530819968}
I20260709 12:10:28.787611 22265 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:28.753720 22263 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.789201 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1682) took 1147 ms. Trace:
I20260709 12:10:28.789486 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1540) took 1507 ms. Trace:
I20260709 12:10:28.790177 22269 rpcz_store.cc:276] 0709 12:10:27.281692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.183695 (+902003us) service_pool.cc:224] Handling call
0709 12:10:28.598443 (+414748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.654748 (+ 56305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.789284 (+134536us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b5400083c50. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:28.789425 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952725888}
I20260709 12:10:28.794021 24219 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.794453 24219 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.794828 24219 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.796792 24245 raft_consensus.cc:2764] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:28.724151 24031 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.806805 24189 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:28.807381 24031 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.797883 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:28.798556 24252 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.799206 24167 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:28.799810 24180 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:28.788290 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 97800.5us
I20260709 12:10:28.770278 24146 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.800849 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1541) took 1518 ms. Trace:
I20260709 12:10:28.789556 22265 rpcz_store.cc:276] 0709 12:10:27.641465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.786950 (+1145485us) service_pool.cc:224] Handling call
0709 12:10:28.787422 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.788913 (+  1491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.789124 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.792593 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1684) took 1068 ms. Trace:
I20260709 12:10:28.780418 24232 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:10:28.811751 22269 rpcz_store.cc:276] 0709 12:10:27.723991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.791277 (+1067286us) service_pool.cc:224] Handling call
0709 12:10:28.791737 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.792259 (+   522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.792287 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.792327 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.792359 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.792414 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.792517 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8440,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":170}
I20260709 12:10:28.818312 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:28.811628 22272 rpcz_store.cc:276] 0709 12:10:27.281974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.185453 (+903479us) service_pool.cc:224] Handling call
0709 12:10:28.597262 (+411809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.653514 (+ 56252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.788610 (+135096us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54000ea450. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:28.800787 (+ 12177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946067328}
W20260709 12:10:28.822583 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 51028.1us
W20260709 12:10:28.827183 24246 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.201s	user 0.000s	sys 0.007s
I20260709 12:10:28.833281 23975 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:28.836925 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 136013us
W20260709 12:10:28.837594 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.839079 23868 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.841552 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:28.843590 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:28.810667 24167 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.813184 24180 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.847071 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:57876 (request call id 77) took 1527 ms. Trace:
I20260709 12:10:28.852231 22268 rpcz_store.cc:276] 0709 12:10:27.286364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.485762 (+1199398us) service_pool.cc:224] Handling call
0709 12:10:28.808980 (+323218us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400289720. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd3f520 00007fcceddc8b42 00007fcceddc7800 00007fcceddc09fa 00007fccf2d884c9 00007fccec304c54 00007fccec304be2 00007fccec304b11 00007fccec304a8c 00007fccec303d42
0709 12:10:28.813325 (+  4345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436146432}
I20260709 12:10:28.851755 22237 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:28.845510 24228 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.859736 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:28.846799 24181 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:28.854588 24180 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.852012 24167 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.860543 24031 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:28.857863 23979 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:28.864413 24228 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.880713 24181 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:28.882790 24228 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.882920 24174 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.883411 24174 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.883816 24174 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.886097 24006 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:28.887691 22263 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:28.888953 24259 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:28.889586 24259 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:28.890069 24259 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.892892 24189 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:28.893065 24031 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:28.893487 24189 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.844822 24113 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:28.894695 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 83378.3us
I20260709 12:10:28.929088 24189 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.930117 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:28.931978 24199 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.932370 24199 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.932693 24199 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.932876 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:28.933789 24232 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:28.934005 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.935127 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 71339.3us
I20260709 12:10:28.883538 24181 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.940507 24166 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:28.941372 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:28.946256 24180 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.897611 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:28.898257 24157 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:28.898815 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1537) took 1617 ms. Trace:
W20260709 12:10:28.881589 22007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f86b841ece254f9bbfd1bd07c08f7004 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:28.899053 24252 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:28.899464 24004 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:28.899551 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58155.5us
I20260709 12:10:28.899825 24245 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:28.900976 23868 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.877915 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 208) took 1564 ms. Trace:
I20260709 12:10:28.871635 24254 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:28.904975 24171 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:28.907677 22272 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:28.910970 22162 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:28.898281 23975 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:28.913414 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68045.3us
I20260709 12:10:29.015436 24249 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.016615 22163 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:29.017648 24249 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.017908 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:29.018862 24249 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.882284 24184 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.021322 24184 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:28.946684 24113 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.895848 24031 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.888518 24006 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:28.960420 24215 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:28.967514 24259 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:28.997543 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58622us
I20260709 12:10:28.970726 22019 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 3 to 4, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 4 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:29.004220 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 109991us
W20260709 12:10:29.003521 22007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 124629us
I20260709 12:10:29.007534 22264 rpcz_store.cc:276] 0709 12:10:27.307692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.468083 (+1160391us) service_pool.cc:224] Handling call
0709 12:10:28.469481 (+  1398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.532342 (+ 62861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.535037 (+  2695us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.601785 (+ 66748us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.699655 (+ 97870us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:28.710187 (+ 10532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.715207 (+  5020us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.858062 (+142855us) raft_consensus.cc:1685] finished
0709 12:10:28.858092 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.871615 (+ 13523us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32611,"raft.queue_time_us":87316,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":67071,"thread_start_us":74282,"threads_started":1,"wal-append.queue_time_us":126825}
W20260709 12:10:29.015125 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 104262us
I20260709 12:10:28.955324 24174 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.015535 24268 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:29.003545 24193 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:29.000653 22266 rpcz_store.cc:276] 0709 12:10:27.280798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.175193 (+894395us) service_pool.cc:224] Handling call
0709 12:10:28.193973 (+ 18780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.194200 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:28.683694 (+489494us) log.cc:844] Serialized 14 byte log entry
0709 12:10:28.874916 (+191222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.877806 (+  2890us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.881835 (+  4029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.898417 (+ 16582us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.898612 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4972,"prepare.queue_time_us":532571,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":226,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":5794,"thread_start_us":604127,"threads_started":2}
I20260709 12:10:29.050364 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:29.055465 24258 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:29.055778 24249 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:29.027769 24181 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:29.058157 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1680) took 1436 ms. Trace:
I20260709 12:10:29.043268 24171 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:29.073539 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1679) took 1464 ms. Trace:
I20260709 12:10:29.073643 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1685) took 1263 ms. Trace:
I20260709 12:10:29.076783 22271 rpcz_store.cc:276] 0709 12:10:27.608956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.754809 (+1145853us) service_pool.cc:224] Handling call
0709 12:10:28.755429 (+   620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.765989 (+ 10560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.766024 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.766666 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.026519 (+259853us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:29.026564 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.026640 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.073277 (+ 46637us) raft_consensus.cc:1685] finished
0709 12:10:29.073295 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.073467 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9495,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":241,"thread_start_us":259343,"threads_started":1,"wal-append.queue_time_us":304278}
I20260709 12:10:29.076910 22265 rpcz_store.cc:276] 0709 12:10:27.810768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.816325 (+1005557us) service_pool.cc:224] Handling call
0709 12:10:28.833393 (+ 17068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.833954 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.833984 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.834587 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.972339 (+137752us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.972396 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.972494 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.073406 (+100912us) raft_consensus.cc:1685] finished
0709 12:10:29.073434 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.073581 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1075,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"spinlock_wait_cycles":6528,"thread_start_us":137226,"threads_started":1,"wal-append.queue_time_us":224703}
I20260709 12:10:29.095220 22857 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:29.043331 24268 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:29.069536 22191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:29.099679 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:29.104956 22191 raft_consensus.cc:606] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:29.067778 22019 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 4 to 5, term changed from 2 to 4, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196), VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New cstate: current_term: 4 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.110338 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:29.080067 22270 rpcz_store.cc:276] 0709 12:10:27.621582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.783887 (+1162305us) service_pool.cc:224] Handling call
0709 12:10:28.784427 (+   540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.819914 (+ 35487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.819965 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.871563 (+ 51598us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.998110 (+126547us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:28.998152 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.998219 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.057933 (+ 59714us) raft_consensus.cc:1685] finished
0709 12:10:29.057954 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.058094 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7086,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":13534,"thread_start_us":100234,"threads_started":1,"wal-append.queue_time_us":103840}
W20260709 12:10:29.113003 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 64940.4us
I20260709 12:10:29.115080 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:29.116175 22123 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.117007 22119 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:29.081660 24113 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:29.114907 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 60237.7us
I20260709 12:10:29.134904 22163 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:29.109864 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:29.141150 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:29.141829 22119 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:29.137830 22019 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:29.145638 22088 connection.cc:256] RPC call timeout handler was delayed by -2.1039678500001173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 12:10:29.146075 22088 connection.cc:256] RPC call timeout handler was delayed by -2.0679678500000591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 12:10:29.146440 22088 connection.cc:256] RPC call timeout handler was delayed by -2.0328678500002297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
I20260709 12:10:29.077234 24167 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:29.067679 24193 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:29.155224 22866 raft_consensus.cc:2368] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
W20260709 12:10:29.143338 24267 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:10:29.161949 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:29.162849 22119 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.167002 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1539) took 1795 ms. Trace:
I20260709 12:10:29.111577 24171 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:29.175187 24126 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:29.175948 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:29.175892 24126 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:29.144586 24219 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.176864 22195 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:29.178575 24126 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:29.178715 24219 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:29.179303 22122 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:29.180703 24193 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:29.144323 24113 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.181725 24259 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:29.183030 24113 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:29.183523 24215 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:29.185017 22197 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:29.137634 24199 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.173158 22267 rpcz_store.cc:276] 0709 12:10:27.281390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.176452 (+895062us) service_pool.cc:224] Handling call
0709 12:10:28.176650 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.176853 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:28.641054 (+464201us) log.cc:844] Serialized 14 byte log entry
0709 12:10:28.807681 (+166627us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b18002fc800. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a 00007fcceddcca2a
0709 12:10:29.009177 (+201496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.027238 (+ 18061us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:29.038034 (+ 10796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.042471 (+  4437us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.076848 (+ 34377us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34531,"prepare.queue_time_us":480163,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":9480,"raft.queue_time_us":5184,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":17918,"spinlock_wait_cycles":35546368,"thread_start_us":536396,"threads_started":2,"wal-append.queue_time_us":412308}
I20260709 12:10:29.190491 24199 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:29.192392 24167 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:29.151409 24184 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:29.193436 24184 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:29.193815 24184 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.194747 22197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "164596fc2efa450581a5b68cad62271f"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:29.195309 22197 raft_consensus.cc:606] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Received request to transfer leadership to TS 164596fc2efa450581a5b68cad62271f
I20260709 12:10:29.195638 22197 raft_consensus.cc:614] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:29.196878 22860 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:29.158175 22019 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 3, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 3 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:29.199112 22197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:29.202531 22864 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:10:29.205840 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.201596 22197 raft_consensus.cc:606] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:29.209020 22861 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:29.210372 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:29.200517 22019 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 2 to 3, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 3 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.215133 22019 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 2 to 4, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 4 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:29.239566 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 140546us
I20260709 12:10:29.239410 22197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:29.240916 22197 raft_consensus.cc:606] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:29.241982 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 87936.2us
I20260709 12:10:29.241107 22123 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:29.211570 24180 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:29.209023 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:29.245884 22019 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 3, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 3 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.215883 22162 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:29.255658 22830 connection.cc:256] RPC call timeout handler was delayed by -1.1613706910000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 12:10:29.221983 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:29.257828 22117 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:29.256541 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51657.7us
I20260709 12:10:29.260864 24174 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:29.203075 24228 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.263547 24228 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:29.266384 24006 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:29.267531 22162 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:29.290086 22019 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.256673 24271 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:29.295550 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 142937us
I20260709 12:10:29.296597 24180 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.290115 24181 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:29.192559 24268 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.300173 24250 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:10:29.302634 22019 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 2, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 2 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.298239 24174 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:29.290086 24031 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:29.272686 22114 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:29.274000 24258 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:10:29.328915 22088 connection.cc:256] RPC call timeout handler was delayed by -1.9248678500000551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 12:10:29.330755 22088 connection.cc:256] RPC call timeout handler was delayed by -1.824967850000121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 12:10:29.337092 22088 connection.cc:256] RPC call timeout handler was delayed by -1.7709678500000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
I20260709 12:10:29.333159 22019 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 2 to 5, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 5 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:29.344125 22019 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 4, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 4 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:29.354606 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47726us
I20260709 12:10:29.339625 24268 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.357986 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:29.324975 24031 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.349145 24250 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:29.369071 24181 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.332661 24271 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:10:29.356976 24258 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:29.379331 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:29.391433 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 123060us
I20260709 12:10:29.376278 24250 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:29.403692 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:29.381045 24258 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:29.396534 24004 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.381057 24113 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:10:29.379639 24228 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:29.426712 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:29.387683 24126 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 12:10:29.428507 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 80976.9us
I20260709 12:10:29.382121 24189 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:29.434307 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:29.435320 22866 raft_consensus.cc:2410] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:29.440094 24291 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.424718 24271 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:29.446334 24276 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:10:29.457543 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 82321.8us
I20260709 12:10:29.455739 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:29.471342 22117 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:29.406217 23975 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
W20260709 12:10:29.475092 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53657.6us
I20260709 12:10:29.476207 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:29.476276 24113 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.477015 24113 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:29.477577 24113 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.477895 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:10:29.479094 24272 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.242s	user 0.000s	sys 0.002s
I20260709 12:10:29.479498 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:29.481374 24126 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:29.482389 24126 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.482826 24126 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:29.483269 24126 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.485049 23868 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:29.486950 22272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:10:29.487701 22272 raft_consensus.cc:606] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:29.488092 22272 raft_consensus.cc:614] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:29.496452 24031 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:29.496891 24254 consensus_queue.cc:1059] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:29.431649 24004 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:29.500100 22196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:29.500941 22196 raft_consensus.cc:606] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:29.501320 22196 raft_consensus.cc:614] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:29.502918 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:29.503149 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:29.455734 24271 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:29.506592 24271 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:29.508011 24271 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.509171 24250 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:29.509357 24167 consensus_queue.cc:1059] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:29.510675 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:29.511022 24167 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.511606 24167 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:29.513321 23868 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:29.509178 22237 leader_election.cc:400] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
I20260709 12:10:29.500360 24004 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:29.521404 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 224362us
I20260709 12:10:29.514645 22237 leader_election.cc:403] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:29.498199 24254 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:29.539459 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:29.539968 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:29.535187 22119 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:29.536193 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:29.536372 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:29.510715 24250 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.545758 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:29.544834 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:29.544725 22267 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:29.541771 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:29.488512 24184 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:29.568995 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:29.539009 24254 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:29.572009 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:29.574536 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:29.578913 22268 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:29.546018 23922 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.568158 24004 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.533917 23868 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:29.587970 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 85176.2us
I20260709 12:10:29.571017 24278 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:29.512704 24167 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.583209 24259 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.566932 24193 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:29.597599 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:29.603099 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:29.605046 22861 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:29.606088 24278 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:29.607290 24278 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.610001 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:29.611457 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:29.601408 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:29.613027 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.613209 22263 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:29.614008 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:29.614188 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:29.614797 22270 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:29.615916 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:29.617223 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:29.618054 22269 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:29.611536 22268 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:29.619513 22272 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:29.621511 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:29.624471 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 79291.1us
I20260709 12:10:29.625947 22270 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:29.629185 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 149807us
I20260709 12:10:29.632447 23868 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:29.633636 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:29.634728 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:29.635962 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:29.636477 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:29.638414 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:29.639850 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:29.640694 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:29.653779 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:29.602591 24259 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:29.640733 22114 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:10:29.656912 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 117559us
I20260709 12:10:29.669644 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:29.669516 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:29.672783 22269 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:29.673592 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.654208 24171 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.685173 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:29.673450 24259 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.692839 22119 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:29.687018 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:29.705463 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:29.697750 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:29.582508 24258 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:29.708335 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 83060.7us
I20260709 12:10:29.709821 24113 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:29.712217 24113 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:29.718516 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:29.691402 24167 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.738197 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:29.746508 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 44429.4us
I20260709 12:10:29.690974 23868 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:29.700615 24126 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:29.715906 24274 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:29.707619 24285 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.722846 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:29.744319 24189 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:29.784385 24297 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.720201 24280 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:10:29.839643 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:29.840083 22830 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:29.713065 24303 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 12:10:29.811779 24258 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:29.843048 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 175436us
I20260709 12:10:29.843366 22863 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:29.813297 24245 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.706156 24254 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:29.848526 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:29.852432 24166 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.846714 24297 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:29.854535 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:29.855058 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:29.875727 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:29.902179 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:29.903232 22198 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:29.903571 24126 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:29.885202 24166 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:29.904675 24166 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.904918 24297 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.841813 24274 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:29.815623 23868 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:29.855222 24298 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:10:29.854416 24289 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.289s	user 0.000s	sys 0.002s
I20260709 12:10:29.849138 24184 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:29.919250 22858 raft_consensus.cc:2393] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:29.852685 24245 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:29.933881 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:29.934669 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:29.936367 23868 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:29.928331 24126 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:29.937938 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 83519us
W20260709 12:10:29.921077 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47455.3us
W20260709 12:10:29.927253 24268 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.000s
I20260709 12:10:29.991331 22192 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:29.937739 24287 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:29.999233 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 144305us
W20260709 12:10:29.984019 22236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.725s (SENT) [suppressed 44 similar messages]
I20260709 12:10:29.959120 24181 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.008948 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.010864 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:30.027047 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.994870 24254 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.017608 22198 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:29.997349 24287 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.009773 24181 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:30.048235 22236 leader_election.cc:336] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.840s (SENT)
I20260709 12:10:30.012218 24249 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:10:30.066695 22007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f86b841ece254f9bbfd1bd07c08f7004 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:10:30.068058 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.047802 24181 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.043210 24287 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:30.069945 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 68750us
W20260709 12:10:30.076795 24308 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:10:30.076449 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.103209 22198 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
W20260709 12:10:30.084619 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53815us
I20260709 12:10:30.089795 24004 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
I20260709 12:10:30.047492 24184 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:30.081341 24295 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
W20260709 12:10:30.096206 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 48020.8us
W20260709 12:10:30.102028 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.135695 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.148420 22198 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:30.150898 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:30.151480 22198 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:30.155593 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.157387 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 441373us
W20260709 12:10:30.168517 24250 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.000s
I20260709 12:10:30.061883 24245 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.185228 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.188112 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:30.153434 22263 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:30.057161 24274 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.191862 24228 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.192500 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:30.210429 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:30.200407 24166 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.209659 24228 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:30.235570 24166 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:30.236351 22859 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:30.236936 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 258945us
W20260709 12:10:30.238256 24309 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:10:30.238751 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:30.240623 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48276.6us
W20260709 12:10:30.238968 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.244655 22198 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
W20260709 12:10:30.245877 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 257812us
W20260709 12:10:30.246168 24259 consensus_meta.cc:287] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260709 12:10:30.246675 24259 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.241262 23868 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:30.249472 24319 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:10:30.251163 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:30.251420 24245 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.252431 24297 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:30.255046 24297 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:30.258720 24279 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:30.261965 22268 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:30.265596 24326 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:30.268181 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:30.269857 24307 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:10:30.271927 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:30.273524 22269 raft_consensus.cc:2410] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:30.274927 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:30.276171 22272 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:30.277673 22270 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.272233 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:30.280653 22271 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:30.285414 22830 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:30.239711 24312 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.233s	user 0.004s	sys 0.000s
W20260709 12:10:30.568594 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.526104 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.244526 24228 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.303015 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:30.319591 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:30.342165 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 58272.7us
I20260709 12:10:30.580178 22268 raft_consensus.cc:2410] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:10:30.570020 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 284740us
I20260709 12:10:30.578122 22272 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:30.344254 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:30.595180 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.579955 22196 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:30.602406 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:30.510151 23868 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:30.377556 24318 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 12:10:30.383625 24330 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:10:30.339025 24313 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:10:30.352859 24268 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:30.615651 22866 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:30.611579 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:30.622586 22270 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:30.289047 24297 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.569720 24245 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:30.607919 24287 consensus_meta.cc:287] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.000s
I20260709 12:10:30.626838 22830 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:30.633941 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:30.636392 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.477686 24126 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.145s
W20260709 12:10:30.639964 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 70880.8us
I20260709 12:10:30.611009 24259 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:30.620639 24288 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:30.652603 24288 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:30.655048 24288 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:30.620460 24286 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.656092 24286 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:30.657143 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:30.658255 24286 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:30.658466 24189 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:30.658857 24189 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:30.660100 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:30.649204 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:30.661049 22269 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:30.661362 22163 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:30.661791 24250 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.599669 24278 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:30.650635 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:30.651703 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:30.651625 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:30.659832 24189 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:30.650077 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.646159 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:30.599923 24193 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:30.671708 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:30.638813 24171 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.690793 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:30.690922 22271 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:30.693015 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.672217 22863 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:30.688135 22859 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:30.690061 24189 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:30.666704 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 360622us
I20260709 12:10:30.645049 24268 raft_consensus.cc:697] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:30.695698 22197 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:30.663492 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:30.694099 24280 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.699232 22267 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.696290 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:30.697710 24171 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:30.669876 24249 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.628865 24245 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:30.629702 24297 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:30.708874 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1525) took 1066 ms. Trace:
I20260709 12:10:30.709146 22271 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:30.635798 24287 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.711614 24167 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:30.709827 22123 rpcz_store.cc:276] 0709 12:10:29.638441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.640831 (+  2390us) service_pool.cc:224] Handling call
0709 12:10:29.641101 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.641540 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.641575 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.667352 (+ 25777us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.801932 (+134580us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:29.801968 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.802024 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.200398 (+398374us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:30.694831 (+494433us) raft_consensus.cc:1685] finished
0709 12:10:30.694861 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.704922 (+ 10061us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25565,"raft.queue_time_us":1643,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":18512,"spinlock_wait_cycles":13344128,"thread_start_us":110769,"threads_started":1,"wal-append.queue_time_us":172124}
W20260709 12:10:30.714648 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53359.4us
I20260709 12:10:30.722429 24338 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:30.724884 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:30.717468 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:30.722841 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.634114 23868 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:30.730676 22197 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:30.706986 24280 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.733465 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:30.740160 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.740746 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.744513 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.745146 24228 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:30.746614 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.747466 22196 raft_consensus.cc:2393] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:30.737011 24280 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.749328 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.754482 22196 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:30.755354 24329 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.388s	user 0.012s	sys 0.000s
W20260709 12:10:30.756525 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.727319 24338 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.716760 24167 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:10:30.773422 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 49722.6us
I20260709 12:10:30.776888 22163 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:30.775493 24171 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:30.770882 24193 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.788038 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.789767 22196 raft_consensus.cc:2410] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:30.756991 24249 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.756632 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 225) took 1246 ms. Trace:
I20260709 12:10:30.804595 24344 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:30.805224 24344 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.807425 24344 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:30.809049 24171 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.816284 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.851538 22197 raft_consensus.cc:2410] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:30.801834 24193 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.856997 24167 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.858285 24167 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.858876 24193 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:30.861505 22263 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:30.863096 24181 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.756s	user 0.013s	sys 0.013s
I20260709 12:10:30.863493 24181 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.845572 24303 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:30.865376 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 90638.2us
W20260709 12:10:30.846990 24258 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.969s	user 0.006s	sys 0.012s
I20260709 12:10:30.868762 22267 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:30.872561 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.776196 24268 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.893224 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.897873 22197 raft_consensus.cc:2376] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6. Re-sending same reply.
I20260709 12:10:30.866961 24287 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:30.864924 24171 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:10:30.885509 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 171523us
W20260709 12:10:30.890962 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 264184us
I20260709 12:10:30.903903 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:30.912021 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:30.880256 24259 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:30.908090 22236 leader_election.cc:336] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.574s (SENT)
I20260709 12:10:30.922770 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:30.923566 22197 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.931787 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:30.933537 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:30.934481 22195 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 6: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:30.935971 24280 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:30.907724 24171 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.936597 24338 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:30.932586 22189 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.946511 24181 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:30.939399 24228 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:30.887766 24250 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:10:30.878628 24303 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:30.880123 24288 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:30.947631 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:30.924887 24279 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 12:10:31.049425 22196 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:31.041953 22192 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.947752 22123 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:30.965278 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:30.948617 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:31.053556 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:31.058780 22190 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:31.054901 22194 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:31.034917 22189 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
W20260709 12:10:31.061408 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 146917us
I20260709 12:10:31.067355 22163 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:31.047510 24344 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:31.073035 22122 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:31.075203 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 173757us
W20260709 12:10:31.079196 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.965566 24297 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:31.065040 24193 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:30.948613 24259 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:31.081482 22117 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:31.141045 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 78548.4us
I20260709 12:10:31.144634 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:31.106508 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.154156 22191 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:31.115000 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:31.111202 24250 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:31.085467 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:31.157230 24343 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.157127 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:31.081624 22192 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:31.155246 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:31.157051 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:31.159654 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44768.5us
W20260709 12:10:31.159505 22236 leader_election.cc:336] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.718s (SENT)
I20260709 12:10:31.084703 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:31.127404 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.155369 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:31.161150 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:31.163319 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:31.178963 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:31.075055 24344 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:31.180250 22195 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:31.141593 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:31.180590 24167 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:31.164954 24356 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.189775 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:31.157883 24343 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:31.169328 24250 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:31.192690 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:31.164592 24349 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.180982 24181 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:31.195088 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 274389us
I20260709 12:10:31.193621 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:31.171125 24274 consensus_queue.cc:1059] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:31.164146 24193 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:31.202732 24343 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:31.243515 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.249363 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 85163.7us
I20260709 12:10:31.253747 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:31.194298 24166 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:10:31.209504 24199 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:31.256520 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 66872.2us
I20260709 12:10:31.239899 22119 raft_consensus.cc:2955] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:31.294564 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:31.295735 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:31.296258 22189 raft_consensus.cc:2376] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4. Re-sending same reply.
I20260709 12:10:30.803002 22264 rpcz_store.cc:276] 0709 12:10:29.510141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.538158 (+ 28017us) service_pool.cc:224] Handling call
0709 12:10:29.586220 (+ 48062us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.994127 (+407907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.997819 (+  3692us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.106064 (+108245us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.342911 (+236847us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:30.348479 (+  5568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.352630 (+  4151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.756327 (+403697us) raft_consensus.cc:1685] finished
0709 12:10:30.756354 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.756493 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":215190,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":437287,"threads_started":2,"wal-append.queue_time_us":578696}
W20260709 12:10:31.305833 24348 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:10:31.208382 24356 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:31.323962 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:31.327595 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 73973.9us
I20260709 12:10:31.329046 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:31.331624 22123 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:31.340237 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:31.343200 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:31.343590 22195 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:31.344105 22194 raft_consensus.cc:2410] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:31.299041 24199 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:31.313678 24340 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:31.225782 24349 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:31.340242 22236 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.901s (SENT)
I20260709 12:10:31.301461 24288 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:10:31.360451 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:31.250936 24344 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:31.330740 24167 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.331560 24294 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:31.331122 24347 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:31.373930 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:31.349457 24297 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.374716 22194 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:31.351310 24340 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:31.379619 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 127840us
I20260709 12:10:31.389635 22163 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:31.353787 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:31.385100 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.386790 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51260.4us
I20260709 12:10:31.393479 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:31.391054 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:31.517328 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 186100us
W20260709 12:10:31.519826 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.520367 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.368978 24303 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:31.521108 22114 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:31.521682 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 128285us
I20260709 12:10:31.527542 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:31.522959 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 186976us
W20260709 12:10:31.520746 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.379925 24297 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:31.523351 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 131973us
I20260709 12:10:31.532596 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:31.365558 24358 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:31.537122 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 166556us
I20260709 12:10:31.539665 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:31.546777 22123 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:31.393765 24340 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:31.557762 22197 consensus_meta.cc:287] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.634s	user 0.014s	sys 0.000s
I20260709 12:10:31.558759 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:31.372732 24167 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:31.364758 24285 consensus_queue.cc:1059] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 12:10:31.561118 22197 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:31.522050 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:31.569854 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:31.570775 22123 raft_consensus.cc:2368] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
I20260709 12:10:31.534530 24350 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:31.604874 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 229877us
I20260709 12:10:31.566975 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:31.537335 24297 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.523638 24370 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:31.544607 24199 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:31.607753 24350 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.616031 24350 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.573787 22117 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:31.577322 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:31.619181 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:31.620343 22118 raft_consensus.cc:2368] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4.
I20260709 12:10:31.578449 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:31.565192 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:31.583532 22236 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.054s (SENT)
I20260709 12:10:31.584167 24303 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:31.584880 24325 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.008s	sys 0.034s
W20260709 12:10:31.585387 24342 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
I20260709 12:10:31.566150 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:31.533209 24361 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:31.607162 22269 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 2.
I20260709 12:10:31.553568 23975 raft_consensus.cc:2764] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:31.621619 22267 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:31.630494 22857 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:31.631381 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:31.632575 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:31.637790 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:31.568316 24369 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:31.638909 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 104108us
I20260709 12:10:31.640683 22123 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:31.660996 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.644984 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:31.635402 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:31.559522 24358 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:31.706256 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.021884 22194 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:31.967052 22121 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
W20260709 12:10:31.796928 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 113127us
I20260709 12:10:32.027958 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.029072 22121 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:10:32.028898 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 401580us
I20260709 12:10:31.794710 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:31.924299 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.031005 22117 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.635269 22264 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:31.634706 24325 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.008s	sys 0.035s
I20260709 12:10:31.640602 24361 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.038640 22195 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:31.928726 22858 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:32.049991 22123 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:31.645044 24370 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:32.051340 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 467816us
I20260709 12:10:32.045532 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:32.056064 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:32.031716 24250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.028s	sys 0.028s
I20260709 12:10:32.060087 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:31.695341 24351 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.796214 24368 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:32.062500 22863 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:32.063750 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:32.064812 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:32.046804 24361 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.646337 24303 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.077689 24167 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:32.213260 24167 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:32.214401 24167 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:32.220196 24249 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.410s	user 0.011s	sys 0.000s
W20260709 12:10:32.140868 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.190457 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.222656 22121 raft_consensus.cc:2368] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
I20260709 12:10:32.223722 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:32.223866 24171 consensus_meta.cc:287] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.282s	user 0.006s	sys 0.004s
W20260709 12:10:32.145721 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 100288us
I20260709 12:10:32.224908 22121 raft_consensus.cc:2410] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:32.041913 22263 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:32.106259 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.106994 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:32.076761 22116 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:32.105844 22189 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:32.110812 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 235) took 1282 ms. Trace:
I20260709 12:10:32.234066 22265 rpcz_store.cc:276] 0709 12:10:30.828310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.829015 (+   705us) service_pool.cc:224] Handling call
0709 12:10:30.848885 (+ 19870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.872315 (+ 23430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.872353 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.878088 (+  5735us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.067529 (+189441us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:31.067587 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.110227 (+1042640us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b54001db5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:32.110292 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.110368 (+    76us) raft_consensus.cc:1685] finished
0709 12:10:32.110389 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.110725 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":603,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":10715,"spinlock_wait_cycles":37107584,"thread_start_us":156043,"threads_started":1,"wal-append.queue_time_us":220474}
I20260709 12:10:32.109006 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.109416 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.237138 22118 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:32.106634 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:32.241263 22088 connection.cc:256] RPC call timeout handler was delayed by -1.7203315340000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260709 12:10:32.105053 22195 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: [4.6-5.7]
W20260709 12:10:32.150998 22236 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.116s (SENT)
I20260709 12:10:32.227936 22117 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:32.107507 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:32.048830 24294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.013s
I20260709 12:10:32.232659 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 205) took 1157 ms. Trace:
I20260709 12:10:32.214228 24379 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.236038 22190 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
W20260709 12:10:32.279867 22088 connection.cc:256] RPC call timeout handler was delayed by -1.6258315340000991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
I20260709 12:10:32.283187 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:32.285588 22088 connection.cc:256] RPC call timeout handler was delayed by -1.4980315339998924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
I20260709 12:10:32.286875 22270 raft_consensus.cc:2410] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:32.280649 22116 rpcz_store.cc:276] 0709 12:10:31.074948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.075077 (+   129us) service_pool.cc:224] Handling call
0709 12:10:32.075880 (+1000803us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:32.076204 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.232223 (+156019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.232594 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3742976}
I20260709 12:10:32.257494 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:32.088837 24378 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:32.286734 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:32.061779 24356 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.288399 22118 raft_consensus.cc:2410] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:32.289433 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:32.290040 22119 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.044s	sys 0.079s
W20260709 12:10:32.294800 22119 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.044s	sys 0.079s
I20260709 12:10:32.285954 22117 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.293752 22189 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:32.286223 22088 connection.cc:256] RPC call timeout handler was delayed by -1.4719315340000776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 12:10:32.296003 22088 connection.cc:256] RPC call timeout handler was delayed by -1.4674315340000703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260709 12:10:32.296474 22088 connection.cc:256] RPC call timeout handler was delayed by -1.423331533999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
W20260709 12:10:32.066370 24250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.028s	sys 0.028s
I20260709 12:10:32.247115 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:32.297457 22088 connection.cc:256] RPC call timeout handler was delayed by -1.2721315339999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 12:10:32.297957 22088 connection.cc:256] RPC call timeout handler was delayed by -1.1839315340000667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
W20260709 12:10:32.298370 22088 connection.cc:256] RPC call timeout handler was delayed by -1.1713315340000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
W20260709 12:10:32.298796 22088 connection.cc:256] RPC call timeout handler was delayed by -1.1434315340000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 12:10:32.299629 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:32.300921 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1505) took 1148 ms. Trace:
I20260709 12:10:32.302471 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.303933 22192 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:32.305972 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.304374 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.241331 24249 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.302641 22190 rpcz_store.cc:276] 0709 12:10:31.136930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.154893 (+ 17963us) service_pool.cc:224] Handling call
0709 12:10:32.108817 (+953924us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b5800196598. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:32.285456 (+176639us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6578048}
I20260709 12:10:32.279072 24126 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.101755 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:32.311909 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.309763 22195 raft_consensus.cc:2410] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:32.089326 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:32.280421 24294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.005s	sys 0.018s
I20260709 12:10:32.224857 24368 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:32.278801 24334 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.078715 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:32.324334 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 262566us
I20260709 12:10:32.342429 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.284947 24379 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:32.343883 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.089422 24362 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.378s
I20260709 12:10:32.346560 22118 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.241694 24171 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.349097 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.303436 24250 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:32.360700 22264 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:32.328971 24126 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:32.361222 24297 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.000s
I20260709 12:10:32.361717 24297 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.361637 24250 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.362857 22121 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:32.362931 24126 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:32.363603 24334 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:32.364842 24350 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.008s
I20260709 12:10:32.364641 24379 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.365916 24379 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.365413 24350 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.367197 22115 raft_consensus.cc:2393] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:32.367844 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 200) took 1304 ms. Trace:
I20260709 12:10:32.368216 22115 rpcz_store.cc:276] 0709 12:10:31.063688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.063799 (+   111us) service_pool.cc:224] Handling call
0709 12:10:32.078508 (+1014709us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9deee 000000000036eb39 00007fccf2d111e0 00007fccf2dda0c4 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:32.367745 (+289237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3664768}
I20260709 12:10:32.102365 24351 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.372184 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 201) took 1308 ms. Trace:
I20260709 12:10:32.372843 22857 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:32.372627 22119 rpcz_store.cc:276] 0709 12:10:31.064031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.064371 (+   340us) service_pool.cc:224] Handling call
0709 12:10:31.073257 (+  8886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.189462 (+116205us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:31.546139 (+356677us) log.cc:844] Serialized 14 byte log entry
0709 12:10:31.636306 (+ 90167us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:31.645187 (+  8881us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.645347 (+   160us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:32.295211 (+649864us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.295453 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.295524 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.371935 (+ 76411us) raft_consensus.cc:1685] finished
0709 12:10:32.371955 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.372111 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111239,"raft.queue_time_us":125537,"raft.run_cpu_time_us":626,"raft.run_wall_time_us":75075,"thread_start_us":606655,"threads_started":2,"wal-append.queue_time_us":26268}
I20260709 12:10:32.375826 24384 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.376542 24384 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.378418 24349 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.379012 22117 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:32.348927 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.352588 22196 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:32.325610 24370 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.354204 24358 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:32.358649 22114 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.833s	user 0.021s	sys 0.000s
I20260709 12:10:32.380893 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.101063 24374 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.223s
I20260709 12:10:32.382861 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:32.384024 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.388513 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.395601 22116 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:32.395835 22194 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:32.395994 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:32.396917 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.397831 22194 raft_consensus.cc:2410] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:32.398608 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.398805 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.399720 22190 raft_consensus.cc:2410] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:32.391693 22198 raft_consensus.cc:2393] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:32.390093 22236 leader_election.cc:336] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.506s (SENT)
I20260709 12:10:32.401330 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:32.401585 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.402398 22196 raft_consensus.cc:2410] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:32.404645 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.407723 22263 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:32.407793 24349 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.405422 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.409130 24167 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:32.409390 22190 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:32.410312 24171 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.391073 22114 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:32.410563 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:32.469041 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 221984us
I20260709 12:10:32.471334 22194 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:32.419710 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.472874 22117 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:32.410352 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:32.473788 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 174298us
I20260709 12:10:32.475131 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:32.409812 24393 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:32.476315 22190 raft_consensus.cc:2393] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:32.479417 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.481199 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.482342 22117 raft_consensus.cc:2368] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5.
I20260709 12:10:32.470052 24380 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.474109 24167 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.469765 24383 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.469664 24375 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.492805 22088 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:32.469664 24367 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.477125 24126 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.476105 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 206) took 1152 ms. Trace:
I20260709 12:10:32.480855 24369 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:32.503269 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.522281 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.523303 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.497951 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.408656 24349 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.552217 24349 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.499145 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 204) took 1425 ms. Trace:
I20260709 12:10:32.552801 22120 rpcz_store.cc:276] 0709 12:10:31.073829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.073965 (+   136us) service_pool.cc:224] Handling call
0709 12:10:32.498650 (+1424685us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:32.498791 (+   141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.498926 (+   135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.498941 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.498970 (+    29us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:32.498990 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.499021 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.499102 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51097984}
I20260709 12:10:32.554168 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.555208 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.555756 22120 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:32.557087 22116 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:32.501309 24258 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:32.557595 24258 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:32.558503 24258 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.559765 24258 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.503648 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.503816 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.561033 22194 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:32.505595 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.561590 22195 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:32.507510 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:32.491603 24343 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 1.229s	user 0.011s	sys 0.003s
I20260709 12:10:32.562877 24343 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.506982 24351 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.525702 24384 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.521164 22114 rpcz_store.cc:276] 0709 12:10:31.323744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.326663 (+  2919us) service_pool.cc:224] Handling call
0709 12:10:32.475110 (+1148447us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:32.527467 24340 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.941s	user 0.012s	sys 0.000s
I20260709 12:10:32.527601 22117 raft_consensus.cc:2368] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5.
I20260709 12:10:32.530006 24259 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.533720 24394 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:32.544100 24367 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:32.499702 24167 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:32.549839 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 65678.4us
I20260709 12:10:32.550370 24391 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.562031 24369 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.536623 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.565531 22118 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:32.605770 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1510) took 1018 ms. Trace:
I20260709 12:10:32.568192 24343 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.568701 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:32.578747 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 94295.9us
I20260709 12:10:32.606124 22118 rpcz_store.cc:276] 0709 12:10:31.587154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.340345 (+753191us) service_pool.cc:224] Handling call
0709 12:10:32.605713 (+265368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.607875 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.607342 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1528) took 1014 ms. Trace:
W20260709 12:10:32.585410 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 109204us
I20260709 12:10:32.599680 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.609905 22117 raft_consensus.cc:2368] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
I20260709 12:10:32.605865 22123 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:32.556499 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:32.575595 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.608615 22118 raft_consensus.cc:2376] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4. Re-sending same reply.
I20260709 12:10:32.612113 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:32.576421 24287 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:32.614161 22268 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:32.611685 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.614742 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1512) took 1027 ms. Trace:
I20260709 12:10:32.608737 22121 rpcz_store.cc:276] 0709 12:10:31.593244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.568433 (+975189us) service_pool.cc:224] Handling call
0709 12:10:32.607269 (+ 38836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.578101 24344 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.617259 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:32.615665 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1526) took 1023 ms. Trace:
I20260709 12:10:32.615267 22117 rpcz_store.cc:276] 0709 12:10:31.587758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.583549 (+995791us) service_pool.cc:224] Handling call
0709 12:10:32.614669 (+ 31120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.618258 22123 rpcz_store.cc:276] 0709 12:10:31.592590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.536323 (+943733us) service_pool.cc:224] Handling call
0709 12:10:32.615599 (+ 79276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.618718 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1492) took 1043 ms. Trace:
I20260709 12:10:32.619130 22120 rpcz_store.cc:276] 0709 12:10:31.575397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.556276 (+980879us) service_pool.cc:224] Handling call
0709 12:10:32.618653 (+ 62377us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.619298 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.620182 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.616830 24287 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.621871 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:32.622064 22088 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:32.622510 22265 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:32.623149 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:32.623358 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:32.624008 22265 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:32.623907 24287 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:32.625094 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:32.626585 24245 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:32.626677 22269 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:32.570362 24365 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:32.629045 24365 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:32.629906 24365 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.631158 24365 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.631835 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.614823 24358 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.632932 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1488) took 1058 ms. Trace:
I20260709 12:10:32.633437 22114 rpcz_store.cc:276] 0709 12:10:31.574147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.599158 (+1025011us) service_pool.cc:224] Handling call
0709 12:10:32.632855 (+ 33697us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.634632 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.635497 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1531) took 1041 ms. Trace:
I20260709 12:10:32.635944 22114 rpcz_store.cc:276] 0709 12:10:31.594162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.634290 (+1040128us) service_pool.cc:224] Handling call
0709 12:10:32.635431 (+  1141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.637368 22196 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.604754 24370 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:32.637560 22269 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:32.637902 24370 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.639031 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:32.639729 22269 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:32.640064 24370 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.640246 24167 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:32.586633 24303 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:32.587857 24340 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.637144 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:32.641304 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.648794 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:32.641287 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:32.649776 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.620234 22123 raft_consensus.cc:2393] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:32.650617 22272 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:32.650827 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1514) took 1062 ms. Trace:
I20260709 12:10:32.651232 22123 rpcz_store.cc:276] 0709 12:10:31.588349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.619022 (+1030673us) service_pool.cc:224] Handling call
0709 12:10:32.650768 (+ 31746us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.648617 23868 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:32.647322 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:32.620422 22190 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:32.624483 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:32.649607 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1504) took 1064 ms. Trace:
I20260709 12:10:32.652554 22121 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:32.653046 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.657639 22195 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:32.654331 22268 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.640694 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:32.641122 24391 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.655228 22120 rpcz_store.cc:276] 0709 12:10:31.585290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.619929 (+1034639us) service_pool.cc:224] Handling call
0709 12:10:32.649532 (+ 29603us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.653824 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.655360 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:32.641841 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1529) took 1048 ms. Trace:
I20260709 12:10:32.617537 24166 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:10:32.628600 24361 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.633261 24358 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.657392 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:32.703680 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 243) took 1075 ms. Trace:
W20260709 12:10:32.677699 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 53280us
I20260709 12:10:32.723517 22271 rpcz_store.cc:276] 0709 12:10:31.628715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.633896 (+  5181us) service_pool.cc:224] Handling call
0709 12:10:32.702739 (+1068843us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b5800180398. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:32.703020 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.703273 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.703300 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.703339 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:32.703376 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.703446 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.703599 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3768576}
I20260709 12:10:32.722959 22272 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.655465 22162 connection.cc:256] RPC call timeout handler was delayed by -1.4472813469999437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 12:10:32.670070 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1530) took 1076 ms. Trace:
I20260709 12:10:32.703229 22122 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:10:32.726984 22122 pending_rounds.cc:85] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 4
W20260709 12:10:32.725243 22162 connection.cc:256] RPC call timeout handler was delayed by -1.3788813470000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 12:10:32.726337 22265 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:32.672531 24340 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:32.693799 22264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 237) took 1330 ms (client timeout 1710 ms). Trace:
I20260709 12:10:32.659164 22269 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:32.686759 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1524) took 1094 ms. Trace:
I20260709 12:10:32.727609 22118 rpcz_store.cc:276] 0709 12:10:31.593549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.611378 (+1017829us) service_pool.cc:224] Handling call
0709 12:10:32.641764 (+ 30386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.729059 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:32.738269 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:32.738498 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.729091 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.739692 22271 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.727854 22117 rpcz_store.cc:276] 0709 12:10:31.593846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.618541 (+1024695us) service_pool.cc:224] Handling call
0709 12:10:32.669969 (+ 51428us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.740602 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.734881 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:32.742244 22162 connection.cc:256] RPC call timeout handler was delayed by -1.2213813470000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
I20260709 12:10:32.742789 22118 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:32.740793 22265 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:32.743568 22120 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:32.762255 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1536) took 1166 ms. Trace:
I20260709 12:10:32.762696 22120 rpcz_store.cc:276] 0709 12:10:31.595668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.734526 (+1138858us) service_pool.cc:224] Handling call
0709 12:10:32.762191 (+ 27665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.744719 22088 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:10:32.743484 22162 connection.cc:256] RPC call timeout handler was delayed by -1.0935813470000539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 12:10:32.764739 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:32.764355 22162 connection.cc:256] RPC call timeout handler was delayed by -1.0242813469999419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 12:10:32.737390 22116 rpcz_store.cc:276] 0709 12:10:31.591981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.399315 (+807334us) service_pool.cc:224] Handling call
0709 12:10:32.686531 (+287216us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54003ad4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:32.686693 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339587968}
I20260709 12:10:32.677508 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:32.665040 24350 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.769052 22120 raft_consensus.cc:2410] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:10:32.767463 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:32.776182 22268 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:32.769822 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.669919 24297 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.689886 24395 raft_consensus.cc:3055] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.687866 24377 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.727756 22122 pending_rounds.cc:107] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:32.792411 22122 raft_consensus.cc:2889] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:32.768299 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.654893 23868 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:32.801806 22272 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:32.787962 22271 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:32.806877 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:32.774220 22236 leader_election.cc:336] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.525s (SENT)
I20260709 12:10:32.663282 24351 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.791742 24280 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.660733 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.671248 24369 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:32.769562 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1490) took 1194 ms. Trace:
I20260709 12:10:32.777065 22117 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:32.820567 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:32.822484 22123 raft_consensus.cc:2368] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4.
I20260709 12:10:32.822626 22118 rpcz_store.cc:276] 0709 12:10:31.574803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.740387 (+1165584us) service_pool.cc:224] Handling call
0709 12:10:32.769500 (+ 29113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.779645 24287 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.780216 24361 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:32.803411 23868 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.777697 22263 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.785912 24358 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:32.787360 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 63009.3us
I20260709 12:10:32.787971 24334 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:32.790762 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.794162 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.794497 22191 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:32.797111 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.837019 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.837699 22116 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.800032 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:32.813277 22271 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:32.813526 22236 leader_election.cc:336] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.529s (SENT)
I20260709 12:10:32.839689 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:32.698216 24181 raft_consensus.cc:3055] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.842653 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1507) took 1256 ms. Trace:
I20260709 12:10:32.842950 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.843039 22119 rpcz_store.cc:276] 0709 12:10:31.586268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.778275 (+1192007us) service_pool.cc:224] Handling call
0709 12:10:32.842602 (+ 64327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.821260 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.845156 24294 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:32.845713 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.846624 24279 consensus_queue.cc:1059] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:32.847071 24369 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:32.777909 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1495) took 1201 ms. Trace:
I20260709 12:10:32.847747 22120 rpcz_store.cc:276] 0709 12:10:31.576300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.763553 (+1187253us) service_pool.cc:224] Handling call
0709 12:10:32.777845 (+ 14292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.842283 24181 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:32.848887 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.849489 22120 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:32.849125 24181 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.850373 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.823984 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.851887 22118 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:32.852310 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1496) took 1275 ms. Trace:
I20260709 12:10:32.852613 22118 rpcz_store.cc:276] 0709 12:10:31.576579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.823719 (+1247140us) service_pool.cc:224] Handling call
0709 12:10:32.852250 (+ 28531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.824182 22114 raft_consensus.cc:2376] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3. Re-sending same reply.
I20260709 12:10:32.853583 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1517) took 1264 ms. Trace:
I20260709 12:10:32.853937 22114 rpcz_store.cc:276] 0709 12:10:31.589532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.636748 (+1047216us) service_pool.cc:224] Handling call
0709 12:10:32.853528 (+216780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.792042 24395 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:32.832168 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:32.855875 24334 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.856499 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:32.841449 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.857832 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.858421 24361 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.846812 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.780967 24391 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:32.859157 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.859398 22193 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:32.820715 24377 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.860255 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.861408 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:32.862015 24377 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:32.862463 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:32.862775 24193 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:32.863775 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.864135 22193 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:32.864434 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.824738 24401 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:32.865065 24401 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:32.866057 24401 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.867247 22193 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:32.869719 22116 raft_consensus.cc:2410] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:32.870227 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1509) took 1283 ms. Trace:
I20260709 12:10:32.870530 22116 rpcz_store.cc:276] 0709 12:10:31.586878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.836721 (+1249843us) service_pool.cc:224] Handling call
0709 12:10:32.870164 (+ 33443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.871201 24369 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.871840 24369 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:32.737113 22264 rpcz_store.cc:269] 0709 12:10:31.363311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.365100 (+  1789us) service_pool.cc:224] Handling call
0709 12:10:32.693510 (+1328410us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b540026cad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:32.693708 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34579840}
I20260709 12:10:32.822913 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1491) took 1247 ms. Trace:
I20260709 12:10:32.855939 24395 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.874531 22117 rpcz_store.cc:276] 0709 12:10:31.575120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.740603 (+1165483us) service_pool.cc:224] Handling call
0709 12:10:32.822853 (+ 82250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.875401 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:32.858475 22190 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:32.880081 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.888830 22120 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:32.818382 24166 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:10:32.886111 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.901063 22195 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:32.891286 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 77784.7us
I20260709 12:10:32.891784 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:32.901773 22236 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.564s (SENT)
W20260709 12:10:32.902380 22236 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.564s (SENT)
I20260709 12:10:32.902722 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:32.903519 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.904213 22119 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:32.892480 22120 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:32.892709 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.905828 22197 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
W20260709 12:10:32.907051 22007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f86b841ece254f9bbfd1bd07c08f7004 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:32.905193 24391 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.914709 22830 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:32.912640 22117 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:32.916217 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1503) took 1331 ms. Trace:
I20260709 12:10:32.921728 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1502) took 1341 ms. Trace:
I20260709 12:10:32.922302 22117 rpcz_store.cc:276] 0709 12:10:31.580720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.887619 (+1306899us) service_pool.cc:224] Handling call
0709 12:10:32.912327 (+ 24708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.921347 (+  9020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.921655 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.920313 22120 rpcz_store.cc:276] 0709 12:10:31.584926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.889784 (+1304858us) service_pool.cc:224] Handling call
0709 12:10:32.890257 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.915924 (+ 25667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.916157 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.900341 24362 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.924965 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.929266 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:32.932554 22236 leader_election.cc:336] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.722s (SENT)
W20260709 12:10:32.933470 22236 leader_election.cc:336] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.722s (SENT)
I20260709 12:10:32.933813 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:32.934049 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.934762 22119 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:10:32.937040 22087 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.665s (SENT)
I20260709 12:10:32.937158 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.937668 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:32.937824 22117 raft_consensus.cc:2376] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3. Re-sending same reply.
I20260709 12:10:32.942256 22120 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:32.931823 22831 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:32.945290 24279 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:32.945856 24279 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:32.946760 24279 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.941962 24351 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.949270 24362 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.918565 24286 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:32.916975 24361 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:32.951807 22236 leader_election.cc:336] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.725s (SENT)
W20260709 12:10:32.952121 22087 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.707s (SENT)
I20260709 12:10:32.922112 24199 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.953629 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:32.918960 24391 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:32.957262 22236 leader_election.cc:336] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.725s (SENT)
I20260709 12:10:32.957770 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:32.952976 24286 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:32.959475 24286 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:32.959627 24368 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:32.965623 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.965968 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:32.966502 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1494) took 1390 ms. Trace:
I20260709 12:10:32.966872 22264 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:32.966922 22118 rpcz_store.cc:276] 0709 12:10:31.576017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.853200 (+1277183us) service_pool.cc:224] Handling call
0709 12:10:32.965455 (+112255us) spinlock_profiling.cc:243] Waited 981 us on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:32.966444 (+   989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257280}
I20260709 12:10:32.968304 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:32.927129 24193 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.970772 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:32.971560 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.974881 22118 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:10:32.975353 22236 leader_election.cc:336] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.823s (SENT)
W20260709 12:10:32.976082 22236 leader_election.cc:336] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.823s (SENT)
I20260709 12:10:32.976452 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:32.942549 24395 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.981619 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:32.982561 22265 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:32.983052 22265 pending_rounds.cc:85] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 6
I20260709 12:10:32.983275 22265 pending_rounds.cc:107] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:32.983482 22265 raft_consensus.cc:2889] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:32.986196 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.978912 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.955286 24303 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.979663 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:32.980242 24297 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.973066 24367 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.980760 24167 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.922722 24334 consensus_queue.cc:1059] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:10:33.003538 24369 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:33.009675 24367 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:33.010634 23868 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:33.012079 24367 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:33.013410 22116 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 4. Ops: []
I20260709 12:10:33.013474 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:33.013818 22197 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:33.014040 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1501) took 1433 ms. Trace:
I20260709 12:10:33.014303 22863 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
W20260709 12:10:33.019985 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.972573 24368 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.014370 22116 rpcz_store.cc:276] 0709 12:10:31.580433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.871293 (+1290860us) service_pool.cc:224] Handling call
0709 12:10:33.013040 (+141747us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:33.013244 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.013810 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.013988 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2322176}
I20260709 12:10:32.990016 22118 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
W20260709 12:10:32.992194 22236 leader_election.cc:336] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.827s (SENT)
I20260709 12:10:33.078873 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:10:32.993315 22198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1507) took 1855 ms (client timeout 2329 ms). Trace:
I20260709 12:10:32.994216 22196 raft_consensus.cc:1240] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.994216 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:32.997752 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1582) took 1455 ms. Trace:
I20260709 12:10:33.081393 22270 rpcz_store.cc:276] 0709 12:10:31.542302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.542413 (+   111us) service_pool.cc:224] Handling call
0709 12:10:32.988475 (+1446062us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b5400331dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:32.997671 (+  9196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497614080}
I20260709 12:10:32.970321 24286 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.993103 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1532) took 1398 ms. Trace:
I20260709 12:10:32.972373 24391 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:33.079707 22198 rpcz_store.cc:269] 0709 12:10:31.138016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.154887 (+ 16871us) service_pool.cc:224] Handling call
0709 12:10:32.993138 (+1838251us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400235fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:32.993262 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2834452224}
I20260709 12:10:33.080819 22192 raft_consensus.cc:2376] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4. Re-sending same reply.
I20260709 12:10:33.140069 22123 rpcz_store.cc:276] 0709 12:10:31.594455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.653577 (+1059122us) service_pool.cc:224] Handling call
0709 12:10:32.992920 (+339343us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b5400326754. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:32.993049 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190578560}
I20260709 12:10:33.146466 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.147328 22123 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:33.148345 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.149108 22123 raft_consensus.cc:2368] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
I20260709 12:10:33.149923 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.150535 22123 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:33.151436 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.152184 22123 raft_consensus.cc:2393] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:33.165693 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.166419 22123 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:33.167640 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:33.171897 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 179729us
I20260709 12:10:33.169703 22123 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
W20260709 12:10:33.172756 22236 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.854s (SENT)
W20260709 12:10:33.173629 22236 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.854s (SENT)
I20260709 12:10:33.174012 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:33.174300 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:32.993139 24245 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.177217 22861 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:33.176010 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:32.998178 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:33.177024 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:33.176362 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:33.181265 24408 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:10:33.181833 22831 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:33.254684 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:33.255286 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 73575us
I20260709 12:10:33.255621 22198 raft_consensus.cc:2410] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 12:10:33.256527 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.223749 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.165167 24367 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.182960 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:33.181274 22236 leader_election.cc:336] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.933s (SENT)
I20260709 12:10:33.249419 24363 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:33.251226 24338 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.258277 22192 raft_consensus.cc:2410] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:33.140534 24334 raft_consensus.cc:3055] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:33.190764 22087 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.922s (SENT)
W20260709 12:10:33.277419 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 86690.9us
W20260709 12:10:33.278313 22087 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.991s (SENT)
I20260709 12:10:33.278801 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:33.261019 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 79784.7us
I20260709 12:10:33.264123 22237 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:33.280995 22236 leader_election.cc:336] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.933s (SENT)
I20260709 12:10:33.281562 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:33.266607 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.282949 22117 raft_consensus.cc:2410] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:10:33.284504 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:33.273972 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.285588 22117 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:33.275846 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:33.288108 22087 leader_election.cc:336] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.055s (SENT)
I20260709 12:10:33.302697 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.306087 24384 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:33.269235 24347 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.320307 24347 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.320897 24347 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.321496 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:33.323176 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:33.324400 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.330715 22117 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:10:33.343847 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:33.346395 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 65418.3us
W20260709 12:10:33.353871 22236 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.017s (SENT)
W20260709 12:10:33.354754 22236 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.017s (SENT)
I20260709 12:10:33.355250 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:33.356751 22236 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.429s (SENT)
I20260709 12:10:33.276728 24334 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:33.363876 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.365703 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:33.367182 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.295302 24344 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.376451 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:33.299758 24303 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.379805 22197 raft_consensus.cc:2410] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:33.403503 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:33.313166 24367 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.385200 22192 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.385970 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:33.401222 22087 leader_election.cc:336] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.146s (SENT)
I20260709 12:10:33.397146 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.409822 22197 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.268260 24401 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:10:33.324083 24384 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:10:33.429011 22087 leader_election.cc:336] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.186s (SENT)
I20260709 12:10:33.297639 22858 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:33.298314 24167 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 12:10:33.274971 24338 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:33.303678 24362 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:33.374136 24369 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:33.444276 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.455185 22195 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:33.446940 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 210) took 1206 ms. Trace:
I20260709 12:10:33.456429 22117 rpcz_store.cc:276] 0709 12:10:32.240517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.421239 (+1180722us) service_pool.cc:224] Handling call
0709 12:10:33.446351 (+ 25112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.446542 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.446573 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.446613 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:33.446649 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.446712 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.446865 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.286034 24363 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:33.402237 24303 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.478796 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.480149 22195 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:33.487670 22197 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
W20260709 12:10:33.489329 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.465916 24367 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:33.495481 22117 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:33.496345 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 211) took 1218 ms. Trace:
I20260709 12:10:33.497069 22117 rpcz_store.cc:276] 0709 12:10:32.278556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.476427 (+1197871us) service_pool.cc:224] Handling call
0709 12:10:33.495125 (+ 18698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.496016 (+   891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.496274 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.473129 24303 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.499732 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:33.473793 22190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.005s	sys 0.052s
W20260709 12:10:33.506122 22190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.006s	sys 0.052s
I20260709 12:10:33.506855 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:33.507540 24413 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:10:33.457278 24334 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:33.495290 24367 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:33.511215 24338 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:33.514823 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:33.519425 22863 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:10:33.518705 22271 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.037s	sys 0.061s
W20260709 12:10:33.520341 22271 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.038s	sys 0.061s
W20260709 12:10:33.537602 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.538700 24340 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:33.539059 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.539206 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.539522 24325 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:33.540134 22115 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:33.540210 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.541018 22117 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:33.543998 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:33.544359 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.511097 24367 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:33.547909 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.556069 22195 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:33.541576 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:33.567981 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:33.598170 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:33.599483 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:33.602133 24181 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.595397 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.606304 22117 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:33.609112 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.547273 24325 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:33.607293 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:33.505411 24384 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:33.541815 24338 consensus_queue.cc:1059] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:10:33.613196 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:33.554538 24350 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:33.626379 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:33.627296 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:33.623580 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.613972 24405 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.433s	user 0.004s	sys 0.000s
I20260709 12:10:33.610395 24377 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.612427 24325 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:33.622738 24340 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.610509 24258 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.610235 24286 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.634150 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:33.643095 22121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1489) took 2068 ms (client timeout 2191 ms). Trace:
I20260709 12:10:33.632966 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 208) took 2306 ms. Trace:
I20260709 12:10:33.629086 24367 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.632752 24259 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.636566 24287 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.633994 24384 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.644086 24340 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:33.663977 22121 rpcz_store.cc:269] 0709 12:10:31.574497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.616281 (+1041784us) service_pool.cc:224] Handling call
0709 12:10:33.642783 (+1026502us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5400311ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:33.643016 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4536064}
I20260709 12:10:33.638521 24338 consensus_queue.cc:1243] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:10:33.666914 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.633698 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:33.640311 24377 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.664152 22122 rpcz_store.cc:276] 0709 12:10:31.326821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.327257 (+   436us) service_pool.cc:224] Handling call
0709 12:10:31.343442 (+ 16185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.803766 (+1460324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.632657 (+828891us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54003df9d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:33.632892 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3125756288}
I20260709 12:10:33.645541 24258 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.689415 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:33.663564 24286 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.704716 22195 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:33.705039 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 321) took 1082 ms. Trace:
I20260709 12:10:33.706955 22122 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.691071 24287 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.710858 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1532) took 1199 ms. Trace:
I20260709 12:10:33.695989 24340 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.706857 24258 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.701058 24377 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.712021 22122 rpcz_store.cc:276] 0709 12:10:32.511138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.698809 (+1187671us) service_pool.cc:224] Handling call
0709 12:10:33.702737 (+  3928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.710504 (+  7767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.710790 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.707166 22194 rpcz_store.cc:276] 0709 12:10:32.617257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.627341 (+ 10084us) service_pool.cc:224] Handling call
0709 12:10:32.627728 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.744093 (+116365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.744124 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:32.777954 (+ 33830us) log.cc:844] Serialized 26 byte log entry
0709 12:10:32.827685 (+ 49731us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:32.827727 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.854993 (+ 27266us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002364d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:32.855044 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.540705 (+685661us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:33.699708 (+159003us) raft_consensus.cc:1685] finished
0709 12:10:33.699739 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.699956 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":18925,"spinlock_wait_cycles":240112640,"thread_start_us":40768,"threads_started":1,"wal-append.queue_time_us":167983}
I20260709 12:10:33.717115 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.703925 22115 raft_consensus.cc:1813] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
W20260709 12:10:33.723330 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 359993us
I20260709 12:10:33.724289 22192 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
W20260709 12:10:33.725009 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.727365 22195 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:33.698936 24338 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.691507 24259 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:33.701455 24363 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:33.708724 24286 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.735026 22121 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:33.747254 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.747640 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1533) took 1236 ms. Trace:
I20260709 12:10:33.748171 22121 rpcz_store.cc:276] 0709 12:10:32.511521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.712683 (+1201162us) service_pool.cc:224] Handling call
0709 12:10:33.734795 (+ 22112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.747383 (+ 12588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.747586 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.748588 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1721) took 1112 ms. Trace:
W20260709 12:10:33.746622 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 133499us
I20260709 12:10:33.713239 24287 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.751952 22266 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:33.752622 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 242) took 2124 ms. Trace:
I20260709 12:10:33.750948 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.752947 22266 rpcz_store.cc:276] 0709 12:10:31.628226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.628424 (+   198us) service_pool.cc:224] Handling call
0709 12:10:33.751318 (+2122894us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b5800180398. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:33.751521 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.752347 (+   826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.752531 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15529856}
I20260709 12:10:33.754446 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.755079 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1534) took 1243 ms. Trace:
I20260709 12:10:33.755544 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.755579 22121 rpcz_store.cc:276] 0709 12:10:32.511897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.749181 (+1237284us) service_pool.cc:224] Handling call
0709 12:10:33.754521 (+  5340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.754720 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.754745 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.754852 (+   107us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:33.754885 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.754934 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.755029 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.757557 22121 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:33.750885 22115 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:10:33.751150 24420 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:10:33.751519 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.765177 22194 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:33.758164 22191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1526) took 1688 ms (client timeout 1614 ms). Trace:
I20260709 12:10:33.760260 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:33.728259 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:33.767800 22191 rpcz_store.cc:269] 0709 12:10:32.069286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.106714 (+ 37428us) service_pool.cc:224] Handling call
0709 12:10:33.757935 (+1651221us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54001090d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:33.758070 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096193792}
I20260709 12:10:33.768584 22192 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
W20260709 12:10:33.746872 22263 consensus_meta.cc:287] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.842s	user 0.012s	sys 0.000s
I20260709 12:10:33.742473 24259 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.776602 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:33.746670 24350 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:33.793702 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:33.773401 22263 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:33.843922 23868 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:33.850629 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:33.824959 24193 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:33.844482 24419 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:10:33.855647 22121 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:33.836961 24431 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.865422 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:33.837229 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1715) took 1193 ms. Trace:
I20260709 12:10:33.783285 24325 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:33.856588 24369 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:10:33.861156 24434 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:33.893071 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.849756 24287 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:33.882282 24414 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:10:33.874754 24167 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:33.917215 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.922041 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.873101 22263 rpcz_store.cc:276] 0709 12:10:32.634354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.677214 (+ 42860us) service_pool.cc:224] Handling call
0709 12:10:33.827847 (+1150633us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:33.902341 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 108700us
W20260709 12:10:33.912940 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.893877 24350 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:33.926612 22163 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:33.928622 24435 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:10:33.929703 24428 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 12:10:33.931366 24429 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:33.869592 24431 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:33.921175 24325 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:33.939272 24347 consensus_meta.cc:287] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.003s
I20260709 12:10:33.949644 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 325) took 1060 ms. Trace:
W20260709 12:10:33.959594 24415 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 12:10:33.951586 24347 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:33.952155 22190 rpcz_store.cc:276] 0709 12:10:32.889658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.891178 (+  1520us) service_pool.cc:224] Handling call
0709 12:10:32.899280 (+  8102us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:32.949041 (+ 49761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.949073 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:32.949696 (+   623us) log.cc:844] Serialized 52 byte log entry
0709 12:10:33.506503 (+556807us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:33.513188 (+  6685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.517923 (+  4735us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.949356 (+431433us) raft_consensus.cc:1685] finished
0709 12:10:33.949376 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.949561 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34098,"raft.queue_time_us":34956,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":13774,"thread_start_us":556433,"threads_started":1,"wal-append.queue_time_us":692849}
W20260709 12:10:33.969807 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.973203 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 107836us
I20260709 12:10:33.975457 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:33.977844 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 246) took 1049 ms. Trace:
W20260709 12:10:33.965066 24395 consensus_meta.cc:287] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.966s	user 0.014s	sys 0.001s
I20260709 12:10:34.009656 24395 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.010504 24395 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.011087 24395 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.005488 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:10:33.990088 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 239440us
I20260709 12:10:34.015038 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:34.016875 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1737) took 1218 ms. Trace:
I20260709 12:10:33.978370 22267 rpcz_store.cc:276] 0709 12:10:32.928744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.928891 (+   147us) service_pool.cc:224] Handling call
0709 12:10:32.929247 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.929588 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.929615 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:32.930026 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.379336 (+449310us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:33.379397 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.379493 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.958912 (+579419us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:33.962300 (+  3388us) raft_consensus.cc:1685] finished
0709 12:10:33.962326 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.977746 (+ 15420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8080,"raft.queue_time_us":949,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10655,"spinlock_wait_cycles":8917248,"thread_start_us":448877,"threads_started":1,"wal-append.queue_time_us":682257}
I20260709 12:10:34.018329 22831 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:33.963258 24167 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.017822 22196 rpcz_store.cc:276] 0709 12:10:32.798452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.798928 (+   476us) service_pool.cc:224] Handling call
0709 12:10:32.994046 (+195118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.139871 (+145825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.016517 (+876646us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b5400235fd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:34.016755 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401992960}
I20260709 12:10:34.051635 22122 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 12:10:34.054082 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 77165.8us
I20260709 12:10:34.052449 22122 pending_rounds.cc:85] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 1
I20260709 12:10:34.056336 22122 pending_rounds.cc:107] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:34.056676 22122 raft_consensus.cc:2889] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:34.060842 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:34.059012 24426 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.062162 24167 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.065795 24287 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:34.085115 24426 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:34.057788 24278 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.059296 24268 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:34.114287 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.158510 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.174455 22122 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:34.204209 24421 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.521s	user 0.000s	sys 0.009s
I20260709 12:10:34.106757 24268 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:34.201925 24391 consensus_meta.cc:287] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.027s	user 0.008s	sys 0.006s
I20260709 12:10:34.100104 24278 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.224628 24431 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:34.241758 24268 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:34.238332 24278 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:34.252537 24286 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.239916 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 217) took 1225 ms. Trace:
I20260709 12:10:34.254254 22115 rpcz_store.cc:276] 0709 12:10:33.014887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.763610 (+748723us) service_pool.cc:224] Handling call
0709 12:10:33.763946 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.825399 (+ 61453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.827849 (+  2450us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.853544 (+ 25695us) log.cc:844] Serialized 26 byte log entry
0709 12:10:34.184698 (+331154us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:34.191330 (+  6632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.195890 (+  4560us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.239642 (+ 43752us) raft_consensus.cc:1685] finished
0709 12:10:34.239664 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.239825 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61915,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":17247,"thread_start_us":307311,"threads_started":2,"wal-append.queue_time_us":361511}
I20260709 12:10:34.256358 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:33.749526 22271 rpcz_store.cc:276] 0709 12:10:32.636332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.844039 (+207707us) service_pool.cc:224] Handling call
0709 12:10:32.844337 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.844556 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:33.520736 (+676180us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.747788 (+227052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.747858 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:33.747904 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.747993 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.748517 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":128514,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":11180,"thread_start_us":836467,"threads_started":2}
W20260709 12:10:34.262096 24258 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:10:34.313524 22115 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.313400 24258 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.313746 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:34.315367 22119 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.315512 24258 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:34.266372 24245 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.316129 24245 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.316507 24245 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.266511 22237 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:34.271028 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:34.273715 22263 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:34.274222 22264 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:34.275521 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:34.277693 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:34.278467 24167 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.433491 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:34.212608 24338 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.290719 22019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 136) took 5499 ms. Trace:
I20260709 12:10:34.222077 24391 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:34.219306 24303 consensus_meta.cc:287] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.003s
I20260709 12:10:34.222633 24347 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:34.311848 22266 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:34.321672 22269 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.316445 22119 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.323479 22263 pending_rounds.cc:85] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 6
I20260709 12:10:34.329559 22120 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:34.330997 24259 consensus_meta.cc:287] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.005s
W20260709 12:10:34.356401 24425 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.519s	user 0.005s	sys 0.003s
W20260709 12:10:34.357695 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 1.17325e+06us
I20260709 12:10:34.358050 24393 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:34.360179 24193 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:34.369354 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 308129us
W20260709 12:10:34.404078 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.379635 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.424453 22123 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:10:34.412493 22088 connection.cc:256] RPC call timeout handler was delayed by -1.0050996850000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260709 12:10:34.366568 22263 pending_rounds.cc:107] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:34.406247 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:34.359427 22019 rpcz_store.cc:276] 0709 12:10:28.791946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.792194 (+   248us) service_pool.cc:224] Handling call
0709 12:10:34.290614 (+5498420us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:29.997863 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:30.091838 (+ 93975us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:30.091914 (+    76us) write_op.cc:435] Acquired schema lock
0709 12:10:30.091942 (+    28us) tablet.cc:662] Decoding operations
0709 12:10:30.093511 (+  1569us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:30.093620 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:30.093660 (+    40us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:10:30.095162 (+  1502us) tablet.cc:701] Row locks acquired
0709 12:10:30.095291 (+   129us) write_op.cc:260] PREPARE: finished
0709 12:10:30.095574 (+   283us) write_op.cc:270] Start()
0709 12:10:30.095777 (+   203us) write_op.cc:276] Timestamp: P: 1783599030095481 usec, L: 0
0709 12:10:30.095808 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:10:30.183216 (+ 87408us) log.cc:844] Serialized 4400 byte log entry
0709 12:10:31.060695 (+877479us) op_driver.cc:464] REPLICATION: finished
0709 12:10:31.352986 (+292291us) write_op.cc:301] APPLY: starting
0709 12:10:31.364118 (+ 11132us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:31.535186 (+171068us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:31.572110 (+ 36924us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:32.215187 (+643077us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:32.215578 (+   391us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:10:32.215641 (+    63us) write_op.cc:312] APPLY: finished
0709 12:10:32.216120 (+   479us) log.cc:844] Serialized 83 byte log entry
0709 12:10:32.323330 (+107210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:32.344127 (+ 20797us) write_op.cc:454] Released schema lock
0709 12:10:32.344226 (+    99us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:32.396022 (+ 51796us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:32.399342 (+  3320us) write_op.cc:454] Released schema lock
0709 12:10:32.697429 (+298087us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddbf32a 00007fccedd44f14 00007fccedd44ec3 00007fccedd44e38 00007fccedd44df3 00007fccedd440dc 00007fccedd6de16 00007fccedd55cbb 00007fccedd4039d 00007fccedd43d75
Metrics: {"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":278426,"apply.run_cpu_time_us":56398,"apply.run_wall_time_us":995115,"num_ops":11,"prepare.queue_time_us":314650,"prepare.run_cpu_time_us":28610,"prepare.run_wall_time_us":697024,"raft.queue_time_us":189265,"raft.run_cpu_time_us":60554,"raft.run_wall_time_us":1764357,"replication_time_us":937864,"spinlock_wait_cycles":92375936,"thread_start_us":864646,"threads_started":5,"wal-append.queue_time_us":659809,"wal-append.run_cpu_time_us":14085,"wal-append.run_wall_time_us":2251517}]]}
I20260709 12:10:34.429618 22263 raft_consensus.cc:2889] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:34.435269 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:34.428350 22270 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
W20260709 12:10:34.428983 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.432094 24377 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.004s
I20260709 12:10:34.439765 24377 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.441036 24193 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.442302 24377 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:34.425158 24367 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.745s	user 0.007s	sys 0.007s
I20260709 12:10:34.427313 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:34.332535 24245 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.451596 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1719) took 1816 ms. Trace:
I20260709 12:10:34.380648 24303 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:34.438294 24340 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.003s
W20260709 12:10:34.477003 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 231907us
I20260709 12:10:34.395090 24345 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:10:34.400641 24259 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.484576 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1760) took 1164 ms. Trace:
I20260709 12:10:34.492157 22198 rpcz_store.cc:276] 0709 12:10:33.320080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.323374 (+  3294us) service_pool.cc:224] Handling call
0709 12:10:33.323653 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.342314 (+ 18661us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:33.426149 (+ 83835us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.190753 (+764604us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b18000781c0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a 00007fcceddcca2a
0709 12:10:34.484211 (+293458us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.484268 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:34.484317 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.484383 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.484502 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115659,"prepare.queue_time_us":80377,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":4576,"raft.queue_time_us":117846,"spinlock_wait_cycles":6148992,"thread_start_us":177473,"threads_started":1,"wal-append.queue_time_us":1042953}
W20260709 12:10:34.459213 24369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.024s	sys 0.042s
W20260709 12:10:34.497951 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.489199 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 222784us
I20260709 12:10:34.499059 24290 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:34.499884 24377 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:34.504549 24334 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.483767 24431 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.505743 24431 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.508071 24431 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:34.486351 24258 consensus_queue.cc:1059] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:10:34.509445 24258 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.509815 24258 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:34.510639 24258 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.511695 24450 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.508167 24245 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:34.512326 24450 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.512807 24450 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.512871 24245 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.513168 24249 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:34.513489 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.513847 24245 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.514323 24245 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.516371 24245 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:34.523170 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1542) took 1618 ms. Trace:
I20260709 12:10:34.523578 22123 rpcz_store.cc:276] 0709 12:10:32.904456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.175484 (+271028us) service_pool.cc:224] Handling call
0709 12:10:34.522947 (+1347463us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400215f54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:34.523109 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2810509056}
I20260709 12:10:34.452198 22272 rpcz_store.cc:276] 0709 12:10:32.635650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.813101 (+177451us) service_pool.cc:224] Handling call
0709 12:10:32.813510 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.813793 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:32.894619 (+ 80826us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.238467 (+1343848us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b18003e5960. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a
0709 12:10:34.451179 (+212712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.451246 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:34.451303 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.451372 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.451534 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103822,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":199043,"spinlock_wait_cycles":7981824,"thread_start_us":313598,"threads_started":3,"wal-append.queue_time_us":279480,"wal-append.run_cpu_time_us":1457,"wal-append.run_wall_time_us":1076959}
I20260709 12:10:34.453019 24274 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:34.511804 24258 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:34.517133 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 590542us
I20260709 12:10:34.482354 24193 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:34.520860 22118 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:34.462898 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:34.524441 22121 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.486982 24167 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.531273 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:34.461551 24286 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:34.530493 24274 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.536841 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1499) took 2957 ms. Trace:
I20260709 12:10:34.537498 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:34.531606 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1530) took 2021 ms. Trace:
I20260709 12:10:34.551950 22863 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:34.552112 22117 rpcz_store.cc:276] 0709 12:10:32.510176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.611606 (+1101430us) service_pool.cc:224] Handling call
0709 12:10:34.524680 (+913074us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:34.524889 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.531239 (+  6350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.531273 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.531320 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:34.531357 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.531418 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.531529 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11715840}
W20260709 12:10:34.554177 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 91394.2us
W20260709 12:10:34.460723 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.498332 24369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.026s	sys 0.043s
I20260709 12:10:34.546476 24259 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:34.546893 24167 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.571789 24361 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.572016 24167 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.572418 24361 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:34.548707 24325 consensus_meta.cc:287] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
I20260709 12:10:34.573053 24377 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:34.573395 24361 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.573975 24377 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.574388 24377 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:34.578022 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 563060us
W20260709 12:10:34.578572 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.579038 24395 consensus_meta.cc:287] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.001s
I20260709 12:10:34.579406 24344 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.579466 24395 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.580945 24350 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.581476 24350 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.583559 24350 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:34.583438 24377 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.584108 24350 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.584805 24377 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.585079 22831 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:34.588392 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1551) took 1045 ms. Trace:
I20260709 12:10:34.589108 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:34.589874 24426 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:34.591869 24426 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.592257 24426 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.580965 22265 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:10:34.593044 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 165777us
I20260709 12:10:34.596483 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:34.492172 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:34.559652 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:34.599298 22198 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:34.551200 24287 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:10:34.560148 24434 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:34.560690 24439 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:10:34.562312 24274 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:34.562239 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:34.562764 24456 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.562690 22114 rpcz_store.cc:276] 0709 12:10:31.579809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.854543 (+1274734us) service_pool.cc:224] Handling call
0709 12:10:32.963775 (+109232us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:32.964037 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.985851 (+ 21814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.989459 (+  3608us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.272355 (+282896us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.758758 (+486403us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:33.768035 (+  9277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.773348 (+  5313us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.355559 (+582211us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:34.524653 (+169094us) raft_consensus.cc:1685] finished
0709 12:10:34.529209 (+  4556us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.536750 (+  7541us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8303,"raft.queue_time_us":14468,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":16430336,"thread_start_us":400196,"threads_started":1,"wal-append.queue_time_us":437598}
I20260709 12:10:34.486603 24181 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
W20260709 12:10:34.565420 24384 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.869s	user 0.013s	sys 0.001s
I20260709 12:10:34.567313 24303 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:34.568981 24363 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.569703 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 213) took 1597 ms. Trace:
I20260709 12:10:34.569955 24391 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:34.488574 24340 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.570950 22237 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:34.659614 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 88758.3us
I20260709 12:10:34.571499 24249 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:34.602797 22269 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:34.603108 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:34.661713 22118 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:34.600899 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:34.662931 22120 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:34.620003 22088 leader_election.cc:336] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.636s (SENT)
I20260709 12:10:34.592603 24426 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.625586 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:34.571003 22115 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:34.629606 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:34.664137 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:34.664680 22193 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:34.629837 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:34.665680 22197 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 2.
I20260709 12:10:34.588793 22122 rpcz_store.cc:276] 0709 12:10:33.542634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.199141 (+656507us) service_pool.cc:224] Handling call
0709 12:10:34.213975 (+ 14834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.214289 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:34.309773 (+ 95484us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.588092 (+278319us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.588141 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:34.588183 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.588242 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.588341 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136323,"prepare.queue_time_us":95968,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":137555,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":141520,"threads_started":1,"wal-append.queue_time_us":234358}
I20260709 12:10:34.631290 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:34.666760 22117 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.592684 24393 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.641402 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:34.593068 24297 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.630249 24259 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:10:34.584592 24350 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.621901 24352 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.654223 22087 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:34.653952 22116 rpcz_store.cc:276] 0709 12:10:32.971893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.754843 (+782950us) service_pool.cc:224] Handling call
0709 12:10:33.755212 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.755601 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.755638 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.756205 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.779933 (+ 23728us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:33.802023 (+ 22090us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.569087 (+767064us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b18002a3be0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceac4fc0a 00007fccf438f219 00007fcceacd7a40 00007fcceacd24e4 00007fcceacd2455 00007fcceddba060 00007fcceddcc716 00007fccedddd287 00007fccedddd208
0709 12:10:34.569299 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.569376 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.569425 (+    49us) raft_consensus.cc:1685] finished
0709 12:10:34.569504 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.569644 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":771105,"prepare.queue_time_us":23812,"raft.queue_time_us":816784,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":19742,"spinlock_wait_cycles":72503424,"thread_start_us":19657,"threads_started":1,"wal-append.queue_time_us":47329}
I20260709 12:10:34.690546 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:34.661798 22831 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:34.691167 22116 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:34.604481 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49544.1us
I20260709 12:10:34.632649 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:34.677785 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1546) took 1158 ms. Trace:
I20260709 12:10:34.656629 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:34.679924 22197 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:34.692173 22863 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.692204 22121 rpcz_store.cc:276] 0709 12:10:33.519578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.876372 (+356794us) service_pool.cc:224] Handling call
0709 12:10:34.524279 (+647907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.541214 (+ 16935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.677541 (+136327us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400215f50. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:34.677719 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464749824}
W20260709 12:10:34.689452 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 66710.6us
I20260709 12:10:34.696343 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:34.699393 22123 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:34.659225 24344 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.677673 24440 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:34.708580 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 146418us
I20260709 12:10:34.701303 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:34.703850 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:34.677219 24369 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.642144 24438 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:10:34.711421 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:34.710716 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.714110 22236 connection.cc:256] RPC call timeout handler was delayed by -1.9138522360001389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
W20260709 12:10:34.715561 22236 leader_election.cc:336] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.510s (SENT)
I20260709 12:10:34.715902 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:34.711097 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:34.718151 22118 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:34.720507 22163 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:34.722368 22863 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:10:34.723258 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:34.702183 24338 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.724790 22119 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.734519 22116 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:34.738746 24439 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:34.681427 24249 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.703517 24384 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:34.739916 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.740989 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:34.730954 22117 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:34.712846 24369 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.741575 22118 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.749707 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:34.750052 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 130090us
W20260709 12:10:34.760226 22088 leader_election.cc:336] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.731s (SENT)
I20260709 12:10:34.760807 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:34.681784 24393 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:34.756615 22236 leader_election.cc:336] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.524s (SENT)
I20260709 12:10:34.764693 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:34.773625 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:34.775275 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:34.775899 22196 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:10:34.713114 24297 consensus_queue.cc:1059] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:34.788064 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:34.724149 22114 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:34.737412 24368 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.788837 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:34.814181 22191 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:34.849550 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 76008.5us
I20260709 12:10:34.850703 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:34.827131 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.848788 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 88571.7us
I20260709 12:10:34.848804 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:34.852478 22088 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.883s (SENT)
I20260709 12:10:34.739202 24439 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:34.856478 22120 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:34.744732 24363 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.749320 24438 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.862010 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:34.859195 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:34.764262 24369 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.744621 24338 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:34.859506 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:34.862164 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:34.862917 22196 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.788841 24434 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.763052 24391 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.781020 24287 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.771219 24245 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.783377 24303 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.813540 24384 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:34.923444 24439 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.924976 24439 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.874426 22191 raft_consensus.cc:2393] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:34.717895 24440 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.924589 24384 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.927946 24440 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:34.878384 22192 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:34.882651 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:34.883457 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 117191us
I20260709 12:10:34.812985 24395 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:34.929239 22190 raft_consensus.cc:2368] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:34.845818 24448 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:34.929226 22236 connection.cc:256] RPC call timeout handler was delayed by -1.8634522360000574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
I20260709 12:10:34.904191 24287 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:34.772498 24268 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:10:34.930222 24448 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.932785 24448 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:34.930250 22236 connection.cc:256] RPC call timeout handler was delayed by -1.7392522360000839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23290000000000002s for a response
W20260709 12:10:34.933766 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6585779160000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:10:34.934103 22236 connection.cc:256] RPC call timeout handler was delayed by -1.5952522360000785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2489s for a response
I20260709 12:10:34.935979 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:34.942155 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:34.942862 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:34.943742 22271 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.942869 22266 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.858631 24368 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.861822 24438 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:34.859107 24430 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.938925 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:34.861989 24361 raft_consensus.cc:3055] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.747440 24465 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.183s
W20260709 12:10:34.952464 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.868847 24352 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:34.917270 24414 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:10:34.960536 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 108089us
W20260709 12:10:35.008739 22088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.916s (SENT) [suppressed 78 similar messages]
W20260709 12:10:35.009586 22088 leader_election.cc:336] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.016s (SENT)
I20260709 12:10:35.009996 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:34.964422 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:35.011634 22270 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:34.970319 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.934806 24287 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:34.904651 24464 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.027376 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:34.868677 24470 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.954618 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:35.015353 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:10:35.021575 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 232841us
I20260709 12:10:34.953106 24368 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.041249 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:35.042083 22267 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:35.043700 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 193124us
I20260709 12:10:35.045202 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:35.048730 24468 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.960225 24361 raft_consensus.cc:740] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:35.064538 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:34.877363 24434 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:35.062840 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:35.007159 24259 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.010078 24448 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:35.087514 24448 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:35.088527 24278 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:35.089038 24278 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:35.089687 24448 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:35.090197 24457 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
W20260709 12:10:35.090901 24417 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.350s	user 0.010s	sys 0.017s
I20260709 12:10:35.090672 24259 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.036643 24338 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:34.956959 24340 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:35.067278 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:35.098570 22265 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.105135 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:10:35.105719 24460 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:10:35.105867 24384 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.106434 24384 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:35.107702 24472 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:10:35.072016 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 62442.8us
I20260709 12:10:35.111775 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:35.112671 22863 raft_consensus.cc:2410] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:35.082247 22270 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.012058 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:35.085726 24360 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:35.086447 24431 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.086637 24434 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:35.089882 24278 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:35.034365 24287 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.114809 22237 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:35.092578 24259 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.117477 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:35.024338 24440 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.120187 22120 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:35.113108 22270 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:35.113132 22180 tablet_service.cc:1558] Processing DeleteTablet for tablet 1baa23cb6635453b9a9cd5ec7e452f6a with delete_type TABLET_DATA_TOMBSTONED (TS 7d3f536360b444b1886777f4776be22c not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56158
W20260709 12:10:35.120919 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 75864.6us
I20260709 12:10:35.193943 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:35.064698 24347 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:35.136807 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.052753 24350 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:35.143496 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:35.082554 24395 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:35.115067 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 160538us
I20260709 12:10:35.061014 24366 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 12:10:35.208003 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:35.136015 24414 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:10:35.140250 22007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f86b841ece254f9bbfd1bd07c08f7004 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cc9b9c8894084021a0c6ddaf659d222e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:10:35.211546 22007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 80620.2us
I20260709 12:10:35.177418 22271 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:35.191105 22265 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:35.214514 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:35.216569 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:35.217749 24477 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:35.218297 24456 consensus_meta.cc:287] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.001s
I20260709 12:10:35.218835 24456 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.219628 24456 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.220314 24456 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.186033 24448 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:35.221160 24448 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:35.221560 24395 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:35.222620 24395 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:35.224100 24377 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.639s	user 0.005s	sys 0.004s
I20260709 12:10:35.135484 24431 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:35.196910 24446 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.196928 24245 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.197458 24278 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:35.198132 24459 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.487s	user 0.002s	sys 0.001s
I20260709 12:10:35.198271 22270 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:35.200371 22163 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:35.140563 22264 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.203123 22191 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:35.202636 24347 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.140641 24384 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:35.195266 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50318.9us
I20260709 12:10:35.146453 24367 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.223898 24167 consensus_meta.cc:287] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.000s
I20260709 12:10:35.184290 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:35.240677 22267 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:35.064052 24438 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:35.206506 22190 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:35.286742 22266 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
W20260709 12:10:35.254930 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 54669.9us
I20260709 12:10:35.206583 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:35.227016 24303 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.208514 24249 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:35.256932 22270 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.257723 24245 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:35.257944 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:35.260995 24377 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:35.266973 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.209075 24478 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.268546 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:35.319521 22197 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:35.321533 22272 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:35.283601 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 168867us
I20260709 12:10:35.287621 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:35.324532 22123 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:35.287647 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:35.290890 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.290760 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:35.296101 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:35.326980 22117 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
W20260709 12:10:35.297259 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.307971 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50105us
I20260709 12:10:35.275988 24347 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.282212 24393 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:35.314845 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:35.192497 24361 consensus_queue.cc:260] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:35.338909 22191 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:35.320554 24468 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:35.345767 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.292601 24363 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:35.340847 22163 connection.cc:256] RPC call timeout handler was delayed by -2.0906845550000526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 12:10:35.357371 22163 connection.cc:256] RPC call timeout handler was delayed by -2.0870845550000467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:10:35.357869 22163 connection.cc:256] RPC call timeout handler was delayed by -1.9907845550001184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
I20260709 12:10:35.225039 24360 raft_consensus.cc:2955] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:10:35.365783 24477 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.367504 22270 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:35.305368 24350 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:35.253993 24446 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:35.370971 22265 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:35.343147 24438 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.375085 22196 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:10:35.375481 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:35.376348 22163 connection.cc:256] RPC call timeout handler was delayed by -1.7972845550000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
I20260709 12:10:35.377441 22270 pending_rounds.cc:85] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 1
I20260709 12:10:35.318856 22858 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:35.330523 24430 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:35.293141 24167 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:35.291409 24458 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:10:35.411298 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:35.374919 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:35.431639 22271 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.432149 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:35.288592 24367 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:35.411634 22270 pending_rounds.cc:107] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:35.433254 22270 raft_consensus.cc:2889] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:35.411008 22163 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:35.443364 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 226836us
I20260709 12:10:35.451709 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:35.454356 22270 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:35.453120 22271 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:35.457193 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:35.412228 24480 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:10:35.383375 24468 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:35.457845 22271 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.452894 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:35.384249 24361 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:35.463963 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.459482 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:35.438122 24249 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:35.380600 24434 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:10:35.384019 24384 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.492197 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:35.513087 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:35.383587 24465 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 12:10:35.409081 24350 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:35.437707 24430 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:35.438908 24245 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:35.736616 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.700062 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1779) took 1002 ms. Trace:
I20260709 12:10:35.565351 22266 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:35.927649 22830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.039s	sys 0.030s
I20260709 12:10:35.662485 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:35.526253 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.521539 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.856246 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.724480 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.617494 22271 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
W20260709 12:10:35.489465 24369 consensus_meta.cc:287] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.001s
I20260709 12:10:36.194190 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:36.248235 22265 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:36.253489 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.193900 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 741036us
I20260709 12:10:36.195892 22270 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:36.196280 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 220) took 1585 ms. Trace:
I20260709 12:10:36.255528 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:36.250103 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.256150 22119 rpcz_store.cc:276] 0709 12:10:34.610465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.734757 (+124292us) service_pool.cc:224] Handling call
0709 12:10:34.755012 (+ 20255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.846395 (+ 91383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.846436 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:34.853658 (+  7222us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.306215 (+452557us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:35.306281 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.306389 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.701900 (+395511us) raft_consensus.cc:1685] finished
0709 12:10:35.701929 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.196206 (+494277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90924,"raft.queue_time_us":93739,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":7989,"thread_start_us":355022,"threads_started":1,"wal-append.queue_time_us":614659}
I20260709 12:10:35.516078 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:35.573184 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.457942 24470 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:36.250533 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.195690 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:10:36.251191 22830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.052s	sys 0.048s
W20260709 12:10:36.263644 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 972922us
W20260709 12:10:35.979306 22120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.021s	sys 0.020s
W20260709 12:10:36.264407 22120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.026s	sys 0.025s
I20260709 12:10:35.636737 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:35.707274 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 329) took 1080 ms. Trace:
I20260709 12:10:35.461962 24477 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:36.250851 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.254339 22267 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.658068 22115 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.694175 24491 tablet_replica.cc:333] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
W20260709 12:10:36.079416 24450 consensus_meta.cc:287] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.566s	user 0.011s	sys 0.001s
I20260709 12:10:35.965788 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 218) took 1356 ms. Trace:
I20260709 12:10:36.261869 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:36.187952 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:35.461570 24344 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.791s
I20260709 12:10:36.268687 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:36.262677 24395 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.175916 24347 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.846s	user 0.009s	sys 0.000s
I20260709 12:10:36.294493 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:36.120123 24426 consensus_meta.cc:287] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 1.437s	user 0.011s	sys 0.000s
W20260709 12:10:36.144822 24368 consensus_meta.cc:287] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 1.060s	user 0.011s	sys 0.001s
W20260709 12:10:35.516902 24439 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.001s
W20260709 12:10:35.658232 24453 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:10:36.108734 24278 consensus_meta.cc:287] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.839s	user 0.008s	sys 0.000s
I20260709 12:10:35.657886 24466 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.248383 22193 rpcz_store.cc:276] 0709 12:10:34.697678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.697804 (+   126us) service_pool.cc:224] Handling call
0709 12:10:34.698132 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.846818 (+148686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.846847 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:34.862168 (+ 15321us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.286499 (+424331us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:35.286536 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.286602 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.699700 (+413098us) raft_consensus.cc:1685] finished
0709 12:10:35.699733 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.699983 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46127,"raft.queue_time_us":72784,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":66988,"thread_start_us":459011,"threads_started":2,"wal-append.queue_time_us":526674}
I20260709 12:10:36.074173 24446 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:36.172220 24286 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.961362 24249 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:36.169179 24258 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:35.652725 24287 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.656450 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:35.654080 24434 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.328377 24434 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:36.329413 24434 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.330560 24434 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.297086 24395 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:35.658547 24444 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:10:36.253949 24384 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.664281 24167 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:35.613623 24495 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.930760 24440 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:35.652581 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:36.265120 22198 rpcz_store.cc:276] 0709 12:10:34.627282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.627745 (+   463us) service_pool.cc:224] Handling call
0709 12:10:34.628101 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.705152 (+ 77051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.705185 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.705225 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:34.705259 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.706918 (+1001659us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b54000fc8d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:35.706985 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.707182 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176699648}
I20260709 12:10:36.270262 24470 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.261951 24492 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:35.666349 24367 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:36.290470 22265 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:35.965925 24479 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.739s	user 0.001s	sys 0.000s
I20260709 12:10:36.293360 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:36.149386 24259 consensus_meta.cc:287] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.948s	user 0.012s	sys 0.000s
I20260709 12:10:36.270730 24477 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:36.295377 22271 raft_consensus.cc:1813] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
I20260709 12:10:35.459743 24363 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.289832 24450 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.403664 24477 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.406786 24450 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:36.166332 22264 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.875s	user 0.010s	sys 0.000s
I20260709 12:10:36.302012 24458 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.299984 24290 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.298055 24426 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.309145 24431 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.294521 24478 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:36.296674 24438 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.884s	user 0.009s	sys 0.003s
I20260709 12:10:36.291177 24465 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.688611 24468 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.312305 24286 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:36.314349 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:36.439826 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 125559us
I20260709 12:10:36.441004 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:36.318564 22267 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:36.444120 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1605) took 1081 ms. Trace:
I20260709 12:10:36.444594 22267 rpcz_store.cc:276] 0709 12:10:35.362676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.707571 (+344895us) service_pool.cc:224] Handling call
0709 12:10:36.444027 (+736456us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.446098 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:36.446940 22267 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:36.447551 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1592) took 1088 ms. Trace:
I20260709 12:10:36.447924 22267 rpcz_store.cc:276] 0709 12:10:35.359332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.445724 (+1086392us) service_pool.cc:224] Handling call
0709 12:10:36.447480 (+  1756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.319979 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 335) took 1595 ms. Trace:
I20260709 12:10:36.312294 22263 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:36.284214 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:36.288511 22114 rpcz_store.cc:276] 0709 12:10:34.609785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.641078 (+ 31293us) service_pool.cc:224] Handling call
0709 12:10:35.965540 (+1324462us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b54002ae4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:35.965704 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85230464}
I20260709 12:10:36.298131 24347 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.316728 24439 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.321432 24446 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:36.317248 24466 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:36.320801 24258 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:36.398846 24249 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.336133 24436 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.465394 24345 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:36.337570 22123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.061s	sys 0.097s
W20260709 12:10:36.496658 22123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.061s	sys 0.097s
I20260709 12:10:36.497534 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1568) took 1202 ms. Trace:
I20260709 12:10:36.497879 22123 rpcz_store.cc:276] 0709 12:10:35.295168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.325458 (+ 30290us) service_pool.cc:224] Handling call
0709 12:10:35.325746 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.336363 (+ 10617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.336391 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.345010 (+  8619us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.497148 (+1152138us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:36.497187 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.497269 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.497338 (+    69us) raft_consensus.cc:1685] finished
0709 12:10:36.497356 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.497481 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13346,"raft.queue_time_us":10733,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":15370,"thread_start_us":1151827,"threads_started":1,"wal-append.queue_time_us":1078791}
I20260709 12:10:36.304968 24368 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.502476 22193 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.399015 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1612) took 1034 ms. Trace:
I20260709 12:10:36.500449 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 337) took 1384 ms. Trace:
I20260709 12:10:36.401342 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1610) took 1037 ms. Trace:
I20260709 12:10:36.402761 22271 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:36.503670 22268 rpcz_store.cc:276] 0709 12:10:35.363898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.283754 (+919856us) service_pool.cc:224] Handling call
0709 12:10:36.401245 (+117491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.407753 22264 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
W20260709 12:10:36.509356 22264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1728) took 1567 ms (client timeout 1548 ms). Trace:
W20260709 12:10:36.509881 22264 rpcz_store.cc:269] 0709 12:10:34.942052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.950377 (+  8325us) service_pool.cc:224] Handling call
0709 12:10:36.509241 (+1558864us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.511234 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:36.512055 22264 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:36.408411 22269 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:36.354816 24384 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.384887 24467 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.382995 24361 consensus_meta.cc:287] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.890s	user 0.010s	sys 0.000s
I20260709 12:10:36.517319 24467 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.387230 24470 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.518242 24361 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.391299 24167 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:36.417416 24290 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.518774 24361 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.520841 24361 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:36.521644 24290 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:36.423297 24431 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:36.403491 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 148043us
I20260709 12:10:36.403684 24350 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:36.403643 24259 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.503602 24345 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.525853 24345 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.390605 24440 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.528328 24440 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:36.379258 24495 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.461370 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:36.465340 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1591) took 1120 ms. Trace:
W20260709 12:10:36.431766 24451 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.340s	user 0.005s	sys 0.000s
W20260709 12:10:36.473145 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 281359us
I20260709 12:10:36.323498 24287 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:36.428581 24464 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.541159 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:36.399278 24492 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.269634 24369 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.463460 24395 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:36.461692 24450 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:36.502985 22265 rpcz_store.cc:276] 0709 12:10:35.364361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.262496 (+898135us) service_pool.cc:224] Handling call
0709 12:10:36.398935 (+136439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.376555 22859 raft_consensus.cc:2410] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:36.504140 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1599) took 1142 ms. Trace:
I20260709 12:10:36.559666 22271 rpcz_store.cc:276] 0709 12:10:35.361234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.294110 (+932876us) service_pool.cc:224] Handling call
0709 12:10:36.504078 (+209968us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:36.426363 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 789708us
I20260709 12:10:36.561460 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:36.562973 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:36.471606 24367 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.530283 22267 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.530318 22270 rpcz_store.cc:276] 0709 12:10:35.345336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.261634 (+916298us) service_pool.cc:224] Handling call
0709 12:10:36.465242 (+203608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.512630 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1606) took 1149 ms. Trace:
I20260709 12:10:36.503597 22194 rpcz_store.cc:276] 0709 12:10:35.116471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.116629 (+   158us) service_pool.cc:224] Handling call
0709 12:10:35.141769 (+ 25140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.202327 (+ 60558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.202363 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.202410 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:35.202437 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.500098 (+1297661us) spinlock_profiling.cc:243] Waited 60.3 ms on lock 0x7b54001bf3d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:36.500165 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.500360 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138707328}
I20260709 12:10:36.477614 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1726) took 1534 ms. Trace:
I20260709 12:10:36.416316 24458 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.457201 22195 rpcz_store.cc:276] 0709 12:10:34.724756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.724966 (+   210us) service_pool.cc:224] Handling call
0709 12:10:34.744270 (+ 19304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.814660 (+ 70390us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:35.013919 (+199259us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.143043 (+129124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.143107 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:35.143165 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.319647 (+1176482us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b540011b054. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:36.319715 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.319896 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":193188,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":9366,"raft.queue_time_us":74586,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"spinlock_wait_cycles":161221888,"thread_start_us":282403,"threads_started":2,"wal-append.queue_time_us":209749,"wal-append.run_cpu_time_us":1359,"wal-append.run_wall_time_us":1050228}
I20260709 12:10:36.542287 22268 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:36.526747 24259 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:36.429376 24478 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.493357 24430 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:36.475340 24439 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.462484 24465 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:36.619719 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 87305.9us
I20260709 12:10:36.541307 24287 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:36.613862 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50964.9us
I20260709 12:10:36.633013 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:36.477427 24446 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.541188 24167 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:36.616552 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:36.643668 22265 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:36.644184 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1601) took 1282 ms. Trace:
I20260709 12:10:36.644487 22265 rpcz_store.cc:276] 0709 12:10:35.361747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.616225 (+1254478us) service_pool.cc:224] Handling call
0709 12:10:36.644129 (+ 27904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.623122 22264 rpcz_store.cc:276] 0709 12:10:35.362934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.510871 (+1147937us) service_pool.cc:224] Handling call
0709 12:10:36.512568 (+  1697us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:36.621290 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 134544us
I20260709 12:10:36.646128 22264 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.627903 22267 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:36.646916 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1590) took 1306 ms. Trace:
I20260709 12:10:36.646962 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1609) took 1283 ms. Trace:
I20260709 12:10:36.647604 22267 rpcz_store.cc:276] 0709 12:10:35.363636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.448694 (+1085058us) service_pool.cc:224] Handling call
0709 12:10:36.646877 (+198183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.555634 24504 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:36.647418 22264 rpcz_store.cc:276] 0709 12:10:35.341023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.645508 (+1304485us) service_pool.cc:224] Handling call
0709 12:10:36.645891 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.646623 (+   732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.646847 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:36.642079 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 140323us
I20260709 12:10:36.650530 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:36.653180 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1598) took 1292 ms. Trace:
I20260709 12:10:36.615995 24507 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.651589 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:36.653498 22264 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.605923 24509 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.653342 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1595) took 1293 ms. Trace:
I20260709 12:10:36.653939 24507 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.654263 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1597) took 1293 ms. Trace:
I20260709 12:10:36.654271 24509 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.655548 22264 rpcz_store.cc:276] 0709 12:10:35.360716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.653038 (+1292322us) service_pool.cc:224] Handling call
0709 12:10:36.653329 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.654031 (+   702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.654209 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.653539 22268 rpcz_store.cc:276] 0709 12:10:35.360992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.617540 (+1256548us) service_pool.cc:224] Handling call
0709 12:10:36.653119 (+ 35579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.613737 24506 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:36.657042 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.617453 24367 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.617266 24245 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:36.679708 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 154515us
I20260709 12:10:36.616957 24290 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:36.683722 22268 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:36.684345 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1602) took 1322 ms. Trace:
I20260709 12:10:36.600844 24497 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.678079 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1589) took 1340 ms. Trace:
I20260709 12:10:36.684623 22268 rpcz_store.cc:276] 0709 12:10:35.361978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.656840 (+1294862us) service_pool.cc:224] Handling call
0709 12:10:36.683548 (+ 26708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.684128 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.684298 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.685078 22265 rpcz_store.cc:276] 0709 12:10:35.337947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.645134 (+1307187us) service_pool.cc:224] Handling call
0709 12:10:36.677568 (+ 32434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.677761 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.677785 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.677836 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:36.677865 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.677912 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.678022 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.655298 22267 rpcz_store.cc:276] 0709 12:10:35.360201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.649039 (+1288838us) service_pool.cc:224] Handling call
0709 12:10:36.649437 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.649668 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.649704 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.653067 (+  3363us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:36.653118 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.653183 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.653291 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.681169 22163 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:36.689332 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:36.691197 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:36.692168 22117 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:36.695047 24496 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:36.696625 22123 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:36.555974 24258 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.698163 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:36.601111 24450 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.664592 24476 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:36.545226 24286 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.656510 24507 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:36.552081 24464 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.699290 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:36.781572 22117 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:36.782821 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:36.783658 22117 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:36.725205 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:36.726634 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45543.2us
W20260709 12:10:36.785053 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.606544 22263 rpcz_store.cc:276] 0709 12:10:34.940915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.960656 (+ 19741us) service_pool.cc:224] Handling call
0709 12:10:36.187720 (+1227064us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b5800180398. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:36.475112 (+287392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17837824}
I20260709 12:10:36.726208 22264 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:36.698895 24502 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.286s	user 0.000s	sys 0.004s
I20260709 12:10:36.707224 22123 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:36.726300 24436 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:10:36.779524 22265 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.725171 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:36.724586 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:36.787686 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:36.754490 24494 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.341s	user 0.001s	sys 0.001s
W20260709 12:10:36.791180 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 261203us
I20260709 12:10:36.804942 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1587) took 1479 ms. Trace:
I20260709 12:10:36.805155 22195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:36.805548 22272 rpcz_store.cc:276] 0709 12:10:35.325991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.326141 (+   150us) service_pool.cc:224] Handling call
0709 12:10:35.335449 (+  9308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.383088 (+ 47639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.383136 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.413785 (+ 30649us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.973325 (+559540us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:35.973371 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.973452 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.804627 (+831175us) raft_consensus.cc:1685] finished
0709 12:10:36.804657 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.804866 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26318,"raft.queue_time_us":18377,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":29599,"thread_start_us":474769,"threads_started":1,"wal-append.queue_time_us":917486}
I20260709 12:10:36.787292 22122 raft_consensus.cc:2368] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:36.808056 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:36.795080 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1604) took 1432 ms. Trace:
I20260709 12:10:36.727773 24395 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.724872 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:36.724602 24508 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.706107 24514 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.751868 24476 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:36.714035 24350 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
W20260709 12:10:36.786892 24501 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.359s	user 0.001s	sys 0.001s
I20260709 12:10:36.764122 24506 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.762662 24468 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:36.829007 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:36.664104 24504 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.816184 22265 rpcz_store.cc:276] 0709 12:10:35.362442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.701370 (+1338928us) service_pool.cc:224] Handling call
0709 12:10:36.779251 (+ 77881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.794736 (+ 15485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.795011 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.809645 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:36.700996 24290 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.788882 24426 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:36.605401 24466 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:36.825708 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 125466us
I20260709 12:10:36.795045 24286 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.829890 22196 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:36.830229 22268 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.778431 24496 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:36.810603 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:36.809916 24510 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:36.837118 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.818445 24514 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.804276 24245 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.853327 22189 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
W20260709 12:10:36.830849 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 197940us
I20260709 12:10:36.867435 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:36.857802 22192 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:36.858378 22088 connection.cc:256] RPC call timeout handler was delayed by -1.5132981090002886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.275s for a response
I20260709 12:10:36.860179 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:36.868835 22088 connection.cc:256] RPC call timeout handler was delayed by -1.4565981090001969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28130000000000005s for a response
I20260709 12:10:36.823988 22115 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:36.830113 24467 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:36.832737 24440 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:36.872923 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:36.888023 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1566) took 1593 ms. Trace:
I20260709 12:10:36.896207 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:36.897171 22122 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.878248 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:36.870620 24507 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:36.837630 24384 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:36.892206 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.865543 24363 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.900200 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.888525 22120 rpcz_store.cc:276] 0709 12:10:35.294585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.295730 (+  1145us) service_pool.cc:224] Handling call
0709 12:10:35.323610 (+ 27880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.330911 (+  7301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.330938 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.331388 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.271015 (+939627us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:36.271063 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.271136 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.887788 (+616652us) raft_consensus.cc:1685] finished
0709 12:10:36.887810 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.887957 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15112,"raft.queue_time_us":12202,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4608,"thread_start_us":911432,"threads_started":1,"wal-append.queue_time_us":1035400}
I20260709 12:10:36.867529 24514 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.870200 24509 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:36.820878 24508 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.831844 24506 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:36.943522 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.884073 24369 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:36.944758 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51882.8us
I20260709 12:10:36.953977 22236 leader_election.cc:400] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4.
I20260709 12:10:36.889691 22121 raft_consensus.cc:2955] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:10:36.944345 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.957121 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.959570 22088 connection.cc:256] RPC call timeout handler was delayed by -1.1208981090001089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3186s for a response
I20260709 12:10:36.884492 24520 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:36.888756 24525 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.964861 22236 leader_election.cc:400] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 2 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 2. Current term is 3.
I20260709 12:10:36.843837 24167 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.873994 24245 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:36.905153 24507 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:36.942649 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:36.942629 24439 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:36.979097 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:37.000273 22088 leader_election.cc:336] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.515s (SENT)
I20260709 12:10:37.000975 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:36.972709 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:36.942378 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:37.028455 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55820.6us
I20260709 12:10:36.979988 22120 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:37.068403 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:36.946383 24495 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:37.076126 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:36.888330 24440 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:36.974061 24511 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.309s	user 0.000s	sys 0.002s
I20260709 12:10:37.062525 22858 raft_consensus.cc:2410] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:37.088080 24533 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:36.970332 24367 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:36.893762 24476 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.973812 24507 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.089367 24506 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:37.078791 24395 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:37.093575 24517 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
W20260709 12:10:37.096320 24521 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:10:36.977231 24492 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:36.982805 24478 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:37.079079 24450 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:36.953047 24363 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:37.087468 24526 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.087842 24530 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.073956 22114 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.075591 24520 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:36.972718 24509 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:36.971623 24458 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.061902 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:37.062328 24465 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.074937 24369 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:37.151697 24530 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:37.083698 24350 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:37.121819 24526 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.173355 24528 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.076839 24529 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:37.152673 24495 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:37.170435 24509 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.195988 24290 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.152520 24520 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:37.195729 24529 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:36.972769 24525 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:37.208847 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 138579us
W20260709 12:10:37.216384 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 216149us
I20260709 12:10:37.187879 24446 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:37.221308 22088 leader_election.cc:336] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.536s (SENT)
I20260709 12:10:37.197364 24495 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:37.224898 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:37.226869 22088 leader_election.cc:336] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.548s (SENT)
I20260709 12:10:37.227147 22191 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:37.227717 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:37.217612 24338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.122s	user 0.012s	sys 0.019s
W20260709 12:10:37.229176 24338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.134s	user 0.012s	sys 0.019s
I20260709 12:10:37.230381 24526 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.185811 24369 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:37.202162 24520 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:37.255137 22088 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.693s (SENT)
I20260709 12:10:37.256487 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:37.197595 24350 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.276716 24350 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.277451 24344 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.255746 24446 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.232986 24495 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:37.289330 24345 consensus_meta.cc:287] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.763s	user 0.008s	sys 0.004s
I20260709 12:10:37.272594 24468 raft_consensus.cc:697] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:37.277501 24384 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.198951 24528 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.310837 24509 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.305991 24345 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:37.313459 24477 consensus_meta.cc:287] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.908s	user 0.012s	sys 0.001s
I20260709 12:10:37.313786 24345 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:37.313956 24477 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.316991 24537 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.311054 24369 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:37.303057 24245 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:37.305677 24470 consensus_meta.cc:287] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.785s	user 0.008s	sys 0.004s
I20260709 12:10:37.322947 24470 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.324615 22195 raft_consensus.cc:606] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:37.325109 22195 raft_consensus.cc:614] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:37.326656 24530 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:37.329792 24471 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 2.357s	user 0.019s	sys 0.003s
I20260709 12:10:37.333441 22120 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.335634 24363 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:37.336504 24440 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:37.337754 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:37.338459 22115 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:37.339289 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:37.339854 22115 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.342502 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:37.343276 22117 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:37.345549 22120 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:37.350318 22272 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:37.356334 24477 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.357296 24477 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.358008 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1603) took 1995 ms. Trace:
I20260709 12:10:37.357882 24477 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:37.360652 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.361506 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1583) took 2046 ms. Trace:
I20260709 12:10:37.361943 22266 rpcz_store.cc:276] 0709 12:10:35.314802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.317686 (+  2884us) service_pool.cc:224] Handling call
0709 12:10:35.317988 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.237754 (+919766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.361271 (+1123517us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b540029c7d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:37.361444 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568300800}
I20260709 12:10:37.362941 24476 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.369726 22122 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:37.372948 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:37.373176 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:37.373751 22190 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:37.374604 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:37.375021 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:37.375837 22266 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.378399 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:37.379416 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:37.380105 22122 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:37.375738 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:37.368516 22163 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:37.376719 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:37.382893 22198 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:37.358495 22268 rpcz_store.cc:276] 0709 12:10:35.362195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.701390 (+1339195us) service_pool.cc:224] Handling call
0709 12:10:36.777831 (+ 76441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.847433 (+ 69602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.357761 (+510328us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b5400160dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:37.357942 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120015232}
I20260709 12:10:37.375238 22117 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:37.381584 22190 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:37.385322 22266 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:37.385629 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:37.386675 22117 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:37.387688 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:37.388712 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:37.389011 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:37.389142 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:37.366861 22114 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:37.444243 22189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:37.392287 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:37.393716 22191 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:37.447939 22271 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:37.442574 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:37.424026 22266 raft_consensus.cc:2393] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:37.419770 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 343725us
I20260709 12:10:37.392031 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:37.392910 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:37.381660 24278 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.494587 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:37.495549 22270 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.496697 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:37.497753 22268 raft_consensus.cc:2368] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 6.
W20260709 12:10:37.481720 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.471931 22121 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
W20260709 12:10:37.464823 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 73577.1us
I20260709 12:10:37.399952 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:37.474401 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:37.488417 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:37.392452 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:37.510727 22866 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.390221 24345 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.501047 22162 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:37.390360 24505 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.392544 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:37.485121 22864 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:37.390616 24436 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.545089 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:37.558178 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:37.393325 24259 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.444762 24249 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.389818 24384 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.471125 24529 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:37.622051 24474 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 2.486s	user 0.009s	sys 0.015s
I20260709 12:10:37.623420 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:37.596632 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:37.472404 24509 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.604640 22864 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:37.630973 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 142627us
I20260709 12:10:37.550768 24369 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.543227 24245 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:37.686069 24286 consensus_meta.cc:287] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.826s	user 0.012s	sys 0.000s
I20260709 12:10:37.686354 24245 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:37.628409 24470 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.686895 24245 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.544514 24278 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:37.687763 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:37.688387 22865 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.689188 24278 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:37.591657 24249 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.689854 24249 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:37.690150 24287 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.033s	user 0.009s	sys 0.003s
I20260709 12:10:37.690599 24287 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.671957 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:37.579787 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:37.693792 22192 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:37.604096 24466 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.390144 24530 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.162s
I20260709 12:10:37.714618 22865 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:37.543223 24468 consensus_queue.cc:237] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.536739 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:37.623755 24431 consensus_meta.cc:287] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.101s	user 0.012s	sys 0.001s
I20260709 12:10:37.698514 24369 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.720731 24430 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.721415 24430 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.721848 24430 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.537333 24345 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:37.716557 22857 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:37.726614 24345 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:37.727437 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:37.552614 24505 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.729338 24505 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.579190 24465 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.733363 24465 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.733783 24465 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.681133 22270 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
W20260709 12:10:37.676858 24474 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:10:37.630786 24434 consensus_meta.cc:287] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.296s	user 0.009s	sys 0.006s
I20260709 12:10:37.685339 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:37.557101 24436 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.550982 24467 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.603857 24519 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:37.700759 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 104219us
I20260709 12:10:37.713729 22866 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
W20260709 12:10:37.686847 22859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 456) took 2582 ms (client timeout 1672 ms). Trace:
W20260709 12:10:37.736594 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.694114 24529 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.579330 24507 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.742861 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:37.741048 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:37.767187 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:37.746688 22859 rpcz_store.cc:269] 0709 12:10:35.104416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.104714 (+   298us) service_pool.cc:224] Handling call
0709 12:10:37.686548 (+2581834us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54006ca7d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:37.686738 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2771239168}
I20260709 12:10:37.768191 24440 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:37.773015 24532 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:37.741652 24525 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.699666 24466 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.743822 24519 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.780870 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:37.778262 22861 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:37.628518 24384 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:37.738523 24167 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.745211 24436 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.694404 24477 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:37.738634 24438 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:37.694552 24509 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.811509 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 231) took 2518 ms. Trace:
I20260709 12:10:37.773090 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 224) took 3119 ms. Trace:
I20260709 12:10:37.816665 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:37.917863 22118 rpcz_store.cc:276] 0709 12:10:35.293402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.293596 (+   194us) service_pool.cc:224] Handling call
0709 12:10:35.323909 (+ 30313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.275410 (+951501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.275457 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.275520 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.275566 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.811244 (+1535678us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54002558d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:37.811294 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.811435 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187441920}
I20260709 12:10:37.918377 22116 rpcz_store.cc:276] 0709 12:10:34.653873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.747980 (+ 94107us) service_pool.cc:224] Handling call
0709 12:10:34.748311 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.771412 (+ 23101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.771445 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:34.789808 (+ 18363us) log.cc:844] Serialized 26 byte log entry
0709 12:10:34.952178 (+162370us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:35.023131 (+ 70953us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.023405 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.023504 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.171022 (+1147518us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b18004091e0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:10:37.493242 (+1322220us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:37.772848 (+279606us) raft_consensus.cc:1685] finished
0709 12:10:37.772874 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.773019 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5804,"prepare.queue_time_us":79248,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":14651,"raft.queue_time_us":42733,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":56631,"spinlock_wait_cycles":33864832,"thread_start_us":79934,"threads_started":1,"wal-append.queue_time_us":158866}
I20260709 12:10:37.815140 22195 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
W20260709 12:10:37.850529 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 109565us
W20260709 12:10:37.870950 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.773083 24369 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:37.743160 22858 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:37.886556 22189 raft_consensus.cc:606] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:37.924790 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:37.925140 22189 raft_consensus.cc:614] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:37.886487 24528 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.816089 24466 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.963924 22863 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:37.972666 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:37.993873 22118 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:37.811594 22115 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:37.977974 24507 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.978327 24509 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:37.963034 24438 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:37.895224 24541 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:37.963213 24477 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:37.803994 24529 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:37.886149 24519 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.031045 24465 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:37.984526 22122 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.961668 24440 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.033519 24430 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.033360 24440 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.035766 24430 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:37.985500 22857 raft_consensus.cc:2393] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:37.775040 24467 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.046906 24467 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:38.015851 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.013212 24541 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:38.022169 24529 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.026131 24438 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.027558 24448 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:38.028028 24477 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.039062 22122 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:37.991760 24444 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.000579 24431 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.010185 24286 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.058657 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1600) took 2697 ms. Trace:
W20260709 12:10:38.065297 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.068365 22264 rpcz_store.cc:276] 0709 12:10:35.361495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.656398 (+1294903us) service_pool.cc:224] Handling call
0709 12:10:36.656672 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.789010 (+132338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.058311 (+1269301us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b540026c0d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:38.058572 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159464320}
I20260709 12:10:38.053210 24541 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:38.095208 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 313494us
I20260709 12:10:38.089768 22163 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:38.097548 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:38.093974 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:38.098110 22163 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:38.100518 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:38.056428 24440 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.101166 22264 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:38.062614 24529 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.110929 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:38.111147 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 333437us
I20260709 12:10:38.111799 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:38.112598 22196 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.102444 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.102900 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:38.114511 22195 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:38.108150 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:38.108709 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:38.115442 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:38.040205 24249 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.114560 22270 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:38.106519 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:38.120719 22272 raft_consensus.cc:2410] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:38.115857 22267 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:38.081650 24464 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.087610 24430 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.130679 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 166405us
I20260709 12:10:38.116623 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:38.124001 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:38.081594 24470 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.094785 24465 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.109694 24528 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:38.099238 24444 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:38.123500 24434 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.135942 22831 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:38.096690 24369 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:38.075421 24431 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:38.135735 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 211056us
I20260709 12:10:38.148733 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:38.081913 24286 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.110113 24167 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:38.146864 22196 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:38.135700 24464 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:38.151582 24369 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:38.160246 24259 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.005s
I20260709 12:10:38.165875 24259 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.167227 24369 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.146202 24434 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:38.169036 24384 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.169190 24401 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.169849 24401 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:38.169030 24434 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.170835 24401 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.157893 24249 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.158780 24477 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.159192 24448 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.151110 22263 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:38.139382 24528 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:38.173729 24528 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.160108 24440 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:38.138911 24268 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:38.139530 24470 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.177115 24440 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.178948 24470 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.160211 24431 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.160750 22191 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.150234 24444 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.186950 24444 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.118638 24245 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.123715 24529 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.188930 24245 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.136320 24430 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.190482 24529 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.190898 24430 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.165174 24464 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.191654 24464 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.147871 24507 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.162856 24286 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.194890 24508 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.163319 24167 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.179018 24440 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.197453 22236 leader_election.cc:400] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:38.197870 22236 leader_election.cc:403] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:38.198046 24167 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.198549 24167 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.198958 24167 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.201505 24167 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:38.201960 24245 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:38.202693 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.246018 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.247066 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:38.247229 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 114948us
I20260709 12:10:38.247869 22117 raft_consensus.cc:2410] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:38.248517 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:38.203737 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.203996 24368 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:38.205650 24287 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.204048 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:38.208415 22269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1722) took 3273 ms (client timeout 3186 ms). Trace:
W20260709 12:10:38.258639 22269 rpcz_store.cc:269] 0709 12:10:34.934806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.935678 (+   872us) service_pool.cc:224] Handling call
0709 12:10:38.208200 (+3272522us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400202e54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:38.208319 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3373588352}
I20260709 12:10:38.140372 24468 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.209434 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:38.238193 24444 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.211755 22118 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:38.212889 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.222628 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.265252 22197 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:38.266330 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.266976 22197 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:38.267771 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:38.268261 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.223748 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:38.227977 22191 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
W20260709 12:10:38.241390 22236 connection.cc:256] RPC call timeout handler was delayed by -1.9768262190000314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
W20260709 12:10:38.228925 24514 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.246s	user 0.008s	sys 0.004s
I20260709 12:10:38.256006 22117 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.275275 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.275811 22123 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:38.276579 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:38.255939 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:38.239984 24495 consensus_meta.cc:287] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.943s	user 0.002s	sys 0.009s
I20260709 12:10:38.262193 22192 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.211184 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:38.269438 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:38.270215 22236 connection.cc:256] RPC call timeout handler was delayed by -1.7158262190000642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 12:10:38.242604 24448 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:38.273269 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.285493 22196 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:38.286442 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.280740 22197 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:38.280673 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6654262189999827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260709 12:10:38.287385 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6096262189998924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 12:10:38.287853 22236 connection.cc:256] RPC call timeout handler was delayed by -1.5781262190000689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
W20260709 12:10:38.288275 22236 connection.cc:256] RPC call timeout handler was delayed by -1.5340262189999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
I20260709 12:10:38.288872 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:38.290097 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:10:38.281380 24515 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.393s	user 0.008s	sys 0.033s
W20260709 12:10:38.281418 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 145554us
I20260709 12:10:38.314952 22237 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:38.283632 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.316435 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:38.240576 24440 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:10:38.328665 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:10:38.271715 24505 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.001s
I20260709 12:10:38.294137 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.329578 22865 raft_consensus.cc:2376] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6. Re-sending same reply.
I20260709 12:10:38.284499 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.330129 22197 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:38.270179 24444 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.274225 24468 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:38.307231 22117 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:38.305826 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:38.310508 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 186568us
I20260709 12:10:38.317273 22118 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:38.360180 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.360611 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.330896 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:38.364418 22864 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:38.361126 22162 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:38.365270 22117 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:38.335086 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.342039 22192 raft_consensus.cc:2410] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:38.271075 24519 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.300088 24245 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:38.330583 22195 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:38.360960 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:38.277909 24520 consensus_meta.cc:287] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.000s	user 0.012s	sys 0.000s
I20260709 12:10:38.328892 22831 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:38.373912 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45163.4us
I20260709 12:10:38.368162 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.368263 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:38.315706 24515 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.463s	user 0.008s	sys 0.034s
I20260709 12:10:38.363874 22118 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:38.386869 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:38.387439 22118 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.357038 24167 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:38.369822 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.378656 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:38.295766 24287 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:10:38.381070 22831 leader_election.cc:400] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 6.
I20260709 12:10:38.414397 22831 leader_election.cc:403] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:38.287698 24495 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.279783 24514 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.295059 24436 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.296587 24448 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.375902 22195 raft_consensus.cc:2393] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:38.399076 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44556 (request call id 23) took 1016 ms. Trace:
I20260709 12:10:38.401641 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:38.402420 24258 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.405385 22118 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:38.463195 22192 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.464049 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:38.465122 22118 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.460918 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:38.409065 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:38.467393 22116 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.473759 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.474715 22195 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:38.475989 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:38.409922 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.477136 22117 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:38.478343 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:38.479100 22117 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.357002 24430 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:38.372581 22114 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.358635 24552 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:38.379563 24507 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:38.450136 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 75500.1us
I20260709 12:10:38.461963 22189 rpcz_store.cc:276] 0709 12:10:37.382346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.382499 (+   153us) service_pool.cc:224] Handling call
0709 12:10:38.398797 (+1016298us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b540004bad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddbc853 00007fccf2d8a60a 00007fccec3107d4 00007fccec310762 00007fccec310691 00007fccec31060c 00007fccec30f8c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:38.398973 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009331072}
I20260709 12:10:38.355808 24369 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
W20260709 12:10:38.481964 22237 leader_election.cc:336] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Timed out: RequestConsensusVote RPC to 127.20.102.196:42539 timed out after 1.672s (SENT)
I20260709 12:10:38.494483 22163 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:38.495688 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:38.495888 22118 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:38.486726 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:38.358870 24505 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.447490 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:38.498039 22193 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:38.437305 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:38.415947 24167 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:38.498696 22120 raft_consensus.cc:2368] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6.
I20260709 12:10:38.481187 24558 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 6.
I20260709 12:10:38.528568 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:38.529392 22189 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.519860 22192 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:38.509481 24438 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:38.509214 24535 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.384361 24559 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.448127 24245 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.493453 24507 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.487696 22195 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:38.385782 24520 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.514274 24286 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.539346 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:38.508329 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.525548 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 209201us
I20260709 12:10:38.528622 24345 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.493803 24430 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.537514 24167 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.571547 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:38.528492 22263 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:38.561285 24559 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.539402 24504 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.582046 22269 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:38.539506 22117 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:38.525203 24508 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:10:38.543496 24438 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:38.563402 24507 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.586705 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.538055 22116 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:10:38.587030 22088 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.733s (SENT)
I20260709 12:10:38.599306 22189 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:38.607295 24541 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.577487 24345 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.616647 24345 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.513116 24468 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.621213 22189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:38.621999 22189 raft_consensus.cc:606] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:38.622414 22189 raft_consensus.cc:614] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:38.623952 22189 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:38.560624 24245 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.593377 24559 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.629359 24436 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.610373 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.578593 24286 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:38.608865 24438 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.611668 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.626385 24507 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.640383 22116 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:38.641690 24564 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.637197 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.609107 24565 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.643994 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.628486 24434 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.660804 22117 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
W20260709 12:10:38.645592 22088 leader_election.cc:336] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.790s (SENT)
I20260709 12:10:38.682775 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:38.685122 22189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:38.685808 22189 raft_consensus.cc:606] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:38.686161 22189 raft_consensus.cc:614] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:38.689106 24334 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.689604 22190 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:38.666183 24466 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.002s
I20260709 12:10:38.690434 24466 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.690902 24434 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.691612 22114 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:38.692713 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.693073 22192 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:38.693986 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.692730 24466 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.694638 22117 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:38.696178 24448 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.697587 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.698307 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:38.698899 22271 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:38.699911 24345 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:38.700681 22114 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:38.701205 24505 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:38.699820 24528 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.000s
I20260709 12:10:38.684176 24519 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:38.663358 22116 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:38.703413 22114 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:38.703661 24540 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.026s	user 0.006s	sys 0.000s
I20260709 12:10:38.665015 24347 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:38.643352 24286 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.665163 24369 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:38.662544 24564 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:38.666183 24514 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.668102 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:38.712446 22121 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
W20260709 12:10:38.672005 24556 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
W20260709 12:10:38.655129 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 159534us
I20260709 12:10:38.715104 22830 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:38.716071 24347 raft_consensus.cc:2764] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:38.716660 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:38.717487 22266 raft_consensus.cc:1813] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
I20260709 12:10:38.718011 22266 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:38.718314 24518 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.874s	user 0.026s	sys 0.021s
I20260709 12:10:38.721606 24430 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:38.706110 24528 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:38.725422 24464 consensus_meta.cc:287] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 12:10:38.633924 24245 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:38.726056 22198 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:39.091845 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.767697 22088 leader_election.cc:336] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.916s (SENT)
W20260709 12:10:39.112174 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 397168us
I20260709 12:10:39.114029 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 242) took 2233 ms. Trace:
I20260709 12:10:38.925120 22194 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 5. Ops: [3.2-3.2]
I20260709 12:10:38.934185 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:39.114383 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:39.121933 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:39.122865 22264 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:38.810256 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 1582) took 1436 ms. Trace:
I20260709 12:10:38.896042 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:39.129175 22268 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:38.897449 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:39.105527 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:38.945900 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 454731us
I20260709 12:10:38.888491 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:39.131521 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:39.130999 22266 raft_consensus.cc:2393] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:39.130947 22831 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:38.643893 24444 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:39.134272 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:39.134091 22195 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:39.108222 22863 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 432) took 3504 ms (client timeout 2108 ms). Trace:
I20260709 12:10:39.130511 22265 raft_consensus.cc:2376] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5. Re-sending same reply.
I20260709 12:10:38.801548 24369 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.862111 24448 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:39.164865 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:39.155529 24476 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.164068 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:38.810941 24533 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:39.104355 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:39.162914 22863 rpcz_store.cc:269] 0709 12:10:35.694490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.695947 (+  1457us) service_pool.cc:224] Handling call
0709 12:10:37.816514 (+2120567us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b5800003c98. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9deee 000000000036eb39 00007fccf2d111e0 00007fccf2dda0c4 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:39.107988 (+1291474us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b54006ca7d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:39.108127 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107009920}
I20260709 12:10:38.886533 24552 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:10:39.178664 22861 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 470) took 2323 ms (client timeout 1597 ms). Trace:
I20260709 12:10:38.840895 24507 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:39.179154 22861 rpcz_store.cc:269] 0709 12:10:36.855006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.855477 (+   471us) service_pool.cc:224] Handling call
0709 12:10:39.178457 (+2322980us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b54005073d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:39.178583 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2067686656}
I20260709 12:10:38.805770 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 434) took 1418 ms. Trace:
I20260709 12:10:39.170213 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:39.158025 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:39.182987 22264 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:39.179141 24476 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:39.184000 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:39.184648 22264 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.184350 24476 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.184918 24495 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:39.172559 22265 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:38.725482 24519 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.805932 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.175763 22266 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.175364 24551 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:38.727082 24528 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:39.130170 24520 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:39.175076 24347 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.174340 24541 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:38.726172 24464 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:39.177188 24533 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:39.172610 24369 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:39.176133 24448 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.196398 24519 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:39.112165 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:39.131547 22120 rpcz_store.cc:276] 0709 12:10:37.374266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.375439 (+  1173us) service_pool.cc:224] Handling call
0709 12:10:38.809980 (+1434541us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54002adad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:38.810177 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2271314816}
I20260709 12:10:39.182219 22263 raft_consensus.cc:2376] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5. Re-sending same reply.
I20260709 12:10:39.197635 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:39.194522 22266 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:39.161926 22269 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:39.198555 22268 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:39.295400 22271 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.307370 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:39.308197 22268 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
W20260709 12:10:39.260752 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 492861us
W20260709 12:10:39.273470 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 406941us
I20260709 12:10:39.274829 22196 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:39.275440 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
W20260709 12:10:39.281144 22006 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f1b154b48c54be6b421b01ed436bf21 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7d3f536360b444b1886777f4776be22c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:10:39.282066 22236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.038s	sys 0.058s
I20260709 12:10:39.293728 22265 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.182060 22858 rpcz_store.cc:276] 0709 12:10:37.387509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.390280 (+  2771us) service_pool.cc:224] Handling call
0709 12:10:38.805509 (+1415229us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b5400431554. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:38.805674 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85753216}
I20260709 12:10:39.298017 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:39.314215 22272 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.294747 22270 raft_consensus.cc:1813] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
I20260709 12:10:39.315557 22270 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:39.284262 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:39.316958 22236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.038s	sys 0.058s
I20260709 12:10:39.317075 22263 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:39.295806 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:39.319964 22266 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.322914 22192 raft_consensus.cc:606] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:39.296003 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:39.324972 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:39.325124 22269 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
W20260709 12:10:39.327452 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 755922us
I20260709 12:10:39.329412 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:39.335361 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:39.336962 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:39.337603 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:39.338541 22268 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.332198 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:39.359169 22236 leader_election.cc:400] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:39.360339 22268 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:39.199294 24345 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:39.395349 22272 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:39.403882 22271 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:39.408190 24541 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:39.410692 24377 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:39.412698 22266 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:10:39.418262 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57091.1us
W20260709 12:10:39.199687 24438 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.539s	user 0.002s	sys 0.008s
I20260709 12:10:39.420867 22265 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:39.219883 24552 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:39.222553 24559 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.001s
W20260709 12:10:39.432173 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 86769.4us
I20260709 12:10:39.215139 24571 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.225605 24448 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:39.440817 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:39.223740 24464 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:39.450306 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:39.208267 24551 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:39.213920 24347 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:39.482548 24347 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.482640 24551 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.225010 24533 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:39.455240 24572 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.456894 24520 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.457468 24495 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.459679 24369 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:39.488958 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:39.460574 22265 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:39.461292 22266 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.225947 24519 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:39.205724 24564 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:39.465559 24438 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.468703 24468 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.470525 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 289294us
I20260709 12:10:39.473263 24377 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:39.474530 24258 consensus_meta.cc:287] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.993s	user 0.015s	sys 0.001s
I20260709 12:10:39.499851 22163 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:39.474972 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:39.476166 24559 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.477234 24526 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:39.478219 24297 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:39.502839 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65501.4us
W20260709 12:10:39.479727 22088 leader_election.cc:336] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.907s (SENT)
I20260709 12:10:39.486769 24533 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:39.505331 24571 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.505451 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:39.506035 24571 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.487129 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:39.497422 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:39.488181 24495 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:39.500378 22197 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:39.448418 24361 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:39.516342 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.516601 24464 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.517292 24464 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:39.517830 24464 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.521004 22118 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.521214 24510 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.521773 24258 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.521938 24510 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:39.524230 24468 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.532470 24297 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.533344 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.534232 24559 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:39.535423 24297 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:39.537118 24438 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:39.538761 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.542017 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:39.542501 24377 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:39.543637 22118 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:39.545070 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:39.545434 24572 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.546293 22117 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:39.546829 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:39.547636 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:39.548468 22117 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:10:39.552416 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72808.3us
I20260709 12:10:39.553053 24361 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:39.553854 24361 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.554543 24361 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.554225 24526 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:39.556239 24167 consensus_meta.cc:287] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.956s	user 0.009s	sys 0.005s
I20260709 12:10:39.557058 22268 raft_consensus.cc:2410] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:39.558245 24468 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:39.558983 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 84200.7us
I20260709 12:10:39.559347 24564 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.560009 24564 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:39.560546 24564 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.561295 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:39.562079 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 355175us
I20260709 12:10:39.562429 22121 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:39.564761 22115 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:39.535346 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.538781 22265 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:39.561364 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:39.553794 22088 leader_election.cc:336] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.060s (SENT)
I20260709 12:10:39.560065 22268 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:39.521060 22264 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:39.569250 22123 raft_consensus.cc:2368] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 6.
I20260709 12:10:39.553195 22272 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.571641 22861 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:39.586704 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:39.548655 24572 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:39.536593 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.605846 22266 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:39.536623 24297 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.587371 24369 raft_consensus.cc:2764] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:39.622704 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:39.623456 22859 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.621263 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.624060 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1576) took 1399 ms. Trace:
I20260709 12:10:39.639055 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.639189 22196 rpcz_store.cc:276] 0709 12:10:38.224393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.286214 (+ 61821us) service_pool.cc:224] Handling call
0709 12:10:39.623740 (+1337526us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b54002e7cd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:39.623967 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269497600}
W20260709 12:10:39.607717 24286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.028s	sys 0.087s
W20260709 12:10:39.648664 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 140289us
W20260709 12:10:39.651211 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47709.9us
I20260709 12:10:39.582602 24167 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.638438 24559 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.629904 22858 raft_consensus.cc:2368] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
W20260709 12:10:39.658011 24286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.028s	sys 0.093s
I20260709 12:10:39.648394 24526 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:39.677196 22266 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:39.682570 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:39.683894 24572 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.684337 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:39.684605 24572 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:39.685364 24572 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.685786 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:39.693215 24361 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:39.653170 24297 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.701021 24369 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.701713 22265 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:39.707134 24595 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.708688 24495 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:39.709357 22237 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:39.710008 24551 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:39.710845 24526 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:39.672346 24559 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:39.712533 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:39.713485 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.714960 22267 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:39.716054 24167 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:39.718463 24572 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.719581 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:39.725329 24258 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.729851 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1575) took 1506 ms. Trace:
I20260709 12:10:39.732277 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1813) took 1617 ms. Trace:
I20260709 12:10:39.737807 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1578) took 1512 ms. Trace:
I20260709 12:10:39.114506 22119 rpcz_store.cc:276] 0709 12:10:36.880969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.881098 (+   129us) service_pool.cc:224] Handling call
0709 12:10:38.696072 (+1814974us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:38.696262 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.696441 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:38.696759 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 12:10:39.113678 (+416919us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:39.113732 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:39.113779 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.113842 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.113968 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2925,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":104,"spinlock_wait_cycles":11962240,"thread_start_us":416544,"threads_started":1}
I20260709 12:10:39.742084 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:39.746939 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:39.750221 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:39.751006 24464 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.758755 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.759578 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.760656 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.761675 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:39.767761 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1577) took 1543 ms. Trace:
W20260709 12:10:39.771338 24587 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:10:39.732414 22859 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:39.778115 22272 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
W20260709 12:10:39.779429 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 189410us
I20260709 12:10:39.781411 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:39.779183 24369 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.790768 22192 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.806432 24552 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.802428 22195 rpcz_store.cc:276] 0709 12:10:38.224659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.564333 (+339674us) service_pool.cc:224] Handling call
0709 12:10:38.564712 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:39.162469 (+597757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.767230 (+604761us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400141ed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:39.767584 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308710784}
I20260709 12:10:39.780629 24564 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.791153 22198 rpcz_store.cc:276] 0709 12:10:38.114663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.114779 (+   116us) service_pool.cc:224] Handling call
0709 12:10:38.115029 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:39.110359 (+995330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.731737 (+621378us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b5400109fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:39.732067 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404485888}
I20260709 12:10:39.791399 22197 rpcz_store.cc:276] 0709 12:10:38.225263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.334822 (+109559us) service_pool.cc:224] Handling call
0709 12:10:39.737616 (+1402794us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540011b554. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:39.737751 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2606256896}
I20260709 12:10:39.790835 22193 rpcz_store.cc:276] 0709 12:10:38.223402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.223527 (+   125us) service_pool.cc:224] Handling call
0709 12:10:39.729410 (+1505883us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54000fc3d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:39.729677 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524613376}
I20260709 12:10:39.798002 22266 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:39.799351 22269 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:39.793653 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 84503.7us
I20260709 12:10:39.814653 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.815580 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:39.816490 22265 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.799325 24495 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.796540 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.820096 22862 raft_consensus.cc:2368] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5.
W20260709 12:10:39.822921 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 137293us
I20260709 12:10:39.809690 22263 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.807839 24369 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.829978 22270 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:39.832554 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 278820us
I20260709 12:10:39.834486 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.832453 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.828480 22237 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:39.828272 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.837543 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.848017 22266 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:39.849700 24258 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.850225 24258 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:39.850625 24258 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.856659 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:39.857864 22123 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.860877 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:39.861066 24297 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:39.861756 22191 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.866714 22115 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:10:39.867826 24557 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.990s	user 0.003s	sys 0.013s
I20260709 12:10:39.868158 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:39.869211 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:39.867892 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.870683 22121 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.841369 22858 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:39.877596 24361 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:39.878763 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:39.878940 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1573) took 1660 ms. Trace:
I20260709 12:10:39.879278 24572 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:39.879639 22117 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:39.879575 22194 rpcz_store.cc:276] 0709 12:10:38.218923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.219093 (+   170us) service_pool.cc:224] Handling call
0709 12:10:38.924756 (+705663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:39.114816 (+190060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.878423 (+763607us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54002a03d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:39.878711 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621884800}
I20260709 12:10:39.881419 22116 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.870158 22118 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:39.832201 24495 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:10:39.895450 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 51170.7us
W20260709 12:10:39.901237 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 72897.7us
W20260709 12:10:39.908188 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 86144.9us
I20260709 12:10:39.824755 24559 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.909004 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:39.899502 24361 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.936712 22265 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:39.935330 24361 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:39.973084 24361 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:39.940917 24297 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:39.974015 24297 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:39.974370 24297 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:39.975005 24258 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.975373 24297 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:39.975455 24369 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:39.941910 22237 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:39.980526 24167 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.942974 24464 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:39.919497 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.983960 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.985324 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.943661 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:10:39.987154 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 74384.3us
I20260709 12:10:39.987500 24572 raft_consensus.cc:2764] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:39.959620 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:39.945096 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.944900 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:39.934238 24571 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.946815 24555 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.948184 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:39.948943 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.949178 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:39.949419 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:39.949606 22195 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:39.976699 24297 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.998057 22197 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:39.951059 22862 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.951820 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.952618 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:39.935734 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:40.000931 22118 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
W20260709 12:10:40.001559 24598 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:10:40.001915 24597 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:40.002463 22118 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:40.003116 24596 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.003414 24597 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:39.961865 22864 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:40.003760 24596 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:40.006580 24596 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:39.959224 24286 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.965075 22271 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:40.009390 24258 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:40.009186 24286 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.009689 24520 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.968158 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:39.969239 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:39.969959 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:40.011575 24286 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:40.011943 22198 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:39.971006 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:39.990800 22116 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:40.014194 22116 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:39.994673 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:40.014603 24495 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:39.995313 22114 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:39.995482 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 63485.4us
I20260709 12:10:40.016736 22163 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:40.017359 24564 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:39.950323 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:40.019279 22865 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:39.996560 22194 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:39.997215 24515 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:40.020924 24515 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:40.022119 24571 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:40.018311 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:40.022446 24345 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.003890 24597 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:40.025182 22123 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
W20260709 12:10:40.036876 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.065868 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 101807us
I20260709 12:10:40.026450 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:40.078883 22114 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:40.080578 22192 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:40.081723 22121 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:40.022996 24345 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:10:40.086709 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 97935.7us
I20260709 12:10:39.990041 22263 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:40.091632 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:40.084249 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 94192.2us
I20260709 12:10:40.109578 24588 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.110229 24588 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.110610 24588 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.117065 24552 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.117646 24552 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.117997 24552 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.121161 24597 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.122819 24597 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.123503 24551 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:40.123831 24510 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:40.125135 24583 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.125659 24583 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:40.126030 22163 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:40.127327 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:40.126901 24583 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:40.128278 24583 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.025593 24167 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:10:40.084079 24287 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:40.139025 24286 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:40.139880 24510 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:40.140748 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 59021us
I20260709 12:10:40.146525 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:40.147778 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.083690 24555 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.151680 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:40.152997 22163 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:40.109647 24345 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:40.157733 24287 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:40.161159 24286 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:40.161757 24603 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:10:40.141163 22860 raft_consensus.cc:2368] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:40.167675 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:40.184845 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:40.179172 24564 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:40.185096 24287 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.205907 24555 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:40.206629 24564 consensus_queue.cc:1243] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:40.207173 24564 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.207522 24564 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:40.022161 24515 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.209450 24286 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.185086 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:10:40.187394 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.189975 24603 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.192013 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 293) took 1803 ms. Trace:
I20260709 12:10:40.200466 22088 leader_election.cc:400] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:10:40.203088 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:40.223701 22088 leader_election.cc:403] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:40.223968 22194 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:40.216503 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68126us
I20260709 12:10:40.213511 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:40.222321 22267 rpcz_store.cc:276] 0709 12:10:38.377986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.378425 (+   439us) service_pool.cc:224] Handling call
0709 12:10:38.378686 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:39.799507 (+1420821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.116708 (+317201us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54001db0d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:40.181118 (+ 64410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3072084352}
I20260709 12:10:40.224691 24571 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:40.233875 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.238408 22191 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:40.239560 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:40.239763 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 72186.2us
I20260709 12:10:40.231685 22198 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:40.193783 24510 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:40.222121 24603 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:40.195014 24551 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:10:40.248525 24510 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.246833 24529 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.250768 24529 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:40.247298 22830 leader_election.cc:400] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 6.
I20260709 12:10:40.251845 24529 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.254098 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:40.245398 22270 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:40.257539 24577 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.258121 24577 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:40.259162 24577 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:40.260111 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:40.260844 22198 raft_consensus.cc:2376] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4. Re-sending same reply.
I20260709 12:10:40.263010 24491 raft_consensus.cc:2243] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:40.263780 22198 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:40.264249 24491 raft_consensus.cc:2272] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:40.265165 24533 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:40.265743 24533 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:40.266841 24533 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.268117 24533 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.268457 22197 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:40.270062 24607 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:10:40.273748 22197 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.274266 24369 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:40.274418 22860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 459) took 2868 ms (client timeout 1672 ms). Trace:
W20260709 12:10:40.275022 22860 rpcz_store.cc:269] 0709 12:10:37.406098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.445010 (+ 38912us) service_pool.cc:224] Handling call
0709 12:10:39.741771 (+2296761us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b5800003c98. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:40.274092 (+532321us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54006ca7d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:40.274285 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603426944}
I20260709 12:10:40.208544 24564 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.285743 24564 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.285815 22118 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:40.287470 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.288188 22264 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.296895 22194 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:40.298851 24446 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:10:40.300652 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:40.300987 22861 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:40.301626 22195 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:40.301858 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:40.302743 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:40.303069 22195 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.303536 22189 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:40.304896 22263 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:40.298885 22017 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:40.310295 24491 ts_tablet_manager.cc:1916] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:40.307056 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:40.302569 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:40.312188 24345 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.313580 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.314611 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.315059 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.315418 22265 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:40.302670 22196 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.315330 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.316745 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.317227 22271 raft_consensus.cc:2368] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:10:40.317148 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.316747 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.318522 22272 raft_consensus.cc:2368] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6.
I20260709 12:10:40.318907 22265 raft_consensus.cc:2376] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4. Re-sending same reply.
I20260709 12:10:40.319316 22189 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:40.297590 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 120884us
I20260709 12:10:40.327204 22272 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.313606 22017 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 2 to 5, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 5 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:40.332265 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:40.334125 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:40.331327 22017 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:40.332247 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:40.338454 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.339403 22265 raft_consensus.cc:2368] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:10:40.341337 22271 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:40.337682 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.345523 24596 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.346163 24596 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:40.347154 24596 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:40.351409 24360 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:40.353415 24360 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:40.355095 24401 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:40.355482 24401 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:40.358006 24559 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:40.357895 24552 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.360330 24552 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:40.248540 24603 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:40.362682 24603 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.333117 24571 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:10:40.366410 22268 raft_consensus.cc:2368] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6.
I20260709 12:10:40.376314 22196 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:40.376415 22119 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:40.378298 24588 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.381371 24581 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:40.382191 24555 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:40.383473 22088 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:10:40.384552 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 144003us
I20260709 12:10:40.386358 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:40.387493 24258 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:40.387842 24360 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:40.388190 24555 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.356417 24401 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:40.383795 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:40.392710 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.393333 22264 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:40.388408 24360 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:40.443377 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.380642 24588 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:40.445796 22270 raft_consensus.cc:2376] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5. Re-sending same reply.
I20260709 12:10:40.398217 22017 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:40.469326 22122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 1592) took 2441 ms (client timeout 1900 ms). Trace:
I20260709 12:10:40.393133 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.480005 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.478325 22017 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:40.474638 22122 rpcz_store.cc:269] 0709 12:10:37.699936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.700094 (+   158us) service_pool.cc:224] Handling call
0709 12:10:40.088661 (+2388567us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54002544d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:40.141405 (+ 52744us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589520768}
W20260709 12:10:40.485584 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.485839 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.488454 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.489622 22266 raft_consensus.cc:2368] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6.
W20260709 12:10:40.491809 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 108347us
I20260709 12:10:40.493623 22162 leader_election.cc:400] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6.
I20260709 12:10:40.493993 22162 leader_election.cc:403] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:40.486600 22270 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:40.509596 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:40.483829 24258 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
W20260709 12:10:40.538581 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43497us
W20260709 12:10:40.539460 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 188469us
I20260709 12:10:40.541019 22830 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:40.542501 22192 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:40.546981 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 203589us
I20260709 12:10:40.485597 24555 raft_consensus.cc:2764] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:10:40.548481 22088 leader_election.cc:336] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.666s (SENT)
I20260709 12:10:40.550117 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:40.551419 22266 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:40.546738 22263 raft_consensus.cc:2368] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:10:40.547578 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:40.560731 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.561532 22266 raft_consensus.cc:2368] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:10:40.545022 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:40.545176 24559 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:10:40.566944 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.550168 24287 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6.
I20260709 12:10:40.573135 22122 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:40.556107 24577 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:40.584515 22194 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:40.586596 24476 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:10:40.587668 24577 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:40.589293 24577 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:40.596840 24334 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.598649 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.600274 22263 raft_consensus.cc:2410] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:40.601192 24559 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:40.581816 24464 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:40.562996 24297 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:40.581808 22196 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:40.608172 22196 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:40.556317 24515 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 12:10:40.610682 24612 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.116s	user 0.001s	sys 0.001s
I20260709 12:10:40.616449 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.617477 22264 raft_consensus.cc:2368] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4.
I20260709 12:10:40.618458 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.619127 22264 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:40.620883 24625 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:40.623292 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 44676.2us
I20260709 12:10:40.584206 24622 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:40.625801 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.606999 22017 catalog_manager.cc:5697] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 3, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 3 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:40.634737 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 76200.4us
W20260709 12:10:40.632191 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 84913.9us
W20260709 12:10:40.636135 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.637630 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.638567 22266 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:40.642982 22162 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:40.644784 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 106928us
I20260709 12:10:40.647532 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.649073 22196 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:40.652520 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:40.658437 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.577356 24604 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:10:40.662185 22017 catalog_manager.cc:5697] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 1 to 2, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:10:40.670145 22017 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 4 to 6, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 6 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:40.568745 24360 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:40.677000 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.677807 22269 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:40.678786 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.682103 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.683452 24491 ts_tablet_manager.cc:1929] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:40.683715 24334 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:40.641381 24564 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:10:40.677083 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.689741 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:40.684996 22088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.898s (SENT) [suppressed 33 similar messages]
I20260709 12:10:40.697050 22269 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:40.701332 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.702033 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.702329 22272 raft_consensus.cc:2376] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5. Re-sending same reply.
I20260709 12:10:40.703261 22266 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:40.668946 24533 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.709203 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 64038.2us
I20260709 12:10:40.710506 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:40.717939 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.720974 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.722339 22265 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:40.721093 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.723732 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:40.732569 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.745918 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.748040 22270 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:40.729127 22272 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:40.749056 24515 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.754233 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.755383 22269 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:40.756071 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:40.758842 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47668.3us
I20260709 12:10:40.753701 24515 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.692580 24464 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:10:40.763558 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 375163us
I20260709 12:10:40.715116 22263 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:40.749354 24491 log.cc:1199] T 1baa23cb6635453b9a9cd5ec7e452f6a P 7d3f536360b444b1886777f4776be22c: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/wals/1baa23cb6635453b9a9cd5ec7e452f6a
I20260709 12:10:40.775414 22272 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:10:40.772454 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.751397 24360 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.775782 22266 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:40.781635 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.781759 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.785518 22266 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:40.787514 22266 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:40.725643 24533 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:40.721872 24287 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:10:40.764577 24515 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.768111 24571 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:10:40.814873 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 129896us
I20260709 12:10:40.820381 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.821429 22269 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:40.811172 24533 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:40.826833 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.803660 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:40.832861 22088 leader_election.cc:336] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.914s (SENT)
W20260709 12:10:40.832885 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 71306.6us
W20260709 12:10:40.841019 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.854537 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77609us
I20260709 12:10:40.855182 22119 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:40.855753 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:40.860363 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.862792 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:40.863865 22270 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:40.866447 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:40.867755 22272 raft_consensus.cc:2410] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:40.818863 24627 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:10:40.886451 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 125716us
I20260709 12:10:40.889779 24491 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56158 (request call id 86) took 6038 ms. Trace:
I20260709 12:10:40.890326 24491 rpcz_store.cc:276] 0709 12:10:34.880996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.003406 (+122410us) service_pool.cc:224] Handling call
0709 12:10:35.516020 (+512614us) ts_tablet_manager.cc:1151] Deleting tablet 1baa23cb6635453b9a9cd5ec7e452f6a
0709 12:10:35.693179 (+177159us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:40.443092 (+4749913us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:40.683274 (+240182us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:40.889636 (+206362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3972494,"tablet-delete.queue_time_us":245875,"thread_start_us":162047,"threads_started":1}
I20260709 12:10:40.892196 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:40.893523 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:40.867548 24571 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:40.894959 22122 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:40.866870 24577 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 12:10:40.920965 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.924144 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68541us
W20260709 12:10:40.935369 24345 consensus_meta.cc:287] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.005s
I20260709 12:10:40.877417 24630 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
W20260709 12:10:40.971836 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 139008us
I20260709 12:10:40.971910 22272 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:40.976277 22163 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:40.983304 22088 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.178s (SENT)
I20260709 12:10:40.983969 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:40.984894 22006 catalog_manager.cc:5028] TS 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): tablet 1baa23cb6635453b9a9cd5ec7e452f6a (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
W20260709 12:10:41.000524 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.000917 24287 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:41.005172 24533 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.005901 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:41.006799 22271 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:41.009781 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.016997 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 107640us
I20260709 12:10:41.025518 24621 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:41.029608 22196 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.030792 24515 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.047381 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:41.049666 22114 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:41.049938 24287 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:41.050004 24641 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:41.051040 24641 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:41.051247 24287 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:41.053781 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47494.7us
I20260709 12:10:41.072863 22196 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:10:41.073383 22196 pending_rounds.cc:85] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 5
I20260709 12:10:41.073634 22196 pending_rounds.cc:107] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:10:41.084621 22196 raft_consensus.cc:2889] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:41.041203 24630 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:41.053254 24648 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:41.052143 24641 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.097777 24515 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:41.187158 22194 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:41.195475 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 220517us
I20260709 12:10:41.194571 24347 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:41.197340 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 218755us
I20260709 12:10:41.208521 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:41.209409 22114 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
W20260709 12:10:41.210901 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 136969us
I20260709 12:10:41.116304 24630 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:41.211869 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.212873 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.215484 22194 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:41.216966 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:41.217773 22120 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:41.219310 24630 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.203794 24347 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:41.224258 24347 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:41.213824 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:41.226402 22122 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:41.228040 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:41.228914 22114 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:41.231638 24642 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 12:10:41.237805 24628 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:41.239701 24604 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:41.254429 22114 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:41.252421 24258 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:41.216513 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.270265 22088 leader_election.cc:336] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.185s (SENT)
I20260709 12:10:41.271540 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:41.274670 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58131.3us
I20260709 12:10:41.276467 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:41.278103 22120 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:41.278595 22120 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:41.278940 22088 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.188s (SENT)
I20260709 12:10:41.279552 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:41.279587 22120 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.280553 24446 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.281378 24446 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:41.288923 24533 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:41.289577 24653 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:10:41.261198 24515 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 12:10:41.293628 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.297655 22120 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.296343 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:41.307898 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:41.333818 24648 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:41.334316 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 93737.2us
W20260709 12:10:41.328908 22236 connection.cc:256] RPC call timeout handler was delayed by -1.3261351539999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 12:10:41.336764 22236 connection.cc:256] RPC call timeout handler was delayed by -1.3099351539999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:10:41.337677 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1974351540000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 12:10:41.338136 22236 connection.cc:256] RPC call timeout handler was delayed by -1.194735154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 12:10:41.338562 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1470351539999228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
I20260709 12:10:41.332325 24446 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.338987 22236 connection.cc:256] RPC call timeout handler was delayed by -1.0984351539998443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 12:10:41.339340 22236 connection.cc:256] RPC call timeout handler was delayed by -1.0948351539998384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 12:10:41.340389 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44175.2us
I20260709 12:10:41.339480 24446 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:41.341605 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 62772us
W20260709 12:10:41.342410 22088 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.221s (SENT)
I20260709 12:10:41.343171 24446 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:41.340830 24510 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:41.345144 24510 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:41.323949 24495 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:41.352067 22268 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:41.355324 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.360127 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:41.364148 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.365432 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:41.366441 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:41.367496 22272 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:41.334993 24533 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:41.335135 24613 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.369712 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:41.370011 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:41.374270 22271 raft_consensus.cc:2368] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5.
I20260709 12:10:41.384313 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:41.384186 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:41.385217 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:41.385895 22269 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:41.389117 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:41.392185 22266 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:41.392422 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 56255.2us
W20260709 12:10:41.393446 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.393798 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:41.394549 22268 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.385146 22267 raft_consensus.cc:2376] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4. Re-sending same reply.
I20260709 12:10:41.401464 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:41.402473 22264 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:41.402933 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.346268 24510 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.412290 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:41.370695 24533 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:41.414294 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:41.420073 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:10:41.420264 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.421955 22269 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:41.423774 22267 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:41.390877 24552 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:41.425670 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.353667 24661 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 12:10:41.429159 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 63838.1us
I20260709 12:10:41.373273 24495 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.421348 24533 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:41.439970 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:41.470384 22088 leader_election.cc:336] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.713s (SENT)
I20260709 12:10:41.472570 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:41.427592 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:41.392722 24613 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.504009 22857 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:41.510839 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 70958.5us
W20260709 12:10:41.511976 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 118835us
W20260709 12:10:41.515798 24664 log.cc:927] Time spent T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:10:41.516072 24347 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.525494 24286 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:41.526080 24286 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:41.527132 24286 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.527967 24667 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.528671 24667 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.545300 22271 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:41.547456 22864 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:41.549635 22268 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:41.562192 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:41.563002 22265 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.531177 24667 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:41.565037 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:41.565263 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.476718 24648 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.496418 22860 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
W20260709 12:10:41.575407 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 215072us
I20260709 12:10:41.573166 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:41.543927 24347 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.588433 22163 connection.cc:256] RPC call timeout handler was delayed by -1.4391009220000797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 12:10:41.589016 22163 connection.cc:256] RPC call timeout handler was delayed by -1.3707009219999691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 12:10:41.589418 22163 connection.cc:256] RPC call timeout handler was delayed by -1.318500922000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 12:10:41.562638 24495 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:41.601346 22163 connection.cc:256] RPC call timeout handler was delayed by -1.3131009220001033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 12:10:41.601768 22163 connection.cc:256] RPC call timeout handler was delayed by -1.2384009219999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 12:10:41.632459 22163 connection.cc:256] RPC call timeout handler was delayed by -1.1628009220000877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 12:10:41.632949 22163 connection.cc:256] RPC call timeout handler was delayed by -1.0917009219999727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
I20260709 12:10:41.581938 24667 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:41.644052 22194 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:41.644884 22192 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:41.646322 22265 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:41.648427 22120 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:41.599455 24464 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:41.661155 22265 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:41.662256 22265 pending_rounds.cc:85] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 2
I20260709 12:10:41.662635 22265 pending_rounds.cc:107] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:41.663074 22265 raft_consensus.cc:2889] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:41.640300 24495 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.590798 24347 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:41.654132 24661 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.691550 24401 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.691016 24671 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.656663 24628 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:10:41.725276 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 254909us
I20260709 12:10:41.732985 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:41.686838 24577 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:10:41.740531 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 175555us
I20260709 12:10:41.741655 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:41.744602 22265 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:41.744870 24670 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.745569 24670 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:41.746076 24670 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.746294 24682 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.746845 22263 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:41.746969 24682 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.749986 24495 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.751773 24682 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:41.754522 24613 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:41.756451 24347 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:41.692724 24621 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:41.688735 24464 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:41.767354 22088 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.341s (SENT)
I20260709 12:10:41.773818 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:41.740901 24286 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:41.696213 24661 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:41.764950 24627 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:41.831893 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 238918us
I20260709 12:10:41.774817 24667 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:41.849113 24633 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.849748 24633 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:41.850396 24667 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:41.853166 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 128500us
I20260709 12:10:41.827409 24571 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.863868 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:41.852447 24552 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.873234 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 105961us
I20260709 12:10:41.826352 24671 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.876057 24446 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:41.890960 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 149397us
I20260709 12:10:41.864801 24675 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.899572 24446 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:41.902736 24678 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.912357 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.912403 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 48600.7us
W20260709 12:10:41.910550 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.907377 22088 leader_election.cc:336] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.806s (SENT)
W20260709 12:10:41.903282 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.913498 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:41.868355 24571 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:41.925181 22123 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:41.888067 24588 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.935045 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:41.885437 24552 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:41.935631 24559 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.939852 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.949795 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:41.950532 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:41.938021 24683 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
W20260709 12:10:41.954380 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53074.9us
I20260709 12:10:41.951129 22163 leader_election.cc:400] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5.
I20260709 12:10:41.956715 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:41.958222 22197 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:41.959630 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:41.963361 24446 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:41.950671 24559 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:41.967088 24559 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:41.967904 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:41.969164 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:41.970188 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:41.971185 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:41.972110 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:41.973191 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:41.974226 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:41.974678 22191 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.975464 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:41.976014 22123 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.982057 24533 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:41.983114 24446 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:41.983716 24671 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:41.988529 22114 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:41.942776 24686 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:41.984030 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:41.988925 24633 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:41.991633 24669 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.399s	user 0.002s	sys 0.000s
I20260709 12:10:41.986184 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:41.947136 24696 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:41.953485 24673 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.244s	user 0.002s	sys 0.000s
I20260709 12:10:42.028024 22191 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:10:42.027155 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:42.031695 22190 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:42.027804 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.018630 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.028905 22123 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:41.924577 24678 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:42.033375 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.033018 22116 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:42.034636 22198 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:10:42.037503 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:42.037427 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 117387us
I20260709 12:10:42.036506 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:42.039783 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:42.038582 22117 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:42.051340 22191 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.053577 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:42.071859 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:42.029533 24464 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:42.077656 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:42.078747 22198 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:42.082345 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 139904us
I20260709 12:10:42.083250 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:42.084024 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 266) took 1100 ms. Trace:
I20260709 12:10:42.077180 24401 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:42.085575 24401 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.085980 24401 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.086184 24678 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:42.031203 24696 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:42.088516 24696 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:42.089345 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 103257us
I20260709 12:10:42.090324 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:42.092173 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:42.093221 22116 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
W20260709 12:10:42.095810 24666 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.440s	user 0.000s	sys 0.006s
I20260709 12:10:42.092320 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:42.096616 22121 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:42.084395 22119 rpcz_store.cc:276] 0709 12:10:40.983307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.983591 (+   284us) service_pool.cc:224] Handling call
0709 12:10:40.984004 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.025531 (+ 41527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.025566 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.511129 (+485563us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b2c00058398. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:10:41.511513 (+   384us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.660896 (+149383us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:41.660949 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.661038 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.072788 (+411750us) raft_consensus.cc:1685] finished
0709 12:10:42.072812 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.083926 (+ 11114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16528,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"spinlock_wait_cycles":11744640,"thread_start_us":72297,"threads_started":1,"wal-append.queue_time_us":154012}
I20260709 12:10:42.129905 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:42.130846 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:42.136025 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.158118 22190 raft_consensus.cc:2410] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:42.052215 24686 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.074597 24671 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.174904 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.158295 22198 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.178041 22865 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
W20260709 12:10:42.181746 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 100320us
W20260709 12:10:42.185412 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 102249us
I20260709 12:10:42.187003 24630 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:42.187326 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 97111.3us
W20260709 12:10:42.187551 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 106406us
I20260709 12:10:42.179931 24588 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.189806 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:42.190382 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.191458 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:42.177240 24446 raft_consensus.cc:2764] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:10:42.200333 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.206071 22190 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:42.211050 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:42.212039 22191 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:42.212790 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:42.184620 24673 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:10:42.174293 24661 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:42.231550 22191 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:42.193881 24686 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.235167 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45489.1us
W20260709 12:10:42.235452 24702 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:42.236207 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:42.227342 24678 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:42.226786 24464 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.218847 24287 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.226976 24627 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.256847 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 377) took 1071 ms. Trace:
I20260709 12:10:42.262414 22196 rpcz_store.cc:276] 0709 12:10:41.185635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.186827 (+  1192us) service_pool.cc:224] Handling call
0709 12:10:41.195080 (+  8253us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:41.213964 (+ 18884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.214001 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:41.217063 (+  3062us) log.cc:844] Serialized 52 byte log entry
0709 12:10:41.236280 (+ 19217us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b1800263560. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:10:41.576152 (+339872us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:41.600596 (+ 24444us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.600876 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.600961 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.237691 (+636730us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b1800263560. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd5522 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:10:42.256623 (+ 18932us) raft_consensus.cc:1685] finished
0709 12:10:42.256645 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.256762 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9312,"prepare.queue_time_us":23310,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":28653,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":23696,"spinlock_wait_cycles":24965760,"thread_start_us":322161,"threads_started":1,"wal-append.queue_time_us":449435}
I20260709 12:10:42.237812 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:42.264480 22195 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:42.233474 24533 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:42.240931 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:42.181856 24671 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:42.253654 24704 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:10:42.252486 24287 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:42.252077 24670 consensus_meta.cc:287] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.004s
I20260709 12:10:42.299481 22198 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
W20260709 12:10:42.287411 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 55413.7us
I20260709 12:10:42.251081 24464 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.243427 24571 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:42.249509 24699 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:10:42.256554 24627 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:42.286213 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:42.256031 24552 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:42.255719 24401 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:42.326216 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.274360 24533 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:42.333479 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.287729 24648 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.320284 24709 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.274888 24588 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:10:42.320395 24464 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.340260 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.308738 24286 raft_consensus.cc:2764] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:42.257220 24686 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:42.320371 24446 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.358007 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.356258 22269 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:42.358882 22272 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:42.354043 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:42.362077 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 86946.9us
I20260709 12:10:42.361218 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.363886 22264 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:10:42.369040 24681 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:42.377354 24632 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.377862 24623 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:42.378791 24623 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:42.379678 24401 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:42.381100 24347 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:42.385725 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1668) took 1006 ms. Trace:
I20260709 12:10:42.316952 24670 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:42.387634 22271 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:42.387667 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:42.390266 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:42.395803 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:42.355934 24552 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:42.406394 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.407353 22831 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:42.386216 22266 rpcz_store.cc:276] 0709 12:10:41.379186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.398756 (+ 19570us) service_pool.cc:224] Handling call
0709 12:10:41.399206 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:41.821964 (+422758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.822013 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:41.850163 (+ 28150us) log.cc:844] Serialized 52 byte log entry
0709 12:10:41.911504 (+ 61341us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:41.943383 (+ 31879us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.943586 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.943703 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.385483 (+441780us) raft_consensus.cc:1685] finished
0709 12:10:42.385501 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.385655 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269,"prepare.queue_time_us":37701,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":3906,"raft.queue_time_us":57612,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":14835,"spinlock_wait_cycles":17152,"thread_start_us":472435,"threads_started":2,"wal-append.queue_time_us":173478}
I20260709 12:10:42.421442 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:42.396533 22263 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.396602 24686 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:42.376325 24627 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:42.377959 24632 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:42.425177 24551 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.426110 24577 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:42.426409 24697 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.248s	user 0.001s	sys 0.001s
I20260709 12:10:42.423476 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:42.462301 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:42.407069 24681 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:42.427459 24648 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.450417 24678 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:42.473681 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50292.5us
I20260709 12:10:42.453164 24552 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:42.467473 24551 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:42.482791 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.473237 24577 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.470058 24623 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:42.475615 24675 raft_consensus.cc:2764] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:42.475911 24571 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.490845 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.494509 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.486162 24551 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.492431 24571 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.486457 24696 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:42.488291 24577 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:42.528910 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.530138 22197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "575c887e89834da7b6e222b41a19b692"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:42.531198 22197 raft_consensus.cc:606] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.533205 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:42.532538 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.499258 24670 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:42.535218 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:42.518772 24571 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.500507 24671 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:42.499259 24632 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:42.539915 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:42.551461 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.557543 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:42.558148 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.562798 24588 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:42.581477 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.499961 24552 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:42.592082 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.563139 24670 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.617884 22865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 452) took 1222 ms. Trace:
I20260709 12:10:42.568964 24718 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.625527 22865 rpcz_store.cc:276] 0709 12:10:41.395060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.395571 (+   511us) service_pool.cc:224] Handling call
0709 12:10:42.617648 (+1222077us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b540075dd54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:42.617776 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431304064}
I20260709 12:10:42.618044 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:42.591306 24675 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.628149 22115 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:42.569543 24671 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:10:42.629065 22123 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:10:42.630395 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49037.1us
W20260709 12:10:42.616878 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 379140us
I20260709 12:10:42.582759 24588 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:42.615916 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:42.641048 22190 raft_consensus.cc:606] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.641575 22190 raft_consensus.cc:614] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:42.648609 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.649302 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.650863 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:42.652302 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.651371 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.654184 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.631255 24681 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:42.662380 24681 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:42.663313 24287 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:42.608038 24696 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:42.660902 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 75298.9us
I20260709 12:10:42.692174 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.693367 22163 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.655668 24675 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:10:42.698892 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1673) took 1260 ms. Trace:
I20260709 12:10:42.654691 24718 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.699051 22162 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:42.698834 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.697280 22117 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:42.705518 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:42.713703 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:42.711915 24630 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:42.714931 24728 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:42.714951 22123 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:42.716178 22121 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:42.699671 22268 rpcz_store.cc:276] 0709 12:10:41.438344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.570339 (+131995us) service_pool.cc:224] Handling call
0709 12:10:41.586183 (+ 15844us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.724851 (+138668us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:41.811445 (+ 86594us) log.cc:844] Serialized 14 byte log entry
0709 12:10:42.651139 (+839694us) spinlock_profiling.cc:243] Waited 880 us on lock 0x7b18003791e0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a
0709 12:10:42.658488 (+  7349us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.658940 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.659120 (+   180us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:42.659345 (+   225us) log.cc:844] Serialized 14 byte log entry
0709 12:10:42.691395 (+ 32050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.691473 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.698641 (+  7168us) raft_consensus.cc:1685] finished
0709 12:10:42.698671 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.698829 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34759,"prepare.queue_time_us":152381,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":104,"raft.queue_time_us":159185,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":178,"spinlock_wait_cycles":2023296,"thread_start_us":306043,"threads_started":4,"wal-append.queue_time_us":232906}
I20260709 12:10:42.696455 24287 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.711093 24678 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:42.725631 24678 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:42.725958 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.727113 22267 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:42.727910 24678 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:42.729449 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.712042 24286 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.730264 24286 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:42.728830 24728 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:42.733489 22271 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:42.731063 24286 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.709992 24670 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:42.734787 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.718271 24719 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:42.741894 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.745551 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.746605 22264 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:42.721899 24696 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:42.741868 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.751205 24728 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:42.755311 24551 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:42.734566 24630 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:42.756817 24729 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:42.775496 24729 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:42.776984 24729 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:42.744341 22268 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:42.747939 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.758885 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.715766 24713 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:42.770458 22196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:42.779435 22196 raft_consensus.cc:606] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.742679 24287 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:42.790700 22266 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:42.798101 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:42.759368 24533 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.745347 24464 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:42.864254 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 85360.5us
I20260709 12:10:42.834041 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:42.865703 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:42.871477 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.872831 22196 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:42.733263 24588 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:42.871702 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 158105us
I20260709 12:10:42.876348 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:42.877156 22117 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.823180 24686 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.758803 24670 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:42.771895 24696 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:42.877123 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:42.880173 22265 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:42.881721 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:42.829144 24533 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:42.882748 22122 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:42.901437 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:42.905521 22265 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:42.904633 22272 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:42.874023 24730 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:10:42.911054 22266 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:42.916406 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:42.912894 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:42.918493 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:42.912966 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:42.914904 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.915802 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:42.919657 22194 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.836480 24287 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:42.906536 22123 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:42.919818 22265 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:42.928599 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:42.930953 22264 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:42.920401 22190 raft_consensus.cc:606] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:42.896896 24729 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:42.935803 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:42.936789 22268 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:42.886533 24686 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:42.884011 24667 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.896636 24728 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.914520 22263 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:10:42.913132 24678 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.913260 24716 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.943873 22267 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:42.926256 24734 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:42.964108 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 87077.1us
I20260709 12:10:42.939023 24581 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:42.935021 24719 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:42.965229 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:42.935988 24552 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:43.006098 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 254674us
I20260709 12:10:42.943308 24686 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.946372 24675 raft_consensus.cc:2764] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:10:42.962639 24577 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.027688 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
W20260709 12:10:43.028424 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 63286.9us
I20260709 12:10:43.028560 22192 raft_consensus.cc:606] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:43.029294 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:43.029414 22192 raft_consensus.cc:614] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:43.030568 22194 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:10:42.958729 24678 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.014858 24734 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.944687 24630 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.048048 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:43.049798 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:43.050607 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:43.051887 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.053158 22117 raft_consensus.cc:2410] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:10:43.053189 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 118545us
W20260709 12:10:43.038079 24731 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:10:43.034938 24667 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.036058 24716 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:43.027650 24552 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:43.013618 24581 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.025264 24625 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:10:43.062947 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.064352 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.067399 24739 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:43.068179 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.024225 24287 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.036898 24713 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:10:43.036556 24627 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:43.069572 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:43.069821 24740 log.cc:927] Time spent T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:43.070361 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:43.071767 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 143262us
I20260709 12:10:43.047544 24551 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:43.068730 24678 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:43.054608 24734 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:43.090528 22118 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.095441 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.094444 22116 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:43.101562 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:43.104049 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.057374 24718 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:10:43.089839 24464 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:43.107208 22122 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:43.112581 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.113361 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.122117 22117 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:43.071059 24719 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.124780 22115 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:43.135247 22115 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:43.141258 24734 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.144932 24743 raft_consensus.cc:993] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
W20260709 12:10:43.156698 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 103917us
I20260709 12:10:43.162778 24746 raft_consensus.cc:1081] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:10:43.094640 24739 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.103160 24555 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:43.194741 22116 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:43.198558 22118 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:43.200515 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:43.203078 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:43.186656 24742 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
W20260709 12:10:43.200408 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.207244 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:43.205395 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:43.208422 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:43.209234 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:43.162210 24286 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.222879 24286 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:43.224820 22197 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:43.222888 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.226336 24577 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:43.227512 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.232295 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:43.233212 22117 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.241911 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.209560 24623 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.241629 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 170419us
I20260709 12:10:43.183996 24722 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.149s
I20260709 12:10:43.263032 22830 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:43.264431 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.213292 24670 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:43.274645 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:43.279706 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 179848us
I20260709 12:10:43.163753 24552 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.282007 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.293618 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:43.295174 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:43.296165 24667 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.296990 24667 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.300827 24581 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:43.302999 24571 consensus_meta.cc:287] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.000s
I20260709 12:10:43.303578 24571 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.268230 24623 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.306939 24623 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:43.259670 24716 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:10:43.274107 24628 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.316529 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.319278 22119 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:43.320304 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.319828 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:43.321625 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:43.330776 22118 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.336027 22163 leader_election.cc:400] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5.
I20260709 12:10:43.338531 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:43.347270 22865 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:43.317695 24728 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.318161 24628 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:43.349259 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:43.351624 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:43.353526 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:43.363085 22118 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
W20260709 12:10:43.397348 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45801.9us
I20260709 12:10:43.334497 24741 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.400003 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50841.4us
I20260709 12:10:43.399691 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:43.348794 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:43.345378 24758 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:10:43.331908 24722 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:43.414652 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:43.347183 24716 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.335217 24577 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:10:43.417743 22119 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:43.404834 24628 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.354306 24750 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:43.399221 24287 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:43.432407 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:43.409451 24625 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.403344 24745 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.403905 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:10:43.438050 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77147.7us
I20260709 12:10:43.426448 24446 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:43.397471 24728 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.417496 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:43.402233 24757 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.401188 24686 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.449369 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:43.435525 24681 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.402007 24752 consensus_queue.cc:1059] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:10:43.441475 24750 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:43.441200 24678 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.439853 24625 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:43.433693 24464 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:10:43.445669 24670 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:43.436548 24713 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:10:43.444885 24630 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:43.499845 24718 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:43.443470 24745 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.430737 24716 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.525985 24716 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:43.526684 24716 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.527056 24716 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:43.527150 24762 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:10:43.527451 24716 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.431253 24754 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:10:43.529084 22122 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:43.530984 22119 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:43.427266 24722 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.531965 24686 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:43.532627 24757 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:10:43.430857 24741 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.533130 24722 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:43.519184 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:43.493242 24756 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.236s	user 0.003s	sys 0.005s
I20260709 12:10:43.493021 24625 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:43.523326 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 90974.9us
I20260709 12:10:43.543959 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:43.490732 24571 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:43.545692 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:43.546795 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:43.451375 24739 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:43.481344 24627 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:10:43.555008 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:43.555157 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 142273us
I20260709 12:10:43.533084 24728 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:43.555737 22116 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:43.556619 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:43.557825 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:43.517180 24667 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:43.488049 24287 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 12:10:43.600430 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44411.5us
I20260709 12:10:43.533380 24758 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 12:10:43.607479 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50950.6us
I20260709 12:10:43.592895 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:43.608374 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46716.6us
I20260709 12:10:43.603869 24728 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.558933 24681 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.613080 24750 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.601753 24652 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:10:43.614526 24741 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:43.559085 24678 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:43.563136 24552 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.618726 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:43.619493 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:43.677680 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 58296.1us
I20260709 12:10:43.680545 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:43.681306 22264 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:43.681151 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:43.682538 22265 raft_consensus.cc:2393] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:43.556059 24722 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.559777 24686 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:43.689075 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:43.545770 24670 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:43.666659 24771 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:10:43.683920 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:43.684803 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 66176.2us
I20260709 12:10:43.687296 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:43.627480 24555 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.626842 24757 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:43.662604 24756 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:43.700625 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:43.692914 22117 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:43.694242 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:43.694844 22267 raft_consensus.cc:2410] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:43.695619 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:43.699470 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:43.702112 22264 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:43.604867 24667 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.705330 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:43.710597 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:43.688469 24741 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.693774 24681 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.713438 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:43.654362 24728 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.693303 24722 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.726831 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:43.700870 24757 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:43.728667 22117 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:43.721298 24737 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.843s	user 0.003s	sys 0.001s
I20260709 12:10:43.706792 24678 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:43.719760 24577 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:43.711690 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:43.703266 24555 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.562687 24739 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:10:43.767865 24696 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:43.732805 24722 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.735642 24757 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.717410 24686 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:43.801613 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 352294us
I20260709 12:10:43.802551 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:43.723839 24628 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.805717 22117 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:43.783700 24577 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:43.735365 24741 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.831528 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:43.786566 22263 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:43.832875 22117 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.833549 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:43.782233 24625 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.799813 24774 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:43.777906 24678 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:43.832463 24710 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:10:43.848812 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:43.832741 24671 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:43.861157 24729 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.916s	user 0.012s	sys 0.002s
I20260709 12:10:43.863556 24775 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:43.864296 24775 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.865990 22266 raft_consensus.cc:2410] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:43.866597 24777 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:43.867102 24777 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:43.845531 24774 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:43.867473 24777 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:43.893736 24286 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:43.894299 24286 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:43.895604 24745 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:43.896946 24782 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:10:43.900941 24577 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:43.895360 24286 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.902927 24286 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:43.905944 24446 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:43.906080 24686 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:43.908192 24787 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.909979 24625 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:43.910449 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 385) took 2242 ms. Trace:
I20260709 12:10:43.922631 22264 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:44.178656 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:44.145910 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1794) took 1416 ms. Trace:
I20260709 12:10:43.976450 22117 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:43.929839 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:44.258646 22268 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:44.061769 24670 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:43.910848 22189 rpcz_store.cc:276] 0709 12:10:41.668245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.668484 (+   239us) service_pool.cc:224] Handling call
0709 12:10:41.682957 (+ 14473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.683453 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:41.940503 (+257050us) log.cc:844] Serialized 14 byte log entry
0709 12:10:42.286307 (+345804us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.319169 (+ 32862us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.319336 (+   167us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:42.319375 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.319453 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.623357 (+303904us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b1800325300. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd5522 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:10:43.534170 (+910813us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b1800325300. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:10:43.910194 (+376024us) raft_consensus.cc:1685] finished
0709 12:10:43.910217 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.910364 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3458,"prepare.queue_time_us":236590,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":62152,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":16969,"spinlock_wait_cycles":18617856,"thread_start_us":505314,"threads_started":2,"wal-append.queue_time_us":388461}
I20260709 12:10:44.320333 22863 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:44.173648 24681 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.277971 22866 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:44.258399 22271 rpcz_store.cc:276] 0709 12:10:42.729026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.729144 (+   118us) service_pool.cc:224] Handling call
0709 12:10:44.145609 (+1416465us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b5400055d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:44.145775 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7509888}
I20260709 12:10:44.319597 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1642) took 1693 ms. Trace:
W20260709 12:10:44.182133 24725 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.682s	user 0.005s	sys 0.006s
W20260709 12:10:44.170521 24766 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.567s	user 0.003s	sys 0.000s
W20260709 12:10:44.344126 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.318408 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 473001us
I20260709 12:10:44.317754 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:44.348274 22117 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.348423 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:44.277642 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:44.261335 22861 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:44.277740 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:44.350741 22270 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:44.138608 24708 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.801s	user 0.003s	sys 0.000s
I20260709 12:10:44.367913 22263 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:44.344226 22120 rpcz_store.cc:276] 0709 12:10:42.626267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.639544 (+ 13277us) service_pool.cc:224] Handling call
0709 12:10:42.639996 (+   452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:42.657407 (+ 17411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.657459 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:42.691832 (+ 34373us) log.cc:844] Serialized 52 byte log entry
0709 12:10:42.729975 (+ 38143us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:42.730013 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.734108 (+  4095us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.720472 (+986364us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:44.319276 (+598804us) raft_consensus.cc:1685] finished
0709 12:10:44.319296 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.319531 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12345,"raft.queue_time_us":7453,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":6324,"spinlock_wait_cycles":16487168,"thread_start_us":14288,"threads_started":1,"wal-append.queue_time_us":60792}
I20260709 12:10:44.172748 24729 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:44.136034 24786 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:44.209929 24752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.024s
I20260709 12:10:44.053509 24630 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.366417 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:44.343686 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:43.911564 24628 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:44.370975 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:44.386623 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:44.387332 22120 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.061604 24754 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:43.930410 24555 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:43.924702 24718 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:44.299365 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:44.173204 24728 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:44.407953 22120 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
W20260709 12:10:44.356442 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77786.2us
I20260709 12:10:44.370252 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:44.254408 24709 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:44.139648 24686 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:43.914172 24716 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:43.933076 24722 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:44.387559 22268 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:44.343015 24744 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:44.374922 24752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.004s	sys 0.027s
I20260709 12:10:43.925851 24757 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:44.007019 24533 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:44.387128 24670 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:44.393150 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44823.5us
I20260709 12:10:44.393815 24775 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:44.394407 24667 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:44.641633 22194 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 6: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:44.409701 24728 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:44.505244 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:44.416692 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:44.484421 24741 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:44.477415 24774 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:44.475100 22120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:10:44.648051 22120 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:44.648468 22120 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.482600 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1666) took 1221 ms. Trace:
I20260709 12:10:44.376698 24786 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:44.507200 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:44.498355 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:44.650804 22265 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:44.519405 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:44.480108 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 281) took 1611 ms. Trace:
I20260709 12:10:44.353690 24681 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:44.482111 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 398) took 1583 ms. Trace:
I20260709 12:10:44.657029 22196 rpcz_store.cc:276] 0709 12:10:42.898564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.898958 (+   394us) service_pool.cc:224] Handling call
0709 12:10:42.899398 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.523992 (+624594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.524023 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.524066 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:43.524104 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.481678 (+957574us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540011a654. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:44.481759 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.481986 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435847040}
I20260709 12:10:44.501071 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1659) took 1307 ms. Trace:
I20260709 12:10:44.658926 22119 rpcz_store.cc:276] 0709 12:10:43.193447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.428815 (+235368us) service_pool.cc:224] Handling call
0709 12:10:43.429213 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.531340 (+102127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.500562 (+969222us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540012b1d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:44.500969 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233110784}
I20260709 12:10:44.377655 24729 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:44.389578 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:44.534261 24464 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:44.535458 24793 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:44.535341 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:44.540243 24588 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:44.409881 24754 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:44.395210 24718 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:44.542709 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:44.547947 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1662) took 1326 ms. Trace:
I20260709 12:10:44.650110 24533 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.566514 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:44.552301 24577 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.571081 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:44.616279 24744 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:44.569396 24581 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:44.410427 22117 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
W20260709 12:10:44.621412 22088 leader_election.cc:336] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.025s (SENT)
I20260709 12:10:44.693341 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:44.638727 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:44.639101 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:44.624269 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:44.640661 22123 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:44.645452 22192 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.646265 24728 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:44.638337 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:44.648991 22122 rpcz_store.cc:276] 0709 12:10:43.260915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.481593 (+1220678us) service_pool.cc:224] Handling call
0709 12:10:44.481984 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.482178 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.482207 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.482252 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:44.482324 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.482414 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.482543 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:44.651985 22114 rpcz_store.cc:276] 0709 12:10:42.868895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.869074 (+   179us) service_pool.cc:224] Handling call
0709 12:10:42.869432 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.926197 (+ 56765us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:42.926228 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:42.926277 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:42.926317 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.479779 (+1553462us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54001298d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:44.479838 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.480029 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129901824}
I20260709 12:10:44.608863 24709 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:44.642844 24791 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:10:44.549670 22189 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.605912 24686 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:44.675777 24675 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.674800 22118 rpcz_store.cc:276] 0709 12:10:43.221260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.693398 (+472138us) service_pool.cc:224] Handling call
0709 12:10:43.709139 (+ 15741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.709486 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.709514 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.711116 (+  1602us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.221494 (+510378us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:44.221561 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.221674 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.547605 (+325931us) raft_consensus.cc:1685] finished
0709 12:10:44.547638 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.547859 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9021,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":89528,"threads_started":1,"wal-append.queue_time_us":811278}
W20260709 12:10:44.677752 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.383973 24630 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:44.681511 22120 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:44.665482 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:44.708650 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 87276.6us
I20260709 12:10:44.731016 22114 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.690814 24793 raft_consensus.cc:3055] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:44.693110 24581 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:44.714973 22859 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:44.740013 22120 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:44.741504 22118 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.746827 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1673) took 1334 ms. Trace:
I20260709 12:10:44.747191 22118 rpcz_store.cc:276] 0709 12:10:43.412192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.720011 (+1307819us) service_pool.cc:224] Handling call
0709 12:10:44.741335 (+ 21324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.746548 (+  5213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.746764 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:44.747660 22270 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:44.691242 24577 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:44.712981 24750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.027s	sys 0.020s
W20260709 12:10:44.738852 24797 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:10:44.751473 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:44372 (request call id 1664) took 1524 ms. Trace:
I20260709 12:10:44.716244 24670 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:44.754499 22120 rpcz_store.cc:276] 0709 12:10:43.221978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.458938 (+1236960us) service_pool.cc:224] Handling call
0709 12:10:44.746238 (+287300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:44.761889 22118 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:44.762828 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1674) took 1342 ms. Trace:
I20260709 12:10:44.763247 22118 rpcz_store.cc:276] 0709 12:10:43.420049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.748040 (+1327991us) service_pool.cc:224] Handling call
0709 12:10:44.756166 (+  8126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.762466 (+  6300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.762751 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:44.737287 24793 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:10:44.756125 24750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.028s	sys 0.020s
I20260709 12:10:44.781845 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1675) took 1344 ms. Trace:
I20260709 12:10:44.782418 22118 rpcz_store.cc:276] 0709 12:10:43.437112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.764231 (+1327119us) service_pool.cc:224] Handling call
0709 12:10:44.781108 (+ 16877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.781379 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.781421 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.781481 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:44.781539 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.781619 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.781765 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:44.732800 24675 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:44.789422 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 261748us
I20260709 12:10:44.815973 22857 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:44.828473 24777 consensus_meta.cc:287] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.847s	user 0.010s	sys 0.004s
I20260709 12:10:44.829097 24777 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:44.832126 24777 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:44.833334 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1669) took 1533 ms. Trace:
I20260709 12:10:44.834082 24709 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:44.833827 22119 rpcz_store.cc:276] 0709 12:10:43.300380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.667529 (+1367149us) service_pool.cc:224] Handling call
0709 12:10:44.667886 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.678622 (+ 10736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.678658 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.688836 (+ 10178us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.818492 (+129656us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:44.818546 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.818675 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.832840 (+ 14165us) raft_consensus.cc:1685] finished
0709 12:10:44.832859 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.833265 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4465,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":16008,"thread_start_us":72950,"threads_started":1,"wal-append.queue_time_us":103859}
I20260709 12:10:44.836180 24577 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:44.836619 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 288) took 1138 ms. Trace:
I20260709 12:10:44.837580 24744 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:44.838780 24729 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:44.839721 24786 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:44.840885 24681 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:44.842341 24757 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:44.844179 24754 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:44.790036 24581 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:44.845741 24630 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:44.846331 24581 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:44.847162 24686 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:44.848284 24793 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:44.791939 24670 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:44.850054 24793 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.850700 24670 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:44.854341 24675 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:44.860406 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.826097 24716 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:44.819912 24722 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:44.868410 24678 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:44.837260 22119 rpcz_store.cc:276] 0709 12:10:43.698602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.835759 (+1137157us) service_pool.cc:224] Handling call
0709 12:10:44.836096 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.836297 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.836326 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.836371 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:44.836405 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.836461 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.836564 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:44.872903 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.850037 24718 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:44.875334 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1672) took 1566 ms. Trace:
I20260709 12:10:44.875787 22114 rpcz_store.cc:276] 0709 12:10:43.309242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.711353 (+1402111us) service_pool.cc:224] Handling call
0709 12:10:44.711773 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.734325 (+ 22552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.875030 (+140705us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5400214b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:44.875251 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43645824}
I20260709 12:10:44.878000 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1667) took 1614 ms. Trace:
I20260709 12:10:44.878420 22115 rpcz_store.cc:276] 0709 12:10:43.263911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.532926 (+1269015us) service_pool.cc:224] Handling call
0709 12:10:44.533317 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.737444 (+204127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.737476 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.737527 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:44.737563 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.877749 (+140186us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b5400311fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:44.877792 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.877936 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468927872}
I20260709 12:10:44.880231 24670 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:44.881748 22162 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:44.883651 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 290) took 1182 ms. Trace:
I20260709 12:10:44.884384 22114 rpcz_store.cc:276] 0709 12:10:43.701425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.876680 (+1175255us) service_pool.cc:224] Handling call
0709 12:10:44.883142 (+  6462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.883341 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.883365 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.883409 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:44.883440 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.883495 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.883591 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:44.880311 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 291) took 1174 ms. Trace:
I20260709 12:10:44.886287 22115 rpcz_store.cc:276] 0709 12:10:43.705961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.879439 (+1173478us) service_pool.cc:224] Handling call
0709 12:10:44.879812 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.879999 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.880025 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.880068 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:44.880114 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.880167 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.880258 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:44.885809 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:44.895087 22114 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:44.896531 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:44.897256 22114 raft_consensus.cc:1813] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
I20260709 12:10:44.898023 22114 raft_consensus.cc:2410] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:44.899142 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1671) took 1595 ms. Trace:
W20260709 12:10:44.865486 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 284480us
W20260709 12:10:44.905022 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.900074 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:44.912371 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:44.912596 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:44.915700 24744 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:44.916729 22263 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:44.916980 24744 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:44.918609 24744 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:44.907060 24718 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.920095 24718 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:44.920493 24718 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.917273 24729 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:44.921342 24729 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:44.922222 22116 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:44.923646 24729 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:44.917464 22269 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:44.917608 24738 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:10:44.923745 22116 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:44.929345 22116 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:44.929672 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:44.930591 22270 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.943024 22116 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:44.899734 22122 rpcz_store.cc:276] 0709 12:10:43.303877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.711115 (+1407238us) service_pool.cc:224] Handling call
0709 12:10:44.728040 (+ 16925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.728416 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.728466 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.743188 (+ 14722us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.884795 (+141607us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:44.884838 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.884907 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.884954 (+    47us) raft_consensus.cc:1685] finished
0709 12:10:44.884966 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.899055 (+ 14089us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124716,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"thread_start_us":117123,"threads_started":1,"wal-append.queue_time_us":117568}
I20260709 12:10:44.951767 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:44.952925 22116 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:44.954492 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:44.954612 22272 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:44.955708 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:44.959513 22270 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
W20260709 12:10:44.963929 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.966926 22864 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.967187 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:44.967988 22122 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:44.968415 24738 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:44.968997 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:44.988039 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:44.991822 22122 raft_consensus.cc:2368] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:44.997008 22116 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:44.954831 24709 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:45.535817 22163 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.045s	sys 0.120s
I20260709 12:10:45.654018 22863 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:45.684584 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 289) took 1985 ms. Trace:
I20260709 12:10:45.669135 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1676) took 2136 ms. Trace:
W20260709 12:10:45.739586 22163 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.068s	sys 0.160s
W20260709 12:10:45.177533 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.524266 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.163188 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:45.745316 22122 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
W20260709 12:10:45.395993 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.663333 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:45.655475 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:45.741793 22120 rpcz_store.cc:276] 0709 12:10:43.532616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.780965 (+1248349us) service_pool.cc:224] Handling call
0709 12:10:44.781425 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.053666 (+272241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.053721 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.054320 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.573048 (+518728us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:45.573103 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.573202 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.668736 (+ 95534us) raft_consensus.cc:1685] finished
0709 12:10:45.668764 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.669058 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":72918,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":600701,"threads_started":2,"wal-append.queue_time_us":489825}
I20260709 12:10:45.741642 22119 rpcz_store.cc:276] 0709 12:10:43.698916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.873285 (+1174369us) service_pool.cc:224] Handling call
0709 12:10:44.873748 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.873969 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:44.900760 (+ 26791us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.684189 (+783429us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.684235 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:45.684275 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.684333 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.684490 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":670202,"prepare.queue_time_us":33242,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":694049,"thread_start_us":112740,"threads_started":1,"wal-append.queue_time_us":768694}
W20260709 12:10:45.757249 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 855834us
I20260709 12:10:45.668545 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1668) took 2402 ms. Trace:
I20260709 12:10:45.339358 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:10:45.694787 22269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.000s	sys 0.007s
W20260709 12:10:45.768806 22269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.000s	sys 0.008s
W20260709 12:10:45.291601 22148 heartbeater.cc:646] Failed to heartbeat to 127.20.102.254:38171 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.102.254:38171 timed out after 15.000s (SENT)
I20260709 12:10:45.772696 22163 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:45.046563 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:45.761612 22121 rpcz_store.cc:276] 0709 12:10:43.266049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.538614 (+1272565us) service_pool.cc:224] Handling call
0709 12:10:44.538984 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.758208 (+219224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.758794 (+   586us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.759382 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.969595 (+210213us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:44.969628 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.969695 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.668274 (+698579us) raft_consensus.cc:1685] finished
0709 12:10:45.668297 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.668460 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104709,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7109,"thread_start_us":396021,"threads_started":2,"wal-append.queue_time_us":875468}
W20260709 12:10:45.678012 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 723566us
I20260709 12:10:45.826476 22088 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:45.830586 24648 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.831545 24648 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:45.832007 24648 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.832370 24648 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:45.487282 24793 consensus_meta.cc:287] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.003s
W20260709 12:10:45.476629 24718 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
W20260709 12:10:45.633648 24744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.014s	sys 0.031s
I20260709 12:10:45.026867 24630 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.883s
I20260709 12:10:45.917852 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:45.918007 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:45.162228 22858 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.284031 24286 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:45.910501 24581 consensus_meta.cc:287] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 1.064s	user 0.012s	sys 0.003s
I20260709 12:10:45.910341 24793 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:45.910928 24533 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.227s	user 0.008s	sys 0.005s
I20260709 12:10:45.715646 24805 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.836433 24676 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:45.835592 24777 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:45.096969 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:45.919170 22270 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:45.771376 24627 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:45.675244 24667 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.246s
I20260709 12:10:45.742556 24728 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:45.707569 24811 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.707576 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:45.092852 24819 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:10:45.769392 24734 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:45.818526 24754 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.916920 24744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.018s	sys 0.044s
I20260709 12:10:45.027094 24743 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.092484 24757 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.834s
W20260709 12:10:45.914054 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 87670.8us
I20260709 12:10:46.024525 22088 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:45.818665 24719 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:45.038017 24632 consensus_queue.cc:1059] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.906s
I20260709 12:10:45.961755 22115 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:45.818595 24786 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.770723 24709 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:45.921551 24718 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:46.039773 24824 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 12:10:46.041723 24816 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:46.042156 24718 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:45.965637 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 492) took 1021 ms. Trace:
I20260709 12:10:46.042840 22858 rpcz_store.cc:276] 0709 12:10:44.944066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.949147 (+  5081us) service_pool.cc:224] Handling call
0709 12:10:45.016120 (+ 66973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.925730 (+909610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.963991 (+ 38261us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:46.043804 22194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37260 (request call id 402) took 2344 ms (client timeout 1891 ms). Trace:
I20260709 12:10:45.996973 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:45.966013 24805 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:46.044991 24709 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:46.045130 22270 raft_consensus.cc:1813] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
I20260709 12:10:46.045868 22270 raft_consensus.cc:2410] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:46.046957 24805 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:45.995041 24627 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:46.047950 22857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 490) took 1454 ms. Trace:
W20260709 12:10:45.988538 24464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.032s	sys 0.108s
W20260709 12:10:46.048712 24464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.036s	sys 0.108s
I20260709 12:10:46.048472 22857 rpcz_store.cc:276] 0709 12:10:44.593612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.596659 (+  3047us) service_pool.cc:224] Handling call
0709 12:10:46.047699 (+1451040us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b540075dd54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:46.047875 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150024576}
I20260709 12:10:46.049461 24627 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:46.005209 24581 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:45.968647 24823 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 12:10:45.962790 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:46.050935 22268 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:46.030308 24754 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:45.962738 24533 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:46.053351 24774 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.053704 24754 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:46.053643 24533 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:46.030113 22860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 495) took 1070 ms. Trace:
I20260709 12:10:46.056109 24533 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:45.964893 24815 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:46.058045 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 287) took 2359 ms. Trace:
W20260709 12:10:46.058045 24798 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.293s	user 0.005s	sys 0.007s
I20260709 12:10:46.058894 22118 rpcz_store.cc:276] 0709 12:10:43.698302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.788230 (+1089928us) service_pool.cc:224] Handling call
0709 12:10:44.813375 (+ 25145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.813864 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.813911 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.821357 (+  7446us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.906543 (+ 85186us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:44.906597 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.906680 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.057797 (+1151117us) raft_consensus.cc:1685] finished
0709 12:10:46.057819 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.057970 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41147,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":59,"thread_start_us":41782,"threads_started":1,"wal-append.queue_time_us":103834}
I20260709 12:10:46.055785 22860 rpcz_store.cc:276] 0709 12:10:44.956032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.957659 (+  1627us) service_pool.cc:224] Handling call
0709 12:10:46.026517 (+1068858us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.968331 24793 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:46.061398 24811 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.062932 24786 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:46.064090 24793 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:45.965123 24676 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:46.065150 24786 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:46.036531 22088 connection.cc:256] RPC call timeout handler was delayed by -1.3636092650001501s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 12:10:46.037822 22859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 493) took 1093 ms. Trace:
W20260709 12:10:46.038367 22238 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.102.254:38171, user_credentials={real_user=slave}} blocked reactor thread for 69676.1us
W20260709 12:10:46.044226 22194 rpcz_store.cc:269] 0709 12:10:43.699774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.700355 (+   581us) service_pool.cc:224] Handling call
0709 12:10:46.043559 (+2343204us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b54003b56d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:46.043711 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2161752832}
I20260709 12:10:45.930155 24286 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:46.052842 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:46.006712 24728 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:46.066489 22088 connection.cc:256] RPC call timeout handler was delayed by -1.3384092650001094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 12:10:46.083947 22088 connection.cc:256] RPC call timeout handler was delayed by -1.2952092650000395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 12:10:46.084381 22088 connection.cc:256] RPC call timeout handler was delayed by -1.0630092650001188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
I20260709 12:10:46.086843 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:46.022672 24804 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:46.081297 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1670) took 2780 ms. Trace:
I20260709 12:10:45.988612 24777 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:46.025516 24743 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:46.025131 24752 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:46.095183 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:10:46.132474 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.132979 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:46.090641 22117 rpcz_store.cc:276] 0709 12:10:43.300817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.693533 (+1392716us) service_pool.cc:224] Handling call
0709 12:10:44.693828 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.746132 (+ 52304us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:44.884119 (+137987us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.678390 (+794271us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.678466 (+    76us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:45.678528 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.080976 (+402448us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b54002ac6d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:46.081036 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.081219 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":679777,"prepare.queue_time_us":124838,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":709176,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":56068,"spinlock_wait_cycles":119564032,"thread_start_us":241566,"threads_started":2,"wal-append.queue_time_us":789201}
I20260709 12:10:46.137852 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:46.026822 24734 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:46.143293 24667 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.140841 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 348) took 1677 ms. Trace:
I20260709 12:10:44.597988 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:46.201063 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.127202 24811 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.255527 24686 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.257613 22866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56950 (request call id 461) took 1314 ms. Trace:
I20260709 12:10:46.258049 24728 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:46.258949 24728 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.258090 22866 rpcz_store.cc:276] 0709 12:10:44.943573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.943731 (+   158us) service_pool.cc:224] Handling call
0709 12:10:44.969414 (+ 25683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.989891 (+ 20477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.989923 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.664246 (+674323us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.995627 (+331381us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:45.995668 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.995749 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.257338 (+261589us) raft_consensus.cc:1685] finished
0709 12:10:46.257358 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.257514 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20076,"raft.queue_time_us":20412,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":24998,"thread_start_us":299939,"threads_started":1,"wal-append.queue_time_us":590826}
I20260709 12:10:46.259975 24676 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:46.259702 24728 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:46.248864 22264 rpcz_store.cc:276] 0709 12:10:44.463991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.464223 (+   232us) service_pool.cc:224] Handling call
0709 12:10:44.464673 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.464999 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:44.791024 (+326025us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.138516 (+1347492us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.138802 (+   286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.138873 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:46.139984 (+  1111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.140060 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.140736 (+   676us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":699517,"prepare.queue_time_us":752537,"prepare.run_cpu_time_us":180,"prepare.run_wall_time_us":12181,"thread_start_us":955763,"threads_started":3,"wal-append.queue_time_us":1214942}
I20260709 12:10:46.066286 24719 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:46.257944 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 120201us
I20260709 12:10:46.131336 24752 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.263917 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:46.079916 22859 rpcz_store.cc:276] 0709 12:10:44.944659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.949231 (+  4572us) service_pool.cc:224] Handling call
0709 12:10:46.037719 (+1088488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:46.152024 24777 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:46.274899 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 502285us
I20260709 12:10:46.157486 24778 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.265861 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:46.321120 22264 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:46.141656 24533 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.259209 24286 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:46.293824 24752 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.148648 24648 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:46.369892 22830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.000s	sys 0.008s
W20260709 12:10:46.370563 22830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.000s	sys 0.009s
I20260709 12:10:46.319962 24667 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:46.373557 22269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.000s	sys 0.008s
W20260709 12:10:46.373968 22269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.000s	sys 0.008s
I20260709 12:10:46.375434 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1694) took 1424 ms. Trace:
W20260709 12:10:46.371277 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 1.03194e+06us
I20260709 12:10:46.376957 22830 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:46.378172 22087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.000s	sys 0.008s
W20260709 12:10:46.378760 22087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.000s	sys 0.009s
W20260709 12:10:46.371682 22236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.003s
W20260709 12:10:46.379541 22236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.006s	sys 0.003s
W20260709 12:10:46.379855 22831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.004s	sys 0.004s
W20260709 12:10:46.380424 22831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.004s	sys 0.004s
I20260709 12:10:46.380656 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:10:46.381620 22237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.002s	sys 0.006s
W20260709 12:10:46.382030 22237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.002s	sys 0.006s
W20260709 12:10:46.380864 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 717641us
W20260709 12:10:46.373188 22164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.008s
I20260709 12:10:46.378408 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:46.384539 22164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.000s	sys 0.008s
I20260709 12:10:46.362844 24533 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:46.386247 22162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.002s	sys 0.033s
I20260709 12:10:46.150143 24743 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:46.373507 22089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.004s	sys 0.004s
W20260709 12:10:46.399255 22089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.005s	sys 0.004s
W20260709 12:10:46.391225 22162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.003s	sys 0.033s
W20260709 12:10:46.400730 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 1.3542e+06us
W20260709 12:10:46.395975 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.157536 24804 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:46.421012 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 125134us
I20260709 12:10:46.422506 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:46.363914 24778 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:46.376030 22269 rpcz_store.cc:276] 0709 12:10:44.950911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.951059 (+   148us) service_pool.cc:224] Handling call
0709 12:10:44.951405 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.951665 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:44.977045 (+ 25380us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.374686 (+1397641us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.374932 (+   246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.375027 (+    95us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:46.375091 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.375180 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.375356 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":729488,"prepare.queue_time_us":37495,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":296540,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":1337928,"threads_started":2,"wal-append.queue_time_us":688056}
I20260709 12:10:46.443717 22162 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:46.445842 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 44070.9us
W20260709 12:10:46.450398 22272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.029s	sys 0.010s
W20260709 12:10:46.450855 22272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.029s	sys 0.010s
W20260709 12:10:46.451174 22086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.010s	sys 0.061s
W20260709 12:10:46.451824 22086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.010s	sys 0.061s
I20260709 12:10:46.373479 24667 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:46.420421 24804 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:46.467098 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1700) took 1404 ms. Trace:
W20260709 12:10:46.464599 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51983.7us
I20260709 12:10:46.398609 24533 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.399001 24630 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:46.399272 24758 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.400084 24777 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:46.440517 24815 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:46.462795 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:46.455120 24787 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.502538 22267 rpcz_store.cc:276] 0709 12:10:45.062580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.062735 (+   155us) service_pool.cc:224] Handling call
0709 12:10:45.091252 (+ 28517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.091540 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:46.133385 (+1041845us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.466641 (+333256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.466720 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:46.466785 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.466874 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.467020 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":649000,"prepare.queue_time_us":731619,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"thread_start_us":725180,"threads_started":2}
W20260709 12:10:46.535857 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 73143.7us
I20260709 12:10:46.460425 24743 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.503654 24750 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.451829 24786 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:10:46.500542 24709 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.462522 24686 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:46.458843 24718 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.545133 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:46.547636 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1706) took 1049 ms. Trace:
W20260709 12:10:46.538337 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 160157us
W20260709 12:10:46.518275 24826 log.cc:927] Time spent T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:46.455646 24588 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:10:46.523247 24667 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:46.528692 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 148140us
I20260709 12:10:46.464848 24676 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:46.563112 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:46.566340 22117 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:46.566253 22267 rpcz_store.cc:276] 0709 12:10:45.498389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.540228 (+1041839us) service_pool.cc:224] Handling call
0709 12:10:46.546914 (+  6686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.547183 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.547222 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.547282 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:46.547329 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.547400 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.547560 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:46.563719 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 58426us
I20260709 12:10:46.564540 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:46.564901 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:46.458611 24754 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 12:10:46.574155 22121 raft_consensus.cc:2376] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3. Re-sending same reply.
I20260709 12:10:46.566728 22830 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:46.564195 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 172593us
I20260709 12:10:46.588932 22120 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:10:46.569988 22118 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:46.593389 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:46.537209 24841 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:46.521715 24804 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:10:46.607416 22235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.014s	sys 0.014s
W20260709 12:10:46.608028 22235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.015s	sys 0.014s
I20260709 12:10:46.598397 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:46.553539 24848 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.599507 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1663) took 3369 ms. Trace:
I20260709 12:10:46.611750 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:46.546527 24777 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:46.666327 22087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.727s (SENT) [suppressed 25 similar messages]
I20260709 12:10:46.631750 22123 rpcz_store.cc:276] 0709 12:10:43.221616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.923990 (+702374us) service_pool.cc:224] Handling call
0709 12:10:43.924411 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.695398 (+770987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.590937 (+1895539us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54003129d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:46.591189 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1646314880}
I20260709 12:10:46.590626 24805 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:46.690543 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 93090.3us
W20260709 12:10:46.694710 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.696827 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 185505us
I20260709 12:10:46.565623 24845 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:46.537916 24630 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:46.563021 24464 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:10:46.683367 22117 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:46.682075 24837 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 12:10:46.526196 24758 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:46.710737 24774 consensus_meta.cc:287] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.627s	user 0.005s	sys 0.006s
I20260709 12:10:46.573280 24709 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:46.712100 24838 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.627732 24287 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:10:46.683516 24842 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:46.692332 24848 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:46.561734 24750 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:46.713893 24852 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:10:46.715269 22118 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:46.539101 24815 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:46.573647 24686 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:46.554543 24787 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:46.923130 22121 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:46.813858 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 225970us
W20260709 12:10:46.813357 22236 connection.cc:256] RPC call timeout handler was delayed by -1.8078685179998502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 12:10:46.933200 22236 connection.cc:256] RPC call timeout handler was delayed by -1.7411540659998082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 12:10:46.933748 22236 connection.cc:256] RPC call timeout handler was delayed by -1.580336041999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2604s for a response
W20260709 12:10:46.934216 22236 connection.cc:256] RPC call timeout handler was delayed by -1.3986510310000995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:10:46.934651 22236 connection.cc:256] RPC call timeout handler was delayed by -1.3473510310000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 12:10:46.935086 22236 connection.cc:256] RPC call timeout handler was delayed by -1.3050510309999481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 12:10:46.921334 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 221168us
W20260709 12:10:46.768064 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.600131 24678 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.855135 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:46.690580 24728 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:46.995754 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:46.836570 24832 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 12:10:46.984200 22123 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:46.984622 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:47.049593 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65064us
W20260709 12:10:46.983915 22236 connection.cc:256] RPC call timeout handler was delayed by -1.202054065999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.253s for a response
W20260709 12:10:47.050355 22236 connection.cc:256] RPC call timeout handler was delayed by -1.163751030999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
I20260709 12:10:47.000818 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:46.976361 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.001863 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:47.002058 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.000902 22122 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:47.002756 24675 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:47.003176 24750 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:46.997180 24840 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.004045 24630 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:46.978430 24632 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.005949 24621 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.010136 24719 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:47.012804 24848 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:47.013695 24839 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.310s	user 0.000s	sys 0.000s
I20260709 12:10:47.017208 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.017488 24686 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:47.017680 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:47.018265 22120 raft_consensus.cc:2376] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6. Re-sending same reply.
I20260709 12:10:47.019152 24815 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:47.083667 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:47.084710 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.090816 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1688) took 2123 ms. Trace:
I20260709 12:10:46.632202 24841 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:47.021216 22115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 1684) took 2137 ms (client timeout 2233 ms). Trace:
W20260709 12:10:47.093119 22115 rpcz_store.cc:269] 0709 12:10:44.883780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.887206 (+  3426us) service_pool.cc:224] Handling call
0709 12:10:47.020960 (+2133754us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400214654. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:47.021122 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2366000896}
I20260709 12:10:47.094503 24841 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:47.094659 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.095804 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1693) took 2147 ms. Trace:
I20260709 12:10:47.097314 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1699) took 2036 ms. Trace:
W20260709 12:10:47.024327 24827 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 1.056s	user 0.003s	sys 0.024s
W20260709 12:10:46.998353 24849 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 12:10:46.979264 24860 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:47.030198 24787 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:46.936926 24846 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:46.704154 24855 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.041549 24862 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.042243 24778 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:47.019188 24581 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:47.009672 24811 consensus_meta.cc:287] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 12:10:47.054239 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:46.976632 24648 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:47.008463 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 405) took 2985 ms. Trace:
I20260709 12:10:47.053365 22861 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:46.976251 24734 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:46.705355 24805 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:46.795372 24676 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.200836 22119 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:47.004283 24709 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:47.038311 24865 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:47.084254 24835 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.091512 22116 rpcz_store.cc:276] 0709 12:10:44.967102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.017437 (+ 50335us) service_pool.cc:224] Handling call
0709 12:10:45.017848 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.039603 (+1021755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.039642 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.039687 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:46.039788 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.090460 (+1050672us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002ad5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:47.090522 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.090731 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349209472}
I20260709 12:10:47.020512 24777 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:47.307339 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.078493 22163 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:47.023738 24533 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.515s	user 0.003s	sys 0.003s
I20260709 12:10:47.287915 22197 rpcz_store.cc:276] 0709 12:10:44.022924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.023223 (+   299us) service_pool.cc:224] Handling call
0709 12:10:44.092214 (+ 68991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.691866 (+599652us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:44.905008 (+213142us) log.cc:844] Serialized 14 byte log entry
0709 12:10:44.912667 (+  7659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.912719 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:44.912788 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.006626 (+2093838us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b1800351e80. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceaca32a6 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419
0709 12:10:47.008116 (+  1490us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54000fb4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:47.008192 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.008379 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174147,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":91,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":1453701760,"thread_start_us":220088,"threads_started":2,"wal-append.queue_time_us":749498,"wal-append.run_cpu_time_us":7078,"wal-append.run_wall_time_us":1395987}
I20260709 12:10:47.085616 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.316723 22123 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:47.198175 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:47.121079 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 454764us
I20260709 12:10:47.197404 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1707) took 1698 ms. Trace:
W20260709 12:10:47.223059 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.094736 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.320276 22267 rpcz_store.cc:276] 0709 12:10:45.498824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.591810 (+1092986us) service_pool.cc:224] Handling call
0709 12:10:46.596814 (+  5004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.095174 (+498360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.095208 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.095257 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:47.095295 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.096625 (+  1330us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54001dabd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:47.096674 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.197298 (+100624us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145557376}
I20260709 12:10:47.065171 24722 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.290478 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:47.290906 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.073503 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.200493 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:47.100064 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.198674 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.089155 22859 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:47.096232 22271 rpcz_store.cc:276] 0709 12:10:44.948238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.948391 (+   153us) service_pool.cc:224] Handling call
0709 12:10:44.948830 (+   439us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:44.958212 (+  9382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.958260 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:45.654232 (+695972us) log.cc:844] Serialized 52 byte log entry
0709 12:10:46.127104 (+472872us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:46.127173 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.128685 (+  1512us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.095513 (+966828us) raft_consensus.cc:1685] finished
0709 12:10:47.095539 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.095704 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":470,"raft.queue_time_us":586,"raft.run_cpu_time_us":642,"raft.run_wall_time_us":83231,"thread_start_us":419512,"threads_started":1,"wal-append.queue_time_us":663830}
W20260709 12:10:47.087414 24752 consensus_meta.cc:287] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.714s	user 0.005s	sys 0.006s
I20260709 12:10:47.199790 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1704) took 1869 ms. Trace:
I20260709 12:10:47.352825 22114 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:47.292284 24805 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.305900 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.292622 24734 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:47.294541 24841 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:47.307921 24855 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:10:47.356747 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.099427 24840 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.294027 22118 raft_consensus.cc:2393] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:47.321336 22122 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:47.358296 24648 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.322798 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.358495 24856 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:47.371732 24855 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.078668 24621 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:47.375985 24621 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.290164 24581 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.096710 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:47.353833 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 49789.7us
I20260709 12:10:47.291517 22266 rpcz_store.cc:276] 0709 12:10:45.061373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.061516 (+   143us) service_pool.cc:224] Handling call
0709 12:10:45.061938 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.094997 (+ 33059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.095043 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.770819 (+675776us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.372916 (+602097us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:46.372968 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.373041 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.097119 (+724078us) raft_consensus.cc:1685] finished
0709 12:10:47.097137 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.097261 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32519,"raft.queue_time_us":33577,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":57634,"thread_start_us":461413,"threads_started":1,"wal-append.queue_time_us":1145357}
I20260709 12:10:47.096290 24667 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.353037 22264 rpcz_store.cc:276] 0709 12:10:45.330682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.361366 (+1030684us) service_pool.cc:224] Handling call
0709 12:10:46.361821 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.362254 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.362294 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.368487 (+  6193us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.731698 (+363211us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:46.859762 (+128064us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.976270 (+116508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.976391 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.199553 (+223162us) raft_consensus.cc:1685] finished
0709 12:10:47.199576 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.199724 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62565,"prepare.queue_time_us":162818,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":41,"raft.queue_time_us":376336,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":4462,"thread_start_us":308123,"threads_started":1,"wal-append.queue_time_us":701195}
I20260709 12:10:47.360467 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.392436 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.298514 24811 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.324412 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.409330 22120 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:47.419512 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.421268 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.422802 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1702) took 2326 ms. Trace:
I20260709 12:10:47.356536 22121 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:47.079077 24632 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.076867 24675 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.309836 24835 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.358279 24752 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.370698 24648 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.288409 24848 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.373471 24709 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:47.299088 24676 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.291741 24860 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:47.362596 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.369268 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:47.458809 22267 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.357100 22116 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:10:47.358546 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 158163us
I20260709 12:10:47.460136 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:47.461472 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:47.462155 24835 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:47.462643 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:47.391484 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.463769 22266 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:47.464905 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.466008 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:47.399885 22238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.002s	sys 0.023s
W20260709 12:10:47.466850 22238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.002s	sys 0.023s
I20260709 12:10:47.467335 24675 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:47.405134 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.406047 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.407099 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.420485 22191 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
W20260709 12:10:47.424393 22830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.004s	sys 0.030s
I20260709 12:10:47.425833 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:47.323338 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 244966us
I20260709 12:10:47.475874 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1703) took 2231 ms. Trace:
I20260709 12:10:47.433277 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.337385 24846 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:47.355909 24722 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:47.322942 24859 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:10:47.423360 22270 rpcz_store.cc:276] 0709 12:10:45.096408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.046598 (+950190us) service_pool.cc:224] Handling call
0709 12:10:46.047025 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.047471 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.047497 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.048004 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.503038 (+455034us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:46.503093 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.503174 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.422560 (+919386us) raft_consensus.cc:1685] finished
0709 12:10:47.422581 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.422734 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36287,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":35838,"thread_start_us":454579,"threads_started":1,"wal-append.queue_time_us":578754}
I20260709 12:10:47.440634 22197 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.441294 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.441794 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.527323 22192 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:10:47.442080 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:46.999192 24842 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.388669 24815 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.450457 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.452437 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1697) took 2445 ms. Trace:
I20260709 12:10:46.987864 24838 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.539726 22189 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:47.456373 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:47.541191 22122 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.325754 24533 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.541426 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.468284 22115 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:47.400523 22237 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:47.403461 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.543226 22190 raft_consensus.cc:2410] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:47.365403 24870 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 12:10:47.388197 24734 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.470920 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1705) took 2012 ms. Trace:
I20260709 12:10:47.543959 22269 rpcz_store.cc:276] 0709 12:10:45.458998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.436996 (+977998us) service_pool.cc:224] Handling call
0709 12:10:46.437537 (+   541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.561631 (+124094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.561679 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.562320 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.120503 (+558183us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:47.120552 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.120637 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.470700 (+350063us) raft_consensus.cc:1685] finished
0709 12:10:47.470723 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.470856 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":267432,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":174,"thread_start_us":547946,"threads_started":2,"wal-append.queue_time_us":715305}
I20260709 12:10:47.425287 24670 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.365731 24841 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.425422 24621 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.435545 24844 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:47.424475 24744 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:47.425294 24856 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:10:47.390446 24787 consensus_queue.cc:1059] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:10:47.454041 24786 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:47.493597 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:47.481734 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.488416 22268 rpcz_store.cc:276] 0709 12:10:45.244616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.051674 (+807058us) service_pool.cc:224] Handling call
0709 12:10:46.052058 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.052445 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:46.066982 (+ 14537us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.561116 (+494134us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.584807 (+ 23691us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.585065 (+   258us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:46.588147 (+  3082us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.597721 (+  9574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.597846 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.015902 (+418056us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b18003b5c00. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:10:47.471867 (+455965us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b18003b5c00. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceaca32a6 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1
0709 12:10:47.475604 (+  3737us) raft_consensus.cc:1685] finished
0709 12:10:47.475631 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.475799 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83449,"prepare.queue_time_us":3011,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":106,"raft.queue_time_us":904243,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":73523,"spinlock_wait_cycles":191443200,"thread_start_us":389990,"threads_started":1,"wal-append.queue_time_us":630526}
I20260709 12:10:47.479244 24848 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.487972 22120 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:47.487645 22196 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
W20260709 12:10:47.487680 22830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.004s	sys 0.030s
I20260709 12:10:47.511653 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:47.534673 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:47.487087 22266 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
W20260709 12:10:47.474462 24743 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.918s	user 0.010s	sys 0.000s
I20260709 12:10:47.454409 24648 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.467837 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:47.532572 22272 rpcz_store.cc:276] 0709 12:10:45.006975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.007152 (+   177us) service_pool.cc:224] Handling call
0709 12:10:45.654167 (+647015us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:45.654559 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.654586 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:45.698250 (+ 43664us) log.cc:844] Serialized 52 byte log entry
0709 12:10:46.451266 (+753016us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:46.451305 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.451370 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.452139 (+1000769us) raft_consensus.cc:1685] finished
0709 12:10:47.452167 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.452355 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":623154,"threads_started":1,"wal-append.queue_time_us":796255}
I20260709 12:10:47.305686 24862 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.525336 24722 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.483945 22858 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:47.604831 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 291144us
I20260709 12:10:47.525691 24793 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.484264 24676 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:47.314457 24865 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.684693 24859 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.618875 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.681769 24793 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.686165 24793 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.686303 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.686615 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.686998 22264 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
W20260709 12:10:47.598556 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 63467.7us
I20260709 12:10:47.527252 24835 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:47.687745 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:47.619361 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 218949us
I20260709 12:10:47.688251 24835 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.689934 24734 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:47.690829 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 156265us
I20260709 12:10:47.691881 24862 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:47.692349 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:47.540145 24854 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:47.623718 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 69711.9us
W20260709 12:10:47.628188 24845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.011s	sys 0.018s
I20260709 12:10:47.487282 22117 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:47.633637 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.704517 22270 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:47.636521 22190 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.637705 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.705727 22198 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:47.476131 24709 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:47.639876 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 1.07314e+06us
I20260709 12:10:47.711167 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:47.641957 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.548064 24815 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.626662 24744 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:47.656599 24752 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:47.657670 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.661233 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.661672 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.662563 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.482643 24860 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.666828 24842 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:47.668453 24840 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:47.669157 24856 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.567816 24670 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.736439 24856 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:47.736610 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.669466 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.737346 22192 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:47.737650 22269 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:47.737432 24856 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.738344 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.738564 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.738757 24856 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.678071 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.739761 22116 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:47.740348 22117 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.682175 24846 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.685501 24838 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:47.686479 24865 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:47.687053 22189 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:47.527560 24675 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.539669 24750 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:47.691030 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.604261 22863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.008s	sys 0.041s
W20260709 12:10:47.749325 22863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.008s	sys 0.042s
I20260709 12:10:47.626554 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1613) took 1055 ms. Trace:
I20260709 12:10:47.692663 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.740721 22267 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:47.709779 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.711513 22236 leader_election.cc:400] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:47.752533 22236 leader_election.cc:403] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:47.626993 24728 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.636456 24803 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:10:47.715670 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:47.766678 22198 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:47.716012 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.716718 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.727104 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.734182 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.735267 24848 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:47.700958 24734 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.730576 24632 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:47.741818 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:47.787539 22117 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:47.742123 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:47.790256 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 78846.5us
I20260709 12:10:47.745204 24873 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.750563 22119 rpcz_store.cc:276] 0709 12:10:46.564409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.564621 (+   212us) service_pool.cc:224] Handling call
0709 12:10:47.619589 (+1054968us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54002c0bd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:47.619736 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057163136}
I20260709 12:10:47.746345 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:47.751216 22197 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:47.755579 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.629473 24844 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.799467 24670 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:47.799729 22119 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.800410 24844 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:47.769137 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.801200 22267 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
W20260709 12:10:47.801684 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 55404.5us
I20260709 12:10:47.802016 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.803134 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.803691 22267 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:47.804308 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:47.709457 24845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.012s	sys 0.018s
I20260709 12:10:47.783804 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:47.640738 24786 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:47.740378 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:47.832980 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 104597us
I20260709 12:10:47.833302 22861 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:47.712675 24286 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:47.809795 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.783218 24667 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:47.810031 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.843590 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:47.844094 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:47.844288 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 114497us
I20260709 12:10:47.844897 22268 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:47.844861 22270 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:47.804522 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.834676 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.792142 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:47.847084 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.847632 22270 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
W20260709 12:10:47.847992 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55950.5us
I20260709 12:10:47.848384 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:47.848978 22270 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.805148 24630 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:47.714112 24854 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:47.749100 24464 consensus_queue.cc:1175] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cc9b9c8894084021a0c6ddaf659d222e" responder_term: 3 status { last_received { term: 3 index: 3 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 3 } }
I20260709 12:10:47.839310 22162 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:47.790863 24750 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:47.848855 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:47.851224 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.772017 24837 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.744848 24744 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.813071 24841 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:47.856662 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:47.835611 24845 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:47.833153 24873 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:10:47.859601 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.859272 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:47.900648 22268 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.901157 22270 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:47.847731 24842 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.863095 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:47.861717 24581 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:47.868878 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.863343 24871 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:47.873430 22120 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:47.873780 24675 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:47.910627 24675 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:47.911386 24675 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.857681 24869 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.845423 24718 consensus_queue.cc:1059] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:47.875408 24648 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.879886 22119 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.880800 22267 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:47.881384 22861 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:10:47.882097 24804 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:47.883070 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43830.3us
I20260709 12:10:47.855273 24630 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:47.885568 24786 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:47.889110 22122 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:47.838867 24286 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.924664 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:47.862711 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:47.902803 24841 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:47.899499 22266 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:47.930222 22865 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:47.905526 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.930946 22270 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:10:47.900462 24882 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.921792 22119 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.924762 22268 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
W20260709 12:10:47.937072 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 74420.2us
I20260709 12:10:47.937480 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:10:47.956882 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.912895 24871 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:47.958295 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:47.885946 24837 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.960731 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:47.962037 22270 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:47.962342 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:47.963423 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:47.924330 24630 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:47.907194 24722 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:47.967943 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.968432 22118 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:47.966408 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:47.976708 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:47.989136 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:47.963712 24842 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:47.997459 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:48.006851 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:48.003474 24718 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:48.009994 22192 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.967460 24786 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.962425 24871 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.017665 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:48.018702 22270 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:48.018873 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:47.930543 24793 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:47.993144 24754 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:47.986506 24750 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.023294 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:48.003750 24869 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.996860 24882 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.957413 24841 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.011368 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:48.004350 24815 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:48.008117 24840 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.009583 24842 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:48.034126 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:48.105511 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 71466.5us
I20260709 12:10:48.013871 24870 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:48.024850 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:48.117702 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:48.118063 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:48.118640 22122 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.119186 24851 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.119632 24851 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:48.119931 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:48.062848 24895 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:48.120752 24842 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.121134 24895 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.123940 24895 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:48.124861 24870 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:48.125430 24870 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.126456 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:48.127430 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1831) took 1053 ms. Trace:
I20260709 12:10:48.127790 22271 rpcz_store.cc:276] 0709 12:10:47.073675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.357960 (+284285us) service_pool.cc:224] Handling call
0709 12:10:48.126244 (+768284us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b5800180398. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:10:48.127342 (+  1098us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7327616}
I20260709 12:10:48.130333 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:48.131065 22271 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:10:48.131987 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:48.139533 24850 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 1.216s	user 0.003s	sys 0.002s
I20260709 12:10:48.132594 22271 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:48.004243 24865 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 12:10:48.067853 24885 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:10:48.070150 24648 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:48.030376 24750 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:48.145183 24750 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.004084 24838 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 12:10:48.071602 24805 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.001s
I20260709 12:10:48.014747 24873 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.072268 24793 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:48.026327 24754 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.063516 24856 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:48.072985 24668 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.073487 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:48.076977 24874 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.079679 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1625) took 1036 ms. Trace:
I20260709 12:10:48.199440 22118 rpcz_store.cc:276] 0709 12:10:47.043714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.872243 (+828529us) service_pool.cc:224] Handling call
0709 12:10:47.968111 (+ 95868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.968898 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.079476 (+110578us) spinlock_profiling.cc:243] Waited 95.6 ms on lock 0x7b54002adfd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:48.079616 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219899264}
I20260709 12:10:48.201236 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:48.082131 24860 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:48.089699 24890 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:10:48.016894 24786 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:48.090373 24286 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:48.091681 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1695) took 3139 ms. Trace:
I20260709 12:10:48.091872 24837 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:48.025319 24859 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:48.094794 24681 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:48.098163 24722 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:48.098680 24581 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:48.098692 22863 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.197198 24856 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:48.099754 24854 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:48.199179 24874 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:47.985869 24845 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.037283 24869 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.100934 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:48.102766 24728 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:48.112978 24836 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.113518 24464 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.116086 24678 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.152377 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:48.153193 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1701) took 3090 ms. Trace:
I20260709 12:10:48.153993 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:48.156481 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:48.157265 24805 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.163360 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:48.167125 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 204850us
I20260709 12:10:48.084231 24675 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.203480 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:48.207983 24668 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.162186 24840 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:48.187942 24754 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.099238 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:48.224005 22122 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:48.242775 22162 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:10:48.242611 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 219401us
I20260709 12:10:48.229146 22263 rpcz_store.cc:276] 0709 12:10:44.952158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.952292 (+   134us) service_pool.cc:224] Handling call
0709 12:10:44.952632 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.958603 (+  5971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.958643 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.580731 (+1622088us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b2c000682a8. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:10:46.595716 (+ 14985us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.921159 (+325443us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b48001ec258. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf2cebaa1 00007fccf2ce2b37 00007fccf2ce29ca 00007fccf2dda26f 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508 00007fccf2dee488 00007fccf2dee443 00007fccf2ded6ec 00007fccf1d17a96
0709 12:10:48.091132 (+1169973us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18003a5c40. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1
0709 12:10:48.091293 (+   161us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:48.091331 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.091417 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.091459 (+    42us) raft_consensus.cc:1685] finished
0709 12:10:48.091470 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.091617 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14842,"raft.queue_time_us":5824,"raft.run_cpu_time_us":42035,"raft.run_wall_time_us":2021495,"spinlock_wait_cycles":1698549760,"thread_start_us":261858,"threads_started":1,"wal-append.queue_time_us":349238,"wal-append.run_cpu_time_us":2046,"wal-append.run_wall_time_us":1006283}
I20260709 12:10:48.497521 22271 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.498793 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:48.458624 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.500197 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:48.434122 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:48.295164 22191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:48.374950 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:48.502043 22191 raft_consensus.cc:606] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:48.502270 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:48.502552 22191 raft_consensus.cc:614] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:48.433507 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:48.489722 22264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1821) took 1433 ms (client timeout 1727 ms). Trace:
I20260709 12:10:48.503612 22118 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:10:48.504379 22264 rpcz_store.cc:269] 0709 12:10:47.055897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.392112 (+336215us) service_pool.cc:224] Handling call
0709 12:10:48.489530 (+1097418us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400056254. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:48.489655 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640697088}
I20260709 12:10:48.506038 22119 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:48.506826 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:48.496922 22120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.001s	sys 0.016s
W20260709 12:10:48.508512 22120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.002s	sys 0.016s
I20260709 12:10:48.502465 22269 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:48.253674 24686 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.228600 24786 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.506704 22265 rpcz_store.cc:276] 0709 12:10:45.063046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.186498 (+123452us) service_pool.cc:224] Handling call
0709 12:10:45.186893 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.241303 (+ 54410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.241349 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.063034 (+821685us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b2c000682a8. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:10:46.063450 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.458317 (+394867us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:46.458356 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.458422 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.138621 (+1680199us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:48.152891 (+ 14270us) raft_consensus.cc:1685] finished
0709 12:10:48.152921 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.153102 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53866,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":16683,"spinlock_wait_cycles":1156082432,"thread_start_us":394463,"threads_started":1,"wal-append.queue_time_us":652455}
I20260709 12:10:48.527652 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:48.499584 22272 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:10:48.522802 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.507826 22263 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:48.528635 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 374788us
I20260709 12:10:48.503093 22122 raft_consensus.cc:2376] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7. Re-sending same reply.
W20260709 12:10:48.530889 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 288229us
I20260709 12:10:48.534797 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:48.532706 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:48.280520 24856 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.546960 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:48.561707 22123 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.562315 22270 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:48.566515 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 66310.4us
I20260709 12:10:48.567572 22271 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:48.564347 22115 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:48.540266 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:48.289762 24874 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.240281 24630 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.568400 24846 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:48.571725 22191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:48.499128 24842 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.279507 24718 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:48.574653 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1697) took 1560 ms. Trace:
I20260709 12:10:48.564071 22268 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:48.501070 24840 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.507233 24464 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:48.506500 24678 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:48.448812 24871 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.526530 24686 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:48.534654 24787 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.508636 24836 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:48.251125 24681 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.520478 24869 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.584663 22263 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:48.601472 22191 raft_consensus.cc:606] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:48.634626 22191 raft_consensus.cc:614] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:48.598121 24902 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:48.602137 22117 rpcz_store.cc:276] 0709 12:10:47.014153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.794189 (+780036us) service_pool.cc:224] Handling call
0709 12:10:47.837745 (+ 43556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.837943 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:48.103573 (+265630us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b18003850c0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fccf17ba3c7 00007fcceddcc9a7 00007fccedddc0bf
0709 12:10:48.103739 (+   166us) log.cc:844] Serialized 14 byte log entry
0709 12:10:48.574097 (+470358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.574296 (+   199us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:48.574356 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.574438 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.574575 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72683,"prepare.queue_time_us":5808,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3229,"raft.queue_time_us":79692,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"spinlock_wait_cycles":5690240,"thread_start_us":403243,"threads_started":2,"wal-append.queue_time_us":335313}
W20260709 12:10:48.612526 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72332.7us
I20260709 12:10:48.638957 22264 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:48.640005 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1713) took 3139 ms. Trace:
I20260709 12:10:48.640506 22264 rpcz_store.cc:276] 0709 12:10:45.500604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.600665 (+3100061us) service_pool.cc:224] Handling call
0709 12:10:48.635903 (+ 35238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.639677 (+  3774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.639947 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.537953 24901 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.544435 24286 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.567800 24722 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.609419 24838 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:48.610154 24464 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.621492 24675 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:48.626946 24805 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:48.600195 24533 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:48.378289 24851 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.577683 24758 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:48.539212 24841 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:48.482543 24854 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:48.620569 24678 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.648893 24901 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:48.642320 24837 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.643118 24871 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:48.643791 24902 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.643791 24743 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.647212 22263 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:48.680949 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1811) took 1629 ms. Trace:
I20260709 12:10:48.681392 22263 rpcz_store.cc:276] 0709 12:10:47.051160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.646642 (+1595482us) service_pool.cc:224] Handling call
0709 12:10:48.646956 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.680650 (+ 33694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.680889 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.683049 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1826) took 1625 ms. Trace:
I20260709 12:10:48.683382 22263 rpcz_store.cc:276] 0709 12:10:47.057313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.682242 (+1624929us) service_pool.cc:224] Handling call
0709 12:10:48.682533 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.682738 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.682766 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.682811 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:48.682843 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.682897 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.683000 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.653370 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:48.684679 22263 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:48.653442 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 159255us
W20260709 12:10:48.656185 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 123578us
I20260709 12:10:48.665845 22857 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:48.656417 24286 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.560318 24734 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:48.643826 24630 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:48.609766 24846 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:48.647204 24870 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.512s	user 0.013s	sys 0.006s
I20260709 12:10:48.617311 24865 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:48.664969 22191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:48.716077 22191 raft_consensus.cc:606] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:48.691841 24533 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.654443 24722 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:48.632380 24787 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.667814 24854 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.667277 24718 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.690164 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1834) took 1490 ms. Trace:
I20260709 12:10:48.692046 22162 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:48.676967 24686 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.704471 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:48.667704 24837 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:48.667240 24901 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.711449 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:48.681216 24743 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:48.665551 22264 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:48.701889 24588 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.702276 24805 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.727336 22263 rpcz_store.cc:276] 0709 12:10:47.199812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.684267 (+1484455us) service_pool.cc:224] Handling call
0709 12:10:48.684514 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.686888 (+  2374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.690097 (+  3209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.740325 22263 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:48.741123 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1719) took 1518 ms. Trace:
I20260709 12:10:48.741631 22263 rpcz_store.cc:276] 0709 12:10:47.222243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.739535 (+1517292us) service_pool.cc:224] Handling call
0709 12:10:48.739890 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.740881 (+   991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.741068 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.731103 24837 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.734786 24722 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.716604 24870 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:48.737589 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 133367us
I20260709 12:10:48.747313 24668 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:48.746915 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1722) took 1490 ms. Trace:
I20260709 12:10:48.735813 22264 pending_rounds.cc:85] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 1
I20260709 12:10:48.718540 24734 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:48.734306 24895 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.739267 24743 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.752524 22263 rpcz_store.cc:276] 0709 12:10:47.256183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.742657 (+1486474us) service_pool.cc:224] Handling call
0709 12:10:48.742999 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.745286 (+  2287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.745326 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.746617 (+  1291us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:48.746669 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.746734 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.746861 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.760257 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:48.738169 24588 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.766805 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:48.749320 24686 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.769550 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:48.770884 22191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:48.747385 24787 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:48.772682 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:48.771443 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:48.787760 22122 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:48.772459 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:48.774032 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:48.788975 22119 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:10:48.767522 24588 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.780949 24668 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.738770 24630 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:10:48.758201 22264 pending_rounds.cc:107] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:48.734856 24533 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.791039 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:48.791756 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:48.793176 22264 raft_consensus.cc:2889] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:48.789954 24862 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:48.836730 24754 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.794986 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:48.913544 22121 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:48.746589 24805 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.785933 24846 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:48.796485 24668 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:48.798224 24902 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:48.799805 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:48.916764 22019 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 5 to 6, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 6 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:48.917866 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 118143us
I20260709 12:10:48.918555 24754 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:48.918673 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:48.919705 24805 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:48.919070 22019 catalog_manager.cc:5697] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 4 to 5, term changed from 2 to 4, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196), VOTER 7d3f536360b444b1886777f4776be22c (127.20.102.194) evicted. New cstate: current_term: 4 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:48.920177 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:48.920328 24805 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:48.803220 24286 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:48.760599 24895 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:48.920908 24805 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:48.921170 24895 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.921288 24667 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.768428 24870 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:48.921820 24667 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:48.813983 24860 consensus_meta.cc:287] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.003s
I20260709 12:10:48.922675 24787 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:48.923098 24787 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.923492 24787 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.924336 24744 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.925637 22857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 503) took 1209 ms. Trace:
I20260709 12:10:48.815550 24840 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.821808 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1815) took 1769 ms. Trace:
I20260709 12:10:48.927047 22270 rpcz_store.cc:276] 0709 12:10:47.052366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.033461 (+981095us) service_pool.cc:224] Handling call
0709 12:10:48.821592 (+788131us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54000ea954. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:48.821741 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835550464}
I20260709 12:10:48.928174 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:48.928750 22270 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.929201 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:48.931540 24811 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:48.794081 24815 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:48.822885 24869 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.824152 24871 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:48.824888 22267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1830) took 1751 ms (client timeout 2181 ms). Trace:
I20260709 12:10:48.827227 22861 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:48.831954 24874 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.765069 24842 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:48.833045 24750 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.003s
I20260709 12:10:48.833516 24854 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:48.876461 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.840608 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:48.833521 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:48.840936 22118 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:48.841084 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:48.841501 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1823) took 1785 ms. Trace:
I20260709 12:10:48.844264 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:48.845577 24837 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.846441 24865 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:48.846987 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1871) took 1188 ms. Trace:
I20260709 12:10:48.849242 24709 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:48.850911 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.851853 24464 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.856573 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1623) took 1816 ms. Trace:
I20260709 12:10:48.857267 24862 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.857704 24835 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:48.860100 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:48.860391 24588 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:48.863438 24906 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.151s	user 0.001s	sys 0.001s
I20260709 12:10:48.883975 24681 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:48.864279 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56950 (request call id 467) took 1791 ms. Trace:
I20260709 12:10:48.868103 22237 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:48.863263 24786 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:48.885232 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 361) took 1046 ms. Trace:
I20260709 12:10:48.887856 24678 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:48.878507 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.889333 22272 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:48.872080 22860 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.893209 22864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56950 (request call id 468) took 1819 ms. Trace:
I20260709 12:10:48.893378 24734 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.895005 24856 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.900065 24851 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:48.901885 24909 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 12:10:48.902138 24722 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:48.905956 22087 connection.cc:256] RPC call timeout handler was delayed by -1.0013259549998565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 12:10:48.906208 22266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1723) took 1649 ms (client timeout 1677 ms). Trace:
I20260709 12:10:48.909111 24836 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:48.910113 22863 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:10:48.911654 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1694) took 1898 ms. Trace:
I20260709 12:10:48.917179 24668 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.922257 24667 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.926061 22857 rpcz_store.cc:276] 0709 12:10:47.716225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.719063 (+  2838us) service_pool.cc:224] Handling call
0709 12:10:47.732091 (+ 13028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.691542 (+959451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.925298 (+233756us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b540071f054. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:48.925563 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114734464}
I20260709 12:10:49.020550 22192 rpcz_store.cc:276] 0709 12:10:47.658572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.739231 (+ 80659us) service_pool.cc:224] Handling call
0709 12:10:47.739556 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.012621 (+273065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.846760 (+834139us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54003b60d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:48.846926 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621255936}
I20260709 12:10:48.772090 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 355) took 1243 ms. Trace:
I20260709 12:10:49.028167 22263 rpcz_store.cc:276] 0709 12:10:47.528862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.771128 (+1242266us) service_pool.cc:224] Handling call
0709 12:10:48.771502 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.771741 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.771767 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.771810 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.771844 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.771897 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.772020 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.028923 22269 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:48.936064 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 207940us
I20260709 12:10:48.931902 22019 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:49.016196 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.938385 22270 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
W20260709 12:10:49.017511 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 176480us
I20260709 12:10:49.029865 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:49.030489 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:49.018828 22117 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:10:48.921356 24805 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.018064 22116 rpcz_store.cc:276] 0709 12:10:47.042986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.481369 (+438383us) service_pool.cc:224] Handling call
0709 12:10:48.856359 (+1374990us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400215f54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:48.856505 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249616128}
I20260709 12:10:49.021281 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:49.033337 22118 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
W20260709 12:10:49.018397 22266 rpcz_store.cc:269] 0709 12:10:47.256553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.640640 (+384087us) service_pool.cc:224] Handling call
0709 12:10:48.906032 (+1265392us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54002eb8d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:48.906145 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430370176}
I20260709 12:10:49.019788 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:49.035336 22119 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:49.019905 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:49.020337 22268 rpcz_store.cc:276] 0709 12:10:47.839240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.976377 (+137137us) service_pool.cc:224] Handling call
0709 12:10:48.885062 (+908685us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54001ad454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:48.885173 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896504064}
I20260709 12:10:49.019066 22264 rpcz_store.cc:276] 0709 12:10:47.056459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.648303 (+1591844us) service_pool.cc:224] Handling call
0709 12:10:48.665263 (+ 16960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.841269 (+176006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.841449 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.016237 22123 rpcz_store.cc:276] 0709 12:10:47.013390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.567671 (+554281us) service_pool.cc:224] Handling call
0709 12:10:47.631363 (+ 63692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.564958 (+933595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.911395 (+346437us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b540025fb54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:48.911591 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139133696}
W20260709 12:10:49.027527 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 159500us
I20260709 12:10:49.028925 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1708) took 3529 ms. Trace:
I20260709 12:10:49.039279 22272 rpcz_store.cc:276] 0709 12:10:45.499122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.538243 (+3039121us) service_pool.cc:224] Handling call
0709 12:10:48.888994 (+350751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.021048 (+132054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.028687 (+  7639us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54001ad450. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:49.028869 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805899008}
I20260709 12:10:49.015617 22864 rpcz_store.cc:276] 0709 12:10:47.097530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.231863 (+134333us) service_pool.cc:224] Handling call
0709 12:10:47.292609 (+ 60746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.292996 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.293025 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.351882 (+ 58857us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.524408 (+172526us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:47.524473 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.524578 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.892067 (+1367489us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b2400343c58. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceab5b9c4 00007fcceab59acb 00007fccead14dc9 00007fccead14a55 00007fccead13fb0 00007fcced98a488 00007fcced98abe8 00007fcced962398 00007fcced95d76a 00007fcced95cbb6
0709 12:10:48.892846 (+   779us) raft_consensus.cc:1685] finished
0709 12:10:48.892869 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.893135 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":767,"raft.queue_time_us":77,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":12554,"spinlock_wait_cycles":43139328,"thread_start_us":162644,"threads_started":1,"wal-append.queue_time_us":405674}
I20260709 12:10:49.031418 22196 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:49.016897 22267 rpcz_store.cc:269] 0709 12:10:47.073382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.804241 (+730859us) service_pool.cc:224] Handling call
0709 12:10:48.824698 (+1020457us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b540026b6d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:48.824831 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77582080}
I20260709 12:10:49.023240 22271 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:49.041815 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.041885 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 356) took 1512 ms. Trace:
I20260709 12:10:49.042438 22271 rpcz_store.cc:276] 0709 12:10:47.529199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.022772 (+1493573us) service_pool.cc:224] Handling call
0709 12:10:49.023063 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.041559 (+ 18496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.041812 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.038818 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 359) took 1502 ms. Trace:
I20260709 12:10:49.043869 22266 rpcz_store.cc:276] 0709 12:10:47.536741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.037875 (+1501134us) service_pool.cc:224] Handling call
0709 12:10:49.038230 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.038431 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.038468 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.038523 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:49.038568 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.038634 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.038749 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.050148 24718 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:49.050712 24718 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.051069 24718 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.051198 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 358) took 1514 ms. Trace:
W20260709 12:10:49.052002 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.053421 22019 catalog_manager.cc:5697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 2 to 5, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 5 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.016007 24871 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:49.055699 22019 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 3, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 3 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.056938 24861 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:49.032717 22163 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:49.057503 24861 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:49.058197 22197 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:49.058745 24754 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:49.058436 24861 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.059268 24754 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:49.059381 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:49.060078 22197 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:49.060956 24555 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:49.061314 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:49.061595 24872 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:49.062515 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:49.063120 24555 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:49.061131 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:49.061866 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:49.056376 22192 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.064790 22272 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:49.065433 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1724) took 1347 ms. Trace:
I20260709 12:10:49.057516 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:49.051697 22264 rpcz_store.cc:276] 0709 12:10:47.536449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.037630 (+1501181us) service_pool.cc:224] Handling call
0709 12:10:49.050609 (+ 12979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.050839 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.050871 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.050915 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:49.050952 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.051009 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.051124 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:49.064894 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.064904 22198 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:49.060127 24754 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.067456 22193 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:49.068190 22191 raft_consensus.cc:606] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:49.068637 22191 raft_consensus.cc:614] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:49.057950 22019 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.069470 22121 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.070585 24648 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.071457 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:49.071257 24648 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.070976 22019 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 3, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 3 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.072058 22191 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:49.075536 24464 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.079061 24862 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:49.080518 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 360) took 1333 ms. Trace:
I20260709 12:10:49.081017 22267 rpcz_store.cc:276] 0709 12:10:47.747550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.045383 (+1297833us) service_pool.cc:224] Handling call
0709 12:10:49.079788 (+ 34405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.080093 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.080123 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.080180 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:49.080213 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.080283 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.080456 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.065878 22272 rpcz_store.cc:276] 0709 12:10:47.718098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.064032 (+1345934us) service_pool.cc:224] Handling call
0709 12:10:49.064417 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.065212 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.065383 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.074357 22019 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 6 to 7, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 7 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.087374 24837 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:49.087913 24872 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:49.087507 22019 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.089236 24872 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:49.089787 24872 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:49.093473 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:49.094525 24464 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:49.095431 24464 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:49.099120 24464 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.098152 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:48.839763 24533 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.102924 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:49.085481 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:49.104136 22265 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:49.091471 24872 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.129901 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1827) took 2072 ms. Trace:
I20260709 12:10:49.130443 22269 rpcz_store.cc:276] 0709 12:10:47.057593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.534503 (+1476910us) service_pool.cc:224] Handling call
0709 12:10:49.129700 (+595197us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54000ea454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:49.129842 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134297344}
I20260709 12:10:49.116557 22197 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.089819 22019 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 3, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 3 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.135037 22115 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:48.937711 24815 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:49.118624 22272 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:49.111891 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.140931 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1709) took 3641 ms. Trace:
I20260709 12:10:49.119050 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1861) took 1609 ms. Trace:
I20260709 12:10:49.142217 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:49.142539 22193 rpcz_store.cc:276] 0709 12:10:47.510097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.511277 (+  1180us) service_pool.cc:224] Handling call
0709 12:10:49.118834 (+1607557us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001bf8d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:49.118988 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2950442880}
I20260709 12:10:49.122072 22196 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.141379 22265 rpcz_store.cc:276] 0709 12:10:45.499420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.560832 (+3061412us) service_pool.cc:224] Handling call
0709 12:10:48.562158 (+  1326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.118706 (+556548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.140654 (+ 21948us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400240254. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:49.140864 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246021504}
I20260709 12:10:49.049263 24836 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.026813 24630 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.150961 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:49.135826 22019 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 1 to 6, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 6 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.151744 22269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:49138
I20260709 12:10:49.102823 24681 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:48.875946 24901 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:49.165553 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.165920 22267 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:49.190701 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1730) took 1393 ms. Trace:
I20260709 12:10:49.191166 22267 rpcz_store.cc:276] 0709 12:10:47.797421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.156967 (+1359546us) service_pool.cc:224] Handling call
0709 12:10:49.165704 (+  8737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.190346 (+ 24642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.190616 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.007386 24743 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:49.173026 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 366632us
W20260709 12:10:49.152164 24873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.008s	sys 0.022s
W20260709 12:10:49.196413 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6361669790001088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32320000000000004s for a response
I20260709 12:10:49.175446 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:49.185425 22831 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:49.027088 24750 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:49.145720 24815 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:49.196939 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6361669790001088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32320000000000004s for a response
I20260709 12:10:49.027056 24865 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:49.224416 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49120.7us
I20260709 12:10:49.229867 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:10:49.231894 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 299020us
I20260709 12:10:49.232487 22198 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.149372 24837 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:49.219022 24873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.008s	sys 0.022s
W20260709 12:10:49.231309 22017 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 223) took 19330 ms (client timeout 15000 ms). Trace:
W20260709 12:10:49.243232 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.236294 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:49.165582 24778 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.236711 22271 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.236363 22194 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.181847 24681 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.246272 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1735) took 1137 ms. Trace:
I20260709 12:10:49.260972 22271 rpcz_store.cc:276] 0709 12:10:48.109386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.236210 (+1126824us) service_pool.cc:224] Handling call
0709 12:10:49.236547 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.245982 (+  9435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.246202 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.262113 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:49.262720 22271 raft_consensus.cc:2376] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6. Re-sending same reply.
I20260709 12:10:49.263809 22263 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.257742 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:57876 (request call id 85) took 1239 ms. Trace:
I20260709 12:10:49.264808 22267 rpcz_store.cc:276] 0709 12:10:48.001580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.197355 (+1195775us) service_pool.cc:224] Handling call
0709 12:10:49.240666 (+ 43311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.265910 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:49.193341 24588 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:49.196827 24889 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:49.194676 24872 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.153333 24882 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:10:49.165040 24752 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:10:49.225039 24630 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.270506 24854 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.275444 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.285267 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:49.275823 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:49.238379 24845 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.231009 24838 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.023147 22858 rpcz_store.cc:276] 0709 12:10:47.073317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.073469 (+   152us) service_pool.cc:224] Handling call
0709 12:10:47.073822 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.684022 (+610200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.863841 (+1179819us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54005073d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:48.864185 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942443264}
I20260709 12:10:49.278841 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:49.291638 22120 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:10:49.284001 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.243124 24837 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.264533 24681 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.275504 24870 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:10:49.290242 24838 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.298229 24874 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:49.257512 24533 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:10:49.302227 24743 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.303203 24750 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.303740 24786 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.304494 24840 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:49.290580 24845 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.259225 24648 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:49.305948 24846 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:49.309604 24837 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.309654 24722 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.273737 24889 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.311873 24856 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:49.257131 24778 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:49.315222 22272 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:10:49.337250 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:49.339147 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:49.287745 24873 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.420907 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:49.448648 22267 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.303203 24869 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:49.426623 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:49.428735 22088 leader_election.cc:336] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.557s (SENT)
W20260709 12:10:49.430405 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 245049us
W20260709 12:10:49.243371 22017 rpcz_store.cc:269] 0709 12:10:29.853038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.932983 (+ 79945us) service_pool.cc:224] Handling call
0709 12:10:49.181049 (+19248066us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:41.533131 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:41.592919 (+ 59788us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:41.636926 (+ 44007us) write_op.cc:435] Acquired schema lock
0709 12:10:41.648730 (+ 11804us) tablet.cc:662] Decoding operations
0709 12:10:41.781323 (+132593us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:41.781400 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:41.781443 (+    43us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:41.782340 (+   897us) tablet.cc:701] Row locks acquired
0709 12:10:41.782399 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:10:41.782628 (+   229us) write_op.cc:270] Start()
0709 12:10:41.782792 (+   164us) write_op.cc:276] Timestamp: P: 1783599041782568 usec, L: 0
0709 12:10:41.782813 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:10:41.862274 (+ 79461us) log.cc:844] Serialized 3316 byte log entry
0709 12:10:42.621243 (+758969us) op_driver.cc:464] REPLICATION: finished
0709 12:10:42.756546 (+135303us) write_op.cc:301] APPLY: starting
0709 12:10:42.756673 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:42.756950 (+   277us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:42.757089 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:43.037787 (+280698us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:43.038114 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:43.047385 (+  9271us) write_op.cc:312] APPLY: finished
0709 12:10:43.120483 (+ 73098us) log.cc:844] Serialized 65 byte log entry
0709 12:10:43.134484 (+ 14001us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:43.134620 (+   136us) write_op.cc:454] Released schema lock
0709 12:10:43.134695 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:43.135073 (+   378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:43.135101 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6631,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":134941,"apply.run_cpu_time_us":6423,"apply.run_wall_time_us":378545,"num_ops":8,"prepare.queue_time_us":267251,"prepare.run_cpu_time_us":37251,"prepare.run_wall_time_us":559254,"raft.queue_time_us":236737,"raft.run_cpu_time_us":20649,"raft.run_wall_time_us":80614,"replication_time_us":838245,"thread_start_us":478765,"threads_started":4,"wal-append.queue_time_us":314086,"wal-append.run_cpu_time_us":22493,"wal-append.run_wall_time_us":1998287}]]}
I20260709 12:10:49.453207 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:49.453209 22123 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:49.458688 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.434723 24845 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.465641 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.434409 24533 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.447425 24889 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.448350 24841 raft_consensus.cc:2764] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:10:49.448827 24778 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.453095 24854 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.448340 24873 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:49.492273 22267 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:10:49.463270 24835 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:49.495136 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 392898us
I20260709 12:10:49.504056 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.507648 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:49.508735 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.509742 22272 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:49.510984 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.511217 22123 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:49.511651 22272 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:49.512601 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:49.513211 22272 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.469692 24533 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:49.514621 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 280743us
I20260709 12:10:49.519136 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:49.477452 24838 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:49.493595 24873 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.577716 22119 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:49.529773 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:49.579432 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:49.585054 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 65987.7us
W20260709 12:10:49.588599 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.502758 24627 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.004s	sys 0.018s
W20260709 12:10:49.533854 24913 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:49.599159 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 357) took 2069 ms. Trace:
I20260709 12:10:49.599705 22263 rpcz_store.cc:276] 0709 12:10:47.536014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.029468 (+1493454us) service_pool.cc:224] Handling call
0709 12:10:49.029771 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.264373 (+234602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.598824 (+334451us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b540026cad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:49.599073 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537683840}
I20260709 12:10:49.600561 24686 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:49.490100 24667 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:49.601056 24686 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:49.601223 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:49.533242 24911 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:10:49.529421 24918 log.cc:927] Time spent T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:49.520870 24533 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.645905 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:49.655301 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.656484 22271 raft_consensus.cc:2393] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:49.646476 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:49.659044 24533 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:49.649663 22866 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 501) took 1934 ms (client timeout 1999 ms). Trace:
W20260709 12:10:49.652516 24668 consensus_meta.cc:287] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.003s
W20260709 12:10:49.659762 24744 consensus_meta.cc:287] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.735s	user 0.007s	sys 0.004s
I20260709 12:10:49.660715 24758 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.661435 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:49.668972 22272 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:49.643652 24837 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.674652 24837 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:49.660180 22866 rpcz_store.cc:269] 0709 12:10:47.715645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.715777 (+   132us) service_pool.cc:224] Handling call
0709 12:10:49.649358 (+1933581us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54006fc7d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:49.649580 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3470357248}
I20260709 12:10:49.492923 24854 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:49.664081 24681 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:49.660434 24668 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:49.634513 24805 consensus_meta.cc:287] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.011s
I20260709 12:10:49.676877 24854 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.677127 24805 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.678094 24668 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:49.679842 24805 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:49.647038 24860 raft_consensus.cc:993] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:10:49.544642 24718 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.680841 22269 raft_consensus.cc:606] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:49.681209 24859 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:49.681309 22269 raft_consensus.cc:614] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:49.681680 24859 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:49.682262 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:49.682576 24718 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:49.669327 24901 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.682857 22272 raft_consensus.cc:2376] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5. Re-sending same reply.
I20260709 12:10:49.682802 24859 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:49.683583 24895 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.762s	user 0.012s	sys 0.000s
I20260709 12:10:49.669713 22271 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.684015 24859 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.684044 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:49.661260 24758 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.681614 24681 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.687790 24758 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:49.680742 24860 raft_consensus.cc:1081] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:10:49.689018 24815 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.691118 24815 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:49.691692 22862 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 499) took 2596 ms (client timeout 2181 ms). Trace:
I20260709 12:10:49.670535 24925 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:49.692191 22862 rpcz_store.cc:269] 0709 12:10:47.095643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.198336 (+102693us) service_pool.cc:224] Handling call
0709 12:10:49.691464 (+2493128us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b540059e7d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:49.691607 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4241332608}
I20260709 12:10:49.633257 24667 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:49.595606 24627 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.005s	sys 0.019s
W20260709 12:10:49.650743 24787 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.002s
I20260709 12:10:49.580498 24924 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:49.588027 24865 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:49.595153 24838 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.684056 24895 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:49.694335 24925 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:49.601989 24686 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:49.784133 22007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f86b841ece254f9bbfd1bd07c08f7004 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cc9b9c8894084021a0c6ddaf659d222e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:10:49.843356 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.843544 22007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 555925us
W20260709 12:10:49.788475 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 331106us
I20260709 12:10:49.844856 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.845711 24815 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:49.845928 22194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:49.847262 22194 raft_consensus.cc:606] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:49.846848 24815 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:49.792465 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1721) took 1764 ms. Trace:
I20260709 12:10:49.848346 22114 rpcz_store.cc:276] 0709 12:10:48.027790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.027980 (+   190us) service_pool.cc:224] Handling call
0709 12:10:48.857786 (+829806us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.858132 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.858165 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.858638 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.182892 (+324254us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:49.182932 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.183002 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.296869 (+113867us) raft_consensus.cc:1685] finished
0709 12:10:49.296893 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.791590 (+494697us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b5400215f50. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:49.792111 (+   521us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1330,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":1907590912,"thread_start_us":323867,"threads_started":1,"wal-append.queue_time_us":385213}
I20260709 12:10:49.850309 24752 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:49.850924 24752 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:49.793718 22115 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.693531 22272 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:49.804178 22163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.004s	sys 0.012s
W20260709 12:10:49.806185 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 215577us
I20260709 12:10:49.807718 22190 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.602007 22263 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:49.811422 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 165404us
I20260709 12:10:49.691668 22271 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:49.811945 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1731) took 1975 ms. Trace:
I20260709 12:10:49.636567 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:49.812693 22268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.000s	sys 0.020s
I20260709 12:10:49.814728 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1734) took 1878 ms. Trace:
W20260709 12:10:49.815675 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.827761 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 371401us
I20260709 12:10:49.837357 24681 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:49.937646 24681 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:49.936753 24464 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:10:49.938443 24681 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.838770 24837 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.751256 24895 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.746915 24936 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.941746 24837 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:49.942901 24936 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:49.944124 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.726044 24838 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.945266 24838 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.946069 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.882268 24854 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:49.885241 22163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.004s	sys 0.016s
I20260709 12:10:49.886379 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:49.887543 24778 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:49.723510 24924 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:49.961838 24667 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:10:49.962527 24924 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:49.964920 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 74416.6us
I20260709 12:10:49.966086 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:49.967887 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.752887 24889 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:49.971643 24889 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:49.972445 24936 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:49.972829 22263 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
W20260709 12:10:49.973278 24942 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.002s
I20260709 12:10:49.973953 24917 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.974318 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:49.522046 24871 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.982702 24871 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.709780 24787 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:49.913643 24752 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:49.934937 22268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.001s	sys 0.020s
W20260709 12:10:49.930392 22088 leader_election.cc:336] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.727s (SENT)
I20260709 12:10:49.953730 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:10:49.954694 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 851750us
I20260709 12:10:49.926406 22270 rpcz_store.cc:276] 0709 12:10:47.935807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.183484 (+1247677us) service_pool.cc:224] Handling call
0709 12:10:49.183839 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.184102 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:49.491253 (+307151us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.813821 (+322568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.813956 (+   135us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:49.814117 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.814272 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.814504 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":418517,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":68158,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":229,"thread_start_us":589858,"threads_started":2,"wal-append.queue_time_us":254278}
I20260709 12:10:49.918556 22266 rpcz_store.cc:276] 0709 12:10:47.836580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.157665 (+1321085us) service_pool.cc:224] Handling call
0709 12:10:49.158106 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:49.166125 (+  8019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.166182 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:49.192704 (+ 26522us) log.cc:844] Serialized 52 byte log entry
0709 12:10:49.474669 (+281965us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:49.474715 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.474796 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.534534 (+ 59738us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b48001ec258. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf2cebaa1 00007fccf2ce2b37 00007fccf2ce29ca 00007fccf2dda26f 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508 00007fccf2dee488 00007fccf2dee443 00007fccf2ded6ec 00007fccf1d17a96
0709 12:10:49.810960 (+276426us) raft_consensus.cc:1685] finished
0709 12:10:49.811018 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.811617 (+   599us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7497,"raft.queue_time_us":29356,"raft.run_cpu_time_us":5022,"raft.run_wall_time_us":341224,"spinlock_wait_cycles":57925504,"thread_start_us":229588,"threads_started":1,"wal-append.queue_time_us":503200}
I20260709 12:10:49.937242 24286 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:49.736616 24925 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:49.964527 24924 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.985883 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:49.993121 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:49.997257 24837 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.998658 24815 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:49.999643 22267 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:50.001116 22195 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:50.003216 24778 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:50.008456 24678 consensus_meta.cc:287] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.981s	user 0.009s	sys 0.012s
I20260709 12:10:49.965307 24854 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.010010 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:50.019477 22858 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.020326 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1728) took 2241 ms. Trace:
W20260709 12:10:50.020445 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 499684us
I20260709 12:10:49.742656 24882 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.274s
I20260709 12:10:50.026491 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:50.031322 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.028614 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:50.030704 22263 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:50.028465 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1736) took 1918 ms. Trace:
I20260709 12:10:50.032073 22266 rpcz_store.cc:276] 0709 12:10:48.109709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.026712 (+1917003us) service_pool.cc:224] Handling call
0709 12:10:50.027444 (+   732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.027990 (+   546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.028019 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.028110 (+    91us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:50.028156 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.028220 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.028365 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.039433 22115 raft_consensus.cc:2393] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:50.040125 22123 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.042184 24778 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:50.043108 24778 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:50.030987 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:50.053480 22114 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:50.104117 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:50.105316 22267 raft_consensus.cc:2410] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:50.110772 24787 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:50.088794 24678 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:50.113035 24851 consensus_meta.cc:287] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.088s	user 0.003s	sys 0.018s
W20260709 12:10:50.113797 24873 consensus_meta.cc:287] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.504s	user 0.016s	sys 0.000s
I20260709 12:10:50.114059 22269 raft_consensus.cc:2410] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:50.114229 24873 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:50.116983 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 163562us
I20260709 12:10:50.118271 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 300) took 1097 ms. Trace:
I20260709 12:10:50.118498 24841 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.119553 24841 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.121730 22117 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:10:50.122027 24845 consensus_meta.cc:287] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.009s
I20260709 12:10:50.122160 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:50.122483 24845 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.118772 22122 rpcz_store.cc:276] 0709 12:10:49.021204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.021304 (+   100us) service_pool.cc:224] Handling call
0709 12:10:49.021543 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.021727 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:49.492442 (+470715us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.043666 (+551224us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.049337 (+  5671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.057061 (+  7724us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:50.117751 (+ 60690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.117899 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.118076 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10284,"prepare.queue_time_us":519461,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":99,"raft.queue_time_us":4914,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":9499,"spinlock_wait_cycles":45528448,"thread_start_us":880252,"threads_started":2,"wal-append.queue_time_us":500500}
I20260709 12:10:50.124032 22859 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:50.027920 22268 rpcz_store.cc:276] 0709 12:10:47.778567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.144152 (+1365585us) service_pool.cc:224] Handling call
0709 12:10:49.164190 (+ 20038us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.166672 (+  2482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.166718 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:49.227506 (+ 60788us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.644181 (+416675us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b48001ec258. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf2cebaa1 00007fccf2ce2b37 00007fccf2ce29ca 00007fccf2dda26f 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508 00007fccf2dee488 00007fccf2dee443 00007fccf2ded6ec 00007fccf1d17a96
0709 12:10:50.019642 (+375461us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:50.019760 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.019915 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:50.019968 (+    53us) raft_consensus.cc:1685] finished
0709 12:10:50.019983 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.020261 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1981,"raft.queue_time_us":23661,"raft.run_cpu_time_us":3659,"raft.run_wall_time_us":452615,"spinlock_wait_cycles":55736704,"thread_start_us":706856,"threads_started":1,"wal-append.queue_time_us":496519}
W20260709 12:10:50.153116 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 184799us
I20260709 12:10:50.123740 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:50.130092 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1729) took 2343 ms. Trace:
W20260709 12:10:50.156855 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 226565us
W20260709 12:10:50.160174 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 47409.9us
I20260709 12:10:50.160820 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1732) took 2241 ms. Trace:
I20260709 12:10:50.161139 24286 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:50.162326 24286 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.162787 24286 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:50.161458 22264 rpcz_store.cc:276] 0709 12:10:47.919259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.182938 (+1263679us) service_pool.cc:224] Handling call
0709 12:10:49.226049 (+ 43111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.226291 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:49.490788 (+264497us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.122673 (+631885us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.158643 (+ 35970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.160161 (+  1518us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:50.160254 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.160377 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.160567 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33637,"prepare.queue_time_us":420932,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":139,"raft.queue_time_us":9697,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":152,"thread_start_us":745513,"threads_started":2,"wal-append.queue_time_us":540646}
I20260709 12:10:50.055497 24815 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:50.164536 22264 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.165395 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:50.123783 24841 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:50.173771 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1747) took 1640 ms. Trace:
I20260709 12:10:50.174512 22264 rpcz_store.cc:276] 0709 12:10:48.530519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.163535 (+1633016us) service_pool.cc:224] Handling call
0709 12:10:50.164157 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.170508 (+  6351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.170762 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.172385 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:50.164140 24286 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.181330 22272 raft_consensus.cc:2410] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:10:50.182149 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 211025us
I20260709 12:10:50.169432 24873 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:50.185141 24925 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.128516 24838 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:50.182723 22088 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.970s (SENT)
I20260709 12:10:50.096935 24778 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.156760 22265 rpcz_store.cc:276] 0709 12:10:47.786368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.145135 (+1358767us) service_pool.cc:224] Handling call
0709 12:10:49.147357 (+  2222us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:49.165319 (+ 17962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.165350 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:49.193147 (+ 27797us) log.cc:844] Serialized 52 byte log entry
0709 12:10:49.473119 (+279972us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:50.015510 (+542391us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.129024 (+113514us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.129382 (+   358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.129527 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:50.129578 (+    51us) raft_consensus.cc:1685] finished
0709 12:10:50.129598 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.129851 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28257,"prepare.queue_time_us":163849,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":71619,"raft.run_cpu_time_us":517,"raft.run_wall_time_us":47670,"thread_start_us":704439,"threads_started":2,"wal-append.queue_time_us":362321}
I20260709 12:10:50.193598 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:50.200830 22271 raft_consensus.cc:2393] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:50.214164 22264 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.221696 22268 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.223500 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1749) took 1379 ms. Trace:
I20260709 12:10:50.223882 22264 rpcz_store.cc:276] 0709 12:10:48.840515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.186826 (+1346311us) service_pool.cc:224] Handling call
0709 12:10:50.206167 (+ 19341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.219871 (+ 13704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.220098 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.227600 24815 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.228041 22272 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:50.224962 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1746) took 2022 ms. Trace:
I20260709 12:10:50.229178 22268 rpcz_store.cc:276] 0709 12:10:48.200140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.165940 (+1965800us) service_pool.cc:224] Handling call
0709 12:10:50.196660 (+ 30720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.222185 (+ 25525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.222328 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.217439 24944 consensus_queue.cc:1059] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:10:50.231874 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1741) took 2093 ms. Trace:
I20260709 12:10:50.233652 22263 rpcz_store.cc:276] 0709 12:10:48.152321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.055196 (+1902875us) service_pool.cc:224] Handling call
0709 12:10:50.183012 (+127816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.224231 (+ 41219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.224263 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.226475 (+  2212us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:50.226523 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.226597 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.226730 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.209971 24838 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:50.235370 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:50.233011 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:50.209241 24686 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.233122 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 363) took 1359 ms. Trace:
I20260709 12:10:50.238641 22272 rpcz_store.cc:276] 0709 12:10:48.869818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.216538 (+1346720us) service_pool.cc:224] Handling call
0709 12:10:50.227697 (+ 11159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.229083 (+  1386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.229276 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.242358 22265 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.242842 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1750) took 1402 ms. Trace:
I20260709 12:10:50.243119 22265 rpcz_store.cc:276] 0709 12:10:48.840747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.199143 (+1358396us) service_pool.cc:224] Handling call
0709 12:10:50.232312 (+ 33169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.242661 (+ 10349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.242799 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.240526 24889 consensus_queue.cc:1059] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:50.245059 24754 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.245895 24944 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:50.246357 24944 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:50.244056 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1743) took 2082 ms. Trace:
I20260709 12:10:50.245123 24464 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:50.249143 24889 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:50.249536 24889 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:50.249589 24464 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:50.250869 24464 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.254063 22190 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.254877 24944 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.255333 24846 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:50.256445 24944 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.244436 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1745) took 2046 ms. Trace:
I20260709 12:10:50.258802 22269 rpcz_store.cc:276] 0709 12:10:48.198142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.166047 (+1967905us) service_pool.cc:224] Handling call
0709 12:10:50.191818 (+ 25771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.238713 (+ 46895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.238732 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.244270 (+  5538us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:50.244297 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.244334 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.244398 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.256784 24882 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:10:50.238785 24845 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:50.264170 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 369) took 1339 ms. Trace:
I20260709 12:10:50.231321 24681 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.264753 22269 rpcz_store.cc:276] 0709 12:10:48.924353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.263099 (+1338746us) service_pool.cc:224] Handling call
0709 12:10:50.263546 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.263787 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.263814 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.263878 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:50.263936 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.263992 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.264111 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.266749 24681 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:50.241652 24286 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:50.271374 24948 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.278s	user 0.000s	sys 0.005s
I20260709 12:10:50.274452 24943 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.274976 24943 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:50.278828 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:50.279696 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1843) took 1012 ms. Trace:
I20260709 12:10:50.280159 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:50.280470 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:50.279594 22866 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.284852 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:50.285725 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:50.286121 24754 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:50.287091 24754 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:50.289103 24861 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:50.289587 22859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 507) took 1041 ms. Trace:
I20260709 12:10:50.290267 24861 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:50.290791 24861 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:50.293819 22195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1859) took 2838 ms (client timeout 2381 ms). Trace:
W20260709 12:10:50.294466 22195 rpcz_store.cc:269] 0709 12:10:47.457077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.457259 (+   182us) service_pool.cc:224] Handling call
0709 12:10:50.293472 (+2836213us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b5400109ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:50.293673 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4954873728}
I20260709 12:10:50.294993 24754 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.296442 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.296639 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.297468 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.298049 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:50.300068 24854 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:50.291981 24861 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.250785 24889 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.302737 22194 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.248502 22267 rpcz_store.cc:276] 0709 12:10:48.161778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.158695 (+1996917us) service_pool.cc:224] Handling call
0709 12:10:50.208518 (+ 49823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.243829 (+ 35311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.243848 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.243886 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:50.243908 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.243946 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.244017 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.301470 24861 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.304255 24889 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.304505 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:50.280283 22271 rpcz_store.cc:276] 0709 12:10:49.267011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.945502 (+678491us) service_pool.cc:224] Handling call
0709 12:10:50.279434 (+333932us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540026cfd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:50.279630 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580284800}
I20260709 12:10:50.306563 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:50.307459 24627 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.308624 24752 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.316138 24627 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:50.317137 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:50.318181 24627 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:50.319494 24627 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.320925 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.309104 22268 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:50.321974 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 365) took 1451 ms. Trace:
I20260709 12:10:50.322364 22268 rpcz_store.cc:276] 0709 12:10:48.870307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.239489 (+1369182us) service_pool.cc:224] Handling call
0709 12:10:50.306996 (+ 67507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.321678 (+ 14682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.321915 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.288584 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:50.310834 24952 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
I20260709 12:10:50.290061 22859 rpcz_store.cc:276] 0709 12:10:49.248501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.248657 (+   156us) service_pool.cc:224] Handling call
0709 12:10:50.289257 (+1040600us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54006a0254. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:50.289493 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925324032}
I20260709 12:10:50.325372 22866 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:10:50.325572 22272 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:50.326620 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 153631us
I20260709 12:10:50.327422 22263 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:50.328605 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 367) took 1457 ms. Trace:
I20260709 12:10:50.331533 22194 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
W20260709 12:10:50.333321 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.334484 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.335538 22266 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.341347 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 366) took 1470 ms. Trace:
I20260709 12:10:50.341652 22265 rpcz_store.cc:276] 0709 12:10:48.870823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.258464 (+1387641us) service_pool.cc:224] Handling call
0709 12:10:50.327961 (+ 69497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.328282 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:50.328309 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.328348 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:50.328375 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.328433 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.328554 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3695,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93}
I20260709 12:10:50.342592 22263 rpcz_store.cc:276] 0709 12:10:48.870545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.243781 (+1373236us) service_pool.cc:224] Handling call
0709 12:10:50.327166 (+ 83385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.341138 (+ 13972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.341304 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.338284 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 370) took 1151 ms. Trace:
I20260709 12:10:50.344617 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:50.314225 24838 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:50.238116 24873 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:10:50.349121 22862 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:50.344199 22269 rpcz_store.cc:276] 0709 12:10:49.187054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.265804 (+1078750us) service_pool.cc:224] Handling call
0709 12:10:50.266164 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.316382 (+ 50218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.316417 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.316465 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:50.326283 (+  9818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.326491 (+   208us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.338236 (+ 11745us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38869,"raft.queue_time_us":40105,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111}
I20260709 12:10:50.348433 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1742) took 2191 ms. Trace:
I20260709 12:10:50.353353 22266 rpcz_store.cc:276] 0709 12:10:48.153109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.334637 (+2181528us) service_pool.cc:224] Handling call
0709 12:10:50.335236 (+   599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.344183 (+  8947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.344372 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:50.354768 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 94527.8us
I20260709 12:10:50.276185 24943 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.352653 22237 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:50.357105 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:50.358912 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 153193us
I20260709 12:10:50.358079 24815 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.360620 24815 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:50.360939 24931 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.361126 24815 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.361531 24931 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:50.362959 24951 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.006s
I20260709 12:10:50.363219 24925 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:50.363919 24925 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.357331 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 364) took 1487 ms. Trace:
I20260709 12:10:50.365341 22264 rpcz_store.cc:276] 0709 12:10:48.870059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.227128 (+1357069us) service_pool.cc:224] Handling call
0709 12:10:50.305654 (+ 78526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.351985 (+ 46331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.352013 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.352055 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:50.357078 (+  5023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.357152 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.357275 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:50.370572 22088 leader_election.cc:336] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.084s (SENT)
W20260709 12:10:50.373814 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.378209 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:50.379145 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:50.380442 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:50.382094 22237 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:50.384832 24851 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:50.387048 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:50.389359 22117 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.392568 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:50.396807 24787 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.421226 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:50.393276 24841 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:50.393023 24851 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:50.444257 22114 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.439287 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:50.448997 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.441799 24787 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:50.447748 24854 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.448783 24873 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.457052 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:50.452837 24943 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:50.466516 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.467710 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:50.475927 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 108515us
W20260709 12:10:50.478247 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.457790 24841 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:50.463135 24854 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:50.482592 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.483433 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 111891us
I20260709 12:10:50.468827 22123 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:50.462910 24873 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:50.487305 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:50.489017 24949 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.337s	user 0.000s	sys 0.004s
W20260709 12:10:50.492043 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.498168 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:50.503042 24931 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:50.504454 22114 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:50.505318 24873 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.508157 24873 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.516376 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:50.516738 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 368) took 1645 ms. Trace:
I20260709 12:10:50.528533 22272 rpcz_store.cc:276] 0709 12:10:48.871069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.261154 (+1390085us) service_pool.cc:224] Handling call
0709 12:10:50.315823 (+ 54669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.339788 (+ 23965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.516524 (+176736us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b540026cfd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:50.516675 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101799808}
W20260709 12:10:50.520200 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.531991 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.524994 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:50.485170 24854 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.535058 22861 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:50.550848 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:50.551788 22114 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.494292 24925 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:50.519251 24859 consensus_meta.cc:287] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.834s	user 0.018s	sys 0.000s
W20260709 12:10:50.559478 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.526842 24845 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.560442 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:50.565883 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.566634 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.569144 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.571684 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.572487 22195 raft_consensus.cc:2393] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 6: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:50.572319 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.573346 22190 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.573416 22194 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:50.576184 22123 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:50.577790 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:50.578619 22115 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.580341 24924 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.580796 24924 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:50.581676 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.581867 24924 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.582604 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.583536 24924 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:50.583953 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.585871 22194 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.592912 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.594450 24787 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.595100 24787 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:50.595584 24787 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.597332 22264 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:50.600755 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.601665 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:50.602423 24944 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:50.603358 24925 consensus_queue.cc:1059] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:50.603679 24944 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:50.604063 24944 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:50.604355 24925 raft_consensus.cc:3055] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.604727 24925 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:50.604882 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.605760 24925 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.606356 24944 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.607060 24925 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.608912 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.609607 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:50.610872 22118 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:50.609716 22194 raft_consensus.cc:2376] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4. Re-sending same reply.
W20260709 12:10:50.600764 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44332.4us
I20260709 12:10:50.613063 22123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:10:50.613761 22123 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:50.614138 22123 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.618321 24851 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:50.628912 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.639294 22272 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260709 12:10:50.640133 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.564257 24845 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:10:50.640580 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.620900 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:50.669879 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 56090.9us
W20260709 12:10:50.677443 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44975.8us
I20260709 12:10:50.562263 24838 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.681146 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 79518.9us
I20260709 12:10:50.683643 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:50.686791 22115 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:50.695108 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:50.696427 22271 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.696971 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.698330 24917 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:50.699045 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:50.699865 22267 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:50.701472 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.702081 22190 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:50.703329 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.704054 22194 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:50.641438 24845 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.704427 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:50.707477 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 182623us
I20260709 12:10:50.708624 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:50.709628 22195 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:50.711460 22198 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:10:50.712555 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.715488 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.717046 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.719349 24917 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.720010 24917 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:50.720736 22121 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.722406 24917 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:50.723310 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:50.724220 22121 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:10:50.724993 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.728024 22117 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:50.729179 24841 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.729724 22121 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:50.712381 22118 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:50.724913 22115 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.729987 24943 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.744329 22271 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:10:50.746572 22114 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:50.746968 22272 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:50.749050 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:50.756095 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50520us
W20260709 12:10:50.757215 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.713143 24882 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:50.753799 22266 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.760439 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.746382 24943 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.764113 24871 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:10:50.767462 24943 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.766218 24882 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:50.769455 24882 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:50.773064 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 87960.5us
I20260709 12:10:50.774013 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.774339 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.776238 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.776916 22189 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.777522 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.777647 24954 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:50.778285 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.779503 22197 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:50.780894 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.780558 22088 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:50.766659 24956 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:10:50.785585 22195 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:50.805377 22123 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:50.807987 22123 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:50.810644 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.811605 22197 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:50.812470 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.813338 22192 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:50.821478 22198 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.745543 24778 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:10:50.762993 24917 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.746585 24838 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:50.826941 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 43498.7us
I20260709 12:10:50.763463 24944 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.828106 22115 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:50.841528 22272 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:10:50.848623 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.844503 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.853075 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.850303 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.850338 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:50.839767 24686 consensus_meta.cc:287] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.001s
I20260709 12:10:50.896653 24686 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:50.897121 24686 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:50.897526 24686 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.900424 22123 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:50.904246 22123 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:50.860327 22196 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.861833 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.865846 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:50.866412 24871 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:50.867096 24627 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:50.867666 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.912585 22123 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:50.913856 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.915050 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.915249 22857 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:50.915570 24871 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.915813 22193 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:50.916126 24871 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:50.867924 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.869259 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.870497 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:50.870802 24286 consensus_meta.cc:287] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.601s	user 0.005s	sys 0.009s
I20260709 12:10:50.871338 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:50.871769 24752 consensus_meta.cc:287] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.554s	user 0.015s	sys 0.001s
I20260709 12:10:50.873780 24787 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.877444 24845 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.852180 24861 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:50.830572 24815 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:50.881251 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:50.884671 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 122784us
I20260709 12:10:50.885186 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.885929 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:50.886677 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.890113 24873 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:50.890549 24838 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:50.891217 24778 consensus_queue.cc:1059] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:50.926924 22267 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:50.892127 22831 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:50.894820 22190 raft_consensus.cc:2393] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:50.857924 22263 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:50.907271 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.911295 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.930312 22087 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:50.911403 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.917465 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:50.919279 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53568.4us
I20260709 12:10:50.923964 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.917661 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.924396 24837 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:50.925022 22197 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:50.925190 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.916925 24841 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:50.925462 24861 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:50.930395 22195 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:50.924190 22194 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:10:50.943523 22198 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:50.944060 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.946784 22196 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:50.920006 24681 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:50.951068 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59073.9us
I20260709 12:10:50.950939 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.926177 24873 raft_consensus.cc:3055] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:50.953202 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.953732 22189 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:10:50.952514 22266 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:50.924214 24627 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:50.954747 22197 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:50.961757 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:50.963686 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.964614 22191 raft_consensus.cc:2393] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:50.962558 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.930630 24859 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.961831 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.916977 24854 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:50.945277 24861 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:50.969509 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.976333 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.976805 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.969619 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 128883us
I20260709 12:10:50.978348 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.979403 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:50.980147 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:50.982589 22272 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.954222 24838 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.956348 24873 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:50.953931 24837 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:50.985091 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.969038 24944 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:50.998171 22270 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 7: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:50.988916 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:50.994848 22190 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:50.998716 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.995285 22198 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:50.995697 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:50.962262 24627 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:50.999141 22861 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
W20260709 12:10:51.002920 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 171690us
I20260709 12:10:51.000578 22266 pending_rounds.cc:85] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 6
I20260709 12:10:51.016103 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:51.018015 22193 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:51.018657 22271 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:51.020375 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:51.024020 22272 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:51.011020 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:51.014144 22266 pending_rounds.cc:107] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:50.982276 24681 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:50.994725 24851 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:50.951901 24871 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.045258 22266 raft_consensus.cc:2889] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:51.051640 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.052030 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.024956 24944 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:50.981812 24841 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.066272 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:50.977378 24859 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:51.070323 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.041743 24678 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.997170 24838 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:51.071398 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 143869us
I20260709 12:10:51.055822 24286 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:51.085772 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 70648.6us
W20260709 12:10:51.142912 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.092970 24286 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.071048 24966 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.154465 24787 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:51.184334 24944 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:51.185003 24973 raft_consensus.cc:2764] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:51.154719 24871 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:51.190958 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.191542 24972 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.114s	user 0.003s	sys 0.000s
W20260709 12:10:51.191742 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.192288 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.193157 24970 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.184206 22020 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 5, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 5 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:10:51.111932 24815 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:51.070822 24851 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:51.201297 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 181059us
W20260709 12:10:51.201653 24969 log.cc:927] Time spent T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:10:51.067893 24861 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.084216 24678 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.177444 24286 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.193801 24970 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.090106 24627 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.197260 24752 raft_consensus.cc:3055] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:51.234171 24630 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:51.234609 24968 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:51.225260 22020 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 3, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 3 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:51.217895 24966 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:51.253145 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 195146us
I20260709 12:10:51.222638 24681 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:51.209556 24778 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:10:51.265750 22272 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:51.266754 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 81903.9us
I20260709 12:10:51.227173 24882 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:51.237727 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 148535us
I20260709 12:10:51.237581 24752 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:10:51.272583 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45954.6us
I20260709 12:10:51.222324 24787 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:51.151180 24837 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:51.293509 22270 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:51.277755 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:51.294176 22162 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:51.217775 24973 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:10:51.247174 24854 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:51.299301 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.282661 24882 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:51.283825 22019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 137) took 11339 ms (client timeout 15000 ms). Trace:
I20260709 12:10:51.284027 22180 tablet_service.cc:1558] Processing DeleteTablet for tablet 97ce44fb81b642f9ad6b0f0d68e82820 with delete_type TABLET_DATA_TOMBSTONED (TS 7d3f536360b444b1886777f4776be22c not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56158
I20260709 12:10:51.284701 24966 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.285245 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:51.285616 24981 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.288924 22267 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:10:51.289208 24954 consensus_queue.cc:1059] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:51.183254 24873 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:51.278160 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60828.1us
W20260709 12:10:51.273336 24889 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.948s	user 0.014s	sys 0.005s
I20260709 12:10:51.265690 24815 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:51.307919 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.312005 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 43821.9us
I20260709 12:10:51.317991 24931 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:10:51.301867 22019 rpcz_store.cc:269] 0709 12:10:39.944483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.944824 (+   341us) service_pool.cc:224] Handling call
0709 12:10:51.283583 (+11338759us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:49.740216 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:49.741009 (+   793us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:49.742406 (+  1397us) write_op.cc:435] Acquired schema lock
0709 12:10:49.742431 (+    25us) tablet.cc:662] Decoding operations
0709 12:10:49.753438 (+ 11007us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:49.753525 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:49.753569 (+    44us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:10:49.884529 (+130960us) tablet.cc:701] Row locks acquired
0709 12:10:49.884624 (+    95us) write_op.cc:260] PREPARE: finished
0709 12:10:49.885161 (+   537us) write_op.cc:270] Start()
0709 12:10:49.885426 (+   265us) write_op.cc:276] Timestamp: P: 1783599049885034 usec, L: 0
0709 12:10:49.885498 (+    72us) op_driver.cc:348] REPLICATION: starting
0709 12:10:49.953463 (+ 67965us) log.cc:844] Serialized 4464 byte log entry
0709 12:10:50.250861 (+297398us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddbde28 00007fccf17f8581 00007fccf17f7d58 00007fccf17fc9f1 00007fccf17fc9a9 00007fccf17fc939 00007fccf17fc901 00007fccf17fbb2d 0000000000388634 0000000000388479
0709 12:10:50.638565 (+387704us) op_driver.cc:464] REPLICATION: finished
0709 12:10:50.842421 (+203856us) write_op.cc:301] APPLY: starting
0709 12:10:50.842540 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:50.842912 (+   372us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:50.842965 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:50.860398 (+ 17433us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:50.860715 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:10:50.860797 (+    82us) write_op.cc:312] APPLY: finished
0709 12:10:50.861247 (+   450us) log.cc:844] Serialized 83 byte log entry
0709 12:10:50.861440 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:50.861646 (+   206us) write_op.cc:454] Released schema lock
0709 12:10:50.861719 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:50.862132 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:50.862159 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16064,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":203446,"apply.run_cpu_time_us":4795,"apply.run_wall_time_us":19713,"num_ops":11,"prepare.queue_time_us":360219,"prepare.run_cpu_time_us":28465,"prepare.run_wall_time_us":510898,"raft.queue_time_us":121812,"raft.run_cpu_time_us":51793,"raft.run_wall_time_us":201598,"replication_time_us":752832,"spinlock_wait_cycles":74921344,"thread_start_us":643357,"threads_started":4,"wal-append.queue_time_us":243353}]]}
I20260709 12:10:51.321033 24917 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:51.321481 24971 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:10:51.321707 24678 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:51.322108 24977 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:51.322541 24841 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:51.322692 24977 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:51.323280 24984 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:51.323791 24977 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.326540 24985 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:51.326952 24985 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:51.327802 24985 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:51.324831 24975 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:10:51.324981 24973 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:51.328941 24851 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:51.328887 24981 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.329512 24973 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:51.330549 24973 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.331416 24981 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:51.325677 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:51.333616 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:51.335377 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:51.337087 24976 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:51.338260 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.338896 24981 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.339991 24686 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.341424 24838 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:51.336584 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:51.318069 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:51.345618 22195 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:51.346855 22263 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
W20260709 12:10:51.361313 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.367867 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.365201 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 58715.1us
I20260709 12:10:51.371059 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:51.325186 24861 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:51.375833 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:51.341747 24982 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:51.387916 22857 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:51.345767 24859 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:51.372548 24838 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.372803 24917 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:51.390942 24943 consensus_meta.cc:287] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.000s
W20260709 12:10:51.395531 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 77565us
I20260709 12:10:51.315248 24815 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:51.316421 24944 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:10:51.383113 24982 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.392023 24985 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.405966 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:51.406507 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.376072 24889 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 12:10:51.410611 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.418596 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:51.412791 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 75718.1us
I20260709 12:10:51.430130 22020 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 3, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:10:51.433552 22192 raft_consensus.cc:2410] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:10:51.486793 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 84744.5us
I20260709 12:10:51.437244 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:51.463521 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.484138 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52249.9us
W20260709 12:10:51.489217 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.419520 24983 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 12:10:51.491827 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60015.5us
I20260709 12:10:51.409188 24976 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:51.415221 24686 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:51.416095 24882 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:51.496284 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:51.413278 24627 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.419409 24982 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.407312 24943 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:51.573062 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.573818 24943 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:51.574811 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:51.414371 24815 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:51.492066 24984 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.418772 24854 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:10:51.568377 22263 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
W20260709 12:10:51.571415 24994 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:10:51.578019 22861 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:51.592653 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:51.497479 24970 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:51.585880 22020 catalog_manager.cc:5697] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 3, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:10:51.498131 24991 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.593360 22198 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.589043 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 170525us
W20260709 12:10:51.578123 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 241587us
I20260709 12:10:51.417418 24752 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:51.620081 22198 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:51.595515 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:51.595511 24630 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.598541 24882 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.604290 22020 catalog_manager.cc:5697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:51.609140 22857 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:51.613247 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:51.616886 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.617327 24464 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.625358 22266 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 7: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:51.626626 22831 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:51.594657 24837 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:10:51.622908 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:51.629570 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:51.631722 22020 catalog_manager.cc:5697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 3, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 3 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:51.658033 24943 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.658716 24943 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:51.659016 24998 tablet_replica.cc:333] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:10:51.593025 24286 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:51.683277 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.683559 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 113607us
I20260709 12:10:51.634657 24995 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.643033 24944 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:51.656993 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:51.660382 24970 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.630110 24882 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:51.699276 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.710366 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.628979 24464 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:51.680841 22020 catalog_manager.cc:5697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
W20260709 12:10:51.704268 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 94708.4us
I20260709 12:10:51.681439 24837 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:51.705514 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 117416us
W20260709 12:10:51.706367 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.692976 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:51.714002 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:51.680346 24630 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:51.703965 24944 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:51.717542 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.718068 24815 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.694831 24976 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.718695 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:51.659822 24943 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:51.707180 24984 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:51.711911 24931 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.729871 24873 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.730898 22163 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:51.732316 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:51.733476 24838 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:51.734153 24838 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:51.735204 24838 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.714877 24837 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:51.736806 24970 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.737733 24837 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:51.738984 24882 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:51.739118 24837 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.739725 24754 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:51.740427 24754 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.740758 24754 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.729718 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:51.718827 24859 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.741111 24754 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.746424 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:51.718798 24980 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 12:10:51.707561 24854 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:51.736660 24838 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:51.752807 25004 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:51.749692 22264 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:51.725864 24944 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:51.755263 22162 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:51.762084 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 132140us
I20260709 12:10:51.768965 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:51.748131 24970 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:51.782002 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.789410 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50761.7us
I20260709 12:10:51.790400 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:51.790463 25005 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.791117 25005 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.791491 25005 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.801839 24286 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:51.792363 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.818181 24752 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:51.749588 24931 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:51.822572 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47892.4us
I20260709 12:10:51.834491 22267 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:51.836122 24943 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.836830 24943 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:51.840454 24943 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:51.849953 25012 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:51.850760 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.851091 25012 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:51.855194 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:51.855988 22198 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
W20260709 12:10:51.857903 22830 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.575s (SENT) [suppressed 37 similar messages]
I20260709 12:10:51.859459 25012 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:51.861866 22267 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:51.863818 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:51.871292 24943 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.871860 24943 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.872334 24943 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.894876 22163 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:51.897964 24815 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:51.911741 24815 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.914362 24815 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:51.915645 24627 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:51.908510 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 153679us
I20260709 12:10:51.916858 24627 consensus_queue.cc:1059] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:51.918077 25016 raft_consensus.cc:3055] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:51.918526 25016 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:51.919668 25016 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:51.921870 25016 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:51.923223 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.941715 24627 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:51.917393 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:51.780979 24970 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:51.955197 24787 consensus_meta.cc:287] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.659s	user 0.012s	sys 0.000s
I20260709 12:10:51.808794 24871 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:51.978416 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:51.823683 24985 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.986773 24997 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.209s
I20260709 12:10:51.972461 24970 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:51.994944 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.992456 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 241103us
W20260709 12:10:51.998152 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.979758 24787 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:52.012271 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 94963us
I20260709 12:10:52.013211 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:52.015777 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49337us
I20260709 12:10:51.990195 24815 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:51.989969 24686 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:52.025496 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:51.819942 24464 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.005936 24973 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:52.049876 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 78593.8us
I20260709 12:10:52.024952 24854 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.020241 25004 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:52.070155 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 57009.7us
I20260709 12:10:52.071513 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:52.076638 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.050812 24873 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.049228 24859 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.982059 24984 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.055466 24787 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.034754 25006 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.331s
I20260709 12:10:52.033702 24686 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.049547 24973 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:52.103441 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 97453.1us
I20260709 12:10:52.078343 24995 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:52.105093 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.073150 24854 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.078189 24815 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:52.111490 24861 consensus_meta.cc:287] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.000s
I20260709 12:10:52.111878 25003 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.112051 24944 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.078963 24627 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:52.159260 25010 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 12:10:52.160130 24993 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.532s	user 0.000s	sys 0.004s
I20260709 12:10:52.161435 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 378) took 1192 ms. Trace:
I20260709 12:10:52.161801 22265 rpcz_store.cc:276] 0709 12:10:50.968621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.968934 (+   313us) service_pool.cc:224] Handling call
0709 12:10:50.978941 (+ 10007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.147320 (+168379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.147369 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:51.179382 (+ 32013us) log.cc:844] Serialized 26 byte log entry
0709 12:10:51.396832 (+217450us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:51.396893 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.597830 (+200937us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000eae54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:51.597907 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.072524 (+474617us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:52.161207 (+ 88683us) raft_consensus.cc:1685] finished
0709 12:10:52.161228 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.161357 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1105,"raft.queue_time_us":125031,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":14955,"spinlock_wait_cycles":298333696,"thread_start_us":200337,"threads_started":1,"wal-append.queue_time_us":382356}
I20260709 12:10:52.163905 25004 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.089975 25025 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:10:52.128933 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:52.138166 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 155860us
I20260709 12:10:52.150741 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:52.154779 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 407243us
I20260709 12:10:52.137593 24871 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:52.173614 22265 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:52.173694 25033 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.174405 25033 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:52.174607 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.175210 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.175468 25033 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.178720 24980 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.179288 24980 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:10:52.175577 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.153846 24973 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:52.087244 24873 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.157455 25026 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:10:52.158128 25013 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:10:52.158602 24944 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:52.169847 24981 consensus_meta.cc:287] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.828s	user 0.008s	sys 0.004s
I20260709 12:10:52.200115 24854 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:52.201344 24873 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:52.205039 24787 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.210119 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:52.210830 22265 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:52.146612 24815 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.242564 24815 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:52.243935 24686 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:52.244485 24981 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:52.223914 22236 leader_election.cc:336] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.636s (SENT)
I20260709 12:10:52.246366 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:52.226318 24995 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.247205 24995 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:52.230796 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.231684 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:52.249500 22267 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:52.248131 24995 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.252573 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:52.180523 24980 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.258937 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:52.259570 22265 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:52.269305 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 128858us
I20260709 12:10:52.271456 24464 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.273860 24871 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.277388 24980 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:52.196781 24982 consensus_meta.cc:287] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.004s
I20260709 12:10:52.193138 24931 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:52.309571 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 204209us
W20260709 12:10:52.344630 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 250673us
I20260709 12:10:52.185741 24943 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:52.361023 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 162332us
I20260709 12:10:52.361166 22123 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:10:52.360872 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.360546 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:52.346269 24837 consensus_meta.cc:287] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.607s	user 0.013s	sys 0.000s
I20260709 12:10:52.308440 25030 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.366628 24838 consensus_meta.cc:287] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
I20260709 12:10:52.367059 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.372802 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:52.369793 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 298406us
W20260709 12:10:52.375283 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.384249 22122 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.359694 25031 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.302860 24982 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.385627 22195 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:52.304944 25005 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.386904 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:52.391955 22114 raft_consensus.cc:2393] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:52.381842 25027 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.402556 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.413280 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.410146 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.418463 22119 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:52.426362 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:52.407578 24686 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:52.409742 25026 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.436558 25013 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.441913 22114 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:10:52.468314 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.385484 25030 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.469197 22114 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.442816 24630 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.445977 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:52.446305 25016 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.447124 24787 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.447860 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:52.448361 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:52.448727 25022 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.543s	user 0.008s	sys 0.000s
W20260709 12:10:52.473217 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 46934.1us
I20260709 12:10:52.473520 22198 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:52.449151 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:52.449213 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:52.450062 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:52.450736 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:52.451467 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:52.452180 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:52.453641 25020 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.502s	user 0.003s	sys 0.000s
W20260709 12:10:52.457399 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.466950 25005 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:52.463940 22265 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:10:52.471649 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.485879 22119 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.488179 22263 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:52.490466 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:52.490926 22266 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:52.492234 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:52.492946 25036 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:10:52.493974 24752 consensus_meta.cc:287] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.003s
I20260709 12:10:52.467258 24686 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.484810 24630 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } attrs { replace: true } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.497166 24686 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:52.499013 25030 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:52.499359 22114 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:10:52.500924 22162 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:52.502262 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.492980 22862 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
W20260709 12:10:52.479072 24754 consensus_meta.cc:287] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.705s	user 0.013s	sys 0.000s
W20260709 12:10:52.503067 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.471072 25039 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.478945 24464 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.479192 25016 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:52.515568 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:52.517943 22268 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:52.518416 22268 pending_rounds.cc:85] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 2
I20260709 12:10:52.518677 22268 pending_rounds.cc:107] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:52.518939 22268 raft_consensus.cc:2889] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.531525 22862 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.531956 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:52.481897 25013 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:52.534070 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:52.534384 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:52.537326 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:52.405067 25027 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.537595 22866 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.504859 25025 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.504112 22114 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:52.468811 25026 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.543838 25029 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:52.544358 25029 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.511570 24754 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.546600 24754 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:52.549212 25013 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.537520 24464 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:52.554785 24752 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:10:52.555200 22866 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:52.555898 24464 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.515273 25039 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.556648 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.557670 22114 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:52.558504 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.558786 25039 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:52.509919 25035 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.563921 22114 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.571084 22192 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:52.544788 25029 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.542142 22831 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:52.573871 22195 raft_consensus.cc:2368] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6.
W20260709 12:10:52.536197 24970 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
W20260709 12:10:52.577814 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.581874 22237 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:52.536208 25012 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:52.594524 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:52.598904 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:52.599133 22263 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.599848 22267 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:52.570425 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:52.573374 24943 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:52.590471 24931 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.593068 24778 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:52.597543 25012 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.612843 22831 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:52.603271 25030 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:52.596980 25035 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:52.650089 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.662123 22114 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:52.580217 24871 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:52.613798 22860 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.592882 24970 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.563971 25025 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.671296 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.651427 25012 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.662796 25030 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.673731 25030 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.651237 24931 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.681360 22114 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.659881 22122 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:52.675205 24980 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.686558 22270 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:52.649605 25016 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.687145 22270 pending_rounds.cc:85] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 6
I20260709 12:10:52.687502 22270 pending_rounds.cc:107] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:52.687836 22270 raft_consensus.cc:2889] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.690104 22263 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:10:52.684572 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:52.663923 24873 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.665525 24778 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:52.691885 22831 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:52.689235 25044 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:10:52.719599 22122 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:52.720422 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.737162 25016 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.738474 22120 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.739728 24778 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.671458 24984 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:52.692795 24944 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.697808 24873 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:52.750458 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 99239.4us
I20260709 12:10:52.754719 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.761152 22122 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:52.682603 25037 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:10:52.750048 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.704533 24943 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.701772 24754 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:52.765925 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.768582 22114 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:10:52.769960 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.772629 22114 raft_consensus.cc:2393] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 8: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:52.760492 24752 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.693907 24980 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:52.774613 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.774843 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.775656 22114 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:52.752053 25027 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:52.777101 22116 raft_consensus.cc:2410] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:52.762255 24873 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:52.788444 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.794289 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:52.799160 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.800213 22119 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
W20260709 12:10:52.801750 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 109958us
I20260709 12:10:52.774319 24984 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:52.774061 24752 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:52.806686 24752 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.809990 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.812192 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.826591 22114 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:10:52.830469 24882 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:52.832912 24970 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:52.793048 24981 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.834565 24931 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:52.772400 24943 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.835583 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.835482 25012 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.837553 24943 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:52.783097 24754 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:52.839732 24754 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:52.844386 24993 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:52.805462 24984 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:52.846179 24984 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:52.847543 25046 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:10:52.847896 24984 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:52.849102 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.850023 22122 raft_consensus.cc:2368] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7.
I20260709 12:10:52.762383 24944 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.834286 24981 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:52.844923 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.857761 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 94674.4us
I20260709 12:10:52.870450 22123 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:52.870824 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.870982 22123 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:52.874562 22272 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.878352 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.879045 22122 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:52.810429 25026 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:52.750699 25035 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.908571 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.919198 22116 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.949265 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:52.969244 22271 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.908244 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:52.914281 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:52.974363 22265 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:52.975155 22118 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.907743 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:52.921523 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:52.976056 22270 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.930271 22123 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:52.977027 22267 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
W20260709 12:10:52.979660 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.924883 25025 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:52.982616 22272 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:52.982765 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.993975 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:52.994781 22114 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
W20260709 12:10:52.929847 25048 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 12:10:52.998736 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 194372us
I20260709 12:10:53.005056 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:53.006349 22121 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:10:53.006733 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.983971 25050 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:10:52.921120 25037 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.888456 24979 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.930539 22860 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:10:53.017988 22123 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.022843 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:53.023536 22114 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 3.
I20260709 12:10:53.017566 22271 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:53.020717 22122 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:53.019454 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:53.020226 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.028625 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.020864 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.998690 25012 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:53.007334 25029 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:53.222366 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:53.136224 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.049636 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:53.053349 22862 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:53.070535 22270 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:53.066847 22866 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:53.189419 22123 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:53.231818 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.128522 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.093542 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:53.054620 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:53.134122 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 170174us
I20260709 12:10:53.239235 22114 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
W20260709 12:10:53.223723 25030 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 12:10:53.250918 22861 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:53.037525 24752 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:53.105861 25021 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 1.153s	user 0.003s	sys 0.004s
I20260709 12:10:53.147646 24970 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.220988 24686 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:53.105053 22857 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:53.258078 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 227116us
W20260709 12:10:53.293870 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.093382 25061 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.028141 24979 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.238847 24944 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:53.269819 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:53.273666 22266 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:53.303802 22266 pending_rounds.cc:85] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 2
I20260709 12:10:53.304157 22266 pending_rounds.cc:107] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:53.304468 22266 raft_consensus.cc:2889] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:53.281586 25067 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:10:53.287181 22267 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:53.140117 24981 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:53.301502 22118 raft_consensus.cc:2410] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:53.269637 24970 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.032243 25037 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.302676 25066 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:10:53.310482 24979 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:53.311365 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:53.326121 22119 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:53.312225 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:53.327432 22114 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
W20260709 12:10:53.313366 25017 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.483s	user 0.005s	sys 0.003s
I20260709 12:10:53.308178 25061 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:53.255972 25030 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:53.316476 24286 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.317032 25006 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:53.056852 24873 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:53.324972 25016 consensus_meta.cc:287] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.583s	user 0.006s	sys 0.006s
I20260709 12:10:53.343890 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:53.345268 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.356348 22266 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:53.335844 25074 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.360272 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.268332 24752 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:53.361310 22196 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:53.339663 24981 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:53.299396 24686 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.371243 25030 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:53.371978 25025 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.372576 25025 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.375339 24970 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:53.377087 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:53.349239 24286 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.364581 25006 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:53.381481 25038 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.962s	user 0.004s	sys 0.000s
I20260709 12:10:53.382229 22830 leader_election.cc:400] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7.
I20260709 12:10:53.382403 24931 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.383082 22830 leader_election.cc:403] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:53.383826 24982 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:53.384130 24931 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7.
I20260709 12:10:53.385418 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:53.387012 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:53.393265 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:53.367756 24984 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.382527 24778 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:53.387012 24925 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:10:53.359560 25074 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.362540 25016 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:53.404822 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.423074 22196 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:53.393035 24686 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:53.368448 24981 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.419728 24970 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.421072 25065 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.429286 25082 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:53.429731 25082 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:53.401705 25066 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:53.442582 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:53.443631 22196 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:53.445946 24970 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.446697 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:53.447912 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:53.448379 24970 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:53.448449 22193 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.444617 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:53.454360 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.422422 24984 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.500797 24981 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:53.503649 24980 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:53.505472 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.507467 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.510459 22190 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:53.511829 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:53.512612 22190 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:53.525787 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.529449 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.529870 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:53.591737 22195 raft_consensus.cc:2410] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:10:53.597071 22190 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:10:53.530927 25016 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.733877 25032 consensus_queue.cc:1175] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" responder_term: 6 status { last_received { term: 5 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:53.607394 25016 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:53.609381 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:53.611227 22193 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
W20260709 12:10:53.613554 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.619833 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.620700 22189 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:53.621116 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1898) took 1166 ms. Trace:
I20260709 12:10:53.621398 22189 rpcz_store.cc:276] 0709 12:10:52.454918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.619473 (+1164555us) service_pool.cc:224] Handling call
0709 12:10:53.621058 (+  1585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:53.628136 22196 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:53.629138 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1900) took 1068 ms. Trace:
I20260709 12:10:53.549484 25081 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.538980 25089 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.631168 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.634373 22193 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:53.632438 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:53.635335 22194 raft_consensus.cc:2410] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:53.635713 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1897) took 1181 ms. Trace:
I20260709 12:10:53.629590 22196 rpcz_store.cc:276] 0709 12:10:52.560731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.444313 (+883582us) service_pool.cc:224] Handling call
0709 12:10:53.629050 (+184737us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:53.635991 22194 rpcz_store.cc:276] 0709 12:10:52.454625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.622039 (+1167414us) service_pool.cc:224] Handling call
0709 12:10:53.635656 (+ 13617us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:53.640448 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:53.641845 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:53.642745 22114 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
I20260709 12:10:53.643896 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:53.644739 22119 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.646409 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:53.647068 22196 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:53.645578 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.637511 24686 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.654603 24686 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:53.660279 22120 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:53.664839 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.665639 22194 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:10:53.668610 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.637859 24981 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.670301 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.506551 25065 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:53.669554 22236 connection.cc:256] RPC call timeout handler was delayed by -1.7702660010002091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 12:10:53.665414 25013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.018s	sys 0.015s
W20260709 12:10:53.675390 25013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.018s	sys 0.015s
I20260709 12:10:53.676808 25006 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:53.677263 25082 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.681262 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.689976 22194 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:53.679177 24981 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:53.673405 24838 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:53.638783 25081 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.647063 25089 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.718067 24998 raft_consensus.cc:2243] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:53.719031 24998 raft_consensus.cc:2272] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:53.704375 24838 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:53.725482 22866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:10:54.071664 22866 raft_consensus.cc:606] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:54.072184 22866 raft_consensus.cc:614] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:54.072971 22119 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:53.755831 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.084473 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:54.085827 22860 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:54.086061 25004 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.086843 25004 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:54.091858 25004 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:54.074806 22267 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 4.
W20260709 12:10:53.829458 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 75682us
I20260709 12:10:54.119730 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:53.755594 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:54.122499 22271 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.125303 22267 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:54.071026 25082 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.133543 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.048368 25081 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.046983 25089 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.121047 25030 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.138566 24838 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:54.138571 22857 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:54.135135 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.143133 22831 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:54.144788 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.144281 25065 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:54.146525 22265 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:54.149991 22194 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:54.153103 22866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:10:54.153721 22866 raft_consensus.cc:606] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:54.158566 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.157850 22271 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:54.158115 25065 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:54.159080 22831 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:54.159946 24882 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:10:54.163208 22236 connection.cc:256] RPC call timeout handler was delayed by -1.4183660010000949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 12:10:54.170588 22236 connection.cc:256] RPC call timeout handler was delayed by -1.4079168440000558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2984s for a response
W20260709 12:10:54.171159 22236 connection.cc:256] RPC call timeout handler was delayed by -1.4079168440000558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2984s for a response
W20260709 12:10:54.171576 22236 connection.cc:256] RPC call timeout handler was delayed by -1.3805660010002612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 12:10:54.172022 22236 connection.cc:256] RPC call timeout handler was delayed by -1.2419660010002644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
I20260709 12:10:54.176286 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.176623 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:54.172461 22236 connection.cc:256] RPC call timeout handler was delayed by -1.2041660010002033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 12:10:54.178642 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1906660010001815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 12:10:54.180392 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1771660010001597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:10:54.179710 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.181142 22866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:10:54.181694 22866 raft_consensus.cc:606] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:54.146675 25030 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:54.160132 25065 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.185326 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.182493 24882 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:54.192468 24882 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:54.180939 24943 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.196676 24943 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.196389 24882 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:54.197093 24943 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.200970 22866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:10:54.201581 22866 raft_consensus.cc:606] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:54.201884 22866 raft_consensus.cc:614] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:54.202705 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.203684 22123 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:10:54.204316 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1666) took 1121 ms. Trace:
I20260709 12:10:54.217451 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.206808 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.228961 24989 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:54.231093 24752 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.233297 24981 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:54.235853 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:54.238770 25037 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.239419 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.240041 22116 raft_consensus.cc:1813] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
I20260709 12:10:54.240471 22116 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:54.241959 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.242563 22190 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:54.206015 22114 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.204689 22123 rpcz_store.cc:276] 0709 12:10:53.083263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.202371 (+1119108us) service_pool.cc:224] Handling call
0709 12:10:54.204231 (+  1860us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.251261 22117 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:54.228134 22194 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
W20260709 12:10:54.204597 25092 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:10:54.205210 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.253885 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:54.205888 25096 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 12:10:54.255499 22119 raft_consensus.cc:2410] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:10:54.256461 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.187660 25065 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.257833 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.262341 22263 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:10:54.263217 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:54.263967 22190 raft_consensus.cc:2368] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:54.206712 25025 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.229599 24989 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:54.206396 25030 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:54.267346 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 181126us
I20260709 12:10:54.265134 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.267809 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.255458 24981 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:54.270364 22831 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:54.270381 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.263370 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.275997 22119 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:54.276979 22194 raft_consensus.cc:2410] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 6 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:54.280046 22120 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:54.289489 22194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4bae45452334273a1c277a0a512021f"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:10:54.281639 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.290393 22194 raft_consensus.cc:606] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:54.294394 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.278725 24752 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.301687 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.307314 22120 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 3.
I20260709 12:10:54.305546 22114 raft_consensus.cc:2393] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:54.310005 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.312624 22266 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:54.273800 24981 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:54.320973 22190 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.302619 25030 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:54.331254 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1670) took 1872 ms. Trace:
I20260709 12:10:54.306286 24752 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.333125 22197 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.334026 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1894) took 1880 ms. Trace:
I20260709 12:10:54.335740 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.334496 22197 rpcz_store.cc:276] 0709 12:10:52.453758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.319534 (+1865776us) service_pool.cc:224] Handling call
0709 12:10:54.332915 (+ 13381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.333678 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.333950 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.336983 22120 raft_consensus.cc:2410] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:54.331756 22190 rpcz_store.cc:276] 0709 12:10:52.449469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.320388 (+1870919us) service_pool.cc:224] Handling call
0709 12:10:54.320754 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.321515 (+   761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.321731 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.338961 22194 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:54.341431 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1912) took 1416 ms. Trace:
I20260709 12:10:54.341979 22194 rpcz_store.cc:276] 0709 12:10:52.924539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.338311 (+1413772us) service_pool.cc:224] Handling call
0709 12:10:54.338732 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.341096 (+  2364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.341355 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.344331 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 444) took 1351 ms. Trace:
I20260709 12:10:54.344696 22194 rpcz_store.cc:276] 0709 12:10:52.993117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.343016 (+1349899us) service_pool.cc:224] Handling call
0709 12:10:54.343433 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.343673 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.343712 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.343769 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:54.343993 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.344096 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.344277 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.346616 22194 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:54.348635 22194 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:10:54.367941 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.339591 24752 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:54.362890 22192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1662) took 1911 ms (client timeout 1646 ms). Trace:
I20260709 12:10:54.382586 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.383605 22197 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:54.380968 22192 rpcz_store.cc:269] 0709 12:10:52.446715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.448887 (+  2172us) service_pool.cc:224] Handling call
0709 12:10:54.357616 (+1908729us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b54000fb9d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:54.357792 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210588928}
I20260709 12:10:54.333570 25030 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:54.397424 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:54.398200 22114 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.398850 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:54.396961 25104 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:54.401052 25104 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:54.402453 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:54.403143 25104 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:54.404218 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:54.405579 25047 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.646s	user 0.004s	sys 0.000s
I20260709 12:10:54.405676 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:54.406639 22860 raft_consensus.cc:2368] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:10:54.407397 22196 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:54.407640 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1774) took 1957 ms. Trace:
I20260709 12:10:54.408711 24981 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:54.409479 24981 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:54.410132 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:10:54.410094 24981 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:54.411454 22830 leader_election.cc:336] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.039s (SENT)
I20260709 12:10:54.411949 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:54.412632 25030 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:54.408104 22115 rpcz_store.cc:276] 0709 12:10:52.450210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.452615 (+  2405us) service_pool.cc:224] Handling call
0709 12:10:52.452998 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:52.453311 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.453343 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:52.453886 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:10:52.612516 (+158630us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:52.612574 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.612677 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.380171 (+1767494us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:54.407316 (+ 27145us) raft_consensus.cc:1685] finished
0709 12:10:54.407340 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.407572 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4549888,"thread_start_us":158170,"threads_started":1,"wal-append.queue_time_us":228374}
I20260709 12:10:54.405913 24984 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.416807 24981 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.416610 22861 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:54.418170 25061 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.418358 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:54.419621 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.413614 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:54.421644 22866 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:54.420563 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.423187 22264 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:54.424057 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.424603 22264 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:54.419596 22114 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:54.425622 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.427179 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:54.427994 22866 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:54.426540 22264 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:54.430716 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.431569 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.432219 22264 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:54.432333 22196 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:54.433138 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.434055 22265 raft_consensus.cc:2410] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:10:54.436352 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:54.437777 22191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1668) took 1988 ms (client timeout 1877 ms). Trace:
I20260709 12:10:54.444756 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:54.445540 22866 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:10:54.443609 22191 rpcz_store.cc:269] 0709 12:10:52.448901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.451926 (+  3025us) service_pool.cc:224] Handling call
0709 12:10:54.437564 (+1985638us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400078d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:54.437705 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620212480}
I20260709 12:10:54.382524 25106 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
W20260709 12:10:54.448398 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.449270 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 187845us
I20260709 12:10:54.450165 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.451818 22268 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:54.452333 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.452986 22263 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
W20260709 12:10:54.459236 22088 connection.cc:256] RPC call timeout handler was delayed by -3.4610193329999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 12:10:54.459883 22088 connection.cc:256] RPC call timeout handler was delayed by -2.0330638790001103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27890000000000004s for a response
I20260709 12:10:54.460520 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:54.435292 24882 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.468521 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.390542 25102 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:54.469211 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.470026 22265 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:54.470037 22198 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:54.469187 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:54.481132 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 69723.7us
W20260709 12:10:54.484051 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 97218.6us
I20260709 12:10:54.454594 25082 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.485337 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:54.486182 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.486011 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.486624 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:54.488855 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:54.490599 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:54.488348 22163 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:54.495266 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.500499 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:54.501169 22114 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.502163 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.509249 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.513612 22265 raft_consensus.cc:1813] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Handling vote request from an unknown peer 7d3f536360b444b1886777f4776be22c
I20260709 12:10:54.514101 22265 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:54.525482 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:54.526408 22087 leader_election.cc:400] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6.
I20260709 12:10:54.525583 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:54.527724 22117 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:54.503257 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:54.511332 22120 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
W20260709 12:10:54.529031 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60898.9us
I20260709 12:10:54.529706 22163 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:54.530298 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.531122 22120 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:54.485069 24989 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.535607 22088 leader_election.cc:400] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:10:54.467743 25062 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:10:54.493824 25111 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.538481 22088 leader_election.cc:403] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:54.494936 24981 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.495133 25012 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.495222 24778 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.545706 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:54.547254 25073 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:54.549894 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:10:54.543617 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 52199.7us
I20260709 12:10:54.556551 25111 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:54.547217 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.532491 25027 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:54.572223 22121 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:10:54.564026 22860 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:10:54.577014 25094 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.497s	user 0.004s	sys 0.000s
I20260709 12:10:54.547490 25089 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:54.528523 24464 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:10:54.581713 22123 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.561349 22114 raft_consensus.cc:2410] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:54.582690 25108 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:10:54.564953 25012 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.583376 25012 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.585705 24686 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:54.502388 25023 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.586882 25023 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.587273 25023 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.587877 25016 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:54.568593 24778 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.575438 25111 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.588999 24778 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.592264 25029 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.593165 25012 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:54.597102 25097 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.519s	user 0.004s	sys 0.000s
I20260709 12:10:54.570116 24997 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:10:54.483650 25102 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:54.496373 25082 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:54.629717 24943 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:54.632143 24943 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.634878 22857 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:54.636876 24981 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
W20260709 12:10:54.640975 22198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1899) took 2082 ms (client timeout 1860 ms). Trace:
W20260709 12:10:54.641507 22198 rpcz_store.cc:269] 0709 12:10:52.560396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.221997 (+661601us) service_pool.cc:224] Handling call
0709 12:10:54.423660 (+1201663us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54004f2520. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc5e18 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:54.640718 (+217058us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540011ba54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:54.640887 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872072320}
I20260709 12:10:54.671339 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 443) took 1694 ms. Trace:
I20260709 12:10:54.671774 22190 rpcz_store.cc:276] 0709 12:10:52.977148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.338971 (+1361823us) service_pool.cc:224] Handling call
0709 12:10:54.339471 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.339786 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:54.480752 (+140966us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.670962 (+190210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.671022 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:54.671071 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.671139 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.671278 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65118,"prepare.queue_time_us":109092,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"thread_start_us":244642,"threads_started":2,"wal-append.queue_time_us":125003}
I20260709 12:10:54.676285 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:54.677140 22270 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:54.678515 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:54.679101 22263 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.664253 22123 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:54.604442 25027 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.616074 25115 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.623272 25104 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.667347 24686 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.617154 25089 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:54.572029 25025 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 12:10:54.670644 25073 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:54.683243 25027 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:54.707587 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.686100 24630 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:54.622691 25065 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:54.709249 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:54.711939 22263 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:54.716123 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.713423 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:54.714289 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 184053us
I20260709 12:10:54.717409 22121 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:54.718566 22121 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:54.733790 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 183940us
I20260709 12:10:54.735065 22087 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:54.692899 25104 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:54.736364 22862 raft_consensus.cc:606] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:54.738198 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 189076us
I20260709 12:10:54.739055 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.740406 22862 raft_consensus.cc:614] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:54.740895 22118 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:54.741163 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:54.740808 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:54.745012 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.751351 22118 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.759302 22118 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:54.739028 24778 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:54.764357 24778 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:54.749697 24630 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.765089 24630 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.765448 24630 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.765691 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.766301 22116 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:54.771629 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.775182 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:54.777465 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:54.778221 22196 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.752059 25115 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.790169 22198 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:54.790477 24630 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:54.791638 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:54.794014 22087 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:54.744217 25119 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:54.801590 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:54.804515 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:54.805305 22191 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.751500 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:54.817253 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65806.2us
I20260709 12:10:54.819453 22163 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:10:54.841389 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 305911us
I20260709 12:10:54.821557 25012 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:54.864183 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44810.8us
I20260709 12:10:54.846352 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:54.851893 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.865866 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 71992.7us
I20260709 12:10:54.867758 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:54.821904 25112 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:10:54.871058 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:54.879065 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 161307us
I20260709 12:10:54.868541 22116 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
W20260709 12:10:54.865772 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 45217.3us
I20260709 12:10:54.865042 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:54.881763 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:54.911664 22857 raft_consensus.cc:2393] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 4: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:54.881189 22191 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:10:54.845908 24873 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:54.914978 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:54.915241 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:54.916100 22190 raft_consensus.cc:2376] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8. Re-sending same reply.
W20260709 12:10:54.910306 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45343.6us
I20260709 12:10:54.917721 22196 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:54.918107 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.878502 24464 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.846982 24981 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.868196 25121 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:54.754612 25089 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:54.865263 25119 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:54.922850 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:54.919611 22116 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:54.937106 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:54.946298 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:54.939929 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:54.918207 25123 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.923756 25060 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.949525 22271 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:54.947705 22264 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.909865 25111 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:54.952858 25039 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:54.953667 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:54.793267 25073 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:54.954011 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:54.924124 25102 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:54.925315 24464 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.957378 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:54.982998 22271 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.921823 24943 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:10:54.912860 25012 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:10:54.986047 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:54.921792 25023 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:54.941330 25121 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.941711 24873 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:54.986796 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64069.2us
I20260709 12:10:54.987515 22116 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:54.923969 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:54.987934 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:54.924320 25082 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:54.950330 25123 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.947304 25129 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:10:54.992118 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:54.954676 24630 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:55.009600 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 90133.9us
I20260709 12:10:54.925084 25118 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:10:54.955708 25060 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.974488 25039 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.002334 22271 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:54.996495 22163 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:54.993013 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:54.986008 24464 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.968730 25115 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:10:55.013530 22162 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:54.993613 24837 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.994244 25026 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.974133 24997 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:55.011469 25104 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:55.034722 22266 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.040256 24286 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:55.017201 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:55.095510 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 78441.9us
I20260709 12:10:55.096423 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:54.995771 25121 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.996284 25111 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:55.045751 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57859.7us
I20260709 12:10:55.009307 25123 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:55.011469 25122 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:10:55.003187 25016 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:10:54.996717 25081 consensus_queue.cc:1059] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:10:55.059197 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 62772.6us
I20260709 12:10:55.286972 22163 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:55.060813 22860 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:55.101004 24627 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:55.101399 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:10:55.290040 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 188719us
I20260709 12:10:55.015007 25082 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:55.016031 24873 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:10:55.103565 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 90127.7us
I20260709 12:10:55.093196 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:55.055845 24464 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:55.058892 24837 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.106613 25115 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:55.012935 25118 consensus_queue.cc:1243] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:10:55.280405 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.283407 22264 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:55.059306 25039 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.093935 25119 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:55.104244 25135 raft_consensus.cc:2764] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:55.019089 25060 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.100128 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:55.102818 25111 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:55.103562 25104 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.043975 24989 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.243s
I20260709 12:10:55.284315 24882 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.279285 25026 raft_consensus.cc:2764] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:55.297864 25082 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.302676 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:55.298791 22116 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:10:55.375506 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 275461us
I20260709 12:10:55.376925 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:55.286782 25139 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.341354 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 409) took 1481 ms. Trace:
I20260709 12:10:55.379869 22272 rpcz_store.cc:276] 0709 12:10:53.859660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.859887 (+   227us) service_pool.cc:224] Handling call
0709 12:10:54.926985 (+1067098us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b5800180398. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:10:54.927302 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.927612 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:54.942659 (+ 15047us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.990665 (+ 48006us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.288872 (+298207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.288928 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:55.288972 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.289037 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.341288 (+ 52251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7913,"prepare.queue_time_us":40395,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":3117,"raft.queue_time_us":157350,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":40540,"spinlock_wait_cycles":60870272,"thread_start_us":359767,"threads_started":3,"wal-append.queue_time_us":118630}
I20260709 12:10:55.297520 24627 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.400583 24627 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:55.403743 22831 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:55.375202 24882 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:55.405372 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:55.405949 22831 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:55.406116 24943 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:55.406714 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1670) took 1148 ms. Trace:
I20260709 12:10:55.406929 24882 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:55.407159 22119 rpcz_store.cc:276] 0709 12:10:54.258202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.259492 (+  1290us) service_pool.cc:224] Handling call
0709 12:10:55.406481 (+1146989us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b54002544d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:55.406620 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13891328}
I20260709 12:10:55.392602 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:55.408716 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:55.422197 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 45326.1us
W20260709 12:10:55.360235 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 445289us
W20260709 12:10:55.298105 25137 log.cc:927] Time spent T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.181s	user 0.002s	sys 0.002s
W20260709 12:10:55.352031 22163 raft_consensus.cc:2686] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:10:55.334605 24837 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.367730 22266 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:10:55.297796 25138 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.335350 25115 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:55.338508 24838 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.472592 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:55.474431 22116 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:55.382980 22120 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:55.387281 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:55.475016 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.391934 25065 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:55.393060 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:55.470671 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:55.479293 22191 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:55.393687 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:55.394387 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:55.481007 22198 raft_consensus.cc:2376] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6. Re-sending same reply.
I20260709 12:10:55.396406 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:55.397452 22862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45120 (request call id 4) took 1006 ms. Trace:
I20260709 12:10:55.397898 25141 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.486191 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:55.486747 22191 raft_consensus.cc:2376] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6. Re-sending same reply.
I20260709 12:10:55.422246 22119 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.470512 22831 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:55.470237 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:55.483067 22862 rpcz_store.cc:276] 0709 12:10:54.391401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.391776 (+   375us) service_pool.cc:224] Handling call
0709 12:10:55.397244 (+1005468us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54002f9c54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddbc853 00007fccf2d8a60a 00007fccec3107d4 00007fccec310762 00007fccec310691 00007fccec31060c 00007fccec30f8c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:55.397361 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748204416}
W20260709 12:10:55.476150 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 189252us
W20260709 12:10:55.415558 24686 consensus_meta.cc:287] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.720s	user 0.014s	sys 0.017s
I20260709 12:10:55.414053 24925 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:55.485217 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:55.472455 25122 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:10:55.484069 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:55.373950 25082 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:55.511650 22120 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:55.429486 25102 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.409212 24873 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:55.473371 25086 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:55.529353 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:55.530625 22119 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:55.531718 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:55.413192 25029 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
W20260709 12:10:55.514132 25136 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 12:10:55.514448 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:55.514987 25143 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:10:55.516454 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46033.1us
I20260709 12:10:55.518093 24931 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.518718 25026 consensus_queue.cc:1059] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:55.411761 24464 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:55.413022 25030 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.415930 25012 raft_consensus.cc:993] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:10:55.519896 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:55.520839 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:55.521726 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:55.413441 24943 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:55.527050 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:10:55.513415 25130 log.cc:927] Time spent T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.254s	user 0.004s	sys 0.000s
I20260709 12:10:55.513686 25004 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:55.637090 25004 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:55.637465 25004 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:55.638357 25004 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:55.533661 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 110423us
I20260709 12:10:55.413976 25074 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:55.535456 24882 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.538019 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:55.535045 25133 log.cc:927] Time spent T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:55.545192 24286 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:10:55.546672 25086 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:55.479979 25138 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:55.549181 25064 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:55.537521 25104 raft_consensus.cc:2764] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:55.552470 25062 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:55.553169 25109 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.595247 22198 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:55.635388 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 108416us
I20260709 12:10:55.635856 24931 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:55.636004 25035 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:55.718720 25027 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.991s	user 0.021s	sys 0.001s
W20260709 12:10:55.640920 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 120185us
I20260709 12:10:55.763150 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:55.640911 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:55.534600 24925 raft_consensus.cc:697] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:55.692335 24882 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:55.693231 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 173419us
I20260709 12:10:55.693427 24995 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.724926 25062 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:55.588588 24998 ts_tablet_manager.cc:1916] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:55.802727 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 1802) took 1001 ms. Trace:
W20260709 12:10:55.802872 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 162013us
I20260709 12:10:55.803303 22122 rpcz_store.cc:276] 0709 12:10:54.801227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.801431 (+   204us) service_pool.cc:224] Handling call
0709 12:10:55.802486 (+1001055us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b540032ffd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:55.802659 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2041085312}
I20260709 12:10:55.803884 22236 leader_election.cc:400] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:55.535807 25139 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.703585 22116 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:10:55.805405 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:55.806211 22116 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.706732 22120 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:55.481745 25111 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:55.722138 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49856.4us
I20260709 12:10:55.813871 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:55.731668 25121 consensus_meta.cc:287] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.593s	user 0.004s	sys 0.004s
I20260709 12:10:55.635157 25030 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:55.739946 22264 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:10:55.741866 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.745124 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:55.753887 22272 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:10:55.717247 25136 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:10:55.720088 24752 consensus_meta.cc:287] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 1.325s	user 0.016s	sys 0.000s
I20260709 12:10:55.587363 24989 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.838490 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:55.838863 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:55.839382 22272 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.706401 24970 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.694238 25118 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.761920 22267 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.528446 24686 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.713420 25029 raft_consensus.cc:1081] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
W20260709 12:10:55.749418 25146 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:10:55.764637 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:55.755314 25143 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:55.787182 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:55.779367 25027 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:55.694232 22121 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:55.788362 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 112812us
I20260709 12:10:55.873989 22121 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:55.795326 25023 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:55.797943 25145 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:55.816246 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:55.878839 22263 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.820447 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:10:55.834715 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.839514 22264 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.879951 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:55.758888 22198 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:55.759766 25081 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:10:55.852731 22116 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:10:55.801121 25101 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.757963 24464 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:10:55.812242 24981 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:55.869074 25062 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:55.814287 24995 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:55.900511 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:55.833943 24286 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.877044 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:55.882117 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 117588us
I20260709 12:10:55.905865 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:55.883251 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 96208us
I20260709 12:10:55.883939 22123 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.906837 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:55.754285 25109 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:55.850962 25118 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:55.898620 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.801120 24931 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:55.589941 25115 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:55.722666 25004 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:55.867806 24984 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:10:55.913195 22190 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:55.893814 22272 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:55.894344 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:55.920462 22264 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:10:55.923305 22263 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:10:55.876890 25135 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.884002 25142 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:55.845794 24752 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:55.912793 25102 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.805907 24943 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:55.837860 25121 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:55.871423 25025 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:10:55.901562 25016 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.930773 24778 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.859974 24989 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:55.860935 24970 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:55.890733 25154 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:55.941717 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:56.011157 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 69530.3us
I20260709 12:10:55.944475 22270 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:10:55.915786 25118 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.934926 22122 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:55.956172 22123 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:10:55.896627 24981 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:10:55.958884 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52114.5us
W20260709 12:10:55.960064 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 139727us
I20260709 12:10:55.966722 25121 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:55.967509 22195 raft_consensus.cc:2368] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:10:55.890949 25101 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:55.819092 25139 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:56.016008 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 98703.1us
W20260709 12:10:56.021974 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 161081us
I20260709 12:10:55.897228 24925 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:55.932235 24837 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:56.034240 22114 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:55.931275 25082 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:56.009382 25089 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:56.041646 22236 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:56.078626 22196 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:56.077773 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:56.024732 25012 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:55.947836 25030 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:56.088249 22163 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:56.003918 25016 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:56.041620 25101 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.090346 22117 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:10:56.087251 25123 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.941s	user 0.012s	sys 0.006s
I20260709 12:10:56.127092 24837 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:56.082448 25060 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.717s	user 0.012s	sys 0.000s
I20260709 12:10:56.070420 25138 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:56.085958 25119 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.081923 25089 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:55.958441 25142 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:56.151288 25039 consensus_meta.cc:287] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.799s	user 0.011s	sys 0.001s
I20260709 12:10:56.119143 22858 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:56.133152 25123 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:56.155854 24686 raft_consensus.cc:2764] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:10:56.138381 25109 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:56.138883 25153 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 12:10:56.157555 25162 log.cc:927] Time spent T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:10:56.158592 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 451) took 2731 ms. Trace:
I20260709 12:10:56.158802 25016 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:56.159979 25027 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:56.158988 22194 rpcz_store.cc:276] 0709 12:10:53.427521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.349261 (+921740us) service_pool.cc:224] Handling call
0709 12:10:54.349508 (+   247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.349873 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.349901 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.350322 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.636895 (+1286573us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b180039fe80. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:10:55.789753 (+152858us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:55.792382 (+  2629us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.793057 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.793129 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.158126 (+364997us) raft_consensus.cc:1685] finished
0709 12:10:56.158228 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.158495 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11189,"prepare.queue_time_us":2339,"prepare.run_wall_time_us":40,"raft.queue_time_us":9628,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":27781,"spinlock_wait_cycles":21254784,"thread_start_us":152683,"threads_started":1,"wal-append.queue_time_us":1561819}
W20260709 12:10:56.139751 25160 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:10:56.160512 25119 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:56.140547 25156 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:10:56.145627 25157 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 12:10:56.162849 25158 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:10:56.154363 22267 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:56.156292 22270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
W20260709 12:10:56.138105 25161 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:10:56.164649 22270 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:56.165175 22270 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:56.167205 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.091674 25037 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.204627 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:56.228814 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 196704us
I20260709 12:10:56.230537 22265 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.043285 25145 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
W20260709 12:10:56.205622 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 60027.5us
I20260709 12:10:56.110446 25012 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:56.041735 25135 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:10:56.121956 25121 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.119313 25030 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:56.229204 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 214655us
I20260709 12:10:56.259948 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:56.261644 22123 raft_consensus.cc:2376] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7. Re-sending same reply.
I20260709 12:10:56.135531 24882 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:56.078332 24995 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:56.204733 25102 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.239074 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:56.163663 25039 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:56.136583 25164 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:56.258729 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:56.116451 24981 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:56.263566 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:56.292687 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:56.384871 24970 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:56.388013 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:56.279170 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:56.237769 25138 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:10:56.322692 25082 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:56.134482 25060 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:56.391543 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55716.1us
I20260709 12:10:56.395258 25060 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:56.373544 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.376204 25164 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:56.294606 25149 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.176s	user 0.000s	sys 0.002s
I20260709 12:10:56.292344 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:56.380267 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.381083 22189 raft_consensus.cc:2368] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6.
I20260709 12:10:56.322113 25144 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.381125 25004 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.336278 22192 raft_consensus.cc:2410] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:10:56.381341 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 122697us
I20260709 12:10:56.403584 25144 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:56.401610 22123 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.405485 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:56.406538 25144 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:56.407313 24464 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:56.332989 22270 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:56.409934 22270 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:56.411191 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:56.411828 22266 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:56.415369 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.382241 24627 consensus_meta.cc:287] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.981s	user 0.006s	sys 0.006s
I20260709 12:10:56.383108 25039 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:56.377223 25176 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:56.388291 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:56.389549 22236 connection.cc:256] RPC call timeout handler was delayed by -2.6004141659998368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 12:10:56.381471 24981 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:56.279760 25150 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.291s	user 0.001s	sys 0.001s
I20260709 12:10:56.417368 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:56.441838 22118 raft_consensus.cc:2410] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:56.452982 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:56.268838 25037 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:56.232870 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1816) took 1294 ms. Trace:
I20260709 12:10:56.462445 22115 rpcz_store.cc:276] 0709 12:10:54.938109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.663017 (+724908us) service_pool.cc:224] Handling call
0709 12:10:55.663495 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.663836 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:55.722194 (+ 58358us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.232504 (+510310us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.232554 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:56.232594 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.232657 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.232755 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":89058,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3947,"raft.queue_time_us":42974,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":9761,"thread_start_us":509907,"threads_started":2,"wal-append.queue_time_us":226258}
W20260709 12:10:56.434473 22236 connection.cc:256] RPC call timeout handler was delayed by -2.5167141659999288s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 12:10:56.435041 22194 pending_rounds.cc:85] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 7
I20260709 12:10:56.465580 22194 pending_rounds.cc:107] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:10:56.465917 22194 raft_consensus.cc:2889] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:56.467392 22123 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:10:56.298172 25121 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:56.432458 22266 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:56.459955 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:56.461429 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.437974 22265 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:56.474604 22268 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:56.467653 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:56.475320 22270 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:56.468591 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.469269 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:56.429085 24871 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.523411 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:56.433652 24627 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:56.526664 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:56.553751 22265 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.284401 25089 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:56.520816 25138 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:56.609874 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 459) took 1183 ms. Trace:
I20260709 12:10:56.610368 22191 rpcz_store.cc:276] 0709 12:10:55.426491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.622423 (+195932us) service_pool.cc:224] Handling call
0709 12:10:55.622742 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.623169 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.623200 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.623734 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.820062 (+196328us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:55.820129 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.820242 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.609623 (+789381us) raft_consensus.cc:1685] finished
0709 12:10:56.609648 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.609801 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5610,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":195899,"threads_started":1,"wal-append.queue_time_us":240666}
I20260709 12:10:56.583844 25175 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:56.518671 24871 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:56.623440 22121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.025s	sys 0.053s
W20260709 12:10:56.630219 22121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.026s	sys 0.053s
I20260709 12:10:56.629233 22270 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:10:56.631943 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.633111 22265 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:10:56.637638 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1938) took 1249 ms. Trace:
I20260709 12:10:56.638180 22195 rpcz_store.cc:276] 0709 12:10:55.388191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.405092 (+ 16901us) service_pool.cc:224] Handling call
0709 12:10:56.633521 (+1228429us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54001f4fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:56.637547 (+  4026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290767744}
I20260709 12:10:56.626708 25089 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:56.619350 24464 consensus_queue.cc:1175] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "164596fc2efa450581a5b68cad62271f" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: [6.7-6.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:56.483325 25012 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:56.626156 25138 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:56.617735 25037 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:56.761205 25179 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:10:56.764622 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.684688 25121 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:56.768282 25118 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.733s	user 0.008s	sys 0.004s
I20260709 12:10:56.630685 25175 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:56.790290 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.794400 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 329516us
W20260709 12:10:56.797858 22236 leader_election.cc:336] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 3.232s (SENT)
I20260709 12:10:56.798260 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:56.804883 25142 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:56.806254 25159 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:56.806857 25159 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:10:56.807348 25183 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:10:56.814581 24627 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:56.807906 25159 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:56.834901 22269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.012s	sys 0.004s
W20260709 12:10:56.837754 22269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.012s	sys 0.004s
W20260709 12:10:56.825520 25101 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.000s
I20260709 12:10:56.838373 25193 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.838436 25101 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:56.839674 22859 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:10:56.840554 22236 connection.cc:256] RPC call timeout handler was delayed by -2.2527737559998968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33010000000000006s for a response
I20260709 12:10:56.841038 25101 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:56.835016 25135 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.010s	sys 0.024s
W20260709 12:10:56.842070 22236 connection.cc:256] RPC call timeout handler was delayed by -1.2278156519998902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 12:10:56.846580 22236 connection.cc:256] RPC call timeout handler was delayed by -1.2251156519998858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 12:10:56.846925 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1531156519999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
W20260709 12:10:56.847235 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1405156519999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 12:10:56.788841 25118 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:56.856361 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:56.859757 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.781343 25138 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:56.870066 25185 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:10:56.874329 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1818) took 1180 ms. Trace:
I20260709 12:10:56.874854 22121 rpcz_store.cc:276] 0709 12:10:55.694318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.896244 (+201926us) service_pool.cc:224] Handling call
0709 12:10:55.896670 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.899556 (+  2886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.899589 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.931546 (+ 31957us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.630973 (+699427us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:56.631019 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.631091 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.873976 (+242885us) raft_consensus.cc:1685] finished
0709 12:10:56.874007 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.874246 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8507,"raft.queue_time_us":31161,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":9298,"thread_start_us":621826,"threads_started":1,"wal-append.queue_time_us":755550}
I20260709 12:10:56.876945 25175 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:56.886109 22866 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:10:56.866603 25159 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.896855 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1944) took 1422 ms. Trace:
I20260709 12:10:56.897423 22190 rpcz_store.cc:276] 0709 12:10:55.473998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.723250 (+249252us) service_pool.cc:224] Handling call
0709 12:10:55.723515 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.947510 (+223995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.896516 (+949006us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400109fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:56.896756 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429199744}
W20260709 12:10:56.899484 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.904069 25180 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.494s	user 0.002s	sys 0.000s
I20260709 12:10:56.906657 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1814) took 1978 ms. Trace:
I20260709 12:10:56.907023 22117 rpcz_store.cc:276] 0709 12:10:54.927794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.654724 (+726930us) service_pool.cc:224] Handling call
0709 12:10:55.707573 (+ 52849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.111049 (+403476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.906429 (+795380us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54002adad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:56.906599 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":879186816}
W20260709 12:10:56.909824 22189 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1932) took 1524 ms (client timeout 1746 ms). Trace:
W20260709 12:10:56.910212 22189 rpcz_store.cc:269] 0709 12:10:55.385841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.386977 (+  1136us) service_pool.cc:224] Handling call
0709 12:10:56.909644 (+1522667us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54000ed654. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:56.909768 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075674496}
I20260709 12:10:56.910537 25118 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:56.911787 25030 consensus_meta.cc:287] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
I20260709 12:10:56.912595 25030 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:56.918989 22088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.990s (SENT) [suppressed 56 similar messages]
W20260709 12:10:56.920375 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.922611 22088 leader_election.cc:336] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.181s (SENT)
I20260709 12:10:56.923084 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:56.928676 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:56.929138 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:56.934911 25181 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:10:56.925127 25030 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.948158 22193 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:56.951610 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:56.951045 25030 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:56.953634 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:56.956225 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.927927 24981 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.916344 25193 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:10:56.996968 24981 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.997815 24981 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:57.001081 24981 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:57.002552 22007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f1b154b48c54be6b421b01ed436bf21 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:57.003690 24998 ts_tablet_manager.cc:1929] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:57.004541 24998 log.cc:1199] T 97ce44fb81b642f9ad6b0f0d68e82820 P 7d3f536360b444b1886777f4776be22c: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/wals/97ce44fb81b642f9ad6b0f0d68e82820
I20260709 12:10:57.005934 24998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56158 (request call id 88) took 5740 ms. Trace:
I20260709 12:10:57.006282 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:57.007184 22264 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.009778 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:57.010200 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37260 (request call id 461) took 1541 ms. Trace:
I20260709 12:10:57.013131 22192 rpcz_store.cc:276] 0709 12:10:55.469171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.537681 (+ 68510us) service_pool.cc:224] Handling call
0709 12:10:57.009969 (+1472288us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54000fc8d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:57.010138 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567475584}
I20260709 12:10:57.013525 25139 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:57.016525 25026 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:10:57.017143 25026 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:57.010696 22263 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:57.029773 22267 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:57.031013 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:57.031226 22265 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:57.031693 22271 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:57.031280 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.033648 25089 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:57.035027 25089 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:57.037045 25073 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:57.037467 25073 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:57.037310 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:57.038239 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:57.038831 22123 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.039558 22121 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:10:57.039676 22087 leader_election.cc:336] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.746s (SENT)
I20260709 12:10:57.040824 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:57.041353 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1933) took 1655 ms. Trace:
I20260709 12:10:57.041719 22196 rpcz_store.cc:276] 0709 12:10:55.386263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.392382 (+  6119us) service_pool.cc:224] Handling call
0709 12:10:57.041177 (+1648795us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54001f45d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:57.041298 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1510276992}
I20260709 12:10:57.042482 24995 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.043522 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:57.044143 22866 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.043784 25073 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:57.044426 25062 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.045207 25030 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:57.046021 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 123426us
I20260709 12:10:57.049849 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:57.050467 22121 raft_consensus.cc:2376] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6. Re-sending same reply.
I20260709 12:10:57.055047 25089 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:57.006335 24998 rpcz_store.cc:276] 0709 12:10:51.283416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.283720 (+   304us) service_pool.cc:224] Handling call
0709 12:10:51.658424 (+374704us) ts_tablet_manager.cc:1151] Deleting tablet 97ce44fb81b642f9ad6b0f0d68e82820
0709 12:10:51.658580 (+   156us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:56.801280 (+5142700us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:57.003549 (+202269us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:57.005857 (+  2308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1966803,"tablet-delete.queue_time_us":321018,"thread_start_us":129288,"threads_started":1}
I20260709 12:10:57.058187 25004 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.058976 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:57.058916 25004 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:57.059932 22196 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 6: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:57.061546 25004 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:57.063498 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:57.066097 22192 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:57.066536 22192 pending_rounds.cc:85] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 6
I20260709 12:10:57.066757 22192 pending_rounds.cc:107] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:57.066980 22192 raft_consensus.cc:2889] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.061549 22859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56950 (request call id 508) took 1164 ms. Trace:
I20260709 12:10:57.071481 22271 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:57.072314 22859 rpcz_store.cc:276] 0709 12:10:55.897638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.897802 (+   164us) service_pool.cc:224] Handling call
0709 12:10:55.898171 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.840027 (+941856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.061274 (+221247us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b54004d44d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:57.061470 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164652928}
I20260709 12:10:57.077579 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:57.077863 22264 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
W20260709 12:10:57.078272 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 221999us
I20260709 12:10:57.080698 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:57.081085 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:57.078874 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1812) took 1341 ms. Trace:
I20260709 12:10:57.081974 22119 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 5: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:57.082800 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:57.083518 22120 raft_consensus.cc:2368] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:57.381151 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1804) took 2557 ms. Trace:
I20260709 12:10:57.208633 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:57.087044 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:57.383368 22114 rpcz_store.cc:276] 0709 12:10:54.866558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.620016 (+753458us) service_pool.cc:224] Handling call
0709 12:10:55.620379 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.077771 (+457392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.380758 (+1302987us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54002acbd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:57.381063 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950791424}
I20260709 12:10:57.085780 24873 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.386545 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:57.091480 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.090116 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 58427.2us
W20260709 12:10:57.388288 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.261379 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.382575 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:57.148984 22123 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:10:57.243599 25199 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.382576 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:57.390843 25199 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:57.090227 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:57.393543 25199 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:57.383975 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 303403us
I20260709 12:10:57.401121 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:57.211826 24995 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:57.106447 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:57.207180 22087 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.881s (SENT)
I20260709 12:10:57.096127 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:57.121745 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:57.144143 25025 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.252s
I20260709 12:10:57.105327 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:57.174247 22866 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:57.340902 25030 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:57.432729 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.398444 22272 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:57.211987 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:57.406270 25209 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:57.408507 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 132653us
W20260709 12:10:57.412932 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.361183 25037 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.083024 22269 rpcz_store.cc:276] 0709 12:10:55.737395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.738448 (+  1053us) service_pool.cc:224] Handling call
0709 12:10:55.738873 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.021553 (+282680us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:56.032362 (+ 10809us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.842335 (+809973us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.842768 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.842924 (+   156us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:56.863561 (+ 20637us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.078566 (+215005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.078657 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.078693 (+    36us) raft_consensus.cc:1685] finished
0709 12:10:57.078704 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.078820 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21785,"prepare.run_cpu_time_us":439,"prepare.run_wall_time_us":6216,"raft.queue_time_us":95744,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":5525,"spinlock_wait_cycles":30720,"thread_start_us":1098919,"threads_started":4,"wal-append.queue_time_us":724434}
I20260709 12:10:57.459594 22861 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.467479 22861 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:57.417083 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:57.216197 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 49553.3us
W20260709 12:10:57.378772 25194 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:57.175196 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:57.475920 22271 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:57.462795 22863 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:57.427212 22264 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
W20260709 12:10:57.460670 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 373544us
W20260709 12:10:57.478132 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.418876 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:57.061599 25026 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:57.469388 22269 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.263984 24981 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.131286 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:57.470249 22121 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:10:57.461977 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:57.142068 24838 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:57.480257 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.517241 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:57.465751 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 77203.2us
W20260709 12:10:57.512125 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 93327.5us
I20260709 12:10:57.458391 25141 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.520133 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:57.523066 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 315913us
I20260709 12:10:57.490994 25115 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:57.473579 24686 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.503114 25184 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.720s	user 0.000s	sys 0.002s
I20260709 12:10:57.466600 25109 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:10:57.491856 25111 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.514197 22861 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:57.483516 25164 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:57.487881 24989 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:57.535107 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:57.517678 25151 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.280707 25188 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.254s
I20260709 12:10:57.242270 25101 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.284s
I20260709 12:10:57.517860 24838 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:57.469594 25030 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:57.557407 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:10:57.558712 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.568564 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.493295 24931 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:57.469771 24995 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:57.536495 24630 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:57.532487 25139 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:57.479651 25037 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:57.556800 25164 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.557072 25200 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:57.613741 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56444.9us
I20260709 12:10:57.614249 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:57.547592 25026 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:10:57.614848 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 97677.6us
I20260709 12:10:57.555935 24989 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:57.567036 24838 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.522447 24981 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:57.566697 25199 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.610788 25155 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.612423 24630 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:57.652359 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:57.536325 24686 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:57.640980 25181 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:10:57.637672 25151 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:57.641520 25164 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.671891 22119 raft_consensus.cc:2410] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:10:57.674449 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:10:57.680873 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 202994us
I20260709 12:10:57.685552 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:10:57.689172 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 128590us
I20260709 12:10:57.654562 25203 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:10:57.670992 25141 raft_consensus.cc:2764] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:10:57.674837 25164 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.699272 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:57.699980 22120 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.662024 25026 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:57.708252 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:57.696074 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 81931.1us
I20260709 12:10:57.703930 22236 leader_election.cc:400] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
I20260709 12:10:57.678284 25151 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:57.709187 22236 leader_election.cc:403] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:57.710444 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:57.661314 25214 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:10:57.711122 22123 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.664340 24989 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:57.716707 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:57.726697 22114 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:57.717325 25218 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:10:57.717686 25037 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:57.721603 24995 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:57.723773 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:57.695433 25200 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:57.702093 25199 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.710541 25139 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.710518 25219 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.773940 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 351) took 1243 ms. Trace:
I20260709 12:10:57.756214 22269 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:57.775130 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1946) took 1947 ms. Trace:
I20260709 12:10:57.741463 22123 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:57.768676 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:57.779102 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:57.773159 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 69423.9us
I20260709 12:10:57.780503 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:57.777311 22193 rpcz_store.cc:276] 0709 12:10:55.827376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.828294 (+   918us) service_pool.cc:224] Handling call
0709 12:10:55.850046 (+ 21752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.948673 (+1098627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.774823 (+826150us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400109ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:57.775064 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2524597504}
I20260709 12:10:57.774597 22118 rpcz_store.cc:276] 0709 12:10:56.531038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.532923 (+  1885us) service_pool.cc:224] Handling call
0709 12:10:56.533840 (+   917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.814732 (+280892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.814768 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.814813 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:56.814851 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.773575 (+958724us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54003124d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:57.773644 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.773851 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645241600}
I20260709 12:10:57.784706 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:57.786346 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:57.787048 22118 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.731619 25109 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.789762 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:57.790053 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 66379.2us
I20260709 12:10:57.791365 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:57.795320 22123 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.795562 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:57.726497 25030 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:57.762953 25141 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6.
W20260709 12:10:57.862648 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.701035 24630 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:57.869920 22088 leader_election.cc:336] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.509s (SENT)
I20260709 12:10:57.744722 25227 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:57.875662 22123 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:57.876827 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:57.877415 22123 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:57.881412 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.881806 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.894102 22118 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:57.820708 25037 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.867384 24286 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:57.867755 24464 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.788738 25139 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:57.788130 25219 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:57.910317 25141 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:57.875392 25216 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.873611 25030 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:57.860062 25109 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:57.952298 22114 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:10:57.928601 25207 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
W20260709 12:10:57.928788 25205 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 12:10:57.914522 25227 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:57.947463 22123 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:10:57.922809 25226 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:57.917819 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 207975us
I20260709 12:10:57.943054 25141 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:57.973400 25141 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.974316 25139 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:57.898758 25151 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:57.979445 25026 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:57.983084 25227 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:57.986142 25109 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:57.960144 24686 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:57.952230 25030 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:57.965351 24989 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:57.931083 24464 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.011899 24464 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:57.928125 24286 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:57.970642 25219 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:57.924281 25037 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.014268 24286 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:58.015065 25037 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:57.992513 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.016342 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:57.992892 22120 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:58.017509 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.017972 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.018198 22193 raft_consensus.cc:2368] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5.
I20260709 12:10:58.018738 22190 raft_consensus.cc:2410] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:10:58.018908 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.019376 22120 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:58.019882 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:57.994799 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.021009 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:58.021370 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.021675 22194 raft_consensus.cc:2368] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:10:58.022380 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:57.997841 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.023046 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.023604 22197 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:10:58.023869 22191 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:57.992754 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:58.001997 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:58.004482 25222 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.006692 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:58.027127 22189 raft_consensus.cc:2368] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8.
I20260709 12:10:58.027334 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:58.028420 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:58.029275 24286 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:58.007264 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.008836 22116 raft_consensus.cc:2368] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5.
I20260709 12:10:58.010185 25030 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:58.036545 22189 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:58.019433 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:58.022435 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:57.996549 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.002754 25026 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.020689 22193 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:58.031958 22163 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:58.032946 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.034855 24286 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:58.073082 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:58.075332 22197 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:10:58.073851 22120 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:10:58.027667 25062 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.080217 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.030568 25129 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.081774 22191 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:58.071650 24286 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:57.962672 25218 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 12:10:58.034819 25121 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:58.084008 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 288550us
I20260709 12:10:58.039595 25081 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.095885 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:10:58.086663 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.096685 22120 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
W20260709 12:10:58.101511 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 321083us
I20260709 12:10:58.104743 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.109277 22120 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.109805 22120 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:58.082333 25062 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:58.084929 25037 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:58.034667 25222 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.110772 22120 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:58.139598 22269 raft_consensus.cc:1217] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[4.2-4.2]   Dedup: 4.2->[]
I20260709 12:10:58.140375 22269 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:10:58.140383 22120 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.114749 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:58.118184 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:58.142577 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 387154us
I20260709 12:10:58.142984 22267 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:58.117529 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.116448 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:58.099262 25081 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.077157 25026 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:58.185215 25081 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.187028 25026 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:58.187696 22190 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.125849 25065 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:10:58.189724 25222 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:58.190992 25115 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.000s
I20260709 12:10:58.191658 22268 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:58.107750 25121 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:58.193696 25121 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:58.178421 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:58.200098 22190 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
W20260709 12:10:58.181974 25197 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.840s	user 0.006s	sys 0.014s
I20260709 12:10:58.144407 22272 raft_consensus.cc:2410] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:58.177703 25226 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:58.201145 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 169316us
I20260709 12:10:58.226817 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:58.087982 25129 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:58.226915 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 83212.8us
W20260709 12:10:58.211068 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.227419 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.230479 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:10:58.231173 22271 raft_consensus.cc:2410] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:58.228240 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.229185 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:58.231667 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:58.232417 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.232944 22272 raft_consensus.cc:2410] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:58.137279 25200 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:10:58.229775 25037 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:58.254534 25123 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:58.224571 25219 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.241768 22163 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:58.236095 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:58.175134 25216 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
W20260709 12:10:58.266343 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 205215us
I20260709 12:10:58.279443 22265 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:58.230690 24838 consensus_meta.cc:287] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.011s
I20260709 12:10:58.274127 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.275671 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.300077 22271 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:10:58.262779 22266 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
W20260709 12:10:58.281888 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 45914.5us
I20260709 12:10:58.278136 25226 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:58.283234 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.284036 22163 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:10:58.286561 25037 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:58.255328 25209 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.298800 22192 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:10:58.305467 22193 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:58.306330 22268 raft_consensus.cc:2410] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:58.309908 22120 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:10:58.311623 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:58.312482 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.320207 22195 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:58.290181 24686 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.315271 25226 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:10:58.310407 22120 pending_rounds.cc:85] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 5
I20260709 12:10:58.305764 24882 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:58.311365 25164 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.001s
I20260709 12:10:58.316304 25227 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.355118 22120 pending_rounds.cc:107] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:10:58.365155 22120 raft_consensus.cc:2889] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.320842 25244 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:58.332715 25139 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.351374 25200 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:58.320941 25209 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:58.321182 24464 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:58.368875 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.370059 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.367275 25164 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.290635 25219 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:58.380724 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.277629 25062 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.310355 24838 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:58.386188 22265 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:58.453784 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:58.512414 22264 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.457381 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1688) took 1354 ms. Trace:
I20260709 12:10:58.517273 22119 rpcz_store.cc:276] 0709 12:10:57.103165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.130937 (+ 27772us) service_pool.cc:224] Handling call
0709 12:10:58.457139 (+1326202us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400214b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:58.457311 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359458048}
W20260709 12:10:58.467849 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 87653.5us
W20260709 12:10:58.510991 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.451289 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.359745 25235 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:58.454869 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.548025 22270 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:58.549378 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.438586 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:58.554096 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:58.503610 25215 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 1.091s	user 0.004s	sys 0.000s
W20260709 12:10:58.494935 25199 consensus_meta.cc:287] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 12:10:58.555083 22265 raft_consensus.cc:2410] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:58.559759 22272 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:10:58.388262 25147 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 12:10:58.561055 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 241466us
I20260709 12:10:58.452662 24752 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:58.451725 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:58.454095 25164 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:58.565239 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.414041 25244 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:58.565907 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.566432 22270 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:58.566690 22265 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:58.428218 24464 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:58.556967 22119 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:58.366990 24882 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.412281 25139 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.569293 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:58.552996 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 197405us
I20260709 12:10:58.573329 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.576985 22267 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:10:58.577347 22265 raft_consensus.cc:2393] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:58.578027 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.578639 22267 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:10:58.579634 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.580309 22267 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:58.573138 24464 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:58.581475 25250 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:10:58.583132 24630 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.561959 25199 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:58.585600 25219 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:58.592391 24871 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:58.592887 25139 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:58.593292 22120 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:58.578552 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.594358 25244 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.595567 25119 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:10:58.594897 25246 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:10:58.594341 22265 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:10:58.387145 25144 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
I20260709 12:10:58.596941 22114 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:58.603634 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.604732 22267 raft_consensus.cc:2410] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:10:58.597795 22119 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:58.598626 22269 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:10:58.563787 25226 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.559103 25065 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:10:58.562007 25081 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:58.602907 25151 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:58.603147 25141 consensus_meta.cc:287] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
I20260709 12:10:58.561059 25209 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:58.558389 25235 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.605386 25144 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:10:58.611294 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.738626 24925 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:58.740278 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:58.698729 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.620930 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.637678 22236 leader_election.cc:400] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5.
W20260709 12:10:58.631660 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 202669us
I20260709 12:10:58.613544 22264 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:58.745150 22267 raft_consensus.cc:2410] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:58.744997 22236 leader_election.cc:403] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:58.746080 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.746680 25115 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5.
W20260709 12:10:58.747000 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 109591us
I20260709 12:10:58.748685 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:10:58.755534 22236 leader_election.cc:400] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:10:58.757136 22236 leader_election.cc:403] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:58.761440 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.762620 22267 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:58.609555 25199 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.644229 25241 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.759752 25115 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:58.751783 25264 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:58.647852 24752 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:10:58.760236 24838 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:58.804282 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:58.759687 25139 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.749289 25141 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:58.828707 22264 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:10:58.817713 25081 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:58.829524 22859 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:58.796993 25241 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:58.797201 25199 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:58.835239 25199 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:58.835961 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:58.837468 25255 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.002s
I20260709 12:10:58.840236 25235 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:58.842679 22118 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:10:58.843215 22118 pending_rounds.cc:85] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 3
I20260709 12:10:58.843475 22118 pending_rounds.cc:107] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:10:58.843770 22118 raft_consensus.cc:2889] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.845563 25139 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.848506 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1833) took 1123 ms. Trace:
I20260709 12:10:58.806610 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:58.804196 25239 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:10:58.818305 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:58.825627 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:58.854310 22863 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:58.782868 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:58.837723 22116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1680) took 2568 ms (client timeout 1789 ms). Trace:
W20260709 12:10:58.807106 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 51676.8us
I20260709 12:10:58.823971 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:10:58.866621 22116 rpcz_store.cc:269] 0709 12:10:56.269543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.388036 (+118493us) service_pool.cc:224] Handling call
0709 12:10:58.837464 (+2449428us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54003df4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:58.837602 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3620909312}
I20260709 12:10:58.829573 25141 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:58.869558 25206 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 1.464s	user 0.004s	sys 0.003s
I20260709 12:10:58.871706 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 446) took 1843 ms. Trace:
I20260709 12:10:58.872149 22263 rpcz_store.cc:276] 0709 12:10:57.028609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.049734 (+ 21125us) service_pool.cc:224] Handling call
0709 12:10:57.050099 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:57.050517 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:57.066228 (+ 15711us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.404657 (+338429us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:57.405364 (+   707us) log.cc:844] Serialized 52 byte log entry
0709 12:10:57.405538 (+   174us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:57.405583 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.405666 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.868997 (+1463331us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:10:58.871317 (+  2320us) raft_consensus.cc:1685] finished
0709 12:10:58.871479 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.871645 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":597,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":5289,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":218,"spinlock_wait_cycles":25638656,"thread_start_us":337723,"threads_started":1,"wal-append.queue_time_us":338606}
I20260709 12:10:58.866490 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:58.849766 22118 rpcz_store.cc:276] 0709 12:10:57.724993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.929830 (+204837us) service_pool.cc:224] Handling call
0709 12:10:58.842157 (+912327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.844309 (+  2152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.848254 (+  3945us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54003df4d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:58.848430 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097343872}
W20260709 12:10:58.854869 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 251052us
W20260709 12:10:58.855139 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.872359 25265 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:58.880700 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.882232 25200 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:58.883734 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:58.884145 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:58.893545 22196 raft_consensus.cc:2410] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:58.884707 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:58.894024 22116 raft_consensus.cc:2410] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:58.821429 24882 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:58.894213 22115 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
W20260709 12:10:58.873311 25260 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:10:58.889763 22263 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:10:58.872496 25241 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:58.751724 25151 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:58.915112 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.808148 25264 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:58.921808 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 176273us
W20260709 12:10:58.922690 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 94762us
I20260709 12:10:58.932657 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:10:58.968847 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.987052 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:58.988657 22265 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:10:58.989256 22272 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:58.990991 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 124610us
I20260709 12:10:58.991729 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:10:58.989782 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1826) took 1299 ms. Trace:
I20260709 12:10:58.993753 22121 rpcz_store.cc:276] 0709 12:10:57.690896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.691080 (+   184us) service_pool.cc:224] Handling call
0709 12:10:58.460003 (+768923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.460355 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:58.460403 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.460473 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:58.460521 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.460630 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.984697 (+524067us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b5400214b50. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:58.989722 (+  5025us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34965,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":1559,"spinlock_wait_cycles":1767455104}
I20260709 12:10:58.996655 22272 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:58.998312 22271 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:58.999450 22271 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:58.999675 22236 leader_election.cc:400] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8.
I20260709 12:10:59.000427 22271 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.001897 22272 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.007802 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:59.015249 25151 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:58.943272 25241 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:10:59.005051 25200 raft_consensus.cc:2764] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:10:59.022037 22267 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
W20260709 12:10:59.032297 22236 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.789s (SENT)
I20260709 12:10:59.032891 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:59.041320 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:59.042321 25089 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:59.042825 25089 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.043221 25089 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.048532 25151 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:59.049041 22236 leader_election.cc:336] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.833s (SENT)
I20260709 12:10:59.021838 25139 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:59.022677 25141 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:59.086961 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.118657 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 116166us
I20260709 12:10:59.121206 25264 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:59.122612 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1854) took 1070 ms. Trace:
I20260709 12:10:59.122987 22123 rpcz_store.cc:276] 0709 12:10:58.052278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.321250 (+268972us) service_pool.cc:224] Handling call
0709 12:10:58.321634 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.378979 (+ 57345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.379010 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.379476 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.742001 (+362525us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:58.765692 (+ 23691us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.765989 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.122225 (+356236us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b54002adad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:10:59.122272 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.122324 (+    52us) raft_consensus.cc:1685] finished
0709 12:10:59.122405 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.122549 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":286,"prepare.queue_time_us":23098,"raft.queue_time_us":1260,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":44025,"spinlock_wait_cycles":135208704,"thread_start_us":326555,"threads_started":1,"wal-append.queue_time_us":515261}
I20260709 12:10:59.125519 24981 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:10:59.132208 25282 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.115s	user 0.001s	sys 0.001s
I20260709 12:10:59.134027 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1842) took 1375 ms. Trace:
I20260709 12:10:59.134454 22117 rpcz_store.cc:276] 0709 12:10:57.758349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.984738 (+226389us) service_pool.cc:224] Handling call
0709 12:10:57.988496 (+  3758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.988899 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:58.027474 (+ 38575us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.873576 (+846102us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b1800222520. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a 00007fcceddcca2a
0709 12:10:59.037943 (+164367us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.038531 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.038685 (+   154us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:59.038718 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.038790 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.133626 (+ 94836us) raft_consensus.cc:1685] finished
0709 12:10:59.133766 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.133958 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38598,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":17677,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":178,"spinlock_wait_cycles":4341120,"thread_start_us":161030,"threads_started":1,"wal-append.queue_time_us":1037131}
I20260709 12:10:59.136253 25129 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:59.141844 25188 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:10:59.142155 22268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1834) took 2660 ms (client timeout 2040 ms). Trace:
I20260709 12:10:59.142554 25188 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:59.145370 25188 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:10:59.112820 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 109139us
I20260709 12:10:59.111203 22271 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:59.149398 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:59.151612 22857 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:59.152045 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.152923 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:59.158937 25276 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:59.161094 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 1951) took 1159 ms. Trace:
I20260709 12:10:59.161556 22190 rpcz_store.cc:276] 0709 12:10:58.001201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.019240 (+ 18039us) service_pool.cc:224] Handling call
0709 12:10:59.160936 (+1141696us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400236ed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:59.161036 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344134016}
I20260709 12:10:59.162416 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:59.163715 25141 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.163303 25276 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.166203 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:59.168481 22263 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:59.171504 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:59.171446 22265 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:59.176870 25062 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.177021 25228 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:59.178035 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.142604 22268 rpcz_store.cc:269] 0709 12:10:56.481804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.523155 (+ 41351us) service_pool.cc:224] Handling call
0709 12:10:59.141907 (+2618752us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540026bbd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:59.142059 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3834674048}
I20260709 12:10:59.177459 25228 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:10:59.181196 25228 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.188081 25089 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:59.171881 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:59.199523 22268 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.213770 25101 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:59.214919 25089 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:59.224730 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.164242 25141 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:59.235487 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:59.231739 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:59.189590 25228 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:59.243747 22270 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.244380 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:59.245138 22862 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.244683 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:59.254179 24995 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:59.254736 24995 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:59.256093 22270 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:59.255774 24995 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:10:59.261283 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.197649 25026 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:10:59.264256 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:59.268035 22866 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.268533 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:59.243441 25111 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:59.269414 22271 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
W20260709 12:10:59.288566 25243 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.904s	user 0.000s	sys 0.007s
I20260709 12:10:59.280581 25101 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:59.291947 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 1.00584e+06us
I20260709 12:10:59.296638 25141 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:10:59.271767 25111 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:59.299505 25111 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:59.305872 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:59.322052 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 1955) took 1287 ms. Trace:
I20260709 12:10:59.322485 22191 rpcz_store.cc:276] 0709 12:10:58.034332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.072491 (+ 38159us) service_pool.cc:224] Handling call
0709 12:10:58.078164 (+  5673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.082155 (+  3991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.321717 (+1239562us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b540011ba50. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:59.321981 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12202752}
I20260709 12:10:59.284296 24995 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:59.331087 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.335644 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 285695us
I20260709 12:10:59.319168 25111 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.338013 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:59.339071 22271 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:59.320720 25225 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:59.346191 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:10:59.347397 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.351564 25039 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.352087 25039 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:59.352499 25039 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.357131 25218 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.357847 25218 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:59.360138 25218 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:59.361884 22862 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:59.363271 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:10:59.366381 24871 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:59.367117 24871 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:59.368242 24871 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:59.395287 25039 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:59.402621 25217 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:59.403589 25081 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:59.413180 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:59.418504 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:59.437402 22120 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:10:59.438588 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:10:59.438872 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.439311 22120 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.436546 22117 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:59.421083 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:59.441340 22267 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.423347 22114 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:10:59.423976 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.424794 22122 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:10:59.426908 22271 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:59.383144 25225 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:10:59.449031 22114 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:59.453786 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.369908 25222 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:10:59.475157 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:10:59.466614 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:10:59.477415 22122 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.475980 22114 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:59.483925 22114 raft_consensus.cc:3055] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:59.484345 22114 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:10:59.486371 22193 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.485214 22114 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:59.497193 22114 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.503512 22118 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:59.521255 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:59.523463 22118 pending_rounds.cc:85] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 2
I20260709 12:10:59.523900 22118 pending_rounds.cc:107] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:10:59.522261 22271 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:10:59.524204 22118 raft_consensus.cc:2889] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.528523 22120 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:59.530530 25039 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:59.548816 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:10:59.549453 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:59.551582 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:59.537417 25218 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.568323 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:10:59.569933 22271 raft_consensus.cc:2410] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:59.563326 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:59.585927 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:59.587661 25232 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.550210 25217 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 12:10:59.597347 25292 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:10:59.597837 25039 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.598618 25209 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.598570 25039 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:59.600824 25039 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:59.599263 25209 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:59.551556 25230 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:10:59.545190 22267 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:10:59.607091 22267 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:59.608604 22122 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:10:59.610867 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:10:59.679905 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.612607 22191 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 7. Ops: [5.4-5.4]
I20260709 12:10:59.611060 22267 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:59.769840 22267 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:10:59.770591 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.564191 25218 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:59.726647 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.604445 22114 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:10:59.773699 22114 pending_rounds.cc:85] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 3
I20260709 12:10:59.774012 22114 pending_rounds.cc:107] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:10:59.774241 22114 raft_consensus.cc:2889] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.774499 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:59.776206 22267 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:59.765509 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.766948 22192 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.778101 22196 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:10:59.778492 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:59.786142 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:59.767161 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 165669us
I20260709 12:10:59.557695 25225 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:59.565905 25208 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.801671 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.807227 22271 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:59.817118 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.839270 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.847910 22192 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
W20260709 12:10:59.869133 25308 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
I20260709 12:10:59.859792 25218 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:59.868901 25224 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:59.893841 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 308153us
W20260709 12:10:59.901348 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.901228 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.904294 25218 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:59.904959 25218 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:59.906759 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:59.907799 22863 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:10:59.913323 25295 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:10:59.804934 25209 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:59.902041 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:10:59.914595 25307 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 12:10:59.906867 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:10:59.917110 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.917896 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:59.918212 22088 connection.cc:256] RPC call timeout handler was delayed by -1.048369300000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27730000000000005s for a response
I20260709 12:10:57.128494 22006 catalog_manager.cc:5028] TS 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): tablet 97ce44fb81b642f9ad6b0f0d68e82820 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:10:59.920482 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:10:59.920895 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.915892 22859 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:59.922171 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:10:59.922375 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.919214 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:10:59.925086 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.925153 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:59.925833 24286 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.926261 24286 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.926640 24286 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:59.926757 22006 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 2.83951e+06us
I20260709 12:10:59.928491 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:10:59.928920 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:59.929586 22863 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:10:59.935185 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.935097 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:59.915889 25039 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.936239 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.946707 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.947398 22194 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:10:59.947742 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.936659 24778 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:10:59.938035 25073 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.931828 25129 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.926816 24871 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:59.907019 25218 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:10:59.940991 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:10:59.933988 25222 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.942615 22861 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.934325 25147 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:59.940560 25111 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.000s
I20260709 12:10:59.949594 25039 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:59.967204 22272 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:59.961474 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.961571 24286 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:10:59.950014 22193 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:10:59.957525 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:10:59.952651 25037 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:10:59.970166 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.970978 22117 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:10:59.971371 22117 pending_rounds.cc:85] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 4
I20260709 12:10:59.971611 22117 pending_rounds.cc:107] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:10:59.971828 22117 raft_consensus.cc:2889] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.952418 25129 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:10:59.969614 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 1894) took 1511 ms. Trace:
I20260709 12:10:59.973789 22264 rpcz_store.cc:276] 0709 12:10:58.455919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.745796 (+289877us) service_pool.cc:224] Handling call
0709 12:10:59.966865 (+1221069us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b540026d4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:10:59.967049 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187225984}
I20260709 12:10:59.977129 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.978271 22193 raft_consensus.cc:2368] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:10:59.979082 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.980131 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.974622 24286 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:10:59.980719 22193 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:10:59.975936 25129 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.981895 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.983888 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.968760 25039 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.976166 25062 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.799s	user 0.007s	sys 0.007s
I20260709 12:10:59.989521 22190 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:10:59.990036 25217 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.985747 22861 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:10:59.984472 22193 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
W20260709 12:10:59.993908 22861 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 537) took 2904 ms (client timeout 1848 ms). Trace:
I20260709 12:10:59.994719 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:10:59.994390 22861 rpcz_store.cc:269] 0709 12:10:57.087569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.087734 (+   165us) service_pool.cc:224] Handling call
0709 12:10:58.378178 (+1290444us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b180027c660. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddfd646 00007fccedd3758e 00007fcceddb8f9e 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c
0709 12:10:59.942154 (+1563976us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b58006d10d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd1e0aa 00007fccedda0447 00007fcceddb8fe7 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c
0709 12:10:59.991675 (+ 49521us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3627064832}
I20260709 12:10:59.992097 25155 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.990473 25217 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:10:59.964658 25222 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:10:59.992380 24995 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.657s	user 0.013s	sys 0.000s
I20260709 12:10:59.999446 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.976277 25037 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:00.002179 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:10:59.997395 25155 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:00.017590 22193 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:11:00.047073 25312 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:11:00.057617 25247 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.052629 25037 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:00.054019 25039 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:00.055665 25222 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:00.050379 25228 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:00.058614 25247 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.060019 25227 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.060523 25227 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.063673 25247 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:00.063910 25129 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.066464 25129 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:00.069079 25217 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:00.069926 25227 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.072156 25039 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:00.072415 25227 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:00.086508 25155 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:00.094395 25309 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.121s	user 0.002s	sys 0.000s
W20260709 12:11:00.141520 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 207843us
I20260709 12:11:00.153939 22163 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:00.165282 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:00.176985 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:00.179652 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.181571 22115 raft_consensus.cc:2368] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:00.198388 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:00.225699 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.226895 22268 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:00.239099 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:00.245525 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.245704 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:00.250515 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 97219.5us
I20260709 12:11:00.253190 25129 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:11:00.254762 22020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 253) took 27359 ms (client timeout 15000 ms). Trace:
W20260709 12:11:00.260210 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.276929 24995 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.277853 24995 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:00.255235 22020 rpcz_store.cc:269] 0709 12:10:32.895310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.895578 (+   268us) service_pool.cc:224] Handling call
0709 12:11:00.254443 (+27358865us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:52.259632 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:52.260399 (+   767us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:52.260458 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:10:52.260478 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:52.403616 (+143138us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:52.409312 (+  5696us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:52.418065 (+  8753us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:10:52.614203 (+196138us) tablet.cc:701] Row locks acquired
0709 12:10:52.641624 (+ 27421us) write_op.cc:260] PREPARE: finished
0709 12:10:52.665743 (+ 24119us) write_op.cc:270] Start()
0709 12:10:52.680612 (+ 14869us) write_op.cc:276] Timestamp: P: 1783599052665643 usec, L: 0
0709 12:10:52.683182 (+  2570us) op_driver.cc:348] REPLICATION: starting
0709 12:10:52.792350 (+109168us) log.cc:844] Serialized 2886 byte log entry
0709 12:10:53.614801 (+822451us) op_driver.cc:464] REPLICATION: finished
0709 12:10:54.152367 (+537566us) write_op.cc:301] APPLY: starting
0709 12:10:54.157291 (+  4924us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:54.166170 (+  8879us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:54.166305 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:54.168712 (+  2407us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:54.168965 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:10:54.169015 (+    50us) write_op.cc:312] APPLY: finished
0709 12:10:54.169306 (+   291us) log.cc:844] Serialized 59 byte log entry
0709 12:10:54.169498 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:54.169636 (+   138us) write_op.cc:454] Released schema lock
0709 12:10:54.169684 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:54.170098 (+   414us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:54.170133 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":859902,"reported_tablets":32,"spinlock_wait_cycles":11648,"child_traces":[["op",{"apply.queue_time_us":525824,"apply.run_cpu_time_us":3196,"apply.run_wall_time_us":20551,"num_ops":7,"prepare.queue_time_us":174341,"prepare.run_cpu_time_us":43014,"prepare.run_wall_time_us":915972,"raft.queue_time_us":193144,"raft.run_cpu_time_us":16164,"raft.run_wall_time_us":39830,"replication_time_us":931445,"thread_start_us":581743,"threads_started":4,"wal-append.queue_time_us":567925,"wal-append.run_cpu_time_us":61724,"wal-append.run_wall_time_us":1910248}]]}
W20260709 12:11:00.278945 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.292683 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44340.9us
I20260709 12:11:00.280702 24995 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:00.280927 24464 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:00.301221 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:00.301535 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.302590 22271 raft_consensus.cc:2368] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7.
I20260709 12:11:00.303097 22120 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:11:00.303664 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.304185 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.305944 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.307058 24838 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.301451 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.310482 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.318140 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1846) took 1150 ms. Trace:
I20260709 12:11:00.318807 22272 rpcz_store.cc:276] 0709 12:10:59.167461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.169678 (+  2217us) service_pool.cc:224] Handling call
0709 12:10:59.967004 (+797326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.967687 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.317656 (+349969us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b540026d4d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:00.317904 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832951040}
I20260709 12:11:00.312347 25239 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:00.324918 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1847) took 1154 ms. Trace:
I20260709 12:11:00.325547 22263 rpcz_store.cc:276] 0709 12:10:59.170331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.192460 (+ 22129us) service_pool.cc:224] Handling call
0709 12:10:59.194657 (+  2197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.194883 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:59.540473 (+345590us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.294831 (+754358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.324270 (+ 29439us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:00.324370 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.324489 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.324678 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":583700,"prepare.queue_time_us":208964,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":417159,"threads_started":3,"wal-append.queue_time_us":356103}
I20260709 12:11:00.326970 22189 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:11:00.327593 22189 pending_rounds.cc:85] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 5
I20260709 12:11:00.327629 22122 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:00.328164 22189 pending_rounds.cc:107] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:11:00.330039 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:00.331048 22114 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.334059 22264 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:11:00.337066 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 85559.3us
I20260709 12:11:00.338713 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:00.339573 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:00.340026 22859 raft_consensus.cc:2393] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:00.342608 25025 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:00.344030 25025 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:00.345535 25025 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.328599 22189 raft_consensus.cc:2889] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.324462 25239 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:00.378187 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.308185 24838 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:00.393826 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:00.387296 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.396874 22122 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:00.398226 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.398967 24838 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:00.399564 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.399866 22264 raft_consensus.cc:2393] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:00.406184 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.406934 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:00.409318 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:00.411769 25204 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:00.412514 25213 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:00.413911 22119 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:11:00.414487 22119 pending_rounds.cc:85] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 4
I20260709 12:11:00.409116 25026 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:00.414867 22119 pending_rounds.cc:107] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:11:00.408609 22272 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:11:00.419806 22119 raft_consensus.cc:2889] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.425384 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:00.426946 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:00.417966 22263 raft_consensus.cc:2376] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7. Re-sending same reply.
I20260709 12:11:00.427845 22859 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:00.428704 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:00.429942 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 55991.1us
I20260709 12:11:00.434398 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:00.434217 24995 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:11:00.435168 22087 leader_election.cc:336] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.500s (SENT)
I20260709 12:11:00.436019 25026 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:00.436499 25026 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:00.437644 25026 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.439282 25026 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.463003 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:00.482246 25320 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:00.483345 25320 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.495307 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:00.492223 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:00.504973 24873 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.505645 24873 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:00.507290 24873 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:00.508440 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.508738 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 972916us
W20260709 12:11:00.510731 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.511054 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:00.514236 25204 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.514820 25204 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.515244 25204 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.525928 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:00.526226 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.526821 22122 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.535221 22114 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:00.495030 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:00.541098 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 78686.5us
I20260709 12:11:00.546902 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:00.532301 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.553570 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.561050 22272 raft_consensus.cc:2376] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5. Re-sending same reply.
I20260709 12:11:00.564670 22266 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.564904 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.566354 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.567785 22118 raft_consensus.cc:2368] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5.
I20260709 12:11:00.568908 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.568408 22119 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:00.567154 22272 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:00.576025 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.579854 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:00.580818 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.582468 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:00.582464 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.584697 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.593016 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 472) took 1299 ms. Trace:
W20260709 12:11:00.592844 22236 leader_election.cc:336] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.530s (SENT)
I20260709 12:11:00.593498 22269 rpcz_store.cc:276] 0709 12:10:59.180466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.188668 (+  8202us) service_pool.cc:224] Handling call
0709 12:10:59.189052 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.189283 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:59.551095 (+361812us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.393665 (+842570us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.423565 (+ 29900us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:00.441784 (+ 18219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.456210 (+ 14426us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.479841 (+ 23631us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":731190,"prepare.queue_time_us":214311,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":857984,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":149,"thread_start_us":441074,"threads_started":2}
I20260709 12:11:00.595085 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:00.595557 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:00.596905 22121 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.597043 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1854) took 1222 ms. Trace:
I20260709 12:11:00.597427 22270 rpcz_store.cc:276] 0709 12:10:59.336598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.337066 (+   468us) service_pool.cc:224] Handling call
0709 12:10:59.362131 (+ 25065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.362370 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:59.406665 (+ 44295us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.416295 (+1009630us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.450952 (+ 34657us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:00.479533 (+ 28581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.500750 (+ 21217us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.559024 (+ 58274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":740659,"prepare.queue_time_us":42129,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":857781,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":142,"thread_start_us":258245,"threads_started":3,"wal-append.queue_time_us":178114}
I20260709 12:11:00.599807 25332 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.600701 25320 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:00.612910 25327 consensus_queue.cc:1059] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:11:00.617590 24873 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.622697 25239 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:00.628588 22190 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.632385 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.591277 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.640383 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:00.642352 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 68158.6us
I20260709 12:11:00.648423 25320 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:11:00.648793 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 105849us
I20260709 12:11:00.650136 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.650167 22018 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 3 to 4, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:00.654239 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1848) took 1483 ms. Trace:
I20260709 12:11:00.654693 22265 rpcz_store.cc:276] 0709 12:10:59.179079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.192861 (+ 13782us) service_pool.cc:224] Handling call
0709 12:10:59.231007 (+ 38146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.231281 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:59.428541 (+197260us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.093893 (+665352us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:00.617622 (+523729us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b1800382ae0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fcceddba060 00007fcceddcc716 00007fccedddd287
0709 12:11:00.618246 (+   624us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.653527 (+ 35281us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.653618 (+    91us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:00.653680 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.653814 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.654014 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":494854,"prepare.queue_time_us":174963,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":611999,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":15672,"spinlock_wait_cycles":11975424,"thread_start_us":622274,"threads_started":3,"wal-append.queue_time_us":523680}
I20260709 12:11:00.651875 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.655591 22018 catalog_manager.cc:5697] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 3 to 4, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 4 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.661804 22272 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:00.587781 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:00.662482 22189 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:00.663262 22120 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:00.673789 22121 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:00.674708 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:00.675390 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 87133.3us
I20260709 12:11:00.680650 22116 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:00.682863 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.685074 22114 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:00.681380 22118 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:00.692026 25320 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.692539 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.694871 25230 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:11:00.705446 22120 raft_consensus.cc:2368] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:00.706138 25230 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:00.706625 25230 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:00.698880 25187 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:11:00.696060 25218 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:00.708961 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51391.3us
I20260709 12:11:00.709477 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.692698 25320 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.694960 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:00.711104 22121 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:00.711565 25213 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.712445 25213 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:00.713318 25328 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:00.713985 25328 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.695338 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.715473 25320 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:00.698254 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 66195.8us
I20260709 12:11:00.697527 22117 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:00.716503 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.719002 22272 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:00.719043 22122 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:00.706626 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:00.678006 22088 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:00.600461 25332 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:00.722425 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 48728.5us
I20260709 12:11:00.722687 22266 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:00.723165 25318 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.670264 24995 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.677958 25331 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.723652 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.723073 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.723905 22119 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:00.725301 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:00.704404 22087 leader_election.cc:336] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.549s (SENT)
I20260709 12:11:00.732177 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:00.734022 22267 raft_consensus.cc:2410] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:11:00.734483 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.734848 22270 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:00.735917 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:00.736272 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.723886 24995 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.737730 22265 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:00.739130 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.739765 25129 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.739923 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.723737 25318 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:00.739176 22087 leader_election.cc:336] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.571s (SENT)
I20260709 12:11:00.697257 25258 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:00.702181 25239 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.742339 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.742240 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:00.742543 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.758097 22263 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:00.753695 22264 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:11:00.760830 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:00.767314 22114 raft_consensus.cc:2410] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:11:00.768285 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.742991 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:00.741878 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:00.778081 22118 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:00.779798 22115 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:00.707975 25230 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.739382 24995 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:00.753648 25318 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.791671 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:00.789163 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 47604.2us
W20260709 12:11:00.789570 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.787415 25213 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:00.793546 22270 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:00.794028 25213 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:00.794785 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.796414 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:00.798571 22269 raft_consensus.cc:2410] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:11:00.709118 25218 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:00.798179 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 86900.7us
I20260709 12:11:00.762389 25239 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:00.800987 22272 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:00.797667 25230 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.803299 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.808745 24995 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.808907 25325 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:00.809770 25325 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.812925 24873 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:00.813688 24873 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:00.817116 25218 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:00.817977 25327 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:00.818817 25327 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:00.821745 22263 raft_consensus.cc:2368] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:11:00.800109 25320 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:00.816624 24873 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:00.833561 25213 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:00.861029 22265 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:11:00.862231 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 123072us
I20260709 12:11:00.874910 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:00.806756 25331 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:00.881045 22265 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:00.806931 25258 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:00.887439 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:00.888798 22265 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:11:00.888981 22087 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.681s (SENT)
I20260709 12:11:00.880389 24873 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 12:11:00.909633 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 260108us
I20260709 12:11:00.897419 25325 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:00.885005 25320 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:00.904873 25218 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.928821 25239 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:00.939932 25239 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.911054 25025 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:00.925459 22018 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 2 to 3, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.944677 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:00.950039 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:00.950651 22265 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:00.940966 25327 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:00.933678 25218 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:00.968876 22236 leader_election.cc:336] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.646s (SENT)
I20260709 12:11:00.969401 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:00.967067 22018 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.965234 25218 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:00.988377 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 54352us
W20260709 12:11:00.986212 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 172258us
I20260709 12:11:00.985621 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:00.980485 25323 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:00.973347 25129 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:01.013356 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.002823 22018 catalog_manager.cc:5697] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 1 to 2, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.997007 24838 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.009313 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:01.025995 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 184734us
I20260709 12:11:01.023962 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:01.028141 22123 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:01.031977 22088 leader_election.cc:400] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7.
I20260709 12:11:01.035881 22088 leader_election.cc:403] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:01.027065 25258 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:01.039955 25331 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:01.048970 25320 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:01.050177 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46264.2us
I20260709 12:11:01.051682 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:01.052984 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 98144.5us
W20260709 12:11:01.054430 22236 leader_election.cc:336] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.763s (SENT)
I20260709 12:11:01.054903 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:01.057782 24995 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.058475 24995 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:01.072706 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.036840 25129 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.065049 25320 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.080200 25258 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:01.093328 25258 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:01.093849 25344 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.056s	user 0.001s	sys 0.001s
I20260709 12:11:01.034637 25323 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.095206 25129 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7.
W20260709 12:11:01.121191 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.129500 25129 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.111161 25320 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:01.177202 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 122837us
I20260709 12:11:01.163297 24995 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:01.180286 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:01.180475 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:01.180979 22116 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.181020 22115 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.188802 22115 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:01.162500 25025 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:01.189451 22116 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:01.195349 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:01.174283 24838 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:01.197256 22123 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:11:01.197929 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:01.210318 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 175971us
I20260709 12:11:01.203006 25351 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:01.220285 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 227871us
I20260709 12:11:01.190582 25320 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:01.217667 22117 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
W20260709 12:11:01.224637 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 260614us
W20260709 12:11:01.225574 25342 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 12:11:01.221150 25204 consensus_meta.cc:287] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.705s	user 0.001s	sys 0.014s
I20260709 12:11:01.226750 22831 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:01.235672 25350 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:11:01.235235 25318 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.236964 25218 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:01.239208 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:01.218076 24838 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:01.247023 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 195418us
W20260709 12:11:01.242118 22236 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.827s (SENT)
I20260709 12:11:01.252485 25349 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.254081 25239 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:01.256551 25349 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.257058 25349 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.256945 25239 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.257997 25318 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:01.259651 25239 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:01.260198 24838 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:01.226254 25351 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:01.261209 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:01.261770 25351 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.263904 25318 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:01.274271 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:01.277431 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 58110.1us
I20260709 12:11:01.230340 25258 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:01.279356 22117 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:01.280268 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:01.283665 25349 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.284420 25320 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:01.285394 25025 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:01.293407 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 67265.5us
I20260709 12:11:01.246258 25323 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:01.249006 25204 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.289223 25360 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:01.230192 25213 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:11:01.295789 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:01.299451 22115 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:01.301771 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:01.309110 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 55520.2us
I20260709 12:11:01.312585 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:01.300516 25320 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.317974 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:01.319041 22116 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:11:01.322907 25232 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.323525 25232 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:01.324076 25232 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.332667 22236 leader_election.cc:400] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:01.349895 22236 leader_election.cc:403] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:01.337604 25354 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:11:01.359601 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:01.369423 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:01.373874 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57074.2us
I20260709 12:11:01.334187 25349 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:01.337407 25362 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.313834 25360 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.388619 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:01.389348 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:01.390161 22861 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.390487 25356 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:01.391331 25356 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.374692 25320 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:01.408864 25359 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.396284 25328 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:01.398193 25362 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:01.403331 25218 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:01.423740 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 91391.1us
I20260709 12:11:01.390019 25367 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:11:01.428342 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:01.409647 25359 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:01.432119 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:01.398159 25025 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:11:01.430541 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:01.463824 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.465166 25204 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:01.465960 25204 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.466374 25204 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.466701 25204 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.467284 25360 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:01.470096 25230 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.473073 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:01.474532 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.481750 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 155775us
I20260709 12:11:01.483312 22861 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:01.489341 22272 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:11:01.491439 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:01.510145 22270 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:01.511264 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 1879) took 1036 ms. Trace:
I20260709 12:11:01.490911 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:01.511677 22264 rpcz_store.cc:276] 0709 12:11:00.462965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.525873 (+ 62908us) service_pool.cc:224] Handling call
0709 12:11:00.577494 (+ 51621us) spinlock_profiling.cc:243] Waited 911 us on lock 0x7b54002eeba8. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3b9f5f4 00007fccf2d88227 00007fccf2d87ab8 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:01.499206 (+921712us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54001c7854. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:01.499387 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406752768}
W20260709 12:11:01.528101 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 72807.1us
W20260709 12:11:01.529384 22088 leader_election.cc:336] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.500s (SENT)
I20260709 12:11:01.530159 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:01.539372 22266 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:11:01.541599 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 124130us
I20260709 12:11:01.547749 25359 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:01.548944 25218 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:11:01.550621 25372 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:11:01.552356 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 142022us
W20260709 12:11:01.553813 25368 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:11:01.528066 25356 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:01.541260 25329 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:01.555812 25329 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:01.556288 25329 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.556900 25353 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:01.557591 25353 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.560052 25353 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:01.561087 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:01.564819 25320 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.565496 25361 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:01.570739 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:01.574044 25187 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.013s	sys 0.051s
I20260709 12:11:01.545450 25349 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 12:11:01.595094 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 48055.2us
W20260709 12:11:01.587946 25187 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.013s	sys 0.051s
W20260709 12:11:01.611505 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 99018.7us
I20260709 12:11:01.603724 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:01.616071 22189 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.612298 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:01.619534 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:01.603644 22236 connection.cc:256] RPC call timeout handler was delayed by -1.0827504359999693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 12:11:01.650617 22236 connection.cc:256] RPC call timeout handler was delayed by -1.074806610999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 12:11:01.651129 22236 connection.cc:256] RPC call timeout handler was delayed by -1.0044504359998427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
I20260709 12:11:01.617489 22190 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:01.646914 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:01.652678 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:01.653527 22865 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:01.653083 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:01.543610 25362 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:01.661912 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57889.7us
W20260709 12:11:01.666786 22088 leader_election.cc:336] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.577s (SENT)
I20260709 12:11:01.667414 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:01.625269 25025 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.605046 25026 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:11:01.624097 25332 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:01.678210 25025 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:11:01.694226 22236 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.943s (SENT)
I20260709 12:11:01.693955 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:01.699239 22268 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.673629 25360 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.702664 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:01.705282 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:01.716524 25325 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:01.725404 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:01.729426 25377 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:01.732196 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:01.735031 25232 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.739746 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:01.742208 25379 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.742456 25360 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:01.743316 25360 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.743137 25365 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:01.742736 25379 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:01.751636 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 76091.3us
I20260709 12:11:01.792616 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:01.793079 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 108375us
I20260709 12:11:01.795447 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:01.795763 25230 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:01.795061 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:01.761370 25379 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.805083 22859 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:01.799612 25332 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.803522 25026 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:01.842731 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53043.9us
I20260709 12:11:01.815893 25232 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:01.858100 22189 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:01.860246 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:01.864179 22866 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
W20260709 12:11:01.874442 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.878033 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 81253us
W20260709 12:11:01.879113 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.881606 25204 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.883886 25204 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:01.884912 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:01.886888 22236 leader_election.cc:400] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5.
I20260709 12:11:01.887153 22236 leader_election.cc:403] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:11:01.887818 25325 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.888494 25325 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 4. Current term is 5.
I20260709 12:11:01.889242 25390 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:11:01.890093 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:01.891057 25332 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.891247 25380 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:01.893070 25386 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:11:01.892913 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:11:01.894963 25383 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 12:11:01.895880 25387 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:11:01.896982 25332 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.897439 25332 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:01.897804 25332 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.899147 25218 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:01.899185 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 232429us
W20260709 12:11:01.908097 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45261.9us
I20260709 12:11:01.909286 25329 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:01.915791 22268 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:01.919296 25331 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.919875 25331 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:01.922036 25331 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:01.923159 22088 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.581s (SENT)
I20260709 12:11:01.928927 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:01.934036 22236 leader_election.cc:400] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:01.934616 22236 leader_election.cc:403] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:01.912098 25353 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:01.914599 25329 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:01.942025 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:01.948670 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:01.949656 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:01.950708 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:01.951220 22191 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:01.951829 25348 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:01.952294 25348 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:01.952565 25389 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.952648 25348 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.953156 25390 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:01.954439 25377 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:01.953292 25396 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:01.955051 25362 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:01.955394 25396 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:01.956512 25396 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.956853 25360 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:01.959157 25360 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:01.931318 25400 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 12:11:01.936882 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 75841.9us
I20260709 12:11:01.971293 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:01.971712 25331 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:01.980261 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:01.980531 25331 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:01.982097 25361 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.983043 25155 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:01.991736 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57908.1us
I20260709 12:11:01.985061 25331 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:01.973259 25325 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
W20260709 12:11:02.003801 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 94834.7us
W20260709 12:11:02.004114 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 81011.9us
I20260709 12:11:01.962706 25353 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:02.057430 25384 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.274s	user 0.001s	sys 0.004s
I20260709 12:11:02.062523 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:02.078248 22088 leader_election.cc:336] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.633s (SENT)
I20260709 12:11:02.079545 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.066210 25328 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.085011 25356 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:02.085706 22088 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.681s (SENT)
I20260709 12:11:02.086213 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.087136 25356 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:02.087476 22088 leader_election.cc:336] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.713s (SENT)
I20260709 12:11:02.088088 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.089174 25356 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.059597 25406 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 12:11:02.096500 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 90674.4us
I20260709 12:11:02.100345 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:02.100703 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:02.100823 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:02.101641 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:02.102598 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:02.103277 22117 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
W20260709 12:11:02.098450 22087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.719s (SENT) [suppressed 38 similar messages]
I20260709 12:11:02.104678 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:02.080406 25365 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:02.109016 22115 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:02.112040 22123 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:02.108904 22120 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:02.113672 22270 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:02.116875 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:02.121935 22162 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:02.122540 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:02.123158 22114 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:02.123411 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.124867 25380 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:02.125617 25380 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:02.126938 25380 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:02.121807 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.133796 25026 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:02.135941 25349 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:02.136380 25349 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:02.137311 25349 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:02.139310 25353 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:02.141618 25328 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:02.142194 25365 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:02.143899 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:02.144488 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:02.145956 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.149186 22272 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:02.142043 25407 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:02.157441 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:02.177182 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 78778.5us
I20260709 12:11:02.145109 22270 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:11:02.194864 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:02.195971 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:02.196587 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:02.196626 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:02.197753 22116 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:02.197127 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:02.199747 22864 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.156883 25365 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:02.226301 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47692us
I20260709 12:11:02.237488 22088 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:02.235507 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.249356 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:02.182473 25025 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:11:02.263752 22116 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:02.230233 25232 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:02.184281 25407 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:02.283248 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:02.260236 25365 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.267828 25230 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.273547 25356 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:11:02.330569 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 220324us
I20260709 12:11:02.331378 22123 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:02.328672 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:02.284406 25232 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.335309 25232 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.336477 25230 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:02.336697 25361 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.337049 25230 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.338138 25348 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:02.341513 25412 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:02.350368 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:02.353830 25422 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:02.354597 25407 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:02.354640 25422 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:11:02.357744 25378 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.657s	user 0.003s	sys 0.000s
I20260709 12:11:02.357312 25422 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:02.359004 25356 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:02.360163 25356 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:02.362356 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:02.241370 25351 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 12:11:02.333837 25379 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.523s	user 0.004s	sys 0.007s
I20260709 12:11:02.289565 25420 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.332355 22116 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.376732 22864 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
W20260709 12:11:02.349078 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 121351us
W20260709 12:11:02.397560 25419 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:11:02.403766 25420 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:11:02.405066 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.415360 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:02.422411 22116 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:02.378399 25379 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:02.421133 25213 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:02.440891 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.442926 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.444847 25218 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:11:02.445767 25129 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.444260 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.448038 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.448832 25218 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.449559 25218 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:02.445005 22191 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.444499 25379 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:02.451344 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:02.452096 25332 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.004s
I20260709 12:11:02.452227 25218 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:02.385742 25230 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:02.475956 22087 leader_election.cc:336] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.577s (SENT)
I20260709 12:11:02.453899 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.476629 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:02.433497 25328 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:02.496608 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 134379us
I20260709 12:11:02.455350 25230 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:02.455938 25213 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:02.503872 22087 leader_election.cc:336] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.595s (SENT)
I20260709 12:11:02.504326 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.496014 25328 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.508752 25328 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.510797 25129 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.511826 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:02.506181 25356 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.452746 25332 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:02.513124 25376 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:02.513473 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 319422us
I20260709 12:11:02.513854 25376 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:02.514423 22268 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.515095 25332 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:02.514889 25376 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:02.516086 25213 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:02.505302 25218 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.520866 25325 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:02.521365 25325 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:02.525318 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:02.525647 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:02.526578 22263 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:02.532065 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:02.497017 25406 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:11:02.532668 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:02.533226 22115 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:11:02.534106 22857 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.535653 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:02.537240 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:02.538100 22115 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.538427 25349 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.538736 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:02.539965 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:02.540875 22115 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:02.469605 25232 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:02.545449 22116 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
W20260709 12:11:02.551190 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49209.3us
W20260709 12:11:02.551645 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 97830.5us
I20260709 12:11:02.554818 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:02.555948 22117 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:02.557614 22268 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:02.562057 22114 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:02.522224 25325 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:02.579063 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:02.572860 25403 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.001s	sys 0.012s
I20260709 12:11:02.589339 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:02.589993 22115 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.574894 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.550956 25390 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:11:02.605082 22191 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.564944 25353 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 12:11:02.607635 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 100527us
I20260709 12:11:02.611346 22119 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:02.601498 25129 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.632231 25227 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:02.632640 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.633075 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.634034 22189 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:02.634588 25232 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:02.634852 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.617015 25325 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.638965 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.640470 24464 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.609683 25230 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:02.643092 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.681612 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.678812 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:02.680294 25433 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:11:02.707752 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:02.624311 25353 consensus_queue.cc:1243] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:02.703512 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:02.644459 25230 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:02.711076 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.713336 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:02.713562 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 149023us
I20260709 12:11:02.685535 25025 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:02.714622 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:02.717998 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.701082 25438 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:02.719542 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:02.721139 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.722604 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:02.724519 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.725258 22198 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:02.730406 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.732800 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:02.735646 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:02.736253 22268 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.737368 25356 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:02.739914 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.726687 25438 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:02.745952 25437 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:11:02.746906 25438 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:02.751737 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:02.752632 22087 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.980s (SENT)
I20260709 12:11:02.725248 25218 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:02.766368 25400 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:02.767091 25400 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:02.768332 25400 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:02.770895 25400 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.778596 22271 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:02.784668 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:02.747828 25230 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:02.788638 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 67548.2us
I20260709 12:11:02.801110 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.799476 22114 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.799472 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.799329 22265 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.809561 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:02.818900 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.821903 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:02.797714 25230 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.826615 22195 raft_consensus.cc:2368] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
W20260709 12:11:02.827943 25436 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:11:02.829061 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.831784 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:02.826440 25348 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:02.833691 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:02.838344 22268 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:02.841629 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:02.842846 22265 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:02.844005 22265 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:11:02.847628 25442 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:11:02.819707 25438 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.850867 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:02.854790 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:02.855652 22195 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.857995 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.847728 25360 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:02.866006 25360 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:02.869855 25360 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:02.871261 25360 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.871641 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.875227 25399 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:02.907775 22114 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:02.902915 25438 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.892223 22265 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:02.916189 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.917709 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:02.918753 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:02.885123 25399 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:02.920527 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.926219 22265 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.934800 25369 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:11:02.937757 25422 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:02.938426 25422 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:02.949819 22190 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.960898 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.962169 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.962989 22194 raft_consensus.cc:2410] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:02.964058 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:02.964942 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.953294 25450 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:02.969411 25328 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:02.971519 22271 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:02.972064 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.973362 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.973809 25328 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:02.914511 25348 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:02.993520 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:03.002485 22194 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:03.012852 22195 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:02.991681 25422 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:03.051043 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 140661us
I20260709 12:11:03.051295 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:03.052897 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:02.973759 25399 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:03.055138 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:03.058498 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 83817.8us
I20260709 12:11:03.063602 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:03.103425 22865 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.106720 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:03.109601 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.111339 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:03.117228 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53452.7us
I20260709 12:11:03.128492 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:03.129462 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:03.134608 25455 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:11:03.136034 25451 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:11:03.138375 25351 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:03.138844 25351 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:03.145931 22118 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:03.139832 25351 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:03.145049 25456 consensus_queue.cc:1059] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:11:03.158572 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:03.159173 25456 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.159648 25456 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:03.165581 22236 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:03.167238 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:03.167032 25325 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.530s	user 0.013s	sys 0.000s
I20260709 12:11:03.179020 22265 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:11:03.181845 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:03.183317 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:03.167995 25422 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.175700 25427 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.160641 25456 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:03.189505 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.184499 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:03.179600 22265 pending_rounds.cc:85] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 3
I20260709 12:11:03.192641 22265 pending_rounds.cc:107] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:11:03.193075 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:03.194211 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.194916 22265 raft_consensus.cc:2889] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:03.195027 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:03.199129 25456 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.200831 22198 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:03.196156 25427 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:03.212205 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:03.213184 22194 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:03.214161 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:03.223515 25465 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:03.205909 25325 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.226811 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:03.230692 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:03.203481 25407 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:11:03.221654 25422 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:03.249740 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46703.1us
I20260709 12:11:03.250984 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:03.230747 25325 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.255335 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:03.224614 25026 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:11:03.256536 22192 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.262331 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:03.266292 25466 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:03.253574 25332 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.281232 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:03.281764 25365 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:03.284736 25026 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.285200 25026 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:03.286175 25026 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:03.287525 25026 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.287714 22196 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:03.276378 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:03.291105 22198 raft_consensus.cc:2410] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:03.263021 25399 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.294077 22196 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:03.297562 25398 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:03.298651 25187 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.299003 25187 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:03.260170 25325 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.299921 25187 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:03.315270 22194 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:11:03.323184 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55896.1us
I20260709 12:11:03.333489 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:03.334896 25399 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.313328 25227 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.337075 25356 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.336923 25227 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:03.338598 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 80645.7us
I20260709 12:11:03.339334 25227 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:03.340130 22236 leader_election.cc:400] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:03.340319 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:03.267881 25422 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.340514 22236 leader_election.cc:403] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:03.348963 25414 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 12:11:03.350862 25454 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 12:11:03.354403 22197 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:03.342285 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:03.408828 22859 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:03.437811 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:03.441581 25453 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.328s	user 0.000s	sys 0.004s
I20260709 12:11:03.465081 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:03.465968 22121 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:03.471738 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:03.472957 22270 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:03.377298 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:03.324085 25129 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.481422 22194 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:03.361863 25227 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:03.309422 25380 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:11:03.378331 25332 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
W20260709 12:11:03.494062 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.500429 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 160390us
I20260709 12:11:03.501227 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:03.502815 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:03.502713 25398 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:03.504320 25398 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.504762 25129 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:03.507332 25129 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:03.509457 22123 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:03.511974 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65832.2us
I20260709 12:11:03.515085 22121 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:03.515512 22121 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:03.522838 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:03.760124 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 356037us
I20260709 12:11:03.793391 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 400) took 1010 ms. Trace:
W20260709 12:11:03.800915 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 745824us
I20260709 12:11:03.800241 25129 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:03.822371 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:03.822371 25129 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:03.827677 25129 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:03.828269 24464 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:03.828729 24464 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:03.829635 24464 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:03.831126 24464 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.835018 25414 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.835687 25414 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:03.809144 22121 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:03.837005 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 364757us
I20260709 12:11:03.837328 22121 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.839737 25470 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:11:03.841590 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59816.2us
I20260709 12:11:03.795791 25422 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:03.853833 25414 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:03.866534 25325 consensus_meta.cc:287] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.566s	user 0.000s	sys 0.011s
I20260709 12:11:03.867276 25325 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:03.871021 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48761.3us
I20260709 12:11:03.872153 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:03.873055 25474 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:03.873869 25475 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:03.802068 25420 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:03.793855 22117 rpcz_store.cc:276] 0709 12:11:02.783008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.783176 (+   168us) service_pool.cc:224] Handling call
0709 12:11:02.797080 (+ 13904us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:02.797918 (+   838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.797959 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:02.798703 (+   744us) log.cc:844] Serialized 52 byte log entry
0709 12:11:03.044615 (+245912us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:03.059190 (+ 14575us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.793010 (+733820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.793099 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.793149 (+    50us) raft_consensus.cc:1685] finished
0709 12:11:03.793162 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.793328 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":255447,"prepare.queue_time_us":11313,"prepare.run_cpu_time_us":363,"prepare.run_wall_time_us":5278,"raft.queue_time_us":277258,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":44948224,"thread_start_us":583043,"threads_started":2,"wal-append.queue_time_us":310140}
W20260709 12:11:03.921548 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 81974.1us
W20260709 12:11:03.930951 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 83403.8us
I20260709 12:11:03.932375 25450 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:03.934331 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:03.939900 25232 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.940382 25232 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.942405 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:03.943169 22192 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:03.943862 25474 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:03.944459 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1939) took 1255 ms. Trace:
I20260709 12:11:03.944984 22271 rpcz_store.cc:276] 0709 12:11:02.689364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.787209 (+ 97845us) service_pool.cc:224] Handling call
0709 12:11:02.802200 (+ 14991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.972099 (+169899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.944178 (+972079us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540026bbd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:03.944392 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388924800}
I20260709 12:11:03.946379 25474 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:03.951835 25398 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.953229 25355 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:03.954154 25355 consensus_queue.cc:1243] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:11:03.952448 25398 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:03.955822 25377 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:03.956239 25377 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:03.956751 25398 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:03.957118 25377 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:03.910095 25422 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:03.962437 25422 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:03.970505 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.979925 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.985986 22265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.022s	sys 0.061s
W20260709 12:11:03.986446 22265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.022s	sys 0.061s
W20260709 12:11:03.981125 25026 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.005s
I20260709 12:11:03.994597 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:11:03.992849 25456 consensus_meta.cc:287] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.790s	user 0.010s	sys 0.003s
I20260709 12:11:03.978201 25420 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:11:04.010591 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 138520us
I20260709 12:11:03.968228 25232 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.998819 22121 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:11:04.059366 22121 pending_rounds.cc:85] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 4
I20260709 12:11:04.062876 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:04.078325 22121 pending_rounds.cc:107] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:11:04.006285 25399 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.080328 22121 raft_consensus.cc:2889] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:04.061069 25474 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.994733 25476 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.005757 25465 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.049053 25213 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.008013 25363 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:04.086234 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.080541 25399 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.089649 25474 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.093755 25399 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:04.094421 25474 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.089983 25476 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:04.097819 25482 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:11:04.098415 25377 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:04.099505 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 1929) took 1573 ms. Trace:
I20260709 12:11:04.099903 22272 rpcz_store.cc:276] 0709 12:11:02.525797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.527168 (+  1371us) service_pool.cc:224] Handling call
0709 12:11:02.527472 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.920889 (+393417us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:02.941749 (+ 20860us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.438896 (+497147us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b18003e02c0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a 00007fcceddcca2a
0709 12:11:03.800250 (+361354us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.812939 (+ 12689us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.813083 (+   144us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:03.813118 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.813189 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.963744 (+150555us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b18003e02c0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:11:04.099251 (+135507us) raft_consensus.cc:1685] finished
0709 12:11:04.099276 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.099435 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":457596,"prepare.queue_time_us":20626,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":441731,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":33621,"spinlock_wait_cycles":46712064,"thread_start_us":320832,"threads_started":1,"wal-append.queue_time_us":868022}
I20260709 12:11:04.102154 22263 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:11:04.103221 25450 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.103755 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 1944) took 1417 ms. Trace:
I20260709 12:11:04.104135 22263 rpcz_store.cc:276] 0709 12:11:02.686431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.751152 (+ 64721us) service_pool.cc:224] Handling call
0709 12:11:04.101859 (+1350707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:04.102584 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.103554 (+   970us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400160dd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:04.103691 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3105643392}
I20260709 12:11:04.087436 25363 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.145056 25420 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.149165 25325 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:04.158823 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 103135us
I20260709 12:11:04.160032 22088 leader_election.cc:400] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:11:04.160310 22088 leader_election.cc:403] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:11:04.090512 25213 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.160872 25438 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 4. Current term is 5.
I20260709 12:11:04.162840 25213 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.170941 25351 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.105165 25465 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.175576 25465 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.176437 25363 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.184247 25476 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.187469 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:04.189646 22087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.015s	sys 0.023s
W20260709 12:11:04.190213 22087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.015s	sys 0.023s
I20260709 12:11:04.188637 22192 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:04.260843 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:04.261806 22272 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
W20260709 12:11:04.265033 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 105145us
W20260709 12:11:04.281292 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 489672us
W20260709 12:11:04.283026 22236 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.627s (SENT)
I20260709 12:11:04.237942 25325 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.295188 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.305452 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:04.305915 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:04.319861 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1911) took 1706 ms. Trace:
I20260709 12:11:04.295178 25456 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:04.325069 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.325906 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:04.320351 22115 rpcz_store.cc:276] 0709 12:11:02.597616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.606591 (+  8975us) service_pool.cc:224] Handling call
0709 12:11:02.622030 (+ 15439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.859041 (+237011us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:02.901204 (+ 42163us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.321744 (+420540us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.350041 (+ 28297us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:03.646807 (+296766us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.795474 (+148667us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.795676 (+   202us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:04.289062 (+493386us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.289465 (+   403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.303614 (+ 14149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.303687 (+    73us) raft_consensus.cc:1685] finished
0709 12:11:04.303704 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.303869 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":527476,"prepare.queue_time_us":250466,"prepare.run_cpu_time_us":150,"prepare.run_wall_time_us":7111,"raft.queue_time_us":373168,"raft.run_cpu_time_us":630,"raft.run_wall_time_us":75895,"spinlock_wait_cycles":6611200,"thread_start_us":950077,"threads_started":4,"wal-append.queue_time_us":155098}
I20260709 12:11:04.316015 25438 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:04.303493 25450 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:04.337399 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:04.337599 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:04.314913 25473 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:04.319238 25474 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:04.341370 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.357589 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:04.342141 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:04.367215 22263 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:04.371089 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:04.372212 22191 raft_consensus.cc:2393] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:04.315317 25325 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:04.378954 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53120.2us
I20260709 12:11:04.379792 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:04.357208 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:04.374293 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:04.369174 25230 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:04.383002 25230 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.355450 25438 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.385502 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:04.395233 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:04.396015 22119 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:11:04.324905 25484 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.385670 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:04.416533 22193 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:04.411933 22190 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:04.419727 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:04.420148 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:04.420867 22192 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:04.436940 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:04.421067 22119 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:04.454560 22270 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:11:04.376240 25413 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:04.333189 25456 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.329672 25465 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:11:04.410514 25474 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.467514 25230 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:04.468441 25422 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:04.452437 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:04.473567 22197 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:04.491034 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.460167 25413 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.472541 25484 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.524049 25363 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.452982 25365 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:11:04.528403 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:04.481371 25474 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.484429 25465 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.471019 25377 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:11:04.520370 25360 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.375876 25450 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.471345 25485 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:04.528018 25413 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.376938 25473 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.559999 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:04.562873 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 208715us
W20260709 12:11:04.566784 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 107273us
W20260709 12:11:04.569897 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 232633us
W20260709 12:11:04.569977 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 165571us
I20260709 12:11:04.570919 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:04.484278 25422 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.573117 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:04.572630 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:04.573724 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.576378 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:04.574123 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 203944us
I20260709 12:11:04.572456 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:04.556641 25380 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:04.549815 25420 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:04.584098 25438 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.603130 25438 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:04.603571 25438 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.603936 25438 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.609961 25325 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:04.586953 25380 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.613734 25380 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:04.615517 25232 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.001s
I20260709 12:11:04.610579 25498 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.567111 25360 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.619194 25360 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.620364 22197 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:04.608897 25420 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.630884 25420 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:04.616016 25232 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:04.639384 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.565886 25465 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.644340 25465 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:04.646454 25497 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:11:04.648138 25495 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:11:04.573966 25484 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:11:04.650207 25484 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:04.650599 25484 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:04.597039 25493 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:04.651468 25493 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.651912 25493 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.651607 25484 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.655699 25363 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:04.656749 25407 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:04.657316 25407 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.657696 25407 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.662194 25473 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:04.663548 25456 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:04.578634 25474 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.669085 25407 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.670262 25422 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:04.567361 25485 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.671452 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1934) took 1218 ms. Trace:
I20260709 12:11:04.601284 22123 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:04.673807 25485 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:04.671842 22122 rpcz_store.cc:276] 0709 12:11:03.452946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.453815 (+   869us) service_pool.cc:224] Handling call
0709 12:11:03.454140 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.789126 (+334986us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:03.841014 (+ 51888us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.284716 (+443702us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:04.300663 (+ 15947us) log.cc:844] Serialized 26 byte log entry
0709 12:11:04.300852 (+   189us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:04.301114 (+   262us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.301326 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.398925 (+ 97599us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b180027bf20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:11:04.626937 (+228012us) spinlock_profiling.cc:243] Waited 9.85 ms on lock 0x7b180027bf20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:11:04.671107 (+ 44170us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b5400152a54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:04.671172 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.671223 (+    51us) raft_consensus.cc:1685] finished
0709 12:11:04.671248 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.671393 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31304,"prepare.queue_time_us":193098,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":159168,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":28801,"spinlock_wait_cycles":176735232,"thread_start_us":443038,"threads_started":1,"wal-append.queue_time_us":495210}
I20260709 12:11:04.676692 22270 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:04.597666 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:04.679311 25450 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.680068 25475 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:04.680681 25475 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.682964 25475 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.684830 25187 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.478502 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:04.691906 25484 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:04.707391 22018 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 234) took 34508 ms (client timeout 15000 ms). Trace:
W20260709 12:11:04.708464 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 110886us
I20260709 12:11:04.708866 25493 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.725169 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:04.736640 22122 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:04.726365 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:04.737838 22123 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:11:04.727463 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:04.730643 25484 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:04.735225 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:04.739064 22117 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:04.749938 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:04.772549 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:04.765174 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 187545us
I20260709 12:11:04.778512 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:04.779260 22864 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:04.671785 25407 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:04.776882 25422 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:04.741755 25450 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:04.735868 22018 rpcz_store.cc:269] 0709 12:10:30.198897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.209382 (+ 10485us) service_pool.cc:224] Handling call
0709 12:10:30.744151 (+534769us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:04.707272 (+33963121us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:01.386092 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:01.386898 (+   806us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:01.386958 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:11:01.386982 (+    24us) tablet.cc:662] Decoding operations
0709 12:11:01.387809 (+   827us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:01.387918 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:01.387970 (+    52us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:11:01.388753 (+   783us) tablet.cc:701] Row locks acquired
0709 12:11:01.407590 (+ 18837us) write_op.cc:260] PREPARE: finished
0709 12:11:01.421453 (+ 13863us) write_op.cc:270] Start()
0709 12:11:01.441011 (+ 19558us) write_op.cc:276] Timestamp: P: 1783599061416409 usec, L: 0
0709 12:11:01.442841 (+  1830us) op_driver.cc:348] REPLICATION: starting
0709 12:11:01.541874 (+ 99033us) log.cc:844] Serialized 2109 byte log entry
0709 12:11:02.051996 (+510122us) op_driver.cc:464] REPLICATION: finished
0709 12:11:02.529442 (+477446us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcceacb80ac 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fccf17f8ef0
0709 12:11:02.632664 (+103222us) write_op.cc:301] APPLY: starting
0709 12:11:02.632811 (+   147us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:02.632998 (+   187us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:02.633035 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:02.633961 (+   926us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:02.634266 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:11:02.634315 (+    49us) write_op.cc:312] APPLY: finished
0709 12:11:02.634627 (+   312us) log.cc:844] Serialized 47 byte log entry
0709 12:11:02.634848 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:02.634965 (+   117us) write_op.cc:454] Released schema lock
0709 12:11:02.635039 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:02.635504 (+   465us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:02.635533 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2095,"reported_tablets":38,"spinlock_wait_cycles":867427072,"child_traces":[["op",{"apply.queue_time_us":571098,"apply.run_cpu_time_us":2836,"apply.run_wall_time_us":2838,"num_ops":5,"prepare.queue_time_us":135035,"prepare.run_cpu_time_us":28739,"prepare.run_wall_time_us":279898,"raft.queue_time_us":104076,"raft.run_cpu_time_us":14996,"raft.run_wall_time_us":605262,"replication_time_us":551515,"spinlock_wait_cycles":3216640,"thread_start_us":714851,"threads_started":4,"wal-append.queue_time_us":155093,"wal-append.run_cpu_time_us":21114,"wal-append.run_wall_time_us":2083272}]]}
I20260709 12:11:04.773535 25380 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.781471 25232 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.782325 25485 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:11:04.778725 25505 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:04.859941 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 283160us
I20260709 12:11:04.789976 25422 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.857849 22020 catalog_manager.cc:5697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:04.891402 22020 catalog_manager.cc:5697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:04.765190 25438 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.900461 22831 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:04.896071 22020 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:04.781591 25475 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:04.863540 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:04.867959 25450 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:04.868609 25502 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:04.911947 25502 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.914211 25502 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:04.914026 25413 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:04.872859 22088 connection.cc:256] RPC call timeout handler was delayed by -1.930226828000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 12:11:04.915429 22088 connection.cc:256] RPC call timeout handler was delayed by -1.6098268279999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:11:04.915895 22088 connection.cc:256] RPC call timeout handler was delayed by -1.2711886909999066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
I20260709 12:11:04.916343 25413 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.916635 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:04.917438 25369 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:04.918133 22088 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:11:04.874900 22236 leader_election.cc:336] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.518s (SENT)
I20260709 12:11:04.918977 22859 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:04.919100 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:04.920320 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45455.9us
W20260709 12:11:04.921657 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.921608 25422 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:04.876228 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:04.922760 22857 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:04.922892 25406 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.923343 25406 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.923699 25406 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.905134 25349 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.925531 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:04.926237 22121 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.929490 25493 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.925580 25349 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.930505 25485 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:04.911250 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:04.931813 25349 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:04.865582 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:04.882735 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:04.934295 22197 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.934407 22267 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:11:04.905746 22192 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:04.936614 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:04.937633 22119 raft_consensus.cc:2410] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:04.938679 25406 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.961140 25422 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:04.910485 25380 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.910578 25475 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:04.871790 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:04.997129 22120 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.931640 25450 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:04.904752 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:04.998210 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 427132us
I20260709 12:11:04.940719 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:04.943367 25456 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:04.943477 25438 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.945375 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:04.947788 25484 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.948323 25505 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:04.949563 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:11:05.015172 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 65703.4us
I20260709 12:11:05.016242 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:04.950726 22270 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:04.952814 22271 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:05.018296 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:04.953536 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:04.954510 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:05.019348 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64940.3us
I20260709 12:11:04.956156 25506 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.957592 22197 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:04.909376 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:04.962164 22858 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:04.963953 25406 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:04.965111 24464 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.903364 22020 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:04.966424 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:04.970819 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:04.976723 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:04.982803 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:04.985435 22121 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:05.031999 22119 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.988168 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:04.995129 22236 leader_election.cc:336] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.995s (SENT)
I20260709 12:11:05.032861 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:05.031105 22263 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:05.007606 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:05.008637 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:05.033830 22268 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:11:05.012310 22269 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.009650 25485 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:04.940227 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45500.8us
W20260709 12:11:05.047262 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60276.2us
I20260709 12:11:05.047571 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.031380 22272 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:05.030010 24464 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:05.038866 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.040139 22116 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:11:05.050326 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:05.045251 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50141.9us
I20260709 12:11:05.051239 22123 raft_consensus.cc:2410] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:05.011270 25512 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:05.031091 22020 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 6, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 6 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:05.054397 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:05.054596 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:05.055629 22121 raft_consensus.cc:2376] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5. Re-sending same reply.
I20260709 12:11:05.055034 22020 catalog_manager.cc:5697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.059439 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.058876 22020 catalog_manager.cc:5697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.053431 25420 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.061791 24464 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:05.062463 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.062721 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:05.063338 22192 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.062852 22020 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.064565 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:05.064862 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.065070 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.065312 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.066318 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:05.066671 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:05.068393 22114 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.069721 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.024154 25505 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:04.996991 25422 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:05.014293 25456 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:05.073246 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.074350 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.075542 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.085022 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.078975 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:05.046253 25501 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.091276 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.064869 22020 catalog_manager.cc:5697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.086541 22264 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.089105 22114 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:05.089048 22865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:05.094785 22865 raft_consensus.cc:606] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:05.095091 22114 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:05.095332 22865 raft_consensus.cc:614] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:05.096560 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.096827 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:05.097232 22122 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:05.097571 22121 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.093150 22020 catalog_manager.cc:5697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.063725 25502 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.102036 22237 leader_election.cc:400] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:05.105444 22237 leader_election.cc:403] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:05.107359 25505 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.109688 25475 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:05.063591 25485 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:05.113267 25485 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:05.062297 25512 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:05.115440 25512 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:05.116091 22264 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:05.116638 25420 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:05.104602 25502 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:05.117467 25502 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.118198 22116 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:05.121001 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.122881 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:05.123770 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.099135 22020 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 6, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 6 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.123466 22116 raft_consensus.cc:2376] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7. Re-sending same reply.
I20260709 12:11:05.153407 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.154461 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.146586 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.156008 22122 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:05.081033 25351 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.161358 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:05.163620 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:05.148787 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 56430.1us
I20260709 12:11:05.165131 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:05.149809 22123 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:05.090896 25501 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:05.149057 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 102063us
I20260709 12:11:05.152264 22119 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:05.117233 22271 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 2.
I20260709 12:11:05.169411 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:05.172130 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.155072 22116 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:05.173025 25370 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:05.173528 25365 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.174201 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:05.174475 22193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:05.149761 22121 raft_consensus.cc:2410] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:05.176057 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.176128 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:05.169696 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52643.6us
I20260709 12:11:05.035851 25506 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.181195 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.241905 22115 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 2.
I20260709 12:11:05.187502 22020 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:05.246423 22020 catalog_manager.cc:5697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 5, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.247360 22192 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:05.248009 22020 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 5, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.154327 25390 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.189553 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.270789 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.271592 22119 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:05.191005 22122 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:05.193600 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:05.197845 22193 raft_consensus.cc:606] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:05.209059 22117 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:05.212596 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:05.274770 22020 catalog_manager.cc:5697] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 5, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.276196 22267 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:05.213004 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:05.277223 22020 catalog_manager.cc:5697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.278441 22114 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:11:05.254717 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:05.279866 22115 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.279420 22020 catalog_manager.cc:5697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.187685 25512 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.214623 22263 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:11:05.281446 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.215482 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:05.282832 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 67448.4us
I20260709 12:11:05.258409 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.217913 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:05.285275 22268 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.259147 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.220363 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.222930 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:05.287019 22266 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.171038 25485 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.262037 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.287664 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:05.290006 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.187901 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:05.213529 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:05.240865 24464 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:05.213397 22269 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:05.292196 22123 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:05.292059 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 104267us
I20260709 12:11:05.293831 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:05.294724 24464 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.180733 22120 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:05.299157 22196 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:05.299925 22189 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:11:05.239281 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44824.9us
I20260709 12:11:05.182533 25450 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:05.195273 25501 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.250036 25406 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.304225 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.210348 25456 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:05.216892 25500 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:05.301055 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.308935 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:05.336663 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 84241us
I20260709 12:11:05.309824 24464 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:05.310016 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.313723 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.315192 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.212543 25506 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:05.236547 25465 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.214501 25370 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:05.318943 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:05.401079 22196 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:05.226194 25422 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:05.378477 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:05.404228 22267 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:05.303093 25438 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.299626 25348 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:05.196492 25365 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:05.299045 25129 raft_consensus.cc:2764] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:05.394675 22198 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:05.391136 25450 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.392836 22192 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:05.398777 22268 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:05.455273 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:05.405911 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:05.421696 25516 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 12:11:05.406908 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 119409us
I20260709 12:11:05.186169 25484 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.199s
I20260709 12:11:05.413053 22191 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:05.418661 22115 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:05.476039 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:05.476437 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 182721us
W20260709 12:11:05.407035 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 237703us
I20260709 12:11:05.477706 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:05.478466 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:05.321113 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.305022 25474 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:11:05.290511 25390 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:05.395879 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:05.432092 25398 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.422387 25472 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.437328 25380 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.438401 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:05.489697 22272 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:05.438627 25503 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.440222 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:05.491989 22121 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:05.494546 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:05.440559 25509 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:05.497810 25503 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.498397 25474 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:05.498951 25474 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:05.445272 25370 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.499853 25474 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:05.404202 25465 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:05.339653 25406 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.468761 25348 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:05.518378 25406 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:05.517899 25348 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.450119 22197 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:05.490103 25523 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.522670 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:05.501536 25398 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.525876 22865 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:05.527168 25398 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:05.528123 25474 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.529340 22190 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:05.403070 25456 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.403270 22020 catalog_manager.cc:5697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.538491 22194 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:11:05.537905 22020 catalog_manager.cc:5697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.463446 22123 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:05.468214 22266 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:05.482137 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:05.542178 22268 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:11:05.539808 25513 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.466s	user 0.005s	sys 0.000s
I20260709 12:11:05.539605 25465 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:05.539618 22020 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 8, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.485054 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:05.544209 22020 catalog_manager.cc:5697] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 1 to 5, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.546643 22859 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:05.546458 22020 catalog_manager.cc:5697] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 4, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.487331 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:05.548812 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 61517.4us
I20260709 12:11:05.549877 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:05.476090 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 53118.3us
I20260709 12:11:05.449549 25365 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:05.482764 22269 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.554288 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:05.485028 25472 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.566205 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.559921 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:05.567016 22195 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:05.567605 22192 raft_consensus.cc:2410] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:05.569315 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:05.566605 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.548014 22020 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:05.580107 25512 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:05.580960 22020 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 6, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 6 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.580109 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:05.583775 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 106172us
I20260709 12:11:05.583549 22020 catalog_manager.cc:5697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.584851 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:05.585491 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:05.585289 22020 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 7, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.586583 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:05.586757 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:05.587015 22020 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 4, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.589659 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:05.589977 22020 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 6, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 6 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:05.591625 22020 catalog_manager.cc:5697] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 6, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 6 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.560675 25506 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.593168 22020 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.574126 25472 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.589109 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:05.605643 22269 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:05.605798 25506 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.582929 25500 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:05.565454 25523 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.501348 25380 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.578234 25422 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.556746 25501 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.540504 25450 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:11:05.589916 25505 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.621192 25506 raft_consensus.cc:2764] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:05.622799 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.623490 25380 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:05.623903 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.621232 25505 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:05.582981 25420 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:05.618943 25502 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 12:11:05.626638 25502 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.627096 25500 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:05.593302 25484 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:05.593463 25525 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.624966 25505 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.602084 25363 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.625779 22866 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 8: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:05.619558 25411 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.634663 25411 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.629115 25484 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:05.635094 25411 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.635304 25484 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.629590 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:05.637493 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:05.623514 22121 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:05.634482 22116 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:05.640518 22116 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:05.642570 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.643260 22121 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:05.615356 22020 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:05.645547 22271 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:05.646245 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:05.650468 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 61443.5us
I20260709 12:11:05.656332 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.657402 22122 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:11:05.877636 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 231472us
I20260709 12:11:05.625823 25501 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:05.882102 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:05.628736 25502 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:05.893700 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 269769us
I20260709 12:11:05.619242 25390 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:05.888639 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:05.629508 25525 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:05.659106 25450 consensus_queue.cc:1243] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:05.908540 22272 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:05.879153 22020 catalog_manager.cc:5697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 7, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.930526 25525 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.932372 22859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:05.934904 22020 catalog_manager.cc:5697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.884824 25380 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.933327 22859 raft_consensus.cc:606] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:05.941365 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:05.943449 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:05.905030 25524 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.903625 25025 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.956269 22020 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:05.989918 22020 catalog_manager.cc:5697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 5, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.943579 25514 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:05.993693 25025 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.017711 22088 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:06.019631 25524 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:06.036904 25529 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:11:06.042547 22859 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:06.046494 25502 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:06.007679 25514 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:06.052611 25514 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.068071 25411 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.070676 25411 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:06.073827 22859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:06.074928 22859 raft_consensus.cc:606] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:06.081810 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:06.082628 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:06.079486 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 200372us
W20260709 12:11:06.086614 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 496980us
I20260709 12:11:06.120971 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:06.085306 25466 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.209432 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:06.210423 22862 raft_consensus.cc:606] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:06.227337 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:06.228153 22862 raft_consensus.cc:606] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:06.240954 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 155320us
I20260709 12:11:06.236321 25502 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:06.248063 25502 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.251050 25502 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:06.254140 25525 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.259888 22857 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
W20260709 12:11:06.261682 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 140867us
I20260709 12:11:06.263336 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:06.263387 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:06.265916 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 179660us
I20260709 12:11:06.268307 25525 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:06.269433 25502 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.269956 25538 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:06.270717 25540 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:06.271266 25540 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:06.262372 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:06.271889 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:06.272146 25540 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.272675 25538 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.273902 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:06.274718 25538 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.276988 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:06.278558 25474 consensus_meta.cc:287] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.004s
I20260709 12:11:06.278852 25538 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:06.279590 25538 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:06.280004 25538 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.264734 25422 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:06.270011 25502 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.278630 25503 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:06.288072 22237 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:06.288094 25502 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:06.290473 25484 consensus_meta.cc:287] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.002s
I20260709 12:11:06.291085 25484 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.291823 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:06.292338 25533 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:06.292829 25533 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.293210 25533 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.294096 25538 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.297137 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:06.297173 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:06.257640 25505 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.003s
I20260709 12:11:06.301254 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:06.274538 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:06.306885 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:06.310105 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:06.329869 22119 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:06.333992 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:06.335060 22119 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:06.309264 25536 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:06.309528 25502 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:06.318986 25422 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.319466 25512 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:11:06.380502 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 73684us
I20260709 12:11:06.370847 25536 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:06.382633 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 72636.9us
I20260709 12:11:06.374537 25538 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:06.321288 25505 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.389566 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:06.390631 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:06.381397 25465 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:11:06.399673 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 80092.6us
I20260709 12:11:06.383741 25422 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:06.399175 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:06.401309 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:06.379215 25502 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.386222 25536 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.403359 22194 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:11:06.393025 22007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f86b841ece254f9bbfd1bd07c08f7004 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cc9b9c8894084021a0c6ddaf659d222e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:06.408838 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1735) took 1154 ms. Trace:
I20260709 12:11:06.409286 22190 rpcz_store.cc:276] 0709 12:11:05.257288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.257430 (+   142us) service_pool.cc:224] Handling call
0709 12:11:05.281403 (+ 23973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.529761 (+248358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.408504 (+878743us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400109fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:06.408719 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539022080}
I20260709 12:11:06.415156 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:06.428105 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:06.429549 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:06.430284 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:06.422331 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:06.423251 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:06.436067 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:06.438611 22122 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:11:06.415953 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:06.391309 25512 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:06.450891 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:06.399765 25485 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:11:06.442556 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:06.452322 22265 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:06.443499 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:06.402441 25538 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.403752 25422 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.465408 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:06.466878 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:06.465786 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:06.467557 22194 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.468079 22118 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:06.471235 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:06.472671 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:06.473534 22269 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:06.457238 25485 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:06.465190 25026 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.476046 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:06.415812 25465 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:06.450146 25540 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:11:06.414592 25547 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.456342 25549 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:06.467365 25474 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:06.482753 25502 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:06.475310 25485 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:06.441365 25484 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:06.477160 25026 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.488647 25509 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.485116 25547 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:06.494726 25026 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.496302 25547 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.412742 25533 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.499269 25533 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:06.484674 25540 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:06.505012 25540 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:06.480418 25512 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:06.476984 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:06.502489 25549 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:06.513135 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:06.501297 25509 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.490692 25546 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:11:06.520673 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43787.1us
I20260709 12:11:06.526818 24464 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:06.532861 24464 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.533296 24464 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.534379 25505 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:06.534742 22197 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:06.535096 25465 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.537705 25549 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.495689 25474 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.544272 25474 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:06.545492 22190 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:06.527540 22866 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:06.556730 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:06.556875 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:06.559206 25026 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.573873 25026 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:06.514943 25512 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.578948 25512 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:06.582310 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:06.568266 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:06.589646 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:06.590823 22270 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:06.531077 25509 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.578977 22194 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
W20260709 12:11:06.592710 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 59836.7us
I20260709 12:11:06.593660 25493 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.595108 25456 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:06.624964 24464 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.627507 24464 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:06.616017 25025 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:06.629663 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:06.630378 22114 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:06.613869 25456 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:06.630517 25370 raft_consensus.cc:993] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:06.636042 25456 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.639225 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:06.650293 22119 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.613626 25548 raft_consensus.cc:2764] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:06.616600 25552 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.652565 25552 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.655529 25552 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:06.660565 22116 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.661619 22116 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.676015 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:06.679970 22116 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:11:06.682216 22116 pending_rounds.cc:85] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 4
I20260709 12:11:06.683306 22116 pending_rounds.cc:107] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:11:06.684441 22116 raft_consensus.cc:2889] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:06.687556 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 1966) took 1484 ms. Trace:
I20260709 12:11:06.650959 25370 raft_consensus.cc:1081] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:06.699504 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:06.701192 22866 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:06.702523 22197 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:11:06.719413 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:06.720345 22123 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:06.725919 22123 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:06.703600 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:06.735285 22198 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:06.705751 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:06.735555 22192 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:06.704154 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:06.736678 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:06.618177 25472 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.953s	user 0.007s	sys 0.006s
W20260709 12:11:06.743029 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.744228 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:06.745587 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:06.691041 25438 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:11:06.744037 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:06.761972 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:06.676945 25456 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.763533 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:06.764571 22191 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:06.765156 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:06.760241 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 284277us
I20260709 12:11:06.689447 22116 rpcz_store.cc:276] 0709 12:11:05.202696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.283898 (+ 81202us) service_pool.cc:224] Handling call
0709 12:11:05.284305 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.634379 (+350074us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540009a220. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc41c0 00007fcceddc5231 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c
0709 12:11:06.660262 (+1025883us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540009a220. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd4006f 00007fcceddb8f60 00007fcceddba7de 00007fcceddc4b49 00007fcceddc5416 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62
0709 12:11:06.686366 (+ 26104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.687475 (+  1109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099662976}
I20260709 12:11:06.678397 25552 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:06.774011 22190 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:06.777724 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:06.787101 22121 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.798888 22236 leader_election.cc:400] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:06.782382 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:06.815930 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 278563us
I20260709 12:11:06.822630 22830 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:06.826373 22119 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:06.828409 25348 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.830194 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:06.673651 25536 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.760987 25512 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:06.835425 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:11:06.842010 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 221386us
I20260709 12:11:06.816169 25546 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:06.848652 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 69491us
I20260709 12:11:06.849349 24464 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:06.860790 24464 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.860862 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:06.861514 24464 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.861815 22263 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:06.825474 25525 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:06.869031 22265 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:06.756757 25472 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.871830 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:06.874871 22196 raft_consensus.cc:2368] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:06.877051 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:06.877645 22272 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:11:06.877959 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47826.2us
I20260709 12:11:06.816752 25552 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.915069 24464 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.869472 25411 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:06.919638 22121 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:06.920840 22194 raft_consensus.cc:2368] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
W20260709 12:11:06.880625 25363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.003s	sys 0.016s
I20260709 12:11:06.838587 25348 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:11:06.841068 25535 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 12:11:06.929335 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 50103.7us
I20260709 12:11:06.929658 24464 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:06.925851 25363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.004s	sys 0.016s
I20260709 12:11:06.857659 25512 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:06.910621 25540 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:06.971319 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 121901us
W20260709 12:11:06.976794 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43611.1us
I20260709 12:11:06.955650 25411 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:06.873725 25525 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:06.985117 25554 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:06.921856 22263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:11:06.994542 22263 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:06.994961 22263 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.925680 25546 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:11:07.001132 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 128122us
W20260709 12:11:07.001132 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 70647.2us
I20260709 12:11:07.005525 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:06.986800 25472 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:06.958737 25538 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:11:06.987726 25502 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.011461 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:07.011598 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:07.022075 25411 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:07.026111 25557 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.091s	user 0.002s	sys 0.000s
I20260709 12:11:07.026752 25512 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:07.027326 25512 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:06.990362 25558 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:11:07.027828 25512 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.029050 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:07.030136 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:07.030637 22268 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.031845 22266 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:11:07.034771 22263 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.003482 25258 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 12:11:07.050195 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44751.5us
I20260709 12:11:07.051328 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:07.051594 22864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56950 (request call id 563) took 1590 ms. Trace:
I20260709 12:11:07.052151 22864 rpcz_store.cc:276] 0709 12:11:05.454583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.454699 (+   116us) service_pool.cc:224] Handling call
0709 12:11:05.475135 (+ 20436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:05.505909 (+ 30774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.505956 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:05.521465 (+ 15509us) log.cc:844] Serialized 52 byte log entry
0709 12:11:06.759547 (+1238082us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b1800418660. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:11:06.989833 (+230286us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:06.989880 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.990905 (+  1025us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.031543 (+ 40638us) raft_consensus.cc:1685] finished
0709 12:11:07.031561 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.045177 (+ 13616us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14167,"raft.queue_time_us":15028,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":12909,"spinlock_wait_cycles":48372992,"thread_start_us":230078,"threads_started":1,"wal-append.queue_time_us":1494163}
I20260709 12:11:07.058511 25438 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:07.059057 25438 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.059437 25438 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.065371 22271 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.066625 25571 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.067481 25571 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.067942 25571 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.068977 25546 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.070071 25540 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:07.070847 25540 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.071375 25540 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.077746 25552 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:07.080317 25536 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:07.081058 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 48895.8us
I20260709 12:11:07.084391 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:07.080503 25547 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.005s
I20260709 12:11:07.090005 22263 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:07.091250 25422 consensus_meta.cc:287] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.000s
I20260709 12:11:07.041464 25528 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:11:07.019187 25502 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.119465 22272 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
W20260709 12:11:07.122227 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 110742us
I20260709 12:11:07.122242 22268 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:07.126932 25569 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.104045 25349 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:11:07.098196 25512 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.142408 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:07.095929 25574 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.145083 25502 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:07.147521 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:07.151418 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:07.097945 25571 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.121641 25533 raft_consensus.cc:2764] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:07.155824 22236 leader_election.cc:400] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:07.092093 25547 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.098141 25540 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:07.169092 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:07.169966 22194 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:07.170588 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:07.170897 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:07.171267 22197 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.173454 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:07.178225 22192 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:11:07.150528 25485 consensus_meta.cc:287] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.646s	user 0.013s	sys 0.001s
W20260709 12:11:07.154654 25509 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.517s	user 0.000s	sys 0.011s
I20260709 12:11:07.149732 25569 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.149482 25466 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:11:07.189393 25466 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:07.189857 25466 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:07.190815 25466 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.192116 25466 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.166271 25575 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:07.193322 25575 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.158447 25525 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:07.163985 22236 leader_election.cc:403] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:07.153363 25380 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.182385 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:07.095182 25422 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.197949 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:07.217460 22264 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.198330 22197 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:07.201851 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:07.162554 25538 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.163879 25552 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.160415 25512 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:07.221823 25547 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.222080 25422 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.149372 25536 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:11:07.213356 25509 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.218497 22191 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:07.215551 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:07.197165 25485 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.239848 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:07.246462 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:07.247669 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:07.249186 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:07.250321 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:07.251042 22123 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.253851 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:07.254807 22114 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.218427 25571 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:11:07.269639 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 185975us
I20260709 12:11:07.195716 25569 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:07.273567 22114 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:07.281605 22190 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:11:07.231130 25380 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:07.307695 22119 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:11:07.237309 25554 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.241135 25525 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.245522 25540 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.264580 25475 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.274094 25512 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.245173 25574 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.244959 25552 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:07.223296 25538 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.324820 22267 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:07.342553 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:07.306951 25547 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.328660 25568 raft_consensus.cc:993] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:07.324903 25353 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:07.276968 25576 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.332835 22237 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:07.307286 25575 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:07.361855 25576 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:07.363049 25578 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.134s	user 0.001s	sys 0.003s
I20260709 12:11:07.366360 25538 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.367978 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:07.369513 22272 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.349682 25547 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.344147 22123 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:07.311401 25569 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:07.343019 25512 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:07.377333 25569 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.378520 25512 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.379681 25569 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:07.343148 25540 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.340250 25525 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.382210 25540 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:07.382586 25525 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:07.339411 25475 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.383558 25552 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.384605 25475 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:07.385838 25509 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:07.386976 25438 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.389158 22116 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:07.348088 25574 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.364473 25576 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:07.397583 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:07.398378 22270 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:07.332840 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 281577us
I20260709 12:11:07.348119 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:07.405293 22866 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.353103 25401 raft_consensus.cc:1081] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:07.410166 22193 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.354353 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:07.355017 25554 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.404856 25569 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.417073 25569 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.419744 25569 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.420127 25554 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.352916 25485 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.356168 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:07.352970 25380 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:07.363201 25456 consensus_meta.cc:287] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.002s
W20260709 12:11:07.331003 25567 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:11:07.372502 25547 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.450762 22270 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:07.406710 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:07.410120 25538 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.452706 22195 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:11:07.452989 25538 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.453763 25422 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.413686 22272 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:07.455237 25538 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.415231 22858 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:07.455440 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:07.455770 22858 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:07.426652 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:07.431483 22866 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:07.456859 22272 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:07.609822 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 203195us
I20260709 12:11:07.622210 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:07.625671 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:07.627483 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:07.637897 22163 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:07.471993 22269 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:11:07.667095 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:07.671252 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:07.457098 25576 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.585217 25401 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.588001 25456 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.590499 25538 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.590204 25547 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.597466 25475 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:07.677420 22087 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:07.459797 25438 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:07.610783 25568 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:07.647389 25525 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.680343 22864 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:07.681066 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:07.646955 25540 raft_consensus.cc:2764] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:11:07.666647 25025 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.437258 25369 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.240s
I20260709 12:11:07.684024 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:07.683780 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:07.693492 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:07.679415 25456 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.672143 25466 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.676025 25576 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:07.697420 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:07.675535 25580 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.678433 25026 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.437717 25554 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.690393 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:07.698984 25525 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.703161 25581 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.704603 25456 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.716974 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:07.717518 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:07.717398 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:07.727185 22123 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:07.718559 22121 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:11:07.684414 25538 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.707734 25540 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:07.708638 25576 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.722667 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:07.752303 22122 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 3: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:07.702486 25438 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.685032 25547 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.723997 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:07.755787 22117 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:07.683939 25484 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:11:07.710705 25025 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:07.691670 25568 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.758309 25025 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.760795 25568 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.761106 25456 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.719887 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:07.721290 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:07.761731 25456 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.749971 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:07.753614 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:07.764138 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:07.685261 25475 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.684090 25401 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.766366 22121 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
W20260709 12:11:07.767324 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 73942.7us
I20260709 12:11:07.768040 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:07.769261 22087 leader_election.cc:400] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
W20260709 12:11:07.768050 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 90937.9us
I20260709 12:11:07.772498 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:07.771567 25438 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:11:07.773641 25547 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:07.773949 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:07.715035 25580 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:07.782269 22119 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
W20260709 12:11:07.785454 25571 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.505s	user 0.002s	sys 0.008s
I20260709 12:11:07.785962 25571 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:07.772462 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:07.774241 22272 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:07.784344 25580 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:07.797333 22270 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:07.777127 25538 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.802623 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:07.776003 25401 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.805045 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:07.803603 22115 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:07.806574 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:07.794130 25552 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:07.802706 25475 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:07.827060 25552 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:07.806466 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:07.809129 22120 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:11:07.829118 22120 pending_rounds.cc:85] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 4
I20260709 12:11:07.829355 22120 pending_rounds.cc:107] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:07.829582 22120 raft_consensus.cc:2889] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.830696 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:07.832171 25512 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.831754 25538 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:07.833875 25538 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:07.834712 25554 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.836426 25538 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:07.837373 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:07.838888 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:07.839923 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:07.840750 22272 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 3: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:07.842337 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:07.843665 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:07.845381 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:07.846340 22265 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:11:07.847350 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:07.848111 22271 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:07.840626 22269 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:07.851187 22271 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:11:07.852033 22271 pending_rounds.cc:85] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 3
I20260709 12:11:07.852449 22271 pending_rounds.cc:107] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:11:07.852861 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:07.854368 22271 raft_consensus.cc:2889] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.865439 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:07.868706 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:07.871452 22266 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.868086 22263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:11:07.918706 22263 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:07.919174 22263 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:08.164358 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 308490us
I20260709 12:11:08.165827 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:08.167594 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:08.169621 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:08.278131 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 108572us
I20260709 12:11:08.279830 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:08.342646 22269 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:08.345283 22265 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:08.348708 25456 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:08.341197 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 177044us
I20260709 12:11:08.354007 22266 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.357558 22271 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:08.282578 25546 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.165518 25571 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:08.163961 25484 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.339298 25549 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.163715 25580 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.164422 25475 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.282330 25554 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.433600 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:08.466560 22263 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:08.470840 22272 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:08.437844 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 83921.4us
I20260709 12:11:08.192265 25438 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.272135 25525 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.350893 25540 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.480436 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:08.272344 25512 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.168s
W20260709 12:11:08.508015 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 228272us
I20260709 12:11:08.509373 22866 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:08.445837 25546 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.368130 25547 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 12:11:08.429720 25456 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.457716 25571 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:08.532763 22114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.075s	sys 0.187s
W20260709 12:11:08.541740 22114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.076s	sys 0.187s
I20260709 12:11:08.540951 22263 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:08.482923 25554 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.550334 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2007) took 1925 ms. Trace:
I20260709 12:11:08.457494 25025 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:11:08.516610 25475 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.584080 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:34878 (request call id 618) took 1104 ms. Trace:
I20260709 12:11:08.534528 25546 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.595044 22263 rpcz_store.cc:276] 0709 12:11:07.438217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.867967 (+429750us) service_pool.cc:224] Handling call
0709 12:11:08.542930 (+674963us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.470316 25484 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.470043 25549 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.551049 22118 rpcz_store.cc:276] 0709 12:11:06.637627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.638126 (+   499us) service_pool.cc:224] Handling call
0709 12:11:06.669119 (+ 30993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.669413 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:06.927991 (+258578us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.036067 (+108076us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.430644 (+1394577us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b1800066040. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fcceddba060 00007fcceddcc716 00007fccedddd287 00007fccedddd208
0709 12:11:08.549830 (+119186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.549901 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:08.549967 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.550066 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.550240 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":327290,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":112949,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":216,"spinlock_wait_cycles":14286208,"thread_start_us":459827,"threads_started":4,"wal-append.queue_time_us":188250,"wal-append.run_cpu_time_us":2203,"wal-append.run_wall_time_us":1070063}
I20260709 12:11:08.483731 25580 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.546444 25571 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.828344 25552 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:08.542268 25538 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.506539 25438 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.548933 25554 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.537570 25456 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.516959 25525 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.580413 25380 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:08.579921 25581 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.529906 25540 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:08.624820 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 620) took 1175 ms. Trace:
I20260709 12:11:08.628204 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1751) took 1458 ms. Trace:
I20260709 12:11:08.628654 22190 rpcz_store.cc:276] 0709 12:11:07.169602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.171862 (+  2260us) service_pool.cc:224] Handling call
0709 12:11:07.172183 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.300397 (+128214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.627937 (+1327540us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400109fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:08.628140 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251047680}
I20260709 12:11:08.627810 22272 rpcz_store.cc:276] 0709 12:11:07.449504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.229381 (+779877us) service_pool.cc:224] Handling call
0709 12:11:08.366548 (+137167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.494669 (+128121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.624455 (+129786us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540029c2d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:08.624716 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239220992}
I20260709 12:11:08.636230 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 2028) took 1260 ms. Trace:
I20260709 12:11:08.636729 22270 rpcz_store.cc:276] 0709 12:11:07.367282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.451790 (+ 84508us) service_pool.cc:224] Handling call
0709 12:11:08.627289 (+1175499us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002c4054. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:08.627429 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368550656}
I20260709 12:11:08.634577 25593 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.642495 25593 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.620698 25456 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.626360 25584 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.607265 25475 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:08.658439 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:08.658342 22237 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:08.659351 22866 raft_consensus.cc:3055] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:08.660102 22866 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:08.640249 25547 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.618142 25538 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.657219 25584 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.631409 25380 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:08.675158 25593 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:08.667892 22866 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:08.648706 25601 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.635027 25581 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:08.685894 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 193612us
I20260709 12:11:08.691936 25525 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:08.697352 25596 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:11:08.667410 25600 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.674677 25584 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.701740 25025 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:08.690778 25601 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.672210 25547 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.726881 25571 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.714879 25525 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:08.729215 25602 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.689819 25599 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.704070 25593 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.712052 25606 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.737847 25485 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.764148 25525 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:08.765187 25603 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.770325 25549 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:08.770533 25380 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:08.743513 25484 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:08.712463 25600 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.753616 25606 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.787802 25571 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:08.788183 25548 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.788808 25548 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:08.790714 25576 consensus_meta.cc:287] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.023s	user 0.006s	sys 0.004s
I20260709 12:11:08.791034 25548 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:08.791150 25576 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:08.792320 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:08.793431 22122 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.793864 25547 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:08.794137 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.794564 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.753919 25599 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.796028 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:08.796522 25525 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:08.777040 25580 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:08.797461 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.794204 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.799404 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.800220 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.801673 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.801786 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.800836 22198 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:08.804605 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:08.807475 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.808908 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.809345 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.809845 22189 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:08.810483 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:08.811108 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.811607 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.812269 22194 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:08.786092 25484 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.813335 25484 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.814596 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:08.812599 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.822265 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.797214 25599 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:08.826421 22237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.196:42539 timed out after 1.688s (SENT) [suppressed 21 similar messages]
I20260709 12:11:08.826512 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.766459 25593 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.798307 25580 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.797740 25540 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:08.773166 25485 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.785969 25606 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.797273 25525 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:08.788663 25438 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:08.843808 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.752192 25602 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.846469 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:08.900049 25484 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:08.900336 25485 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:08.905164 25525 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.835258 25547 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:08.909268 22117 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.007s	sys 0.011s
I20260709 12:11:08.775983 25603 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:08.910843 22117 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.007s	sys 0.011s
I20260709 12:11:08.916064 25484 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.925249 25484 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:08.926330 25525 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:08.927878 25484 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:08.894481 25475 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:08.848567 25580 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:08.929872 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 103490us
W20260709 12:11:08.941075 22235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.003s	sys 0.014s
W20260709 12:11:08.941603 22235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.003s	sys 0.014s
I20260709 12:11:08.917210 25538 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:08.912235 25547 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:08.949867 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 134660us
I20260709 12:11:09.176110 22114 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:09.037930 25533 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:09.113619 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2020) took 2254 ms. Trace:
I20260709 12:11:09.014430 25593 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:09.319958 25187 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.059854 22120 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:09.259891 22115 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:09.167650 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1780) took 1362 ms. Trace:
I20260709 12:11:09.381655 22114 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:09.380111 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.014797 25601 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:09.388026 22192 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:08.969486 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 253496us
I20260709 12:11:09.389178 25582 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:11:09.401582 25187 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.405423 22864 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:09.406497 25187 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:09.404091 22123 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:09.403846 22858 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.103786 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 446) took 1314 ms. Trace:
I20260709 12:11:09.408017 22858 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.408437 22122 rpcz_store.cc:276] 0709 12:11:07.788932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.789058 (+   126us) service_pool.cc:224] Handling call
0709 12:11:07.789379 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.793781 (+1004402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.103440 (+309659us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54003124d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:09.103698 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308652416}
I20260709 12:11:09.025252 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:09.089012 25581 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:08.976261 25600 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:09.415187 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:09.337450 25484 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:09.114215 25398 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.417660 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:09.418066 25398 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:09.377573 25456 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.002s
I20260709 12:11:09.075824 25580 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:09.019229 25584 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.106761 25536 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:11:09.420912 25536 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:08.994257 25475 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.421944 25536 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:09.134661 25546 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.008s
I20260709 12:11:09.400046 22117 rpcz_store.cc:276] 0709 12:11:07.805699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.806744 (+  1045us) service_pool.cc:224] Handling call
0709 12:11:07.831055 (+ 24311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.831264 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:08.912888 (+1081624us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.167033 (+254145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.167146 (+   113us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:09.167223 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.167340 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.167550 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1091149,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":201,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":119,"thread_start_us":1333349,"threads_started":2,"wal-append.queue_time_us":462755}
W20260709 12:11:09.424546 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 248132us
I20260709 12:11:09.177452 22264 rpcz_store.cc:276] 0709 12:11:06.859535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.859693 (+   158us) service_pool.cc:224] Handling call
0709 12:11:06.879924 (+ 20231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.217889 (+337965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.113018 (+1895129us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b540026c0d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:09.113494 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775735168}
I20260709 12:11:09.422458 25475 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.423840 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:09.393633 22866 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.393234 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:09.427047 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.177091 25533 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:09.397766 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:09.381963 25485 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.027667 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:09.398726 22119 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.376425 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:09.433447 22196 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.435760 22866 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:09.415373 25547 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:09.451599 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:09.397065 25602 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:09.455884 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.416240 25484 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.109426 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:09.446959 25620 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
W20260709 12:11:09.450766 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 423139us
I20260709 12:11:09.462746 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:09.452112 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:09.177230 25576 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:09.455560 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:09.085556 25353 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:09.079825 25574 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:09.456763 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.483047 22263 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:09.464048 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.458076 22266 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:09.458447 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:09.464730 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.485679 22114 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:09.465333 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.467235 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:09.455304 25363 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:11:09.471119 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.491155 22268 raft_consensus.cc:2410] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:09.491402 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:09.474057 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:09.474761 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:09.492889 22862 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:09.495972 22114 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:09.109843 25554 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.476948 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.477698 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.456589 22267 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:09.480504 25353 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.452656 25603 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:09.481294 25407 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:09.474737 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:09.521108 25536 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:11:09.522101 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 47424.1us
I20260709 12:11:09.523540 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:09.081266 25609 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:09.528448 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:09.488821 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.534135 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.535207 22122 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:11:09.481168 25585 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:09.502766 22263 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:09.439455 25584 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:09.430156 25456 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.450246 25575 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.477052 25422 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.544955 25575 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.545161 25422 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.459357 25600 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:09.431689 25546 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.456110 25538 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:09.524812 25502 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:09.533192 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 107777us
I20260709 12:11:09.489799 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.577169 22270 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:09.498268 22119 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:09.509126 22121 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.469195 22858 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:09.544183 22269 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.487251 25602 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:09.546461 22115 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:09.484920 25547 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.548511 25584 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:09.521163 25407 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.503330 25576 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:09.551699 25600 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.548956 25501 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:09.533839 25605 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.607137 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.567915 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:09.609066 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:09.597482 25602 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.610293 25187 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:09.610719 25187 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.611124 25187 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:09.613624 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:09.582804 25025 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.503646 25581 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:11:09.547879 25574 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.593437 22265 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:11:09.595906 22121 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:09.455585 25485 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.540567 25533 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.668650 25533 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.538730 25526 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:11:09.541509 25609 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.538470 25601 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:09.640936 25622 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:11:09.619000 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.681430 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.682117 22267 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:09.683156 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.627763 25025 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.629482 25503 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:09.585122 25349 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.575707 25603 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:09.604140 22858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 566) took 2241 ms (client timeout 1688 ms). Trace:
I20260709 12:11:09.607805 25576 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.598448 25502 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.671276 25574 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.546731 25585 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.598275 25584 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.598096 25547 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.634721 25407 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:09.634876 25398 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:09.636991 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:09.584033 25538 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.606815 25600 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:09.638321 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:09.671144 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 212069us
I20260709 12:11:09.710414 22268 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:09.618000 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:09.672691 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 44816.3us
I20260709 12:11:09.680604 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.628278 25422 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:09.686486 22120 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:11:09.694343 25631 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.712949 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.665997 25580 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.719743 25580 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.720176 25609 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:09.700127 25475 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:09.693262 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.693869 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:09.614454 25353 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.697938 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:09.633000 25606 consensus_meta.cc:287] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.738s	user 0.005s	sys 0.005s
I20260709 12:11:09.607524 25605 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.711961 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.714397 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.685932 25601 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.718564 25538 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:09.698004 22858 rpcz_store.cc:269] 0709 12:11:07.351517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.354026 (+  2509us) service_pool.cc:224] Handling call
0709 12:11:09.403402 (+2049376us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400592020. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd4006f 00007fcceddb8f60 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2
0709 12:11:09.593175 (+189773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583280000}
W20260709 12:11:09.691452 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 66338.6us
I20260709 12:11:09.722973 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:09.723719 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.703727 25503 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:09.718052 25585 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:09.724488 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.775164 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.700111 25603 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.704169 25574 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.699816 25472 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 12:11:09.779280 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 84751.7us
W20260709 12:11:09.779997 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 86219.6us
W20260709 12:11:09.815722 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.777822 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 62760.3us
I20260709 12:11:09.838578 22116 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.780439 22114 raft_consensus.cc:2393] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:09.840169 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.861172 22263 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:11:09.702279 25627 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.862664 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:09.844703 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.866119 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:09.778841 22267 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:09.866647 22192 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:09.702333 25349 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.877614 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:09.779812 25605 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.867533 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.868667 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.842599 22117 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:09.721999 25485 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:09.880689 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.731587 25628 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.888424 22267 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:09.886615 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:09.791061 25581 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.888535 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:09.889140 22266 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
I20260709 12:11:09.842432 25609 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.703359 25502 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.892846 22263 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:09.901919 22116 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:09.854633 25503 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:09.903126 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 45963.4us
I20260709 12:11:09.759456 25526 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.159s
I20260709 12:11:09.855993 25575 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:09.861853 25627 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.862303 25422 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:09.966799 25422 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.877038 25475 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:09.968950 25475 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.874354 25538 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:09.902833 25628 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.970811 25538 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.972436 25628 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:09.945559 25602 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:09.945722 25501 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.893703 25580 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:09.973469 25602 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.974031 25602 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:09.949487 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 71415.7us
I20260709 12:11:09.953047 22120 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 12:11:09.980566 25601 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:09.981874 25547 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:09.985674 25576 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:09.986289 25636 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:11:09.987684 22237 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:09.730892 25631 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:09.989727 25619 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.593s	user 0.004s	sys 0.000s
I20260709 12:11:09.953769 25575 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.905032 25581 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.942943 25593 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:09.959517 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 626) took 1198 ms. Trace:
W20260709 12:11:09.964979 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 167119us
I20260709 12:11:09.780004 25606 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:09.965306 25232 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:09.947853 25626 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.056231 25025 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.064419 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2028) took 1263 ms. Trace:
W20260709 12:11:10.057690 25634 log.cc:927] Time spent T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:11:09.896819 25611 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:10.104921 25611 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.107585 25611 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:10.095677 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 154403us
I20260709 12:11:10.062012 25353 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.097080 25575 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:09.939282 25609 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.075938 25538 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:10.099759 25581 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:10.128819 25602 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.065662 25584 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.064762 25456 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.088189 25593 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:10.129994 25593 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.132174 25258 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.132736 25258 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.134268 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.134941 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.135572 25258 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:10.136173 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.137113 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:10.137370 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.103539 25502 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:10.103958 25603 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.086675 22270 rpcz_store.cc:276] 0709 12:11:08.760825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.761024 (+   199us) service_pool.cc:224] Handling call
0709 12:11:08.761361 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.577774 (+816413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.959182 (+381408us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54003c96d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:09.959438 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875494144}
I20260709 12:11:10.110939 25422 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.086781 25626 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:10.118901 25575 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:10.065012 25187 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.076520 25601 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:10.057914 25627 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:10.069036 25547 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:10.087656 22191 rpcz_store.cc:276] 0709 12:11:08.800713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.800905 (+   192us) service_pool.cc:224] Handling call
0709 12:11:08.801160 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.814439 (+ 13279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.814487 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.823822 (+  9335us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.971700 (+147878us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:08.971759 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.971852 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.988922 (+1017070us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:10.063962 (+ 75040us) raft_consensus.cc:1685] finished
0709 12:11:10.063992 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.064328 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1432,"raft.queue_time_us":13610,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":16863,"spinlock_wait_cycles":74700672,"thread_start_us":77621,"threads_started":1,"wal-append.queue_time_us":549415}
I20260709 12:11:10.122859 25474 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.157730 25484 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:10.158953 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:10.159430 25638 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:10.160631 25626 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.161690 25626 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.161489 25585 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:10.161878 25616 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:10.163655 25616 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.163450 25585 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:10.164927 25472 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.165093 25616 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.165374 25472 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:10.165531 25616 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.150399 25353 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:11:10.167466 25187 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:10.152217 25363 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:11:10.164288 25612 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:10.168895 25601 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.169375 25612 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.169729 25612 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:10.170493 25612 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.171006 25601 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:10.127336 25631 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:09.942689 25376 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:11:10.182174 22122 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:10.070564 25546 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:10.155567 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.171692 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.178544 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:10.114096 25365 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:11:10.175706 22087 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:10.213913 22163 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:10.171670 25612 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.216018 25509 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:10.216387 25398 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.216933 25407 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:10.217604 25407 consensus_queue.cc:1243] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:11:10.192328 22119 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:10.192974 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:10.218827 25474 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.219165 22118 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:10.216979 25398 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:10.193892 22267 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:10.220819 25606 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.221022 25398 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.195374 22858 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:10.196139 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 2038) took 1116 ms. Trace:
I20260709 12:11:10.222311 22121 rpcz_store.cc:276] 0709 12:11:09.069160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.069290 (+   130us) service_pool.cc:224] Handling call
0709 12:11:10.184969 (+1115679us) spinlock_profiling.cc:243] Waited 73.9 ms on lock 0x7b540012a2d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:10.185087 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170003840}
I20260709 12:11:10.223747 25398 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.198225 25554 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:10.216425 25509 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.226778 25509 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.193583 25638 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:11:10.229620 25638 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.230108 25638 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:10.231199 25638 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.179030 25547 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:10.236625 25547 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:10.243945 25533 consensus_meta.cc:287] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.005s
I20260709 12:11:10.245177 22271 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:11:10.245647 22271 pending_rounds.cc:85] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 4
I20260709 12:11:10.245913 22271 pending_rounds.cc:107] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:11:10.246212 22271 raft_consensus.cc:2889] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:10.202915 25574 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.179617 25422 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:10.218519 25349 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:10.128645 25609 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:10.196862 25472 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:10.251468 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 56846.1us
I20260709 12:11:10.253690 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:11:10.253706 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 376183us
W20260709 12:11:10.255438 22236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.019s	sys 0.017s
W20260709 12:11:10.256480 22236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.019s	sys 0.017s
I20260709 12:11:10.270819 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:10.250722 25422 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.263643 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:10.275139 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:10.286338 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:10.287544 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:10.288501 22266 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:10.286260 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:10.293733 22116 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:10.296232 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.297708 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:10.299194 22115 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:10.300161 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.300840 22862 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:10.301433 22020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 254) took 8587 ms. Trace:
I20260709 12:11:10.262483 25353 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:10.262483 25533 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.279403 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:10.301815 22020 rpcz_store.cc:276] 0709 12:11:01.683582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.689258 (+  5676us) service_pool.cc:224] Handling call
0709 12:11:01.951566 (+262308us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b5400280690. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9e640 00007fccf3b75846 00007fccf3c7f90e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:10.271133 (+8319567us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:06.261135 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:06.268223 (+  7088us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:06.268290 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:11:06.268325 (+    35us) tablet.cc:662] Decoding operations
0709 12:11:06.420947 (+152622us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:06.441294 (+ 20347us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:06.449460 (+  8166us) tablet.cc:685] Acquiring locks for 35 operations
0709 12:11:06.506626 (+ 57166us) tablet.cc:701] Row locks acquired
0709 12:11:06.506650 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:11:06.506830 (+   180us) write_op.cc:270] Start()
0709 12:11:06.506959 (+   129us) write_op.cc:276] Timestamp: P: 1783599066506773 usec, L: 0
0709 12:11:06.506981 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:11:06.512530 (+  5549us) log.cc:844] Serialized 13775 byte log entry
0709 12:11:07.314733 (+802203us) op_driver.cc:464] REPLICATION: finished
0709 12:11:07.460259 (+145526us) write_op.cc:301] APPLY: starting
0709 12:11:07.460356 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:07.461070 (+   714us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:07.461204 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:07.584192 (+122988us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:07.584656 (+   464us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=35
0709 12:11:07.584710 (+    54us) write_op.cc:312] APPLY: finished
0709 12:11:07.709373 (+124663us) log.cc:844] Serialized 230 byte log entry
0709 12:11:07.713490 (+  4117us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:07.731359 (+ 17869us) write_op.cc:454] Released schema lock
0709 12:11:07.731518 (+   159us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:07.732093 (+   575us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:07.732136 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28007,"reported_tablets":50,"spinlock_wait_cycles":9824512,"child_traces":[["op",{"apply.queue_time_us":139097,"apply.run_cpu_time_us":10902,"apply.run_wall_time_us":271762,"num_ops":35,"prepare.queue_time_us":174254,"prepare.run_cpu_time_us":38212,"prepare.run_wall_time_us":526916,"raft.queue_time_us":210164,"raft.run_cpu_time_us":7658,"raft.run_wall_time_us":193401,"replication_time_us":773682,"thread_start_us":585990,"threads_started":4,"wal-append.queue_time_us":364161,"wal-append.run_cpu_time_us":23906,"wal-append.run_wall_time_us":1862983}]]}
I20260709 12:11:10.311175 24464 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:10.311744 22271 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:10.312489 22857 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:10.304168 25353 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:10.319283 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.319952 22191 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:10.322819 22123 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:10.324580 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.326524 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:10.315537 25606 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.328742 25606 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.329176 25606 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.333061 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:10.333299 25601 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:10.333841 25601 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:10.262799 25609 raft_consensus.cc:476] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:10.334213 25601 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.335407 25365 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.335855 25365 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.336228 25365 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:10.336925 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.337235 25591 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:11:10.337255 25353 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:10.322383 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:10.275658 25638 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:10.339987 22264 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.022s	sys 0.045s
W20260709 12:11:10.343181 22264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.022s	sys 0.046s
I20260709 12:11:10.346355 22121 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.342316 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:10.337052 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:10.298342 25475 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.316645 25546 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:11:10.298219 25582 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.359887 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:10.362950 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.363835 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.364645 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:10.338750 25600 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.004s
I20260709 12:11:10.263481 25376 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:11:10.368625 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.370062 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.372105 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.373741 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.384742 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.338326 25591 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.374557 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.342566 25472 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.391100 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.391669 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.276686 25585 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:11:10.393278 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.395174 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.276202 25232 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:11:10.356091 25593 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.397554 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.405565 25591 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:10.437651 25591 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.439334 25591 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.406237 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.406257 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.441831 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.442018 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.442412 22861 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:10.410923 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.412643 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.415285 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.417704 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.440567 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:10.432320 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 72543us
I20260709 12:11:10.450700 22197 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:10.450776 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.372903 25606 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.454602 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.454668 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.455231 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:10.367242 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:10.465948 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.367236 25554 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.470687 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.455561 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.400085 25422 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.466862 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:10.339201 25533 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.342726 25556 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 12:11:10.458237 25546 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:10.472566 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.465679 25398 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:10.475067 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.420645 25232 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:10.476711 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:10.478123 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:10.404978 25600 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.480435 24464 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:10.481154 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2048) took 1027 ms. Trace:
I20260709 12:11:10.542476 22264 rpcz_store.cc:276] 0709 12:11:09.453393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.453566 (+   173us) service_pool.cc:224] Handling call
0709 12:11:09.509670 (+ 56104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.707778 (+198108us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:10.343635 (+635857us) log.cc:844] Serialized 14 byte log entry
0709 12:11:10.465548 (+121913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.465627 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:10.465682 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.480913 (+ 15231us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54001c7854. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:10.480959 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.481099 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6785,"prepare.queue_time_us":778572,"raft.queue_time_us":9917,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7642,"spinlock_wait_cycles":466140416,"thread_start_us":676181,"threads_started":2,"wal-append.queue_time_us":163975}
I20260709 12:11:10.421736 25593 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:10.461695 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 135258us
I20260709 12:11:10.412340 25585 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:10.489691 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.478910 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.493606 22196 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:10.469761 25631 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:11:10.541316 22267 pending_rounds.cc:85] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 2
I20260709 12:11:10.546032 24464 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.555858 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:10.567706 22267 pending_rounds.cc:107] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:11:10.568308 22267 raft_consensus.cc:2889] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:10.482872 25584 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:10.487684 25546 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:10.570191 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 89988.5us
I20260709 12:11:10.573858 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.573218 22198 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 3.
I20260709 12:11:10.575970 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.570279 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.500417 25232 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:10.492877 25398 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:10.571571 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.581811 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.583738 22195 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:10.581126 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.584749 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.542268 25502 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.586127 25502 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.587505 25652 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:10.590233 25502 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:10.604254 24464 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.551872 25585 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:10.574862 25605 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.674s	user 0.006s	sys 0.007s
I20260709 12:11:10.482654 25645 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 12:11:10.632376 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:10.579680 25546 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.647845 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:10.636219 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:10.591060 25536 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:10.656934 25653 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:11:10.666411 25600 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:10.582062 25594 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 12:11:10.667339 25626 consensus_meta.cc:287] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
W20260709 12:11:10.671244 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 102140us
I20260709 12:11:10.641839 25574 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:10.687274 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.644840 25605 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.690555 25187 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:11:10.707324 25187 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:10.707723 25187 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:10.708799 25645 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.708493 25187 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.697340 25606 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:10.709749 25187 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.708493 25232 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.712378 25232 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.690886 25585 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.713769 25585 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.709189 25645 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:10.716284 25509 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.717746 25645 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.709079 25605 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:10.719465 25645 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.720052 25353 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.723460 25353 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.727137 24464 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:10.727759 24464 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:10.728492 25546 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.729765 24464 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.730719 25546 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:10.733994 25398 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.735503 25407 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:10.735981 25407 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:10.736195 25398 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:10.736984 25616 consensus_meta.cc:287] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.001s
I20260709 12:11:10.737424 25616 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.739555 25616 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:10.739555 25407 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.742791 25533 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:10.743606 25407 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.742364 25601 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.689992 25365 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:10.747953 25601 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:10.718505 25509 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:10.809293 22019 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:10.823056 22122 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:10.825881 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 180522us
W20260709 12:11:10.833621 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.835585 22019 catalog_manager.cc:5697] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:10.839200 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.839337 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.840762 22192 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:10.637169 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.838156 22191 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:10.841504 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.842432 22189 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:10.843151 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.843791 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.839351 22194 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:10.845120 22189 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:10.838184 22193 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:10.846199 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.844592 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:10.841157 22019 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:11:10.858256 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 381527us
I20260709 12:11:10.849215 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.859853 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:10.860160 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:10.856299 22198 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:10.854890 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:10.862861 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:10.863058 22196 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.863783 22189 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.865935 22196 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:10.869095 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:10.868983 22019 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:11:10.880352 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.881295 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:10.884546 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:10.912035 22189 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:10.917179 25547 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.917552 25365 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:10.918231 25547 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:10.927632 22865 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.929144 22019 catalog_manager.cc:5697] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 3 to 5, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:10.935588 25546 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.936976 25533 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:10.937896 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57053us
I20260709 12:11:10.938349 25456 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:10.939060 25456 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:10.939612 25456 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:10.948181 25487 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.950757 25487 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:10.951368 25487 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:10.969331 25671 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:11:10.969897 25547 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:11.007992 25609 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:11.015813 25609 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:11.016743 25609 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:11.019605 25609 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:11.038906 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 77738us
W20260709 12:11:11.060428 25554 consensus_meta.cc:287] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.007s
I20260709 12:11:11.061332 25554 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.057312 22087 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:11.080876 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 212005us
I20260709 12:11:11.085103 22865 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:11.095806 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:11.097462 22860 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:11.098543 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:11.100180 25474 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:11.100883 25474 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:11.101487 25603 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.113950 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:11.116163 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:11.118434 25547 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.119566 25547 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:11.121942 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 64973.7us
I20260709 12:11:11.108922 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:11.130630 22019 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 1 to 5, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:11.139287 25456 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.102443 25474 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.153517 22195 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:11.154386 25644 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.156427 25644 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.159714 25644 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.162145 25552 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:11.163090 25552 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.167662 25552 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:11.170162 25456 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:11.172638 25487 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.173734 22190 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:11.175695 25487 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:11.173116 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 69682.9us
I20260709 12:11:11.181525 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:11.185784 25670 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:11.184614 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:11.217342 25398 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:11.222545 25363 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.228763 22265 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:11.259619 24464 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.266587 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.306469 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:11.306998 22861 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:11.307765 22194 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:11.288756 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:11.329859 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:11.329636 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:11.242717 25644 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.350284 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:11.350425 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:11.351122 22858 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.351472 22265 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 8: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:11.356492 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:11.357298 22266 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.350421 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:11.361047 25585 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.368081 22122 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.373203 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:11.373303 25398 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:11.375432 25398 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:11.375826 25398 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:11.396481 22271 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:11.401641 22266 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:11.390657 25398 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.434257 25398 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.444196 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.448372 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:11.451431 25582 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.453316 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:11.453631 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:11.456842 22266 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:11.461138 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 213870us
W20260709 12:11:11.462563 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.473711 22122 raft_consensus.cc:2410] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:11.474700 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.456841 22860 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:11.441208 25363 consensus_queue.cc:1175] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cc9b9c8894084021a0c6ddaf659d222e" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 9 } }
I20260709 12:11:11.484956 25547 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:11.486028 25547 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.486377 25547 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:11.487401 25547 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.484357 25645 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:11:11.489475 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.491032 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:11.491820 22860 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:11.492921 25547 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.498302 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:11.504483 22123 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.499375 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:11.508526 22120 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.516325 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.517355 22267 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:11.517390 22117 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:11.499392 25585 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:11.519151 25585 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.526089 25644 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:11.527189 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:11.538268 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.539644 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.540076 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.540570 22116 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:11.542094 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.542347 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.543967 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:11.544601 22272 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:11.544907 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.549619 22236 connection.cc:256] RPC call timeout handler was delayed by -1.2888297800000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 12:11:11.550127 22236 connection.cc:256] RPC call timeout handler was delayed by -1.2888297800000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 12:11:11.550631 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1043297799999436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 12:11:11.550930 22236 connection.cc:256] RPC call timeout handler was delayed by -1.0170297800000299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 12:11:11.558382 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45997.8us
I20260709 12:11:11.562304 22123 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:11.563972 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.564571 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.563627 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.566680 22272 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:11.563437 25603 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.568051 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.569811 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:11.571010 22120 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:11.573403 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.575367 22117 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:11.577733 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:11.584988 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.585722 22272 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:11.576154 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:11.596072 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.598315 22268 raft_consensus.cc:2393] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:11.600291 25353 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:11:11.604554 22163 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:11.605931 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.592509 25474 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:11:11.613713 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 86623.5us
W20260709 12:11:11.612797 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47662.3us
I20260709 12:11:11.611406 25474 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:11.618710 25474 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:11.622467 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.626003 22268 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:11.635496 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.643100 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.644656 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:11.657325 24464 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:11.646458 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.636433 25585 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:11.667327 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.671026 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.671368 22271 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
W20260709 12:11:11.679778 22088 leader_election.cc:336] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.735s (SENT)
I20260709 12:11:11.684315 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:11.684370 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:11.685973 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48584.2us
I20260709 12:11:11.687448 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.690349 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.691387 25475 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:11.691882 25684 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:11:11.692135 25407 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:11.692842 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:11.686796 25585 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:11.693502 25585 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:11.694706 25585 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:11.695794 25585 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:11.693594 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 69670.1us
I20260709 12:11:11.696897 22268 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.697489 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:11.693504 22118 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.691622 22264 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:11.701088 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:11.706846 22268 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:11.708283 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.716981 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.713831 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.719331 22272 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:11.720137 25575 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.720372 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:11.721159 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.721554 22860 raft_consensus.cc:606] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:11.722057 22860 raft_consensus.cc:614] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:11.722126 22267 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:11.723418 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.724012 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:11.725064 25484 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:11.725513 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:11.730306 25484 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.730755 25484 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:11.731137 25484 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.728343 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:11.720477 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44174.2us
I20260709 12:11:11.733398 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.733647 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.708585 25407 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:11.739356 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52314.4us
I20260709 12:11:11.718948 25475 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:11:11.761754 22271 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:11.762864 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:11.759366 22265 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:11:11.771083 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:11.741992 25659 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.780478 25659 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.781546 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.774159 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.774298 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:11.775030 25475 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:11.776476 25407 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:11.801120 22267 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:11.779678 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:11.783509 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:11.791028 22118 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:11.803272 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:11.807369 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:11.812444 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 74825.8us
I20260709 12:11:11.813416 22265 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:11.816721 22270 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:11.823570 25693 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.819912 22860 raft_consensus.cc:606] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:11.836439 22265 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:11.822029 25547 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:11.824923 22860 raft_consensus.cc:614] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:11.844734 25474 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:11.848893 22268 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:11.856403 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:11.857394 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 129184us
I20260709 12:11:11.859481 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:11.833324 25353 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:11:11.852977 25575 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.862301 25575 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:11.863016 25575 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.872344 25487 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:11.873144 25487 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.873270 25475 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:11.875329 25487 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:11.825045 25688 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:11.876933 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:11.879319 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:11.880016 22193 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:11.881062 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
W20260709 12:11:11.881245 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 107082us
W20260709 12:11:11.881094 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.882439 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:11.887740 22830 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:11.889182 25640 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.889637 25640 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:11.890019 25640 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.893942 25659 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:11.900489 22858 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:11.904819 22190 raft_consensus.cc:606] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:11.905251 22190 raft_consensus.cc:614] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:11.918287 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 67042.5us
W20260709 12:11:11.919406 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 78210.4us
W20260709 12:11:11.928129 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 114825us
I20260709 12:11:11.932564 25640 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:11.935360 25640 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:11.937654 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:11.938040 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:11.938544 22121 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.939038 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.939263 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.939855 22119 raft_consensus.cc:2410] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:11.940255 22120 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:11.940887 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:11.942153 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:11.942844 22122 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:11.938491 22118 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:11.946583 22121 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:11.949028 25696 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.949661 25696 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.950070 25696 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.952732 25474 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:11.912994 25603 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:11.975127 25575 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:11.977479 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48049.5us
I20260709 12:11:11.981103 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:11.980034 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:11.989712 22858 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:12.015374 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:12.015559 24464 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.016109 22270 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:12.017666 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:12.018507 22265 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:12.019578 25697 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:12.020314 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:12.021014 22263 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:12.025241 25456 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:12.025768 25456 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:11.986821 25693 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:11:12.026273 25456 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.991389 25688 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:11:12.016119 24464 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:12.055797 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48211.7us
I20260709 12:11:12.055930 24464 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.042076 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:12.062233 24464 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.066028 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:12.067667 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:12.068375 25694 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:12.070319 25484 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.070946 25407 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.072664 25688 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:12.073810 25693 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:12.074246 25693 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:12.075314 25693 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.067591 25695 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:12.086380 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44466.2us
I20260709 12:11:12.102978 25710 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:11:12.102152 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 219883us
I20260709 12:11:12.105096 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:12.115154 25711 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:12.115954 25711 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:12.117282 25711 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.076756 25693 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:12.124213 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57308.2us
I20260709 12:11:12.127460 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:12.129575 25704 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:12.130407 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:12.131534 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:12.135360 25456 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.137042 25704 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:12.137354 25484 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:12.137751 25704 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:12.139277 25456 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:12.139650 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:12.141165 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:12.143366 25704 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:12.144212 25187 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.145000 25187 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.147593 25187 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:12.155689 22865 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.156900 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:12.157629 22114 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:12.158752 25690 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.159387 25690 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.161787 25690 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:12.162289 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:12.162577 25641 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:12.162986 22123 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:12.163080 25641 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.163617 25641 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.164044 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:12.164659 22121 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.178980 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:12.143807 25704 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:12.090713 25695 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:12.141697 25456 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:12.187718 22865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:12.192251 22865 raft_consensus.cc:606] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:12.210104 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 82738.8us
W20260709 12:11:12.214957 22087 leader_election.cc:336] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.840s (SENT)
I20260709 12:11:12.186691 25694 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:12.188395 25704 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.244971 22198 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:12.186947 25695 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:12.245555 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:12.254424 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 46788.9us
I20260709 12:11:12.250962 22121 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:12.189496 25547 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:12.257197 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:12.256265 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 172518us
I20260709 12:11:12.263036 25694 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:12.263450 25547 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.262925 22021 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 4 to 9, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 9 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.264197 25694 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.272070 22271 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:12.274453 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:12.275032 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 72335.5us
I20260709 12:11:12.277298 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:12.285212 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.268038 25696 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.289368 25688 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.289837 25688 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:12.290850 25696 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:12.291512 24464 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.294998 25645 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:12.299355 25645 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:12.300472 25645 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.313097 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:12.310294 25702 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:11:12.320178 25701 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.333578 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:12.334477 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 128220us
I20260709 12:11:12.319265 25456 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:12.337500 25456 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:12.338088 25456 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:12.339169 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.314499 25695 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.342268 25695 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:12.343834 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 68076.5us
W20260709 12:11:12.345326 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47616.3us
I20260709 12:11:12.290850 25688 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.350919 25688 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.356616 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:12.362581 22865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:12.363229 22865 raft_consensus.cc:606] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:12.363575 22865 raft_consensus.cc:614] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:12.363775 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:12.370085 25711 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:12.370419 22087 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.089s (SENT)
I20260709 12:11:12.370970 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:12.372983 25475 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.373665 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:12.374493 25187 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:12.374898 25187 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.375272 25659 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:12.375852 25659 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:12.376857 25659 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.375281 25187 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.406752 22021 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 4 to 7, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 7 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:12.413131 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1962556000000859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 12:11:12.418680 25693 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:12.419344 25693 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:12.425402 22830 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:12.427023 25487 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.427552 25487 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.429579 25487 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:12.429872 25721 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:12.430433 25721 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:12.433562 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:12.434300 22121 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:12.436666 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:12.445032 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:12.420212 25693 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.448680 25688 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:12.452560 25688 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.453060 25688 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.405522 25547 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:12.463097 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 129664us
I20260709 12:11:12.475996 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.476353 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:12.477316 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.476915 22190 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:12.482285 22193 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:12.486043 22121 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.462253 25487 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:12.476015 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:12.488624 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.489377 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:12.481784 22021 catalog_manager.cc:5697] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.489511 22194 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:12.467180 25701 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.493708 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.490653 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:12.474447 25547 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:11:12.499995 22087 leader_election.cc:336] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.638s (SENT)
I20260709 12:11:12.501288 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:12.502207 22019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 235) took 18767 ms (client timeout 15000 ms). Trace:
I20260709 12:11:12.489120 25487 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.514438 22121 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
W20260709 12:11:12.519675 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57152.5us
I20260709 12:11:12.524525 22021 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.527770 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:12.528165 22087 leader_election.cc:336] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.669s (SENT)
I20260709 12:11:12.504904 25721 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.532580 22270 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:11:12.536085 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50227.6us
I20260709 12:11:12.536526 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:12.515213 25475 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:12.518535 25487 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.557627 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.532927 25353 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.602641 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:12.554885 22021 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 6 to 8, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 8 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:12.563475 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.564258 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.564532 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.604444 22189 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:12.604605 22195 raft_consensus.cc:2410] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:11:12.604882 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 50578.4us
I20260709 12:11:12.565270 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.565960 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.566627 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.606362 22196 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:12.567210 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.567363 25711 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:12.519145 25187 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.542510 25645 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.561849 25724 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.061s	user 0.003s	sys 0.000s
I20260709 12:11:12.625934 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.626897 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.654008 22195 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:12.627020 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:12.628701 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 74000.3us
I20260709 12:11:12.628873 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.659628 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.630772 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:12.631995 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.636555 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:12.660868 22118 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:12.638057 25187 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:12.638818 22117 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:12.639006 22119 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:12.640724 22121 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 12:11:12.661983 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 211669us
W20260709 12:11:12.623940 22087 leader_election.cc:336] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.500s (SENT)
I20260709 12:11:12.650420 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:12.552646 25475 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.652592 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.669847 22196 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
W20260709 12:11:12.670912 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47026.8us
I20260709 12:11:12.673388 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.673550 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:12.674181 22190 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.679911 22189 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:12.674299 22116 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
W20260709 12:11:12.676633 22087 leader_election.cc:336] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.701s (SENT)
I20260709 12:11:12.539719 25547 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.690110 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.651404 25701 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.692871 22191 raft_consensus.cc:2410] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:12.687928 22021 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.693382 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.694113 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.694622 22194 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.695061 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.691913 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.696190 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.697600 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:12.697783 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.622282 25456 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.699823 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.699914 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:12.703887 22118 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.674958 25475 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.602329 25704 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.698333 22189 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:12.711258 22122 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:12.680680 25585 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.622490 25353 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.715095 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.653815 25688 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.717760 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:12.508845 22019 rpcz_store.cc:269] 0709 12:10:53.717948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.720908 (+  2960us) service_pool.cc:224] Handling call
0709 12:11:12.484914 (+18764006us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:11.416980 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:11.417982 (+  1002us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:11.418063 (+    81us) write_op.cc:435] Acquired schema lock
0709 12:11:11.418111 (+    48us) tablet.cc:662] Decoding operations
0709 12:11:11.419278 (+  1167us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:11.419403 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:11.419446 (+    43us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:11:11.420346 (+   900us) tablet.cc:701] Row locks acquired
0709 12:11:11.420415 (+    69us) write_op.cc:260] PREPARE: finished
0709 12:11:11.420690 (+   275us) write_op.cc:270] Start()
0709 12:11:11.432762 (+ 12072us) write_op.cc:276] Timestamp: P: 1783599071420588 usec, L: 0
0709 12:11:11.432815 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 12:11:11.433700 (+   885us) log.cc:844] Serialized 2481 byte log entry
0709 12:11:11.681531 (+247831us) op_driver.cc:464] REPLICATION: finished
0709 12:11:11.845746 (+164215us) write_op.cc:301] APPLY: starting
0709 12:11:11.845866 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:11.846059 (+   193us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:11.846192 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:11.847180 (+   988us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:11.847459 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:11:11.847509 (+    50us) write_op.cc:312] APPLY: finished
0709 12:11:11.847861 (+   352us) log.cc:844] Serialized 53 byte log entry
0709 12:11:11.848045 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:11.848167 (+   122us) write_op.cc:454] Released schema lock
0709 12:11:11.848238 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:11.876527 (+ 28289us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:11.876559 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":560405,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":163901,"apply.run_cpu_time_us":2988,"apply.run_wall_time_us":9241,"num_ops":6,"prepare.queue_time_us":194923,"prepare.run_cpu_time_us":43720,"prepare.run_wall_time_us":153733,"raft.queue_time_us":35465,"raft.run_cpu_time_us":16861,"raft.run_wall_time_us":60848,"replication_time_us":248546,"thread_start_us":319199,"threads_started":4,"wal-append.queue_time_us":182135}]]}
I20260709 12:11:12.659003 25641 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.723095 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.729182 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.730031 22195 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:12.655375 25645 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.729228 22266 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.732637 22263 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.733410 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:12.735817 22192 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.715794 25696 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:12.739393 25353 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:12.752739 22193 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:12.752568 22196 raft_consensus.cc:2368] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
W20260709 12:11:12.755398 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64068.2us
I20260709 12:11:12.749903 25696 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:12.761881 25696 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:12.762292 25696 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:12.765219 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:12.765818 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:12.766371 25730 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:11:12.771785 25484 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:12.772282 25484 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:12.772655 25484 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:12.758924 25707 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.774830 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.775055 25707 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.722220 25585 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.778681 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:12.777170 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.777174 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.782423 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.783524 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.786222 25704 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:12.786325 22117 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:12.789095 25735 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.786367 25707 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:12.791193 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:12.791450 25487 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:12.784521 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.777161 25645 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:12.799443 22189 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:12.832254 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.832981 22189 raft_consensus.cc:2376] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8. Re-sending same reply.
W20260709 12:11:12.802448 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.756906 22021 catalog_manager.cc:5697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.804426 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.806783 22195 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:12.808935 22190 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:12.841154 22194 raft_consensus.cc:2410] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:12.831055 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:12.846086 22189 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:12.848762 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 70147.3us
I20260709 12:11:12.845057 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:12.795318 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:12.830060 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.853708 22162 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:12.830221 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:12.852001 22021 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.856118 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.861250 22198 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:12.863278 22192 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:12.866318 25693 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:11:12.867295 25659 raft_consensus.cc:993] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:11:12.867761 25729 raft_consensus.cc:1081] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:11:12.794894 25353 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 12:11:12.869091 25733 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 12:11:12.852923 25712 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.878021 25688 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:12.878530 25585 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:12.879623 25645 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.880394 25645 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:12.882290 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.883507 25645 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:12.885913 22118 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:12.889788 25353 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:12.890424 25353 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:12.891060 22193 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:12.891594 25353 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.893409 25353 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:12.894856 25641 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:12.899281 25552 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.899691 25552 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:12.899834 25585 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:12.900540 25552 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.901932 25487 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:12.902169 24464 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:12.902606 25585 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:12.902963 25585 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:12.901803 25552 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:12.903774 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47822.8us
I20260709 12:11:12.903884 25585 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.905452 25585 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.908293 25456 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:12.912846 25690 raft_consensus.cc:2764] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:11:12.916157 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60750.4us
I20260709 12:11:12.922205 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:12.905210 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:12.923593 22193 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.899998 25475 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:12.940056 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:12.940856 22266 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.955144 22193 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:12.963755 22114 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.968609 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:12.970909 25547 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:12.971014 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:12.972766 22263 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:12.954689 25735 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:12.929967 25641 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:12.938802 25701 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:11:12.993351 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 94866.8us
I20260709 12:11:12.983192 25735 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:13.008077 25735 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.978976 25547 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:11:13.013660 25720 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:13.014508 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.015774 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:13.016546 25707 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.017364 25707 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.020022 25475 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:13.020856 25363 raft_consensus.cc:3055] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:13.021396 25363 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:13.022367 25363 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.025678 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:12.979184 25645 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.024228 25484 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.032959 22266 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:13.033185 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.027627 25475 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.044920 25696 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.046959 25696 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:13.027746 25729 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.049036 25729 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.051100 25729 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:13.051648 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.052564 22269 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:13.031982 25547 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.056499 22270 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:13.057874 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.058499 22197 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 6.
I20260709 12:11:13.059991 22198 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:11:13.060344 22198 pending_rounds.cc:85] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 6
I20260709 12:11:13.060572 22198 pending_rounds.cc:107] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:11:13.060863 22198 raft_consensus.cc:2889] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.061339 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.062309 25710 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.063366 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:13.064842 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:13.067847 22114 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:13.069423 22118 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:13.069804 25729 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:13.070258 25729 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.070755 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:13.071494 22119 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.071559 25728 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:11:13.070864 25729 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.071473 25484 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:13.087839 22119 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:13.090946 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.091998 22269 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.097133 22270 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:11:13.097705 22270 pending_rounds.cc:85] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 3
I20260709 12:11:13.097965 22270 pending_rounds.cc:107] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:11:13.098233 22270 raft_consensus.cc:2889] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.111707 25735 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.104616 25547 raft_consensus.cc:2764] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:11:13.113412 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 357034us
I20260709 12:11:13.113816 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:11:13.114085 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 80996.6us
I20260709 12:11:13.115411 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.105513 25363 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.126478 25735 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:13.118726 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.118053 25398 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:13.149748 22269 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:13.154474 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:13.160604 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:13.166146 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47511.3us
I20260709 12:11:13.167255 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:13.170068 25729 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.170965 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:13.172286 25729 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:13.156477 25695 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.174000 25695 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.176407 25695 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:13.153483 25547 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.178377 25747 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.178887 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:13.196938 25398 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:13.198311 25398 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.198863 25742 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:13.196456 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:13.202996 25731 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.203707 25731 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.206106 22268 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:13.206341 25731 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:13.208317 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:13.196959 24464 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.209414 24464 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.209785 24464 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.211761 25695 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:13.183338 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.159070 25456 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.191748 25735 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.192816 25645 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.212931 22193 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.213406 25721 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:13.212503 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52022.4us
I20260709 12:11:13.215610 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.219472 25353 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:13.172686 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.222651 25742 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.231487 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.260035 22266 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 3.
I20260709 12:11:13.242959 22197 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
W20260709 12:11:13.247558 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 78780.9us
I20260709 12:11:13.247825 22865 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:13.250901 24464 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:13.257700 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 85109.3us
I20260709 12:11:13.263826 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.240952 25735 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:13.266875 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.267333 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:13.259245 22193 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:13.258965 25721 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:13.270272 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.263134 25742 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.273056 25745 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.273065 25704 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.273785 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:13.263284 25695 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:13.296846 25742 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:13.296600 25695 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.297366 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.259156 25707 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.283073 25729 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.258744 25693 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:11:13.284755 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:11:13.306622 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44612.1us
I20260709 12:11:13.284694 25735 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.310684 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:13.268882 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 334550us
I20260709 12:11:13.293826 25547 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.293637 25721 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.299906 22236 leader_election.cc:400] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:13.300752 22269 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:13.314507 22236 leader_election.cc:403] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:13.286667 22268 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
W20260709 12:11:13.303690 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49921.7us
I20260709 12:11:13.304622 24464 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:13.319554 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.323935 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:13.324659 22120 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.325109 25746 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.326403 25746 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.316431 25640 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:13.306473 25645 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:13.329172 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:13.329864 22118 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:13.335846 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.305603 25456 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.344592 22120 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:13.307272 25729 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.347754 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:13.307229 25704 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:11:13.352941 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:13.358747 22162 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:13.362813 22162 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:13.325305 25701 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:13.430015 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 115303us
I20260709 12:11:13.431007 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:13.414691 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44899.3us
W20260709 12:11:13.435330 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 101768us
I20260709 12:11:13.370548 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:13.353379 25645 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:13.348887 25640 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:13.438452 22163 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:13.432214 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:13.354535 25547 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:13.363981 25729 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.453254 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:13.453913 22118 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.358004 25707 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:13.457073 25745 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.457717 25745 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:13.458842 25745 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.459699 25711 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:11:13.460186 25711 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.460517 25711 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:13.461218 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:13.461475 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 108673us
I20260709 12:11:13.461867 22116 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.462287 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.464169 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:13.464408 25741 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:13.465179 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:13.448469 25734 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:11:13.449445 22123 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:13.452157 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:13.452903 25759 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:11:13.465843 22117 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.434230 25353 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.440187 25746 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:13.428066 25690 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:13.477926 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:13.496529 22193 raft_consensus.cc:2410] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:13.478571 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:13.497721 22192 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:13.478749 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:13.486912 22118 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:13.492962 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.467490 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:13.501291 22119 raft_consensus.cc:2376] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7. Re-sending same reply.
I20260709 12:11:13.495394 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:13.502357 22197 raft_consensus.cc:2368] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7.
I20260709 12:11:13.482510 22120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:11:13.505142 22120 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:11:13.505565 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 169791us
I20260709 12:11:13.505537 22120 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.509594 25749 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.512161 22195 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:13.493501 25731 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.489300 25484 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.514343 25731 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:13.514660 25735 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.515545 25731 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.517262 25645 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.499236 25353 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:13.521912 25353 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.526093 22087 leader_election.cc:400] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7.
I20260709 12:11:13.526521 22087 leader_election.cc:403] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:13.528973 25711 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.529767 25640 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.466662 25747 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:13.537107 22116 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
W20260709 12:11:13.503610 25748 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:11:13.466362 25728 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:11:13.525707 22120 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.543272 22117 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:13.496069 25690 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.549007 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:13.554787 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.555709 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.581427 22120 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:13.581625 22268 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:13.558614 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65728.9us
I20260709 12:11:13.507364 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.583093 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.578449 22122 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:13.557018 25484 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:13.587338 22269 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:11:13.592432 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 107353us
W20260709 12:11:13.594962 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 87676.8us
I20260709 12:11:13.595969 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.574303 25475 raft_consensus.cc:2764] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:11:13.568506 25747 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:13.575902 25744 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7.
I20260709 12:11:13.601781 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.585729 25690 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.569545 25644 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:11:13.623078 22268 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:13.629360 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.629580 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.630223 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.630944 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.631016 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.631557 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.632205 22266 raft_consensus.cc:2376] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7. Re-sending same reply.
I20260709 12:11:13.632403 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.633051 22271 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.634377 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.634665 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.635466 22268 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:13.635576 22195 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:13.630273 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.642418 22263 raft_consensus.cc:2393] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:13.603252 25696 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:13.644951 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.659356 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.662030 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.607357 25747 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:13.659611 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.737967 25746 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:13.738672 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:13.747017 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.613551 25749 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:13.612432 25484 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.660144 22264 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:13.663878 25735 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:13.777907 25711 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:13.779397 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:13.780952 25769 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.781586 25769 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.784358 25769 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:13.787734 22198 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.043s	sys 0.128s
W20260709 12:11:13.788141 22198 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.043s	sys 0.128s
I20260709 12:11:13.791386 25729 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.796361 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:13.739742 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 138032us
I20260709 12:11:13.739723 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.739718 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.608217 25764 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.741890 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.812930 25729 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:13.815376 25747 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.747658 22193 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:13.640530 25744 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:13.613670 25398 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:13.761659 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.762290 25749 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.762822 25746 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.766119 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.767732 25765 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.770376 25767 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.831656 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:13.833441 22192 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:11:13.836839 22120 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:13.839041 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:13.839617 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:13.840103 22118 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:13.837030 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:13.842204 22118 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:13.843744 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.809027 22196 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:13.809307 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.810037 22195 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 4: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:13.740193 25696 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:13.810082 22271 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:13.822122 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:13.859639 22193 raft_consensus.cc:2376] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9. Re-sending same reply.
I20260709 12:11:13.824034 22194 raft_consensus.cc:2376] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6. Re-sending same reply.
I20260709 12:11:13.839170 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:13.869393 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:13.871317 22122 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:13.845395 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.874003 22117 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:13.883774 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:11:13.890393 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45104.8us
I20260709 12:11:13.892004 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:13.892714 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 126645us
I20260709 12:11:13.893713 22197 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:13.895488 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:11:13.894405 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 255868us
I20260709 12:11:13.900558 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.901314 22270 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:13.866894 25645 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.903163 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:13.903966 22195 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:13.914728 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.881131 25742 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.890170 25711 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.833276 25398 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.915735 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:13.915989 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:13.923659 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:13.912758 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:13.929265 22195 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.926501 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:13.930081 22858 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:13.930474 22858 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:13.898772 25735 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.932603 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.890301 25744 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:13.933719 22264 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:13.920225 25765 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:13.947973 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.949941 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.954677 22269 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.944825 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.958168 25696 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.867147 25767 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.915355 25774 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.933238 25742 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:13.966074 22265 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:13.969228 25774 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.970901 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.971691 25475 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.976356 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.952874 25701 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:13.952702 25456 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:13.963352 25767 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:13.963351 25747 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:13.933704 25711 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:13.990024 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:13.992740 22195 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:13.993556 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:13.975708 25765 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:11:13.995683 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 83017.3us
I20260709 12:11:14.011626 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:11:14.051514 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47274.1us
I20260709 12:11:13.995311 25701 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:14.009075 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:14.056564 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44989.5us
I20260709 12:11:14.000031 25744 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:14.072078 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 72857.5us
I20260709 12:11:14.074712 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:14.078245 22270 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:11:14.078998 22266 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:11:14.066200 25771 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.083884 22269 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
W20260709 12:11:14.081228 25731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.008s	sys 0.005s
I20260709 12:11:14.073235 25735 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.091892 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:14.081779 25645 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:14.088215 25731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.005s
I20260709 12:11:14.097543 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:14.123133 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 114162us
I20260709 12:11:14.124239 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:14.095775 25456 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.129915 25456 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:14.130901 25456 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.132632 25701 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.134387 25398 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:14.099893 25407 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:14.142920 25407 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.145395 25407 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:14.099581 25645 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.090714 25771 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:14.090299 25547 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:11:14.091447 25690 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:14.169425 25776 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 12:11:14.178248 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 119623us
I20260709 12:11:14.141892 25735 raft_consensus.cc:2764] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:14.191488 22123 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:14.192087 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 99233.4us
I20260709 12:11:14.137916 25765 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.168203 25645 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.164645 25744 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:14.194965 22189 raft_consensus.cc:2368] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:14.184033 25742 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:14.193377 25547 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:14.199687 22163 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:14.192375 25704 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:14.208031 25783 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:11:14.207046 25704 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:14.201583 25711 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:14.219411 25775 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.220247 25775 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.222697 25775 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:14.219413 25704 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.226992 25704 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.201990 25744 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.236038 25744 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:14.267656 25475 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:14.267781 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 62046us
I20260709 12:11:14.259491 25771 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.278995 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:14.292098 22191 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:14.293605 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:14.294195 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:14.289187 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 89591.3us
I20260709 12:11:14.295985 22197 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:14.297585 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:14.301793 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:14.302651 22121 raft_consensus.cc:2410] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:14.304422 22117 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:14.308022 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:14.309423 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:14.313401 22268 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:14.313454 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:14.304796 25475 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:14.310737 25744 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.312625 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:14.286293 25764 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.292656 25788 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:11:14.288884 25701 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:14.316572 25747 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:14.334399 25788 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:14.339334 25788 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.325757 25398 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:11:14.324468 25774 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:14.343024 25774 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:14.353219 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:14.354465 22197 raft_consensus.cc:2410] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:14.324589 25187 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:14.371145 22191 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:11:14.365901 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.372937 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:14.374222 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:14.376888 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:14.377866 22271 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:14.382565 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:14.383582 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:14.385030 24464 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:14.334558 25690 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:14.387009 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:14.388077 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:14.388636 22197 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:14.389492 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:14.394299 22117 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:14.396319 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:14.397722 22116 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:14.398010 22193 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:14.397130 22191 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:14.401836 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:14.405817 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:14.407012 22117 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:14.366396 25187 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:14.390749 25547 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.423135 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:14.397321 25765 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:11:14.418167 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:14.428365 22271 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.427475 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:14.430208 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:14.433557 25735 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.444633 25735 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.445114 25735 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.422561 25767 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:11:14.465899 25767 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:14.466365 25767 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:14.437129 22268 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:14.467933 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57239.8us
I20260709 12:11:14.469729 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:14.470997 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:14.400717 25704 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:11:14.417346 25764 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.429939 25775 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.452492 22117 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:14.476626 22271 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:14.403723 25456 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:11:14.490080 22114 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:14.480929 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:14.492269 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:14.432049 25187 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.446735 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:14.487936 25764 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:14.495828 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:14.429777 25774 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.497466 24464 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:14.497977 24464 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:14.488175 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58375.5us
I20260709 12:11:14.493854 22122 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.443290 25547 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:11:14.433981 25696 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:11:14.502256 24464 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.530905 25789 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:14.496886 25711 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:14.508338 25805 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.537976 22123 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.519558 25765 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:14.501459 25767 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:14.558378 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 63986.7us
I20260709 12:11:14.561664 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:14.567562 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:14.533955 25645 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.556394 25742 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.578548 22122 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:14.580485 22264 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:14.570811 25710 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.573160 25767 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.573175 25775 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.570679 25805 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:11:14.577210 25746 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 12:11:14.604437 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 85242.5us
I20260709 12:11:14.591869 25710 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.610914 25645 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:14.611651 25746 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:11:14.614573 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:14.612165 25746 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:14.584031 25742 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.612107 25710 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:14.601913 25807 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:14.626134 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:14.628806 22269 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
W20260709 12:11:14.639622 25808 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:11:14.640399 25811 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:14.641458 25812 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.642151 25711 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:14.603456 25745 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:11:14.651405 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:14.652105 22122 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:14.657476 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:14.669894 22196 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:11:14.671325 25187 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.673898 25187 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:14.653571 25812 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.679024 25812 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:14.680953 25798 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.681645 25798 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.654440 25711 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.684002 25798 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:14.685446 25711 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:14.686208 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:14.687007 22269 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:14.685982 25816 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:14.688758 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:14.686131 25785 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.692927 25816 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.646354 25746 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:14.714813 25809 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:11:14.726681 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:14.727187 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:14.727322 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:14.730571 22114 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:11:14.728030 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:14.728060 22197 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:14.731323 22115 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:14.714663 25816 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:14.734894 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:14.734711 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:14.729619 22193 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:14.715118 25823 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:11:14.716873 25735 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:14.767418 25781 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.787s	user 0.002s	sys 0.000s
I20260709 12:11:14.773348 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 623) took 1669 ms. Trace:
I20260709 12:11:14.773847 22198 rpcz_store.cc:276] 0709 12:11:13.103927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.104050 (+   123us) service_pool.cc:224] Handling call
0709 12:11:13.106109 (+  2059us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:13.106468 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:13.788522 (+682054us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.917811 (+129289us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:13.918305 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:11:13.918436 (+   131us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:13.918467 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.918540 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:14.766766 (+848226us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:14.772963 (+  6197us) raft_consensus.cc:1685] finished
0709 12:11:14.773072 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:14.773249 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13407,"prepare.queue_time_us":181707,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":34729,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":23147,"spinlock_wait_cycles":4686080,"thread_start_us":797941,"threads_started":2,"wal-append.queue_time_us":191657}
I20260709 12:11:14.718073 25815 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:11:14.789647 22118 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:14.781489 25742 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:14.795297 25750 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:14.796310 25735 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:14.796037 25750 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.798738 25750 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:14.856981 25742 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.858701 25742 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.861171 25742 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:14.862797 25750 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:14.863546 25750 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.865743 25750 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:14.871487 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1816) took 1004 ms. Trace:
W20260709 12:11:14.865794 25818 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:11:14.887094 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:14.872008 22194 rpcz_store.cc:276] 0709 12:11:13.867239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.867397 (+   158us) service_pool.cc:224] Handling call
0709 12:11:13.893294 (+ 25897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:13.996874 (+103580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.996909 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:14.343551 (+346642us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b2c00000448. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:11:14.349365 (+  5814us) log.cc:844] Serialized 26 byte log entry
0709 12:11:14.410190 (+ 60825us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:14.456786 (+ 46596us) log.cc:844] Serialized 14 byte log entry
0709 12:11:14.457726 (+   940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.871137 (+413411us) spinlock_profiling.cc:243] Waited 93.4 ms on lock 0x7b54000fb4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:14.871190 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:14.871235 (+    45us) raft_consensus.cc:1685] finished
0709 12:11:14.871248 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:14.871407 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10338,"prepare.queue_time_us":58712,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":16733,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":2026,"spinlock_wait_cycles":222111360,"thread_start_us":60410,"threads_started":1,"wal-append.queue_time_us":133473}
W20260709 12:11:14.902601 25820 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:11:14.904742 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:14.891219 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:14.877909 25767 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:14.907830 25767 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.911962 25767 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:14.912199 25645 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:14.912955 25767 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:14.913053 25645 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.913650 25767 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.918912 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:14.919684 22270 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:14.921588 22858 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:14.922704 22858 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.929980 25816 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.802738 25741 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:14.932690 25741 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.933184 25741 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.938668 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1811) took 1142 ms. Trace:
I20260709 12:11:14.939185 22189 rpcz_store.cc:276] 0709 12:11:13.795945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.796120 (+   175us) service_pool.cc:224] Handling call
0709 12:11:14.938363 (+1142243us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54001090d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:14.938544 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914630016}
I20260709 12:11:14.944630 25645 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:14.946446 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:14.961836 22860 raft_consensus.cc:2410] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:14.961599 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:14.963236 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:14.964497 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:14.968391 25774 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:14.969033 25774 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:14.971254 25690 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:14.971773 25690 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:14.973423 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:14.973819 22865 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.974146 22264 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.978904 25816 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:14.981611 22270 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:14.988245 22267 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:14.989179 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:14.997012 22116 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:14.947376 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.948010 22861 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:14.949319 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:14.949641 25767 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:14.948516 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:15.000584 22115 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:15.000682 25741 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:15.002900 25741 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:15.005095 25782 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.005697 25782 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:15.007939 25782 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:14.950471 25728 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:15.008862 25728 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:15.011255 25728 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:15.011994 22189 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:14.953375 25746 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:14.956482 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:14.958604 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:14.959532 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:15.014437 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:15.030675 22858 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:15.063182 22264 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
W20260709 12:11:15.069525 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.090394 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:15.091269 22122 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:15.093619 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 580) took 1149 ms. Trace:
I20260709 12:11:15.094005 22858 rpcz_store.cc:276] 0709 12:11:13.925075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.926216 (+  1141us) service_pool.cc:224] Handling call
0709 12:11:14.921191 (+994975us) spinlock_profiling.cc:243] Waited 8.95 ms on lock 0x7b4c0036c340. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec08ea20 00007fccec09fa29 00007fccec065644 00007fccec08cf2d 00007fccec08cb93 00007fcceddbd18b 00007fcceddbdcb5 00007fcceddb8f30 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17
0709 12:11:15.074245 (+153054us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20582656}
I20260709 12:11:15.048844 25704 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.058919 25398 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.971328 25774 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:15.102808 22857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44679affd4554006a2cb59b10b589a27"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:15.105587 22857 raft_consensus.cc:606] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:15.101246 22264 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:15.103912 22021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 138) took 14973 ms (client timeout 15000 ms). Trace:
I20260709 12:11:15.048837 25807 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:15.058841 25475 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.127748 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:15.110189 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:15.128822 22114 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:15.091681 25456 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:15.107717 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:15.073400 25728 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:11:14.972644 25690 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:15.147549 22267 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:15.112860 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:15.148720 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:15.110083 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:15.146727 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:15.108872 25398 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.098140 25775 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:11:15.177121 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:15.106776 22021 rpcz_store.cc:269] 0709 12:11:00.123980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.126863 (+  2883us) service_pool.cc:224] Handling call
0709 12:11:00.159879 (+ 33016us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:15.097290 (+14937411us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:13.053219 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:13.053797 (+   578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:13.053833 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:11:13.053849 (+    16us) tablet.cc:662] Decoding operations
0709 12:11:13.054708 (+   859us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:13.054792 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:13.054832 (+    40us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:11:13.055448 (+   616us) tablet.cc:701] Row locks acquired
0709 12:11:13.055466 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:11:13.055601 (+   135us) write_op.cc:270] Start()
0709 12:11:13.055734 (+   133us) write_op.cc:276] Timestamp: P: 1783599073055558 usec, L: 0
0709 12:11:13.055756 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:11:13.056405 (+   649us) log.cc:844] Serialized 3306 byte log entry
0709 12:11:13.284070 (+227665us) op_driver.cc:464] REPLICATION: finished
0709 12:11:13.345705 (+ 61635us) write_op.cc:301] APPLY: starting
0709 12:11:13.350077 (+  4372us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:13.350298 (+   221us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:13.350435 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:13.615680 (+265245us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:13.741124 (+125444us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:11:13.741176 (+    52us) write_op.cc:312] APPLY: finished
0709 12:11:13.741510 (+   334us) log.cc:844] Serialized 65 byte log entry
0709 12:11:13.741694 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:13.741830 (+   136us) write_op.cc:454] Released schema lock
0709 12:11:13.743738 (+  1908us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:13.766857 (+ 23119us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:13.766892 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":330380,"reported_tablets":24,"spinlock_wait_cycles":56109824,"child_traces":[["op",{"apply.queue_time_us":34020,"apply.run_cpu_time_us":4901,"apply.run_wall_time_us":448399,"num_ops":8,"prepare.queue_time_us":148898,"prepare.run_cpu_time_us":16138,"prepare.run_wall_time_us":82111,"raft.queue_time_us":108793,"raft.run_cpu_time_us":3134,"raft.run_wall_time_us":34390,"replication_time_us":228109,"thread_start_us":274666,"threads_started":4,"wal-append.queue_time_us":104407,"wal-append.run_cpu_time_us":12063,"wal-append.run_wall_time_us":1616321}]]}
W20260709 12:11:15.171144 25820 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 12:11:15.107836 25704 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:15.190269 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:15.192143 22120 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.169494 25398 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.132889 25805 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:11:15.133550 25475 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:15.196671 25735 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:15.197896 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:15.214354 22270 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:15.189195 25813 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:15.192662 25774 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:15.201612 25696 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:15.248586 22117 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:15.151171 25456 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:15.211143 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:15.130873 25807 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:15.253193 22269 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:11:15.229813 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:15.257099 22115 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:15.230547 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:15.261184 22116 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.242208 22858 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:15.265386 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 66806us
I20260709 12:11:15.195665 25363 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.266683 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:15.268661 25711 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.269318 25711 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.269726 25711 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:15.271643 25711 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:15.272039 25711 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.273135 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:15.274631 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:15.275229 22189 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.275415 22196 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:15.277521 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:15.278227 22194 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:15.279209 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:15.280221 22858 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:15.272433 25711 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:15.277573 22193 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:15.282020 25695 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.284878 25747 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:15.286324 25747 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:15.286309 25711 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:15.285210 22189 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:15.211795 25690 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.132524 25782 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:11:15.273028 25788 consensus_queue.cc:1059] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:11:15.320200 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 173427us
I20260709 12:11:15.322427 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:15.325373 22116 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:15.323635 22269 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:15.246232 25765 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:11:15.332134 22115 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
W20260709 12:11:15.319664 25830 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:11:15.297302 25774 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:15.335951 25832 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:11:15.251788 25813 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:15.337815 25456 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:15.339255 25813 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:15.334928 25778 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:15.340124 25778 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:15.341163 25844 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:15.342548 25778 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:15.350862 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:15.365739 25475 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:15.366504 25846 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:11:15.381137 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.381503 25735 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:15.387554 25842 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:11:15.372144 25456 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:15.406980 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:15.284471 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:15.421957 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 137585us
I20260709 12:11:15.423143 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:15.431754 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:15.432655 22115 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
W20260709 12:11:15.439301 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 117469us
I20260709 12:11:15.440435 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:15.393678 25735 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:15.398769 25704 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:15.399024 25456 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:15.445755 25836 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.474072 25735 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:15.477169 25807 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:15.445132 25780 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:15.478197 25780 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.478673 25780 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.489362 25456 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:15.491443 25839 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:15.456037 25782 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.513077 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:15.521013 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 64927.9us
I20260709 12:11:15.510861 22018 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 7, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 7 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:11:15.526134 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 417143us
I20260709 12:11:15.527019 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:15.527359 22018 catalog_manager.cc:5697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:15.530524 22018 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 7, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 7 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:11:15.549233 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 93699us
I20260709 12:11:15.533509 22272 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.560353 22269 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:15.565740 22263 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:15.561512 22018 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 6, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 6 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:15.578114 22119 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:15.578883 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:15.581954 22190 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:15.583824 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 160774us
I20260709 12:11:15.588302 22264 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:15.588389 22117 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:15.590641 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:15.593185 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:15.570322 25704 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:15.597086 22018 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:15.687507 22264 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:15.686429 22018 catalog_manager.cc:5697] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:15.688910 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:15.689159 22018 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 7, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:15.692065 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:15.692704 22117 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:15.693118 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:15.595484 25815 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:15.697741 22831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.012s	sys 0.063s
W20260709 12:11:15.702936 22831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.012s	sys 0.063s
W20260709 12:11:15.703346 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 522756us
W20260709 12:11:15.703557 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 102101us
I20260709 12:11:15.710157 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:15.711403 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:15.698484 22018 catalog_manager.cc:5697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:15.713662 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:15.714030 22018 catalog_manager.cc:5697] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 7, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 7 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:15.715626 22018 catalog_manager.cc:5697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:15.709465 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:15.709383 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 76900.4us
I20260709 12:11:15.693660 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:15.712662 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:15.719590 22018 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 9, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 9 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:15.683764 25807 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:15.688498 25704 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:15.754196 22236 leader_election.cc:400] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:15.754832 22236 leader_election.cc:403] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:15.684263 25798 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:11:15.754688 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:15.753527 25823 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:15.730371 22018 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 3 to 9, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 9 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:15.808435 22018 catalog_manager.cc:5697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:15.753926 25704 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.720597 25834 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.729518 25828 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:15.722947 25745 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:11:15.856706 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:15.837217 25398 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.001s
I20260709 12:11:15.753003 25775 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
W20260709 12:11:15.875229 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 156319us
W20260709 12:11:15.836154 25781 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:11:15.886796 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:15.758713 25846 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:11:15.799533 25840 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:15.902688 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:15.753835 25807 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:15.851783 25812 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:15.912496 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 195750us
W20260709 12:11:15.917713 25851 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:11:15.899892 25690 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.006s
W20260709 12:11:15.933365 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 178764us
I20260709 12:11:15.799335 25845 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.144s
I20260709 12:11:15.886622 25823 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:15.938664 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:15.951781 22115 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:15.919750 25834 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.911675 25721 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:15.921520 25187 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.924263 25812 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.906260 25828 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:15.938651 25745 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.920675 25838 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:15.911911 25398 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:15.962001 25746 consensus_meta.cc:287] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.928s	user 0.013s	sys 0.001s
I20260709 12:11:15.932953 25769 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:11:15.935122 25717 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:11:15.964704 25721 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.008958 25833 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:11:15.975773 25812 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.980054 25701 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:16.018757 25807 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:16.026438 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 308238us
W20260709 12:11:16.011199 25852 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:16.033222 22123 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:11:15.980705 25767 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:16.058341 22123 pending_rounds.cc:85] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 2
I20260709 12:11:16.058926 22123 pending_rounds.cc:107] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:11:16.059486 22123 raft_consensus.cc:2889] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:16.032162 25843 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.033367 25721 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:16.057765 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 129538us
W20260709 12:11:16.067216 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 147337us
W20260709 12:11:16.081746 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.038481 25701 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:16.038101 25745 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:16.084842 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:16.034078 25782 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:11:16.100266 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 142627us
I20260709 12:11:16.097997 22163 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:16.005410 25838 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:16.115280 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:16.115770 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:16.083391 25807 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:16.136034 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 423366us
I20260709 12:11:16.068620 25767 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:16.145658 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:16.069358 25823 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:16.120187 25788 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.131202 25840 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:16.085476 25843 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:16.148707 25701 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:16.162840 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:16.144426 25746 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:16.121209 25846 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 12:11:16.147629 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53611.3us
I20260709 12:11:16.111337 25859 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:11:16.105940 25745 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:16.157133 25788 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.135473 25807 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:16.216082 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 108596us
W20260709 12:11:16.163367 25854 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.091s	user 0.002s	sys 0.000s
I20260709 12:11:16.166101 25840 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:16.228259 25788 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:16.227957 25820 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:11:16.275617 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 94137.4us
I20260709 12:11:16.230847 25834 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:16.165514 25837 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
W20260709 12:11:16.330013 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 220728us
W20260709 12:11:16.330617 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 103885us
I20260709 12:11:16.333621 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:16.228842 25867 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:16.334522 22121 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.109869 25828 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:16.341948 25784 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.343992 22191 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:16.344139 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:16.345593 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:16.259356 25840 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:16.328531 25837 consensus_queue.cc:1243] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:16.415722 22121 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:16.440025 25881 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:16.440841 25881 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:16.443735 25704 consensus_meta.cc:287] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.001s
W20260709 12:11:16.445873 25866 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
W20260709 12:11:16.456666 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 358819us
I20260709 12:11:16.457708 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:16.388262 25784 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:16.419844 25690 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.335553 25834 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:16.491593 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 63252.5us
W20260709 12:11:16.461891 25872 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:11:16.444262 25704 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:16.460052 25746 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.501606 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 156080us
I20260709 12:11:16.381481 25867 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:16.526072 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:16.495551 25798 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:16.496600 25398 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:16.498750 25690 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:16.559446 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52911.9us
I20260709 12:11:16.585475 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2155) took 1357 ms. Trace:
I20260709 12:11:17.079836 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2160) took 1850 ms. Trace:
W20260709 12:11:16.644282 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 111978us
W20260709 12:11:17.087733 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.569386 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2151) took 1369 ms. Trace:
I20260709 12:11:16.547043 22857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45120 (request call id 14) took 1437 ms. Trace:
W20260709 12:11:16.781903 22831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.003s	sys 0.012s
I20260709 12:11:17.078636 22122 rpcz_store.cc:276] 0709 12:11:15.228001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.228200 (+   199us) service_pool.cc:224] Handling call
0709 12:11:15.245146 (+ 16946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.252399 (+  7253us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:15.252428 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.298333 (+ 45905us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.387895 (+ 89562us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:15.387938 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.584891 (+1196953us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b5400311ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:16.584979 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.585056 (+    77us) raft_consensus.cc:1685] finished
0709 12:11:16.585077 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.585396 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55553,"raft.queue_time_us":3363,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8862,"spinlock_wait_cycles":15799552,"thread_start_us":85824,"threads_started":1,"wal-append.queue_time_us":212187,"wal-append.run_cpu_time_us":1463,"wal-append.run_wall_time_us":1007248}
W20260709 12:11:17.098527 22831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.008s	sys 0.017s
W20260709 12:11:17.099325 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 865223us
I20260709 12:11:17.080359 22123 rpcz_store.cc:276] 0709 12:11:15.229769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.231024 (+  1255us) service_pool.cc:224] Handling call
0709 12:11:15.231292 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.060307 (+829015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.079563 (+1019256us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b5400311fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:17.079768 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842655488}
I20260709 12:11:17.105310 22866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 590) took 1142 ms. Trace:
I20260709 12:11:17.098364 22857 rpcz_store.cc:276] 0709 12:11:15.089772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.089966 (+   194us) service_pool.cc:224] Handling call
0709 12:11:16.506596 (+1416630us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b540019f8a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd3f520 00007fcceddbc652 00007fccf2d8a60a 00007fccec3107d4 00007fccec310762 00007fccec310691 00007fccec31060c 00007fccec30f8c2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:16.527547 (+ 20951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109402368}
I20260709 12:11:17.097453 22120 rpcz_store.cc:276] 0709 12:11:15.200191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.200930 (+   739us) service_pool.cc:224] Handling call
0709 12:11:15.201365 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.343704 (+142339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.343740 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.343797 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:15.343861 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.569094 (+1225233us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54002553d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:16.569153 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.569284 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326840704}
I20260709 12:11:17.105813 22866 rpcz_store.cc:276] 0709 12:11:15.941485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.941705 (+   220us) service_pool.cc:224] Handling call
0709 12:11:15.942095 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.985495 (+ 43400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.985523 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.985564 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:15.985593 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.083229 (+1097636us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b54004d44d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:17.083297 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.083478 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99225344}
W20260709 12:11:16.574112 25885 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:16.573081 25871 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.572882 25860 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.334s	user 0.000s	sys 0.002s
W20260709 12:11:16.712754 25888 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 12:11:17.165299 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 54046.9us
W20260709 12:11:17.104238 25721 consensus_meta.cc:287] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 1.005s	user 0.013s	sys 0.000s
I20260709 12:11:17.103729 25798 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.210091 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 2065) took 1102 ms. Trace:
I20260709 12:11:17.211503 25798 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:17.210536 22272 rpcz_store.cc:276] 0709 12:11:16.108048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.108221 (+   173us) service_pool.cc:224] Handling call
0709 12:11:16.131780 (+ 23559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.211693 (+ 79913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.211743 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.212500 (+   757us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.393497 (+180997us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:16.521024 (+127527us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.696725 (+175701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.696857 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.209839 (+512982us) raft_consensus.cc:1685] finished
0709 12:11:17.209862 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.209999 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":253501,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":220707,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":1300,"thread_start_us":534224,"threads_started":4,"wal-append.queue_time_us":283133}
I20260709 12:11:17.212558 22857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44711cbd4d234e36807a94726a691570"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:17.212985 25882 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.213352 22857 raft_consensus.cc:606] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:17.213768 22857 raft_consensus.cc:614] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:17.213792 25882 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.216468 25882 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:16.696745 25844 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:17.104586 25840 consensus_meta.cc:287] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.003s
I20260709 12:11:16.760280 25696 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.255976 25696 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.255852 25840 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.258750 25696 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:16.586711 25829 raft_consensus.cc:3055] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:16.593396 25704 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:16.591498 25784 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:17.080426 25456 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.273622 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:16.696835 25881 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:16.630455 25838 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:16.570567 25892 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:16.532737 25864 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:17.170773 25735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.012s	sys 0.039s
I20260709 12:11:17.207531 25893 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:16.909628 25780 consensus_meta.cc:287] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.430s	user 0.010s	sys 0.005s
I20260709 12:11:17.222420 25865 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.223171 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 723) took 2107 ms. Trace:
I20260709 12:11:17.268493 25829 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:16.527904 25767 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:16.711983 25831 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:16.569031 25889 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:16.570117 25895 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.217124 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1835) took 1526 ms. Trace:
I20260709 12:11:17.218209 25715 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:16.747917 25765 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.236238 25774 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:17.236918 25690 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:17.237560 25788 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.925s	user 0.007s	sys 0.004s
I20260709 12:11:17.238962 25833 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:16.519491 25746 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.242779 25745 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:17.243798 25812 consensus_meta.cc:287] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.186s	user 0.005s	sys 0.005s
I20260709 12:11:16.940362 25867 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:16.590157 25834 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:17.262287 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:17.263077 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:17.208218 25721 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.162999 25782 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:16.532465 25884 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.743s
I20260709 12:11:17.268349 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:16.527714 25778 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:17.273422 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:17.259914 25882 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:16.710619 25886 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.282563 22265 rpcz_store.cc:276] 0709 12:11:15.115289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.115455 (+   166us) service_pool.cc:224] Handling call
0709 12:11:15.115847 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.314430 (+198583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.314470 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.314517 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:15.314564 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.222856 (+1908292us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400055854. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:17.222911 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.223037 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456087936}
W20260709 12:11:17.281474 25735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.012s	sys 0.040s
I20260709 12:11:17.265516 25840 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:17.292003 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 2064) took 1192 ms. Trace:
I20260709 12:11:17.266105 25844 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.285847 25903 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.281191 25863 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:17.322659 25845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.025s	sys 0.039s
I20260709 12:11:17.286286 25704 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.282017 25780 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.286180 25838 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.405375 25735 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:17.441249 25735 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.335490 25745 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.336264 25864 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:17.336640 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.444924 25745 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:17.337145 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 233975us
I20260709 12:11:17.232296 25871 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.290732 25767 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:17.312842 25857 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.349752 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:17.456128 22264 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:17.290455 25889 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.317981 25765 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.347504 22190 raft_consensus.cc:606] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:17.327905 25774 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.286851 22118 rpcz_store.cc:276] 0709 12:11:15.690846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.691094 (+   248us) service_pool.cc:224] Handling call
0709 12:11:15.691525 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.691963 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.692005 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.692623 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.938331 (+245708us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:15.938381 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.938453 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.216861 (+1278408us) raft_consensus.cc:1685] finished
0709 12:11:17.216889 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.217051 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6960,"raft.queue_time_us":5235,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7564,"thread_start_us":216917,"threads_started":1,"wal-append.queue_time_us":335078}
I20260709 12:11:17.368203 22272 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:17.366781 22269 rpcz_store.cc:276] 0709 12:11:16.099716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.099958 (+   242us) service_pool.cc:224] Handling call
0709 12:11:16.100990 (+  1032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.101978 (+   988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.102035 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.138194 (+ 36159us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.271439 (+133245us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:16.271510 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.271628 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.291658 (+1020030us) raft_consensus.cc:1685] finished
0709 12:11:17.291691 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.291892 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":829,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":3794,"thread_start_us":93925,"threads_started":1,"wal-append.queue_time_us":244092}
I20260709 12:11:17.376482 25912 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.377434 25696 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.379892 22120 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:17.347149 25909 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.288988 25831 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.353832 25778 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:17.330396 25833 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.288602 25865 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.360550 25867 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.346777 25782 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.326558 25788 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.448271 22189 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:11:17.449652 25780 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:17.434836 25907 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:11:17.450083 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:17.451100 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:17.360190 25834 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:17.358049 25900 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.315621 25895 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.635715 25834 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.637892 25895 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:17.638000 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:17.638692 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:17.639472 22862 raft_consensus.cc:606] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:17.639804 22862 raft_consensus.cc:614] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:17.640061 25844 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:17.453162 22266 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:17.286577 25893 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.313865 25715 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.341343 25812 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.370647 25882 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.526948 25833 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:17.498099 22114 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:17.526074 25778 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.587342 25901 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:17.468321 25704 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.468448 25881 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.468640 25767 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.527578 25774 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.458979 25838 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:17.533667 22237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.005s	sys 0.018s
W20260709 12:11:17.534142 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 94421.5us
W20260709 12:11:17.534200 25873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.010s	sys 0.016s
I20260709 12:11:17.529366 25889 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:17.530884 25696 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.537820 25765 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:17.404860 25863 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.541626 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:17.545950 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:17.403954 25840 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.650872 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:17.751708 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:17.752429 22123 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:17.637897 25834 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:17.664371 22197 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:17.526755 25909 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.681321 25877 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.469292 25923 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:17.687058 25913 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:17.687261 25778 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.688434 25882 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:17.688755 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:17.689039 25833 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.705627 25914 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:17.705367 25881 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.665668 25895 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.668505 25844 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:17.682583 25920 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.711778 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:17.669312 25828 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.669598 25690 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:17.591427 25867 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:17.715073 22237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.005s	sys 0.018s
I20260709 12:11:17.727365 22270 raft_consensus.cc:2410] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:17.445072 25864 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.351122 25829 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:17.729673 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.732682 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:17.402978 25845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.025s	sys 0.039s
I20260709 12:11:17.748478 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:17.533206 25912 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.370815 25886 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.405432 25903 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.583547 25837 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:17.759768 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:17.710822 25901 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.761221 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:17.750417 25849 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 1.631s	user 0.008s	sys 0.009s
I20260709 12:11:17.469128 25857 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.750790 25765 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.665083 25900 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.781569 25918 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.783732 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:17.742935 25873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.011s	sys 0.017s
I20260709 12:11:17.737462 25746 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:17.744511 25456 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.790427 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:17.779131 22862 raft_consensus.cc:606] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:17.791647 25913 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.759995 25840 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.792057 25877 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.898748 25884 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.175957 25807 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.236846 25864 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:17.813463 25828 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.208885 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:18.182844 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2123) took 2037 ms. Trace:
I20260709 12:11:17.961555 22268 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:18.058480 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51217.4us
I20260709 12:11:17.783281 25923 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.234848 22266 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.306121 25918 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.622391 22271 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
W20260709 12:11:18.622717 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.623008 22118 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:11:18.624063 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 2213) took 1079 ms. Trace:
I20260709 12:11:18.233093 25774 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:18.107965 25936 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 12:11:18.339313 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.624464 22271 rpcz_store.cc:276] 0709 12:11:17.544468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.637659 (+ 93191us) service_pool.cc:224] Handling call
0709 12:11:18.623842 (+986183us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54001ad454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:18.623963 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2261982080}
I20260709 12:11:18.344503 25931 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:17.895226 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 94471.8us
I20260709 12:11:18.626241 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:18.089419 25911 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:18.551904 22115 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:18.628243 25911 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.875728 25939 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.627265 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:18.630082 25806 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:18.629604 25939 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.630561 25806 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:18.631011 25806 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:18.234851 25884 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:18.363402 25917 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 12:11:17.802165 25833 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.634240 25874 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:18.635057 22267 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:17.792608 25834 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:18.636271 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 2215) took 1091 ms. Trace:
I20260709 12:11:18.635911 25834 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.636684 22267 rpcz_store.cc:276] 0709 12:11:17.545085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.650450 (+105365us) service_pool.cc:224] Handling call
0709 12:11:18.636102 (+985652us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54000ea454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:18.636210 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034212096}
I20260709 12:11:18.638396 22267 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:18.638810 25834 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:18.640048 25834 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:18.441879 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 538) took 1055 ms. Trace:
I20260709 12:11:18.618731 25745 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:18.621443 25704 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.659914 22121 rpcz_store.cc:276] 0709 12:11:17.386201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.386485 (+   284us) service_pool.cc:224] Handling call
0709 12:11:17.386795 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.689981 (+303186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.690013 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.690058 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:17.690105 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.440638 (+750533us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b5400327654. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:18.440706 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.441779 (+  1073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696717056}
I20260709 12:11:18.243222 22122 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:18.377660 25775 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.663230 25775 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:17.814658 22120 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:18.641520 22267 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:18.533453 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2118) took 2390 ms. Trace:
I20260709 12:11:18.665918 25834 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.835739 25690 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.670651 25690 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.170347 25843 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:18.532473 22270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 2057) took 2968 ms (client timeout 2792 ms). Trace:
I20260709 12:11:18.671347 25918 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:18.671518 22865 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:18.657924 25893 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:18.608943 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.551431 22114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1839) took 2026 ms (client timeout 1913 ms). Trace:
W20260709 12:11:18.673086 22114 rpcz_store.cc:269] 0709 12:11:16.525562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.525774 (+   212us) service_pool.cc:224] Handling call
0709 12:11:18.551049 (+2025275us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b540032ffd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:18.551269 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232981248}
W20260709 12:11:18.305796 25910 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.557s	user 0.000s	sys 0.002s
I20260709 12:11:17.922051 25921 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:17.894661 25915 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:18.675640 25921 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.560657 25838 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:18.677484 25838 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.678258 25838 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.679082 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:18.576467 22089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.131s	user 0.003s	sys 0.000s
W20260709 12:11:18.680688 22089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.005s	sys 0.006s
I20260709 12:11:18.680838 25838 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:18.227970 25715 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:17.880988 25920 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:17.813316 25844 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.118069 25871 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:18.149940 25927 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 12:11:18.244017 22196 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:18.173171 25865 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:18.566219 25909 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.366546 25767 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.082197 25929 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.648866 25901 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.773788 25945 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:18.553785 25908 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.186s	user 0.003s	sys 0.000s
I20260709 12:11:18.307938 25765 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.563589 25903 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.650892 25877 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:18.159063 25788 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:18.652124 22265 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:11:17.922991 25882 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:18.376415 25867 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:18.651166 22266 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:18.653041 25837 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.376415 25857 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:18.653865 25840 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:18.355100 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:18.838631 22862 raft_consensus.cc:606] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:18.839308 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 730) took 1095 ms. Trace:
I20260709 12:11:18.306563 25456 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.654852 25884 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:18.420060 22866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 601) took 1159 ms. Trace:
I20260709 12:11:18.841053 22866 rpcz_store.cc:276] 0709 12:11:17.261041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.261291 (+   250us) service_pool.cc:224] Handling call
0709 12:11:17.261830 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.657266 (+395436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.657313 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.657374 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:17.657427 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.419726 (+762299us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54002f8fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:18.419794 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.419973 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908730752}
I20260709 12:11:18.618475 25829 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:17.808804 25916 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:18.560034 25828 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:18.533658 25778 consensus_meta.cc:287] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.752s	user 0.013s	sys 0.000s
I20260709 12:11:18.658452 25923 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.196947 25782 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:18.113531 25902 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.308287 22119 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:18.243186 22197 rpcz_store.cc:276] 0709 12:11:16.145804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.146886 (+  1082us) service_pool.cc:224] Handling call
0709 12:11:16.147455 (+   569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.760723 (+1613268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.172732 (+412009us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001f3bd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:18.182754 (+ 10022us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3474845952}
I20260709 12:11:18.661398 25704 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:18.575522 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.664286 25735 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:18.621162 25812 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:18.863734 25791 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.008s	sys 0.009s
I20260709 12:11:18.664839 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:18.664338 25775 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:17.813378 25895 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.394050 25941 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:18.666082 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:18.666687 22189 rpcz_store.cc:276] 0709 12:11:16.142931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.143171 (+   240us) service_pool.cc:224] Handling call
0709 12:11:16.143652 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.584593 (+1440941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.533086 (+948493us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54003b65d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:18.533355 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2999652096}
I20260709 12:11:18.438031 25701 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:18.671700 22270 rpcz_store.cc:269] 0709 12:11:15.563767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.564282 (+   515us) service_pool.cc:224] Handling call
0709 12:11:18.532061 (+2967779us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b54002274d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:18.532324 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4884283136}
I20260709 12:11:18.673520 25912 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:18.240538 25831 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:18.675818 25915 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.676719 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:18.678829 25921 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:17.847445 25924 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:18.416724 25906 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.041s	user 0.003s	sys 0.001s
I20260709 12:11:18.233845 25721 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:17.850131 25914 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.681648 25774 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.682752 25863 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.683424 25834 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:18.686479 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 60111.3us
W20260709 12:11:18.688453 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.691376 22123 consensus_meta.cc:287] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.906s	user 0.011s	sys 0.000s
I20260709 12:11:18.937526 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:18.937582 22123 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:18.937877 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:18.676620 25833 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:18.708477 25883 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.872340 25828 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:18.732147 22237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.025s	sys 0.061s
W20260709 12:11:18.743482 22830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.019s	sys 0.028s
W20260709 12:11:18.942974 22237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.026s	sys 0.061s
W20260709 12:11:18.943079 22830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.020s	sys 0.028s
I20260709 12:11:18.730567 25718 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:11:18.732255 25690 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.737852 25780 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.626451 25931 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.732405 25798 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:18.657289 25913 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.660319 25696 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:18.574939 25881 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:18.641888 25911 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:18.785773 25920 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.789120 25695 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:18.790134 25939 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:18.790956 25900 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:18.644178 25806 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.794044 25929 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.818994 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1825) took 2476 ms. Trace:
I20260709 12:11:18.794507 25945 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.822376 25765 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:18.779801 25918 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:18.839762 22266 rpcz_store.cc:276] 0709 12:11:17.740979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.746030 (+  5051us) service_pool.cc:224] Handling call
0709 12:11:18.836411 (+1090381us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:18.846480 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2206) took 1390 ms. Trace:
W20260709 12:11:18.850404 22264 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.330s	user 0.010s	sys 0.009s
I20260709 12:11:18.937397 25774 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:18.852517 22238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.007s	sys 0.051s
W20260709 12:11:18.994977 22238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.007s	sys 0.052s
I20260709 12:11:18.830452 25871 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:18.868561 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:18.995834 22121 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:18.870033 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:18.906472 25924 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.998310 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:18.999172 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:18.870782 22263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.009s	sys 0.012s
I20260709 12:11:18.873700 22197 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:11:19.000954 22263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.010s	sys 0.012s
I20260709 12:11:18.869088 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:19.001945 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 2069) took 1653 ms. Trace:
W20260709 12:11:18.864733 25791 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.008s	sys 0.009s
I20260709 12:11:18.888849 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1842) took 1142 ms. Trace:
I20260709 12:11:18.840214 25882 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:19.005467 22119 rpcz_store.cc:276] 0709 12:11:17.748018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.748180 (+   162us) service_pool.cc:224] Handling call
0709 12:11:18.888502 (+1140322us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b540031d3d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:18.888712 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170312064}
I20260709 12:11:19.006942 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:18.927349 22271 pending_rounds.cc:85] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 6
I20260709 12:11:19.007937 22271 pending_rounds.cc:107] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:11:18.870260 25782 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:11:18.928392 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 211745us
I20260709 12:11:18.870708 25812 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:18.938257 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1843) took 1187 ms. Trace:
W20260709 12:11:18.686218 22088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.792s (SENT) [suppressed 58 similar messages]
I20260709 12:11:18.938807 22122 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.619292 25886 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:18.940861 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 209772us
I20260709 12:11:18.954511 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:18.845877 25916 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.958443 25846 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:18.966074 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:18.961174 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 738) took 1216 ms. Trace:
I20260709 12:11:18.872040 25704 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.968407 22193 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:18.942639 25861 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:18.982327 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 165473us
W20260709 12:11:18.850884 25836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.004s	sys 0.013s
W20260709 12:11:18.991954 22264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.472s	user 0.010s	sys 0.010s
I20260709 12:11:18.987075 22196 rpcz_store.cc:276] 0709 12:11:16.342891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.345396 (+  2505us) service_pool.cc:224] Handling call
0709 12:11:18.111119 (+1765723us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b5800196598. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:11:18.111449 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.781684 (+670235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.818566 (+ 36882us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54001095d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:18.818880 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306628224}
I20260709 12:11:18.991317 22265 rpcz_store.cc:276] 0709 12:11:17.455619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.456471 (+   852us) service_pool.cc:224] Handling call
0709 12:11:17.456810 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.830628 (+1373818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.846203 (+ 15575us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400056254. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:18.846405 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2748158848}
I20260709 12:11:19.004034 25871 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.951256 25788 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:11:19.008270 22271 raft_consensus.cc:2889] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:19.008792 22116 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:18.888994 25902 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.004134 25918 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.021174 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:18.927318 25941 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.980857 25695 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.964843 25780 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.969370 25798 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.962723 25828 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:18.959187 25690 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:18.950752 25883 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.012411 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.353403 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:19.031282 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:11:19.354882 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.354748 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 333641us
W20260709 12:11:19.355446 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.283902 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:19.002432 22263 rpcz_store.cc:276] 0709 12:11:17.348144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.348345 (+   201us) service_pool.cc:224] Handling call
0709 12:11:17.348854 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.349189 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:17.534139 (+184950us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.001427 (+1467288us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:19.001507 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:19.001581 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.001678 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.001870 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":316596,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":816147,"raft.run_cpu_time_us":483,"raft.run_wall_time_us":21358,"spinlock_wait_cycles":1962240,"thread_start_us":1631344,"threads_started":3,"wal-append.queue_time_us":1243649}
I20260709 12:11:19.013347 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.131616 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:19.057467 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.023341 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.358878 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:19.016245 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 330032us
I20260709 12:11:19.353519 22268 rpcz_store.cc:276] 0709 12:11:17.744634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.643291 (+898657us) service_pool.cc:224] Handling call
0709 12:11:18.643524 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.643750 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:18.644109 (+   359us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.960739 (+316630us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:18.960824 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:18.960875 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.960968 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.961105 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29909,"prepare.queue_time_us":320397,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":51288,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":20222,"spinlock_wait_cycles":39143040,"thread_start_us":286387,"threads_started":1,"wal-append.queue_time_us":361753}
W20260709 12:11:19.320820 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.363036 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:19.162130 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:19.286680 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:19.015897 22123 rpcz_store.cc:276] 0709 12:11:17.751165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.751396 (+   231us) service_pool.cc:224] Handling call
0709 12:11:18.938195 (+1186799us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:19.370986 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 404952us
I20260709 12:11:19.372008 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:19.371946 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.226290 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:19.359859 22119 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.068667 22122 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:19.014185 22237 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:18.991674 25833 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:19.419617 22862 raft_consensus.cc:2393] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:11:19.358134 25836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.460s	user 0.015s	sys 0.041s
I20260709 12:11:19.199524 25945 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:19.114661 25839 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:19.364423 22861 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:19.316154 25456 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:19.014384 25954 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:19.005513 25887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.007s	sys 0.011s
I20260709 12:11:19.450807 22190 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.419438 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2177) took 1383 ms. Trace:
I20260709 12:11:19.452868 22194 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:19.456760 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:19.458477 22272 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:19.463650 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:19.464624 22118 rpcz_store.cc:276] 0709 12:11:18.035942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.670243 (+634301us) service_pool.cc:224] Handling call
0709 12:11:18.670586 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.979910 (+309324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.979941 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:18.979981 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:18.980019 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.419202 (+439183us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400084154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:19.419249 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.419380 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710858112}
I20260709 12:11:19.470960 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:19.019903 25920 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:19.486837 22121 raft_consensus.cc:2410] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:19.369704 25585 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.441411 25915 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:19.481568 22116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1844) took 1722 ms (client timeout 1921 ms). Trace:
I20260709 12:11:19.015766 25765 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.011863 25882 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:19.277010 25900 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:19.379451 25876 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.358634 25940 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:19.490738 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:19.417840 25831 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:19.199602 25931 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:19.566238 25940 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.116719 25844 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.446060 25895 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:19.501562 22116 rpcz_store.cc:269] 0709 12:11:17.759269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.759419 (+   150us) service_pool.cc:224] Handling call
0709 12:11:19.481240 (+1721821us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540012b1d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:19.481459 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763156224}
I20260709 12:11:19.058633 25947 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:19.554111 22119 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:19.015759 25812 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.115082 25857 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.385s
W20260709 12:11:19.491499 25887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.340s	user 0.013s	sys 0.029s
I20260709 12:11:19.502395 25920 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.536424 25876 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:19.595003 25876 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.598143 25916 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:19.492074 25585 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.599678 25585 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.600343 25812 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.601154 22198 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:19.558153 25900 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:19.603075 25941 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.603885 25900 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:19.604125 25914 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.014894 25782 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.606384 25940 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.489499 25775 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.588469 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.609464 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.610092 22116 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:19.610845 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.589556 25690 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:19.590133 25774 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.590626 25806 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.592264 25902 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.592396 25704 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.593735 25695 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:19.543174 25837 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:19.595077 25798 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.606304 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.581884 25735 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.695245 22190 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:19.580936 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.558260 25831 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.473560 25954 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:19.635980 25701 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.757s	user 0.013s	sys 0.000s
I20260709 12:11:19.636831 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.589658 25924 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.589630 25920 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.606472 25782 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:19.615237 25947 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:19.722168 25947 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:19.724926 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 729) took 1984 ms. Trace:
I20260709 12:11:19.454620 25839 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.614256 25828 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.709002 22118 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:19.455144 25833 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:19.735111 25833 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:19.617882 25778 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.378700 25846 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.738001 25806 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:19.738790 25846 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.738662 25806 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:19.739509 22123 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:19.725353 22269 rpcz_store.cc:276] 0709 12:11:17.740696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.540708 (+800012us) service_pool.cc:224] Handling call
0709 12:11:18.541229 (+   521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.854956 (+313727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.855003 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.867179 (+ 12176us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.391918 (+524739us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:19.391979 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.392073 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.724678 (+332605us) raft_consensus.cc:1685] finished
0709 12:11:19.724697 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.724862 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4699,"raft.queue_time_us":236045,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":3172,"thread_start_us":753067,"threads_started":2,"wal-append.queue_time_us":797937}
I20260709 12:11:19.749210 22122 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:19.751372 22122 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:19.771173 25954 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.777652 25918 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.781527 25780 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.706758 25831 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.709267 25735 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.787254 25806 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:19.794183 25871 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:19.795624 25883 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:19.715144 25893 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.801592 25893 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.803138 22114 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:19.810518 25929 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:19.636379 25765 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:19.815861 25765 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:19.816536 22272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 727) took 2076 ms (client timeout 2172 ms). Trace:
W20260709 12:11:19.817186 22272 rpcz_store.cc:269] 0709 12:11:17.740115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.756663 (+ 16548us) service_pool.cc:224] Handling call
0709 12:11:19.816273 (+2059610us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54001db0d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:19.816447 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1923598080}
I20260709 12:11:19.820969 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2218) took 1214 ms. Trace:
I20260709 12:11:19.821502 22267 rpcz_store.cc:276] 0709 12:11:18.606807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.666128 (+ 59321us) service_pool.cc:224] Handling call
0709 12:11:19.819032 (+1152904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.819291 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.819331 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:19.819391 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:19.819449 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.819529 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.820719 (+  1190us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001db0d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:19.820888 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2650711424}
I20260709 12:11:19.736222 25778 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.835940 25778 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:19.847133 22117 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:19.848517 22117 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:19.851620 25839 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:19.856459 25836 raft_consensus.cc:993] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:19.857052 25836 raft_consensus.cc:1081] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
W20260709 12:11:19.858083 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 478598us
W20260709 12:11:19.858873 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 434302us
I20260709 12:11:19.860321 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:19.860930 22267 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:19.859372 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 503460us
W20260709 12:11:19.859820 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 437127us
I20260709 12:11:19.862152 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.862919 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.862936 22269 raft_consensus.cc:2410] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:19.865134 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.867959 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.873003 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:19.880623 25977 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.880764 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.883343 22114 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:19.883595 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2175) took 1848 ms. Trace:
I20260709 12:11:19.885047 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.888971 22117 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:19.876052 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.892274 22272 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:19.886693 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:19.892506 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.893049 22196 raft_consensus.cc:2376] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11. Re-sending same reply.
I20260709 12:11:19.893273 22117 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:19.893149 25735 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.894721 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.895660 22263 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:19.896116 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.896299 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.896903 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.896816 22269 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:19.897807 22265 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:19.888209 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2172) took 1853 ms. Trace:
I20260709 12:11:19.899466 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:19.875200 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.889240 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:19.901160 22198 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:19.896479 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.902837 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.890656 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:19.891075 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:19.895328 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.884187 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.905961 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:19.905920 22114 raft_consensus.cc:2393] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:19.907723 25839 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:19.908134 22272 raft_consensus.cc:2410] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:19.908277 25839 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:19.909101 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:19.909715 22270 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.909483 25839 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.910404 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:19.911113 22190 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:19.911856 25949 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:11:19.912328 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 898190us
I20260709 12:11:19.888327 25893 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:19.912398 25949 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:19.913826 25946 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:19.915419 25949 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:19.913298 22237 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:19.916373 25834 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:19.917188 22237 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:19.919605 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:19.919898 25895 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.923084 25948 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:19.884043 22120 rpcz_store.cc:276] 0709 12:11:18.035323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.668731 (+633408us) service_pool.cc:224] Handling call
0709 12:11:18.889550 (+220819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.889809 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:18.925780 (+ 35971us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.373972 (+448192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:19.374021 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:19.374067 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.374128 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.840466 (+466338us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:19.883407 (+ 42941us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540031d3d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:19.883531 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12284,"prepare.queue_time_us":36379,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":6306,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":30704,"spinlock_wait_cycles":681648768,"thread_start_us":441555,"threads_started":1,"wal-append.queue_time_us":834623}
I20260709 12:11:19.923659 25948 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:19.924464 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:19.928285 22272 raft_consensus.cc:2376] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11. Re-sending same reply.
I20260709 12:11:19.927145 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:19.929164 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 67800.2us
I20260709 12:11:19.931211 25978 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:19.930426 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:19.932348 25978 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:19.932749 25978 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:19.927779 22267 raft_consensus.cc:2410] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:19.931846 25948 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:19.933866 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.933343 22270 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:19.935276 25645 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:19.936233 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:19.946698 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.979054 22123 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:19.981333 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.958081 25972 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:19.949776 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.983935 22114 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:19.982103 22121 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:11:19.984795 25645 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:11:19.963372 25965 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.202s	user 0.000s	sys 0.004s
I20260709 12:11:19.985242 25645 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:19.985673 25645 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:19.987419 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.989210 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.989801 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:19.991091 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.992245 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.989148 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.993499 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.994339 22266 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:19.995941 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.994899 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.996742 22272 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:19.997536 22122 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:19.997680 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.003588 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.898538 22115 rpcz_store.cc:276] 0709 12:11:18.034422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.631104 (+596682us) service_pool.cc:224] Handling call
0709 12:11:18.656583 (+ 25479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.359617 (+703034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.359650 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.401159 (+ 41509us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.847870 (+446711us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:19.847906 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.887816 (+ 39910us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54002c06d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:19.887866 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.887915 (+    49us) raft_consensus.cc:1685] finished
0709 12:11:19.887928 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.888135 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":535,"raft.queue_time_us":95116,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":29939,"spinlock_wait_cycles":834076032,"thread_start_us":356611,"threads_started":1,"wal-append.queue_time_us":388977}
I20260709 12:11:19.947150 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:19.874743 25829 consensus_meta.cc:287] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.030s	user 0.011s	sys 0.003s
I20260709 12:11:19.998709 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:19.999205 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.004902 22272 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:19.933810 25978 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:19.946985 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:19.982111 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.013989 25978 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.014178 22118 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:20.014952 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.016086 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.016480 25585 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:20.017182 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.017735 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.018239 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.018841 22263 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:20.019039 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.019675 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.020285 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:20.016836 25836 consensus_queue.cc:1175] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7d3f536360b444b1886777f4776be22c" responder_term: 8 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: [7.8-7.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:20.049635 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:20.027506 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:19.958356 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:11:20.052057 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 93776.5us
I20260709 12:11:20.006400 22018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 255) took 7268 ms. Trace:
I20260709 12:11:20.053699 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.030179 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.036201 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.058140 22263 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:11:20.037101 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.037474 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.037804 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:11:20.039423 22831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.004s	sys 0.009s
W20260709 12:11:20.039731 22161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.007s	sys 0.006s
I20260709 12:11:20.037109 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.064461 25977 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:11:20.064579 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 165160us
I20260709 12:11:20.065037 25977 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:19.976387 25876 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:20.044023 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:20.044268 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:20.053160 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:20.067036 22120 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:20.044934 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:20.047744 22266 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:20.022715 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.011693 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.060436 22864 raft_consensus.cc:2410] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:11:20.068945 22270 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:20.069362 22272 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 4.
W20260709 12:11:20.060607 22161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.007s	sys 0.007s
W20260709 12:11:20.060918 22831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.005s	sys 0.009s
I20260709 12:11:20.058562 22858 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:20.064038 25836 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.042379 25585 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:20.077260 25791 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:20.077610 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:20.077950 25791 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:20.071842 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 627435us
I20260709 12:11:20.074477 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:20.083945 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:20.076124 22269 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:11:20.087218 22269 pending_rounds.cc:85] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 4
I20260709 12:11:20.087657 22269 pending_rounds.cc:107] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:20.088011 22269 raft_consensus.cc:2889] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:20.116806 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.121225 22831 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:20.121620 22190 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.128290 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.053663 22018 rpcz_store.cc:276] 0709 12:11:12.737969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.738226 (+   257us) service_pool.cc:224] Handling call
0709 12:11:20.006302 (+7268076us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:16.179359 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:16.470835 (+291476us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:16.492533 (+ 21698us) write_op.cc:435] Acquired schema lock
0709 12:11:16.496539 (+  4006us) tablet.cc:662] Decoding operations
0709 12:11:16.594723 (+ 98184us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:16.594805 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:16.594847 (+    42us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:11:16.894584 (+299737us) tablet.cc:701] Row locks acquired
0709 12:11:16.894615 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:11:16.894858 (+   243us) write_op.cc:270] Start()
0709 12:11:16.895028 (+   170us) write_op.cc:276] Timestamp: P: 1783599076894784 usec, L: 0
0709 12:11:16.895074 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:11:16.896047 (+   973us) log.cc:844] Serialized 5330 byte log entry
0709 12:11:19.012582 (+2116535us) op_driver.cc:464] REPLICATION: finished
0709 12:11:19.719322 (+706740us) write_op.cc:301] APPLY: starting
0709 12:11:19.719478 (+   156us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:19.719940 (+   462us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:19.720121 (+   181us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:19.827488 (+107367us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:19.827996 (+   508us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:11:19.828075 (+    79us) write_op.cc:312] APPLY: finished
0709 12:11:19.828647 (+   572us) log.cc:844] Serialized 95 byte log entry
0709 12:11:19.921024 (+ 92377us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:19.921223 (+   199us) write_op.cc:454] Released schema lock
0709 12:11:19.922312 (+  1089us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:19.931447 (+  9135us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:19.931483 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":680405,"apply.run_cpu_time_us":5698,"apply.run_wall_time_us":217333,"num_ops":13,"prepare.queue_time_us":190261,"prepare.run_cpu_time_us":60937,"prepare.run_wall_time_us":2146238,"raft.queue_time_us":572568,"raft.run_cpu_time_us":7404,"raft.run_wall_time_us":352126,"replication_time_us":2117274,"thread_start_us":2131906,"threads_started":4,"wal-append.queue_time_us":1469781}]]}
I20260709 12:11:20.139988 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2210) took 2675 ms. Trace:
I20260709 12:11:20.133821 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.074059 25836 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:20.089542 25839 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.159672 22862 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:20.160485 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:19.973742 25948 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:20.140406 22264 rpcz_store.cc:276] 0709 12:11:17.464546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.464658 (+   112us) service_pool.cc:224] Handling call
0709 12:11:17.465053 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.465315 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:19.356459 (+1891144us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.137922 (+781463us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.138843 (+   921us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.138915 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.138999 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.139771 (+   772us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.139919 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":353930,"prepare.queue_time_us":274842,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":299960,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":566,"spinlock_wait_cycles":36992,"thread_start_us":2317344,"threads_started":3,"wal-append.queue_time_us":487649}
I20260709 12:11:20.162130 22861 raft_consensus.cc:2410] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:20.120194 25782 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.180053 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:20.194754 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:20.090451 25972 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:20.089542 25976 consensus_queue.cc:1059] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:11:20.118204 25831 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:20.137928 25780 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:20.089720 25883 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:11:20.197472 25954 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.158998 25456 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:20.177139 25836 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.159559 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.177421 25839 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.231703 22866 raft_consensus.cc:2393] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:20.191227 25782 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:20.198653 25949 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.256203 25949 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:20.209040 25915 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.204571 25833 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:20.255162 25839 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.190411 25645 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:20.205042 25946 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:11:20.208860 25978 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:20.356288 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.215622 25778 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:11:20.355547 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 160905us
I20260709 12:11:20.360138 25978 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:20.367714 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 246612us
I20260709 12:11:20.375767 22267 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:20.347554 25970 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:20.255905 25782 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.256685 25949 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.376267 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:20.389853 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:20.341140 22017 catalog_manager.cc:5697] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 4 to 6, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 6 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:20.257436 25915 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:20.279623 25833 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:20.297364 25972 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:20.215531 25791 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:20.233991 25780 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:20.409124 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:20.401847 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:20.437294 22263 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:20.257608 25456 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:20.443187 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:11:20.396597 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:20.380930 25775 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.395596 25978 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.253867 25954 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:20.393654 25970 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:20.428860 25895 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:20.473485 25895 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:20.474105 25895 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.476306 25992 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:20.477478 22017 catalog_manager.cc:5697] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 2 to 5, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 5 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:20.476542 25970 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.431979 25915 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.428181 25721 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:11:20.454785 25833 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:20.428457 25883 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:11:20.388379 25778 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:20.467057 25977 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:20.487068 25893 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:20.512233 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 539) took 1156 ms. Trace:
I20260709 12:11:20.470146 25775 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:20.509351 25893 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:20.512741 22119 rpcz_store.cc:276] 0709 12:11:19.356200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.717707 (+361507us) service_pool.cc:224] Handling call
0709 12:11:19.718131 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.718386 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:20.204888 (+486502us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.509682 (+304794us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.509738 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:20.509793 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.509871 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.512160 (+  2289us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":521088,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"thread_start_us":790393,"threads_started":2}
W20260709 12:11:20.535214 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.515024 25948 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:20.522079 25831 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:20.538928 25893 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.585856 22017 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:20.551432 25645 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:20.590639 25988 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:11:20.524627 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 447075us
W20260709 12:11:20.604849 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 215063us
I20260709 12:11:20.522332 25972 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:20.609651 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:20.627307 25973 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:20.647814 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.644695 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.647468 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.664455 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.643925 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.665799 22196 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:20.669917 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:20.670641 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.672581 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.668884 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.673288 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.679698 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.604247 25775 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:20.628224 25977 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.682577 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.653759 22010 maintenance_manager.cc:419] P 724c00f1bc7e49c9835e5c0e664b7356: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033346
I20260709 12:11:20.686039 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.687080 22193 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:20.688458 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:20.688859 26000 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:11:20.689754 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.690025 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.690834 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.691593 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.691905 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.628880 25780 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:20.641335 25788 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:20.693614 25788 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:20.696707 25788 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:20.697003 25977 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:20.699331 25977 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:20.700546 25983 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 12:11:20.702240 25987 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:20.702824 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 732) took 2961 ms. Trace:
W20260709 12:11:20.703876 25996 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:20.703194 22271 rpcz_store.cc:276] 0709 12:11:17.741525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.628489 (+886964us) service_pool.cc:224] Handling call
0709 12:11:18.628866 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:19.910841 (+1281975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.910873 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:19.911479 (+   606us) log.cc:844] Serialized 52 byte log entry
0709 12:11:20.132747 (+221268us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:20.132819 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.199843 (+ 67024us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54001db5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:20.199894 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.702514 (+502620us) raft_consensus.cc:1685] finished
0709 12:11:20.702532 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.702764 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":565130,"raft.queue_time_us":549218,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":685665664,"thread_start_us":220917,"threads_started":1,"wal-append.queue_time_us":653569}
I20260709 12:11:20.705595 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.707332 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.706606 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:20.708923 22196 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:20.709812 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.712395 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.713811 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.713951 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:20.714087 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 312333us
I20260709 12:11:20.715269 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.716388 22195 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:20.716120 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:20.717192 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.729537 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.731796 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.734683 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.718024 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.630232 25973 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:20.742489 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.684319 25954 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:20.747627 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:20.745415 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.748382 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.716322 25977 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.762315 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.717237 25775 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.748060 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.722723 25883 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.719128 25718 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.763046 22198 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:20.764811 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:20.723450 25788 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.708168 25828 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 12:11:20.767458 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 157862us
I20260709 12:11:20.771380 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.771785 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.772720 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.773933 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.774197 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 540) took 1417 ms. Trace:
I20260709 12:11:20.775110 22119 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:20.778055 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.778582 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:20.775780 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:20.773157 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:20.779171 22193 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:20.704023 25782 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:20.782081 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.756857 25778 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:20.786163 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:20.800105 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:20.808118 25974 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.811996 25974 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:20.812413 25974 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.812613 25782 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:20.813287 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.807989 25999 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:20.816216 25999 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:20.816671 25999 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.818830 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:20.825142 25990 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:11:20.826030 26008 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.826538 26008 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.826881 26008 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.829779 26006 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.803014 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.811173 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:20.842348 22859 raft_consensus.cc:2410] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:20.773617 25775 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:20.868010 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.868649 25905 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:11:20.869063 25836 consensus_meta.cc:287] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.614s	user 0.013s	sys 0.000s
I20260709 12:11:20.871142 25895 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:20.869601 25836 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:20.853505 25949 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:20.934389 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.869313 25905 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:20.979038 22857 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:20.946261 26003 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:11:20.988039 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.990294 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:20.990340 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:20.990439 22163 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:20.853868 25839 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:21.000653 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 222167us
I20260709 12:11:21.001019 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.001505 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:21.001690 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.000504 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.003651 22196 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:21.004701 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.006094 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.007143 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.007450 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.008091 22196 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:21.009256 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.009554 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:21.011162 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:21.008473 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:21.013599 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:21.014369 22265 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.014751 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:21.015508 22263 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:21.015446 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.008131 22195 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:21.018082 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:21.022830 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.023422 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:21.023701 22195 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:21.024039 22263 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:11:21.025254 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.025461 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.024598 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.026412 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.027822 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:21.027954 22866 raft_consensus.cc:2368] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9.
I20260709 12:11:21.028440 22266 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:21.030407 22195 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:21.004020 25780 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.041108 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.044945 22193 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:20.986452 25893 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:21.046674 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:21.049465 25982 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.498s	user 0.009s	sys 0.005s
I20260709 12:11:21.018780 26009 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:21.064754 25839 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:21.065549 25949 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:21.066629 25895 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:21.069523 25775 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:21.070592 25970 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.591s	user 0.013s	sys 0.000s
I20260709 12:11:21.071028 25970 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.073665 22190 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:21.023339 26004 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:11:21.083098 22265 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:21.056331 25999 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.085402 26004 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:21.085649 25837 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:21.112241 25837 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:21.092166 25893 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:21.081992 25915 consensus_meta.cc:287] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.005s
I20260709 12:11:21.093600 25973 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:21.093631 25978 consensus_meta.cc:287] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.606s	user 0.013s	sys 0.000s
I20260709 12:11:21.095538 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2235) took 1205 ms. Trace:
I20260709 12:11:21.061561 25974 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.115005 22268 rpcz_store.cc:276] 0709 12:11:19.890326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.890457 (+   131us) service_pool.cc:224] Handling call
0709 12:11:19.890864 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.891121 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.891149 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.891843 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.085052 (+193209us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:20.085096 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.085184 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.048837 (+963653us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:21.095152 (+ 46315us) raft_consensus.cc:1685] finished
0709 12:11:21.095184 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.095458 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82187520,"thread_start_us":192770,"threads_started":1,"wal-append.queue_time_us":611033}
I20260709 12:11:21.096357 25970 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:21.116559 25999 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:21.115033 25978 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.118105 26008 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:21.119164 25978 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:21.120028 22861 raft_consensus.cc:2393] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 13: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:21.120290 26008 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:21.110073 22862 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:11:21.108820 26004 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:21.113395 25915 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.120915 22862 pending_rounds.cc:85] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Aborting all ops after (but not including) 10
I20260709 12:11:21.122071 22862 pending_rounds.cc:107] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:11:21.121502 26004 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.122500 22862 raft_consensus.cc:2889] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:21.122695 25915 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:21.123255 26004 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.123634 22198 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.124712 25974 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:21.126096 25833 consensus_meta.cc:287] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.001s
I20260709 12:11:21.126727 25833 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.128003 22269 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:21.128499 22269 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:21.133776 25837 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.135866 25837 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:21.139357 25833 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:21.174563 25857 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:21.187148 25905 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.202903 25836 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:21.204286 25876 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:21.205137 25905 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:21.241711 25456 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:21.181872 25857 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:11:21.251796 25991 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.728s	user 0.000s	sys 0.002s
I20260709 12:11:21.250771 25857 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.255371 25857 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:21.259449 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.325279 22191 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:21.355204 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.349323 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:21.364817 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 346601us
I20260709 12:11:21.237914 22269 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:21.445333 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.455574 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.460984 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.462735 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:21.467473 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53629.8us
I20260709 12:11:21.470010 22196 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:21.472015 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.478085 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.481035 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.482733 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.483606 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.486689 25974 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:21.492575 25974 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.494033 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:21.495994 25994 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.778115 22116 rpcz_store.cc:276] 0709 12:11:19.356460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.741439 (+384979us) service_pool.cc:224] Handling call
0709 12:11:19.761727 (+ 20288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.762075 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:20.118464 (+356389us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.625705 (+507241us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.773843 (+148138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.773895 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:20.773951 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.774018 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.774140 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":495079,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":16817,"raft.queue_time_us":315378,"thread_start_us":999084,"threads_started":4,"wal-append.queue_time_us":451197}
I20260709 12:11:21.500535 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.501845 22191 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:21.401470 26002 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.488641 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:21.513693 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.516924 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:21.518525 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:21.410009 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 1.01395e+06us
I20260709 12:11:21.520902 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.521636 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.527585 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.528906 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.533238 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.534371 22119 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:21.414494 26023 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:21.509903 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:21.543515 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.547358 22190 raft_consensus.cc:2368] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:21.539315 22831 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:21.543767 26002 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:21.552620 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.553145 26002 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.554365 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.556277 25905 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.557581 22195 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:21.558524 25954 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:21.558936 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.559405 25954 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.557109 25905 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.554418 22269 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:21.556522 22271 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.560421 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.557966 22270 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:21.540305 25974 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:21.567548 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:34878 (request call id 750) took 1155 ms. Trace:
I20260709 12:11:21.568742 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.570905 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.546259 26023 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:21.574760 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.577648 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.579572 25972 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:21.580191 25972 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:21.577127 22189 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
W20260709 12:11:21.583586 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 95278.3us
I20260709 12:11:21.582782 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.580907 25972 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.569868 22269 rpcz_store.cc:276] 0709 12:11:20.410583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.410716 (+   133us) service_pool.cc:224] Handling call
0709 12:11:21.523764 (+1113048us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b540029ccd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddb9a3d 00007fccf2d89cd0 00007fccec30e254 00007fccec30e1e2 00007fccec30e111 00007fccec30e08c 00007fccec30d342 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:21.566144 (+ 42380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568273152}
I20260709 12:11:21.590956 26008 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:21.576462 22087 leader_election.cc:336] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.660s (SENT)
I20260709 12:11:21.588629 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.591832 22191 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:21.577643 26023 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.584076 25954 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:21.600457 22190 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:21.593421 26008 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.606190 26008 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.615890 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:21.624353 22272 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:21.652050 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 113208us
I20260709 12:11:21.661795 22271 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:21.645789 25954 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.667702 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:21.673820 25456 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.673123 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:21.676725 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.676554 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.680127 22191 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:21.679886 22021 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.679703 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.682669 22021 catalog_manager.cc:5697] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 6 to 7, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 7 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:21.684993 22194 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:21.685213 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:21.686101 22195 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.689066 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:21.696458 22272 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:21.703037 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 60373.1us
I20260709 12:11:21.702909 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.706507 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:21.698483 25905 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:21.715853 22194 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:21.716670 22193 raft_consensus.cc:2410] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:21.717393 22021 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:21.719038 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.722236 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47787.9us
I20260709 12:11:21.723708 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:21.726300 25954 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:21.726955 25954 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:21.727591 25954 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:21.727882 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:21.732698 22860 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:21.733991 22017 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 224) took 26326 ms (client timeout 15000 ms). Trace:
I20260709 12:11:21.731426 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:21.734534 22017 rpcz_store.cc:269] 0709 12:10:55.407667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.407856 (+   189us) service_pool.cc:224] Handling call
0709 12:11:21.733728 (+26325872us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:21.086072 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:21.086613 (+   541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:21.086649 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:11:21.086680 (+    31us) tablet.cc:662] Decoding operations
0709 12:11:21.087263 (+   583us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:21.087327 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:21.087361 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:11:21.087814 (+   453us) tablet.cc:701] Row locks acquired
0709 12:11:21.087831 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:11:21.087976 (+   145us) write_op.cc:270] Start()
0709 12:11:21.088070 (+    94us) write_op.cc:276] Timestamp: P: 1783599081087924 usec, L: 0
0709 12:11:21.088089 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:11:21.088718 (+   629us) log.cc:844] Serialized 1326 byte log entry
0709 12:11:21.285737 (+197019us) op_driver.cc:464] REPLICATION: finished
0709 12:11:21.290798 (+  5061us) write_op.cc:301] APPLY: starting
0709 12:11:21.290902 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:21.291482 (+   580us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:21.291601 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:21.292030 (+   429us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:21.292258 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:11:21.292318 (+    60us) write_op.cc:312] APPLY: finished
0709 12:11:21.292572 (+   254us) log.cc:844] Serialized 35 byte log entry
0709 12:11:21.292795 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:21.292905 (+   110us) write_op.cc:454] Released schema lock
0709 12:11:21.292952 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:21.293391 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:21.293427 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4411111,"reported_tablets":51,"spinlock_wait_cycles":259456,"child_traces":[["op",{"apply.queue_time_us":4706,"apply.run_cpu_time_us":2563,"apply.run_wall_time_us":2565,"num_ops":3,"prepare.queue_time_us":454821,"prepare.run_cpu_time_us":37359,"prepare.run_wall_time_us":104148,"raft.queue_time_us":8392,"raft.run_cpu_time_us":4987,"raft.run_wall_time_us":6085,"replication_time_us":196431,"spinlock_wait_cycles":27904,"thread_start_us":259532,"threads_started":4,"wal-append.queue_time_us":184322}]]}
I20260709 12:11:21.745563 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:21.747129 25456 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.747767 25456 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.748243 25456 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:21.749055 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 198153us
W20260709 12:11:21.712242 26027 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:11:21.721158 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:21.760273 22195 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
W20260709 12:11:21.753716 22088 connection.cc:256] RPC call timeout handler was delayed by -1.4529045540000425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 12:11:21.767473 22088 connection.cc:256] RPC call timeout handler was delayed by -1.3278045540000676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 12:11:21.767882 22088 connection.cc:256] RPC call timeout handler was delayed by -1.299004554000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
W20260709 12:11:21.774645 22088 connection.cc:256] RPC call timeout handler was delayed by -1.2639045539999643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 12:11:21.775040 22088 connection.cc:256] RPC call timeout handler was delayed by -1.2288045540001349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 12:11:21.776683 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:21.775456 22088 connection.cc:256] RPC call timeout handler was delayed by -1.0569045540000843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
W20260709 12:11:21.781906 22088 connection.cc:256] RPC call timeout handler was delayed by -1.0389045540000552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 12:11:21.791003 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.799181 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:21.798434 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.800387 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:21.807060 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:21.807536 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.808732 22119 raft_consensus.cc:2410] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:21.774806 26002 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.815816 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.814733 22195 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:21.792722 22021 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 9 to 10, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 10 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.828253 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.813462 25974 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.810305 26023 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:21.840235 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45932.4us
I20260709 12:11:21.832978 25791 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.843780 22270 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:21.839551 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:21.845983 22116 raft_consensus.cc:2410] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:21.861138 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.862092 22115 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:21.863433 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.869782 22272 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:21.873755 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 64977us
I20260709 12:11:21.877017 26023 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:21.877791 26023 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:21.878242 26023 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:21.878666 26023 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:21.881088 25791 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.881088 22120 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:21.845276 26008 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.887055 26008 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:21.891748 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.892845 22121 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:21.893947 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.896488 26002 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:21.898247 22021 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.900203 22021 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 8 to 9, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 9 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.914402 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:21.926280 25791 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.929082 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:21.924415 25954 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:21.929308 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.932622 25954 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:21.935873 22271 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:21.937175 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.937335 22114 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:21.938158 22119 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:21.938069 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.874524 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:21.939868 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 89881.1us
I20260709 12:11:21.940068 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.940904 22116 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:21.941362 25836 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.942137 25836 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:21.944689 26031 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:21.945197 26031 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:21.945348 25836 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:21.946399 26031 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.947487 25837 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:21.948388 25837 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:21.949856 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:21.949685 25905 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:21.950963 25994 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:21.950055 25837 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:21.951546 25994 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:21.937523 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.952662 25837 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.953533 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:21.957820 22021 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.959987 22021 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 11 to 12, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 12 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:11:21.969971 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 188219us
I20260709 12:11:21.908154 25972 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:21.981405 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 130210us
I20260709 12:11:21.947986 26031 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:21.989526 22087 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.595s (SENT)
I20260709 12:11:21.997593 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:21.996666 22163 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:21.997020 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:22.007783 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:21.952739 25994 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.009289 22120 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:22.011219 25791 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:22.011751 25791 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.012089 25791 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.013605 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.014701 22115 raft_consensus.cc:2410] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:22.021258 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:22.022182 22123 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.034403 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:22.036826 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.037221 26035 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:22.037806 26035 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:22.038232 26035 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:22.048198 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 122665us
I20260709 12:11:22.051321 26008 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:22.063362 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:22.065212 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 71586.9us
I20260709 12:11:22.065570 22860 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:22.066098 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.066854 22120 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:22.048345 22021 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 4 to 10, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 10 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:22.069324 22021 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 8 to 9, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 9 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:22.081460 22119 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:22.082340 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77589.7us
I20260709 12:11:22.084105 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:22.071045 22021 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 5 to 7, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 7 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.086246 25954 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.086790 25954 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.089071 25954 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:22.109717 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:11:22.117869 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 136663us
I20260709 12:11:22.119824 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:22.120265 22120 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:22.120736 22122 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 9: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:22.122490 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.123243 22115 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:22.144251 22123 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:22.154894 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:22.161854 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.058223 25836 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.132185 25456 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:22.178668 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:22.190379 25857 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.195s
I20260709 12:11:22.190963 22123 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:22.200886 26034 consensus_queue.cc:1059] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 12:11:22.202189 25837 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.202368 25456 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:22.202702 25837 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:22.203836 25837 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.205708 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:22.207125 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.207507 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:22.207983 22114 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:22.170029 25974 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:22.209028 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.209419 25974 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:22.211647 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.212121 25974 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:22.212972 25837 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:22.215999 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.217129 22116 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:22.225675 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:22.227430 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:22.228667 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:11:22.216657 22087 leader_election.cc:336] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.739s (SENT)
I20260709 12:11:22.247216 22864 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:22.251384 22864 pending_rounds.cc:85] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Aborting all ops after (but not including) 7
I20260709 12:11:22.242573 25972 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:22.246773 25974 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.259063 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:22.253767 22864 pending_rounds.cc:107] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:22.261698 22864 raft_consensus.cc:2889] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:22.253960 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:22.266196 22865 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:22.267307 22866 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:22.281052 22087 leader_election.cc:336] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.927s (SENT)
W20260709 12:11:22.281553 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 204818us
I20260709 12:11:22.295966 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:22.297986 22270 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:22.298449 25456 consensus_queue.cc:1059] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:22.300271 22272 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 7. Ops: []
I20260709 12:11:22.305697 22087 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:22.307262 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:22.263160 25974 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:11:22.322511 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 60789.8us
I20260709 12:11:22.324020 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:22.310900 25456 raft_consensus.cc:3055] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.323087 25857 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:22.326833 25974 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.349880 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:22.349200 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:22.331501 26008 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.353433 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:22.356086 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:22.352762 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:22.358515 22865 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:22.353369 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:22.360530 22858 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:22.362849 22861 raft_consensus.cc:2393] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 13: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:22.343605 25456 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:22.372866 22857 raft_consensus.cc:3055] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:22.376227 25836 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:22.373325 22857 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:22.385257 26033 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:22.385885 26033 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.385653 25456 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.387208 25456 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.388103 25905 consensus_queue.cc:1059] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:22.384639 22831 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:22.386289 26033 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.390491 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:22.394836 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 130533us
I20260709 12:11:22.398648 22267 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.402331 22237 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:22.403398 22237 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:22.362329 25857 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.405009 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:22.405254 25954 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:22.405707 25954 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:22.406118 25954 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.406504 25857 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:22.406513 26043 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:22.409117 26032 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.405059 22269 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:22.412276 22831 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:22.421842 22866 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
W20260709 12:11:22.419993 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 74140.6us
I20260709 12:11:22.432997 22860 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:22.419339 25972 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:22.441627 22087 leader_election.cc:336] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.077s (SENT)
I20260709 12:11:22.454181 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:22.470129 25791 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:22.483042 26023 consensus_meta.cc:287] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.004s
I20260709 12:11:22.488920 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:22.464982 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.490892 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49316us
I20260709 12:11:22.491608 26008 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:22.492245 26002 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:22.496517 22862 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
W20260709 12:11:22.508059 22236 connection.cc:256] RPC call timeout handler was delayed by -1.8883145390000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 12:11:22.508723 22236 connection.cc:256] RPC call timeout handler was delayed by -1.8802145390000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 12:11:22.511678 22236 connection.cc:256] RPC call timeout handler was delayed by -1.8163145390001318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
W20260709 12:11:22.512149 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6711902100000771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 12:11:22.512554 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6153902099999868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 12:11:22.513968 22236 connection.cc:256] RPC call timeout handler was delayed by -1.5850145389999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 12:11:22.514354 22236 connection.cc:256] RPC call timeout handler was delayed by -1.5838902100001633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
I20260709 12:11:22.454792 26043 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:22.484592 25456 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:22.514755 22236 connection.cc:256] RPC call timeout handler was delayed by -1.5667902100001356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 12:11:22.516415 22267 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:22.512581 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
W20260709 12:11:22.507197 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 101171us
I20260709 12:11:22.520897 22190 raft_consensus.cc:606] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:22.520097 22236 connection.cc:256] RPC call timeout handler was delayed by -1.5553145389999372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 12:11:22.521683 22236 connection.cc:256] RPC call timeout handler was delayed by -1.549690210000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 12:11:22.521978 22236 connection.cc:256] RPC call timeout handler was delayed by -1.4806145390000438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
W20260709 12:11:22.522292 22236 connection.cc:256] RPC call timeout handler was delayed by -1.4281902100001389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 12:11:22.522667 22236 connection.cc:256] RPC call timeout handler was delayed by -1.2841902100001334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 12:11:22.523022 22236 connection.cc:256] RPC call timeout handler was delayed by -1.2643902100001014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 12:11:22.523283 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1140902100000858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
W20260709 12:11:22.523547 22236 connection.cc:256] RPC call timeout handler was delayed by -1.0483902099999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 12:11:22.513454 25791 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:22.533416 26031 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:22.537531 22087 leader_election.cc:336] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.179s (SENT)
I20260709 12:11:22.519771 25456 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.538487 26035 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:22.545962 26043 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:22.549639 26033 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.550771 22237 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:22.551597 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.538739 22857 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.506664 26023 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:22.557973 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:22.543612 22831 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:22.555968 22267 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 7. Ops: []
I20260709 12:11:22.566815 22119 raft_consensus.cc:2368] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9.
I20260709 12:11:22.567709 22115 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:22.575932 22857 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.562503 25456 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.528291 25954 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:22.576539 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 83899.6us
I20260709 12:11:22.574482 26032 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:22.600618 26055 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:11:22.580169 26031 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.601811 26031 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.603912 26031 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:22.604442 26053 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:11:22.590402 26002 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:11:22.605861 26002 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:22.606187 26002 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:22.607070 26002 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:22.608357 26002 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.600987 26033 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:22.617880 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 75272.5us
W20260709 12:11:22.610997 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 60428.8us
I20260709 12:11:22.629412 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.630342 22271 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:22.640470 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:22.641294 22862 raft_consensus.cc:606] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:22.641677 22862 raft_consensus.cc:614] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:22.641718 25836 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.642530 25836 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.644047 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:22.593034 26032 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:22.651438 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:22.660281 22268 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:22.660977 25836 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:22.618839 22857 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:22.673683 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:22.678898 22237 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:22.648593 25954 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:22.692137 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.689625 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.685652 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.705444 22270 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:22.710888 26002 consensus_queue.cc:1059] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:22.678112 25857 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:11:22.634685 25974 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:22.657955 25994 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:22.714205 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.743932 22862 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:22.745491 22857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:22.746260 22857 raft_consensus.cc:606] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:22.749374 22271 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:22.748315 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.753958 26064 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.737380 25994 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.755196 25994 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.754985 26064 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.761340 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.768378 26002 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:22.768872 26023 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:22.769217 26002 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:22.769460 26057 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 12:11:22.770884 26064 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:22.766690 26052 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:22.770602 26002 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.771901 26052 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:22.772439 26002 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.778617 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:22.781479 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.782056 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.782956 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.783185 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.784096 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.784210 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.785516 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.787256 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.787453 22195 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:22.789369 22266 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.790700 25974 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:22.796941 26061 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:22.797803 26061 raft_consensus.cc:697] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:22.798663 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:22.798898 26061 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.799952 22266 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:22.801204 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:22.801416 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.802222 22264 raft_consensus.cc:2393] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:22.802721 22266 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:22.803121 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.807235 25994 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.805625 22265 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:22.762135 22270 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:22.808717 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.856391 22264 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:22.807014 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.811005 22237 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:22.857859 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 46974.5us
I20260709 12:11:22.768592 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:22.858979 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 248511us
I20260709 12:11:22.859197 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.859440 22267 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:22.860112 22264 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:22.861218 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.781349 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.826642 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:22.847170 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 260376us
I20260709 12:11:22.825560 22269 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:22.864003 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:22.858325 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.862772 22119 raft_consensus.cc:2376] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7. Re-sending same reply.
I20260709 12:11:22.849737 22115 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 12:11:22.749972 26008 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:11:22.866806 22270 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:22.869045 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:22.870939 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:22.872255 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.873864 22267 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:22.875432 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:22.875864 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.876639 22267 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:11:22.876951 26008 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:22.877251 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.877533 26008 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:22.878525 26008 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:22.878859 26052 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.877022 22857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:22.876874 22123 raft_consensus.cc:2393] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:22.875432 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.885397 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.770928 26057 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.881537 22857 raft_consensus.cc:606] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:22.885176 22121 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:22.893668 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:22.868420 26035 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:22.880113 26008 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.880892 26023 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:22.899459 22270 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:22.897516 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:22.915239 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.929332 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.931077 22857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:22.931833 22857 raft_consensus.cc:606] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:22.932227 22857 raft_consensus.cc:614] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:22.887539 26057 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:22.933622 26057 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.935760 22857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:22.929354 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.936445 22857 raft_consensus.cc:606] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:22.936875 22857 raft_consensus.cc:614] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:22.937317 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:22.941095 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47025.1us
I20260709 12:11:22.938306 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:22.948048 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:22.950408 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.820982 26032 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.956054 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.957779 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.949833 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:22.953976 22192 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:22.952579 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.951190 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.952574 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.960052 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.955717 22117 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.952466 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.959925 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.963498 22191 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:22.964006 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:22.948019 26023 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:22.985771 26023 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:22.965075 22190 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:22.981101 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:22.981855 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.984376 26065 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:22.989845 26072 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:22.994586 26065 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:22.995174 26072 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:22.995577 26072 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:22.990689 26053 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:22.992748 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:22.926489 25857 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:22.993525 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:23.000428 22190 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:22.997454 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:22.997082 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:23.013840 22087 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.015174 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:23.016700 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:23.016987 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:23.017686 22123 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.020375 22121 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:23.033169 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:23.035266 25791 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:23.035790 25791 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:23.038461 22123 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:23.042860 25456 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:23.044335 22271 raft_consensus.cc:2368] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 6. Current term is 7.
I20260709 12:11:23.036630 25791 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:23.047233 26079 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:11:23.049257 26057 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.049654 26065 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:23.050555 26072 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:23.052119 26072 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.070271 22117 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:23.069782 26002 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:23.077828 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:23.078459 22265 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.079610 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:23.076081 25994 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:23.088503 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:23.091959 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 78239us
I20260709 12:11:23.093163 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:23.095876 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:23.075903 26002 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:23.097065 26076 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:11:23.105261 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:23.105849 26069 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.106446 25837 raft_consensus.cc:993] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:23.066046 26065 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.107187 25456 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:23.107595 26065 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:23.109869 26065 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:23.113839 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:23.113945 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:23.115444 22116 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:23.117812 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:23.118304 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:23.118371 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:23.119048 22122 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:23.118646 22857 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:23.119187 22862 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.119937 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:23.120517 22119 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:23.118515 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.119580 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:23.121747 22197 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:23.124863 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:23.126976 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:23.133771 22117 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:23.133126 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 146660us
I20260709 12:11:23.142400 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:23.145141 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:23.159475 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:23.162453 22862 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:23.162916 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:23.165069 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.167062 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:23.194482 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60671.6us
I20260709 12:11:23.197847 22117 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:23.197295 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:23.201200 22193 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:23.202289 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 84045.7us
I20260709 12:11:23.209908 22237 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:23.218145 22163 connection.cc:256] RPC call timeout handler was delayed by -1.1262132060001022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2465s for a response
I20260709 12:11:23.219660 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:23.213197 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:23.220954 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:23.213645 22265 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:23.225203 22270 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:23.228281 22267 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.232820 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:23.233601 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:23.235195 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:23.236161 22272 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:23.212734 26050 raft_consensus.cc:1081] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:23.214529 25456 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:23.245249 22857 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:23.245429 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:23.242453 22271 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:23.246987 22268 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:23.246999 22265 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:23.255630 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.262012 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:23.263152 22265 raft_consensus.cc:2410] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:23.268002 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:23.213757 26053 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:11:23.272454 26068 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:23.273072 26068 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:23.274590 25791 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:23.278712 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 73233us
W20260709 12:11:23.279644 22236 leader_election.cc:336] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.685s (SENT)
W20260709 12:11:23.280296 22236 leader_election.cc:336] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.685s (SENT)
I20260709 12:11:23.280642 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:23.291888 22267 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:23.292570 22193 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
W20260709 12:11:23.298118 22088 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.792s (SENT)
I20260709 12:11:23.302192 26078 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:23.303095 26078 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:23.262987 25456 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:23.305161 25954 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.306006 25456 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:23.308990 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:23.309358 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.315971 26073 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.316290 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:23.316795 26073 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:23.320901 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:23.322595 26085 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:11:23.330850 26002 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:23.332305 25974 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:23.349905 26078 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:23.352006 26073 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:23.353149 26043 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:23.367007 22119 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
W20260709 12:11:23.371482 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 73428.2us
I20260709 12:11:23.376402 26075 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.370971 26069 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:23.369989 26043 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:23.368851 25974 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:23.430825 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 110129us
W20260709 12:11:23.433517 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 166424us
I20260709 12:11:23.436221 22196 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:23.444926 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.448900 22087 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.453325 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.457724 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:23.439282 26053 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:11:23.462366 22263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:11:23.463128 22263 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:23.463505 22263 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.464095 26033 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:23.465128 26049 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.464706 26068 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:23.465660 26049 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:23.466244 26068 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:23.473927 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.477250 26096 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.475409 26057 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:23.475163 26008 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:23.471378 26033 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:11:23.525516 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72280.9us
I20260709 12:11:23.569809 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.569801 26033 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:23.573812 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 117890us
I20260709 12:11:23.574649 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:23.576107 26053 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:23.578926 26094 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:11:23.582299 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.547861 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 99131us
I20260709 12:11:23.438846 26043 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:23.561688 26072 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:23.563449 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.566423 25974 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:23.568581 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 80260.4us
I20260709 12:11:23.590510 26093 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:11:23.591769 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.590514 26096 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:11:23.595670 26069 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:23.603726 26069 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:23.603907 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.605005 26069 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:23.608974 26049 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:23.600258 22267 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:23.597316 26072 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:23.625358 22194 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:23.638103 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.640415 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.642203 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:23.615422 22263 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:23.643899 22265 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.663568 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:23.637002 26072 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.637833 26052 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.675509 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.659866 26002 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:23.685890 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:23.637118 25994 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:11:23.657305 26053 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:11:23.699148 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.671847 26008 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:23.695931 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:23.688069 22236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.855s (SENT) [suppressed 78 similar messages]
I20260709 12:11:23.709021 26057 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:23.731122 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51678.6us
I20260709 12:11:23.679760 26078 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:23.750237 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.674995 25974 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:23.758773 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 70822.5us
W20260709 12:11:23.759275 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 89262us
I20260709 12:11:23.760574 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.750923 26057 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.761941 26057 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.680464 26052 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:23.748950 26008 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:11:23.789350 22236 leader_election.cc:336] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.913s (SENT)
I20260709 12:11:23.771847 26044 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:23.791785 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:23.793206 22236 leader_election.cc:336] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.913s (SENT)
I20260709 12:11:23.793753 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:23.798069 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 102247us
I20260709 12:11:23.801220 25456 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:23.789310 26008 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.803568 22263 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:23.808336 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:23.809677 26093 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:23.810127 26093 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:23.810545 26093 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.813946 26053 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:23.815244 26044 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:23.815884 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 55412.1us
I20260709 12:11:23.816319 26044 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:23.817274 26065 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.817559 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.818109 26065 consensus_queue.cc:1059] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:23.819043 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.819259 26065 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:23.820233 26068 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:23.794991 26078 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:23.820853 26068 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:23.821645 26078 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:23.822168 26068 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:23.826421 26069 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:23.827286 26069 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.827996 26069 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:23.833221 26052 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:23.834723 26043 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.850981 26057 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:23.852898 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 59738.7us
I20260709 12:11:23.853303 26057 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:23.855253 26055 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:23.855984 26055 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:23.863500 25791 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:23.864444 25791 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:23.874644 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 175588us
I20260709 12:11:23.875511 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.879448 22857 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:23.880359 22860 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:11:23.864990 26101 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.083s	user 0.003s	sys 0.000s
I20260709 12:11:23.883373 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:23.884073 22862 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:23.884424 22862 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:23.885353 22862 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:23.886792 22862 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.893045 25791 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:23.896299 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.898017 26033 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.898625 26033 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:23.902905 26072 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:23.897121 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:23.903797 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:23.904076 22857 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:23.907121 26002 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:23.913304 26055 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:23.873390 26074 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:23.914871 26074 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:23.916610 25456 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:23.918916 25456 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:23.926986 22858 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:23.928429 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:23.931563 26008 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:23.934152 26008 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:23.935199 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 64885.9us
W20260709 12:11:23.937021 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 61615.9us
I20260709 12:11:23.938274 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.941087 22237 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:23.943214 26052 raft_consensus.cc:2764] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 12:11:23.956542 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 135842us
I20260709 12:11:23.961674 26008 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.962875 26093 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:23.966332 25456 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:23.944119 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 135863us
I20260709 12:11:23.970932 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.971446 22862 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:23.936555 26002 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:23.954325 26072 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:23.951378 22021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 139) took 3991 ms. Trace:
W20260709 12:11:23.983888 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45689.8us
I20260709 12:11:23.984730 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:23.989097 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:23.990494 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:23.991644 22270 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:23.994493 22860 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:23.995474 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:23.988235 22017 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 13, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 13 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:24.001257 22017 catalog_manager.cc:5697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 7, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 7 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:24.003372 22271 raft_consensus.cc:2410] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:24.004105 22017 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 9 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:24.004232 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:23.980041 22021 rpcz_store.cc:276] 0709 12:11:19.959485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.959678 (+   193us) service_pool.cc:224] Handling call
0709 12:11:20.035513 (+ 75835us) spinlock_profiling.cc:243] Waited 69.9 ms on lock 0x7b5400280690. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9e0b2 00007fccf3c17759 00007fccf3bafa76 00007fccf3b80d58 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc
0709 12:11:23.951251 (+3915738us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:22.446422 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:22.591513 (+145091us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:22.617293 (+ 25780us) write_op.cc:435] Acquired schema lock
0709 12:11:22.619466 (+  2173us) tablet.cc:662] Decoding operations
0709 12:11:22.710395 (+ 90929us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:22.710481 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:22.710507 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:11:22.711604 (+  1097us) tablet.cc:701] Row locks acquired
0709 12:11:22.711663 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:11:22.711858 (+   195us) write_op.cc:270] Start()
0709 12:11:22.712003 (+   145us) write_op.cc:276] Timestamp: P: 1783599082711790 usec, L: 0
0709 12:11:22.712032 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:11:22.726599 (+ 14567us) log.cc:844] Serialized 4464 byte log entry
0709 12:11:23.241925 (+515326us) op_driver.cc:464] REPLICATION: finished
0709 12:11:23.437714 (+195789us) write_op.cc:301] APPLY: starting
0709 12:11:23.437828 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:23.448197 (+ 10369us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:23.448322 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:23.461041 (+ 12719us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:23.561837 (+100796us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:11:23.561892 (+    55us) write_op.cc:312] APPLY: finished
0709 12:11:23.562369 (+   477us) log.cc:844] Serialized 83 byte log entry
0709 12:11:23.563377 (+  1008us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:23.563557 (+   180us) write_op.cc:454] Released schema lock
0709 12:11:23.563652 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:23.564256 (+   604us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:23.564296 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":72143,"reported_tablets":27,"spinlock_wait_cycles":160859392,"child_traces":[["op",{"apply.queue_time_us":192542,"apply.run_cpu_time_us":5392,"apply.run_wall_time_us":126493,"num_ops":11,"prepare.queue_time_us":199521,"prepare.run_cpu_time_us":17968,"prepare.run_wall_time_us":458932,"raft.queue_time_us":151531,"raft.run_cpu_time_us":91595,"raft.run_wall_time_us":201007,"replication_time_us":488356,"thread_start_us":499356,"threads_started":4,"wal-append.queue_time_us":168515}]]}
I20260709 12:11:24.007802 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:24.010433 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:24.011175 22017 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 8, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:23.997845 26069 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.013093 22271 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:24.013631 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:24.018010 22269 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:24.014700 22017 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.020110 22017 catalog_manager.cc:5697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 8, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 8 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:24.021438 22017 catalog_manager.cc:5697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 10, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 10 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.024125 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:24.003822 26033 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:24.005354 26002 raft_consensus.cc:2764] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:24.027384 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:23.996322 26044 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:11:24.040149 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:24.047361 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 106362us
I20260709 12:11:24.029909 26008 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.047889 26044 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:24.048300 26044 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:24.048403 22237 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:24.030478 26057 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:24.026747 26053 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:11:24.042119 26107 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.049165 26044 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.064340 26044 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.041711 26074 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.043680 22163 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:24.028734 25972 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.044260 25974 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:24.044458 26093 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:24.044972 26082 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.045512 25456 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:24.070987 25456 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:11:24.045929 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 60848.4us
I20260709 12:11:24.046420 26052 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.072114 26052 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.072490 26052 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.077046 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:24.069661 25972 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.078065 25972 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.078469 25456 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.079519 25456 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.046839 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:24.070662 26053 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:24.083523 26053 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:24.029212 26109 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:11:24.084550 26053 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.085392 26109 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:24.085842 26109 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:24.086616 26109 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.041769 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:24.053570 22263 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:24.054162 26061 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.054106 25954 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:24.070756 26082 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:24.071012 22162 leader_election.cc:400] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9.
I20260709 12:11:24.094666 22162 leader_election.cc:403] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:11:24.097383 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 55711.8us
I20260709 12:11:24.098240 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:24.098919 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:24.090310 26061 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.102037 26002 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:24.108413 26002 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:24.108526 26093 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9.
W20260709 12:11:24.110812 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 58151.8us
I20260709 12:11:24.111975 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:24.112850 25954 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.113505 25954 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:24.114095 26043 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.114466 25954 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.087890 26109 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:24.116501 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:24.066000 26075 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:24.119457 22087 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:24.022765 22017 catalog_manager.cc:5697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.133612 22017 catalog_manager.cc:5697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 8, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 8 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:24.135923 26119 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:24.136659 26034 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:24.137393 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:24.153556 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:24.156109 22118 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:24.156829 22115 raft_consensus.cc:2410] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:24.125999 25994 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.139068 26072 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.139840 26107 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.118321 26074 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.141848 26108 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.095961 26082 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.094710 26057 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:24.152390 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:24.148483 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:24.117528 26061 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.159348 26106 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:24.159437 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:24.169063 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:24.140666 26055 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.169945 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:24.172362 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:24.127182 26002 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.173873 22123 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:24.126535 26069 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.196100 22120 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:24.196450 22263 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:24.176563 22118 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:11:24.156401 22017 catalog_manager.cc:5697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 6, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 6 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:24.179641 22119 raft_consensus.cc:2410] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:11:24.185627 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 108689us
I20260709 12:11:24.188651 22115 raft_consensus.cc:2368] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10.
W20260709 12:11:24.195534 26120 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 12:11:24.202627 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 154287us
I20260709 12:11:24.197810 22017 catalog_manager.cc:5697] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.217661 22017 catalog_manager.cc:5697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 9 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:24.219121 22017 catalog_manager.cc:5697] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 9, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 9 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:24.176075 25791 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:24.221992 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:24.179863 26057 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:24.226284 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 66967.2us
I20260709 12:11:24.220468 22017 catalog_manager.cc:5697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:24.227066 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:24.231526 22017 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.232972 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:24.174744 25994 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.243471 25456 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.244022 25456 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:24.213449 26107 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.246905 22269 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:24.186481 26068 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:24.228964 26057 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.181124 26108 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.260408 26096 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:24.262445 26108 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:24.265275 26093 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:24.230997 25791 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.268682 22271 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.273947 26057 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.274243 25972 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.262462 25994 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:24.277411 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.278041 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 51077.6us
I20260709 12:11:24.242491 26069 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:24.287985 26096 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:24.290023 26108 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.292263 25791 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:24.294489 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:24.287207 25456 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.306139 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:24.289151 22162 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:24.326613 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:24.330022 22857 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 10: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:24.301566 25954 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:24.300702 26106 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:24.301334 26008 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.298856 26065 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:24.297242 26057 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:24.356113 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 67050.5us
I20260709 12:11:24.360289 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:24.362735 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:24.364428 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.366137 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 133280us
W20260709 12:11:24.367448 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 61358.7us
W20260709 12:11:24.369333 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 205414us
I20260709 12:11:24.370051 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:24.368687 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:24.374080 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:24.296731 26061 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.381880 22271 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:24.365207 25954 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:24.384603 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:24.364146 25791 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.359457 26065 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:24.387639 22162 leader_election.cc:400] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10.
I20260709 12:11:24.392426 22162 leader_election.cc:403] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.352346 26108 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.394625 26093 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:11:24.395787 26108 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:24.397045 25954 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.405045 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:24.405779 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:24.366730 26068 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.404213 26078 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.423270 22119 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:24.382184 26106 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.440824 22269 raft_consensus.cc:2368] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11.
W20260709 12:11:24.407104 26116 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.274s	user 0.006s	sys 0.000s
I20260709 12:11:24.380647 26075 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.382606 26031 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:24.385895 26072 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:24.378289 26057 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:24.428696 26113 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:11:24.392338 25791 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:24.465020 25791 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.453912 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:24.429677 26108 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.456503 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:24.459452 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:24.461817 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.391757 26044 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:11:24.445102 26008 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.463609 26002 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.455854 25972 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:24.502274 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:24.503324 22123 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.480491 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:24.505831 22122 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 9: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:24.440421 25974 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.483381 22271 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.485962 22120 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:24.487249 22115 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 5. Current term is 7. Ops: []
I20260709 12:11:24.475618 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:24.516861 22123 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:24.516872 22119 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:24.478040 26069 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:24.521735 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:24.481446 26128 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.524184 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:24.527853 22116 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:24.429754 26096 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.469372 26057 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.467012 26031 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.544665 22271 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:24.555799 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:24.558729 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:24.559509 22191 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:24.576687 26131 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.527016 26078 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:11:24.585299 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:24.586087 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:24.587755 22192 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.588702 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:24.589354 22192 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:24.596040 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:24.597034 22123 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:24.598194 25456 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.601086 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:24.602305 22119 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.604485 22116 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:24.605020 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:24.611905 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 65772.2us
I20260709 12:11:24.614454 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:24.615270 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:24.532318 26069 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.629676 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:24.632007 22189 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:24.634647 22123 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:24.590508 26096 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:24.608826 26052 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.001s
I20260709 12:11:24.606211 26107 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:24.604753 25836 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.668953 22116 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:24.670042 26126 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.646704 26093 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:11:24.670861 26033 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.727941 22263 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:24.674085 26061 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:24.753787 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 81276.6us
I20260709 12:11:24.664229 26052 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.762876 22163 leader_election.cc:400] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11.
I20260709 12:11:24.764197 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:24.673931 25836 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.767915 22121 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:24.768545 22163 leader_election.cc:403] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.676573 26126 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.680310 25791 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.777094 22119 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:24.778216 22116 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:24.782869 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:24.783716 22857 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.784730 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:24.788923 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:24.796108 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:24.798275 26137 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:11:24.786816 26121 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:11:24.803503 26031 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:24.806955 22857 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
W20260709 12:11:24.808082 26136 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 12:11:24.812284 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:24.818116 22115 raft_consensus.cc:2376] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8. Re-sending same reply.
I20260709 12:11:24.790004 22121 raft_consensus.cc:2376] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8. Re-sending same reply.
I20260709 12:11:24.756290 26033 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.822674 22194 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:24.831650 26069 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:24.832173 25836 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:24.834273 26126 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:24.841969 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 56589us
W20260709 12:11:24.842953 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58310.9us
I20260709 12:11:24.844118 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:24.837718 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65619.1us
I20260709 12:11:24.838478 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:24.846774 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:24.856392 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.765019 26065 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:24.836728 26142 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:24.886821 22237 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:24.830055 26096 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:11:24.890606 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47738us
I20260709 12:11:24.839779 26057 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:24.899536 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 55528.6us
W20260709 12:11:24.904502 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.885567 26069 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.908721 22266 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:24.888902 26126 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.907481 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:24.897089 25836 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.954349 25836 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:24.956029 26150 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.114s	user 0.003s	sys 0.000s
I20260709 12:11:24.889294 26119 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.838171 26128 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:11:24.921361 26126 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:24.957577 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:24.956733 25836 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:24.961309 26082 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.762s	user 0.004s	sys 0.007s
I20260709 12:11:24.972908 26082 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.975859 26082 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:24.961813 26128 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:24.979935 26128 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:11:24.925843 26055 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.003s
I20260709 12:11:24.910898 26069 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.981431 26069 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.981057 26128 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:24.982829 26128 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.927641 26052 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:24.931803 26117 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:24.932371 26002 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:24.937572 26123 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.939085 26096 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11.
I20260709 12:11:24.962405 25791 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:24.987349 26123 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:24.988806 26123 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.963104 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:24.939990 26138 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:11:24.964910 26126 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:24.966609 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:24.999351 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 330165us
I20260709 12:11:24.941988 25974 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10.
I20260709 12:11:24.949998 22860 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:24.950624 26145 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:11:24.951193 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:24.952057 26033 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:24.953495 26152 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:25.000438 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:25.006404 22087 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:25.015232 22266 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
W20260709 12:11:25.035166 22088 leader_election.cc:336] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.892s (SENT)
I20260709 12:11:25.038794 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:25.009879 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 102514us
I20260709 12:11:25.039669 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:25.040385 22122 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:25.053689 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47371.1us
I20260709 12:11:25.044392 22118 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:11:25.054503 22123 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:25.040328 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:25.001523 26002 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.060524 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60173.7us
I20260709 12:11:25.070597 22117 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:25.071084 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:25.070619 22194 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.069639 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:25.074154 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:25.071888 22114 raft_consensus.cc:2376] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9. Re-sending same reply.
I20260709 12:11:25.074816 22189 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.076872 26033 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.077488 26033 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.077962 26033 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.078608 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:24.915303 26065 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:25.084936 22193 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:25.089012 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:25.087582 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 78223us
I20260709 12:11:25.036001 26052 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.056420 26141 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.056635 26057 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.098536 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:25.099175 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58959.1us
I20260709 12:11:25.100188 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.099954 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:25.100967 22195 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:25.102651 22122 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:25.106485 22114 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 9: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:25.073418 26002 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.118830 26002 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:25.120976 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:25.092940 25791 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.128826 26078 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.128816 25791 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.129454 26078 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.131161 26149 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.131461 26078 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:25.131670 26149 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.121026 26044 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:11:25.133948 26149 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:25.102247 26061 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:25.138233 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:25.138741 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:25.139531 22121 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:25.140834 26119 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:25.141621 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:25.142298 22114 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:25.143802 26118 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:25.105597 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.151063 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.140697 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:25.152509 22189 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:25.158238 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:25.158869 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.158727 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.160208 22189 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:25.166056 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:25.167256 22088 leader_election.cc:336] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.035s (SENT)
I20260709 12:11:25.167830 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:25.170184 22271 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:25.172376 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:25.173233 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:25.173924 22265 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.171555 22271 pending_rounds.cc:85] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 6
I20260709 12:11:25.176846 22271 pending_rounds.cc:107] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:25.177233 22271 raft_consensus.cc:2889] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.174116 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:25.178584 26147 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:25.177086 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:25.181664 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:25.182156 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.186559 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.188441 22271 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:25.193610 22263 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.170408 26141 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.174432 26118 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:25.198592 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.191052 25994 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:25.209209 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.179996 26107 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.218740 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.219663 22194 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:25.182964 25837 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:25.173532 26106 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:11:25.243839 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.187124 26061 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:25.233228 22265 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:25.221172 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.237902 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.251113 22189 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:25.242513 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.252192 22198 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:25.238521 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.256464 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.209828 25994 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.218271 26119 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:11:25.262023 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.237180 26082 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.268246 22862 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:11:25.271111 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.271394 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:25.262801 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 77793.1us
I20260709 12:11:25.272428 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.279433 22198 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
W20260709 12:11:25.274114 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 100176us
I20260709 12:11:25.199493 26147 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:25.282532 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.282932 22857 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.239389 26118 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:25.289289 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:25.290580 22189 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.255575 26002 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:25.283135 22196 raft_consensus.cc:2376] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9. Re-sending same reply.
I20260709 12:11:25.287820 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:25.287958 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:25.282351 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.248152 26107 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:11:25.319905 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 114911us
I20260709 12:11:25.324725 22194 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:25.325587 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:25.247854 26149 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:11:25.340914 22121 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.269425 25994 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.330905 22123 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 5.
I20260709 12:11:25.341958 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:25.355854 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:25.357137 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.365269 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.366261 22196 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:11:25.358394 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:25.368090 22117 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:11:25.376518 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57297.8us
I20260709 12:11:25.377591 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:25.402041 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:25.404224 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.406298 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:25.289294 26061 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:25.409941 22189 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:25.415210 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.422966 22120 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:25.425984 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.291630 26082 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.432497 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.361162 25837 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:11:25.419185 25972 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:25.435814 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.330484 26147 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
W20260709 12:11:25.412189 26138 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:11:25.443554 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:25.445184 22122 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:25.452000 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.435096 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.452813 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:25.453352 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 174016us
I20260709 12:11:25.453812 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:25.456631 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 168965us
I20260709 12:11:25.420753 26087 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.458886 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.462119 22272 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.474917 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.459641 22197 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:25.461419 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:25.468930 22120 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:25.476316 22117 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:25.484202 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.485862 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:25.487393 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.489161 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:25.489711 22196 raft_consensus.cc:2376] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11. Re-sending same reply.
I20260709 12:11:25.493737 22191 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:25.497171 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.506163 22195 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:25.477279 25972 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:25.509071 26127 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.226s
I20260709 12:11:25.509960 25972 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:25.459594 26154 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.518376 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:25.513437 22118 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:25.514576 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:25.515937 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:25.516594 22116 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:25.522466 22194 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.526604 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.462553 26069 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.512888 25954 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.462692 26033 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:25.479261 26107 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.534003 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.636458 26148 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.636713 26167 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:25.637144 26148 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:25.553571 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.637480 26082 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:25.630702 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:25.601882 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.533865 22198 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:25.514000 26164 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.524432 22195 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:25.563342 22194 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:25.526072 26154 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.580137 22118 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:25.607167 22114 raft_consensus.cc:2368] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:25.601559 26052 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.643540 26052 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.644248 26154 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:25.644333 22118 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:25.646338 22120 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:25.630100 26163 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:11:25.654959 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:25.657739 22266 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.542583 26002 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:25.664000 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:25.667783 26159 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.248s	user 0.001s	sys 0.001s
I20260709 12:11:25.608054 26106 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:25.678745 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:25.679881 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 149038us
W20260709 12:11:25.680511 22088 leader_election.cc:336] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.108s (SENT)
I20260709 12:11:25.681217 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:25.648006 26173 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:25.682118 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:25.686295 22088 leader_election.cc:336] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.191s (SENT)
I20260709 12:11:25.686707 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:25.690467 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.690807 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.660390 26171 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.668247 26069 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:25.679029 26176 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:25.693385 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.707545 22270 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:25.708811 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.692406 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.691483 22272 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:25.709604 22270 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:25.711037 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:25.703233 22266 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:25.525599 26061 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.676941 26128 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:25.645762 25954 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.715256 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:25.721854 22272 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:25.728624 22088 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.236s (SENT)
I20260709 12:11:25.728704 22121 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:25.689183 26052 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:25.712512 26065 consensus_meta.cc:287] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.001s
W20260709 12:11:25.744529 22088 leader_election.cc:336] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.243s (SENT)
I20260709 12:11:25.637576 26167 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.745241 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:25.522883 26118 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.751155 22193 raft_consensus.cc:2410] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:25.681391 26106 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.802577 22190 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:11:25.805364 26158 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.170s	user 0.002s	sys 0.000s
I20260709 12:11:25.833602 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:25.836532 25791 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:25.844555 22191 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:11:25.845271 26160 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.571s	user 0.003s	sys 0.000s
I20260709 12:11:25.846895 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:25.848151 26172 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
W20260709 12:11:25.851106 26170 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.362s	user 0.006s	sys 0.000s
W20260709 12:11:25.876225 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 142353us
I20260709 12:11:25.876618 26065 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.877331 26065 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.877660 26140 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:25.878463 26031 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:25.879156 26144 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:25.879595 26144 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:25.879793 26065 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:25.705639 26002 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.689297 26173 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.745783 26128 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.890973 26179 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:25.891230 26144 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.892585 26153 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.893368 26153 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:25.713828 26171 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.715503 26176 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:25.900906 26175 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:25.909672 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 76202.1us
I20260709 12:11:25.883138 26055 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.873831 26154 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:11:25.896327 26153 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:26.032447 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47651.3us
I20260709 12:11:26.150406 22857 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:11:26.057317 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 72772.3us
I20260709 12:11:26.058111 22858 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:25.915673 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:25.925634 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.088840 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 322073us
I20260709 12:11:26.155155 22162 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:26.161015 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 245428us
I20260709 12:11:26.159819 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:26.159567 25456 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:11:26.158216 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:25.922230 26165 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.179376 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:25.913319 26069 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:25.958456 26057 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.924962 26128 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.183642 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:25.931003 25791 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:26.001138 26148 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:25.947019 26033 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:26.191502 22830 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:26.193749 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:26.173827 26184 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:26.178594 26122 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.184726 26052 raft_consensus.cc:476] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:25.915931 26082 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.284s
I20260709 12:11:26.214372 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.159677 26055 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.212829 22197 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.198773 26074 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.189091 26165 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:26.236084 26165 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.237607 26165 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.232229 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:26.241086 26189 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.197395 25836 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:26.243310 25836 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.243769 25836 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.188491 26174 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.203370 25791 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.244606 25791 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:26.244613 26174 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.191146 26119 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:26.203727 26053 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:26.263998 26149 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.266721 26184 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:26.203025 26057 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.274477 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:26.252414 26119 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.287884 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:26.221577 26147 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.294549 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:26.295228 22194 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.298275 22190 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:26.298905 22190 pending_rounds.cc:85] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 7
I20260709 12:11:26.299213 22190 pending_rounds.cc:107] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:26.299497 22190 raft_consensus.cc:2889] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.294299 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:26.260627 26151 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.304075 22194 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:26.271026 26053 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.228390 25954 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:26.320101 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 136524us
I20260709 12:11:26.321223 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:26.332149 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.288569 26167 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.333770 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.338371 26173 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.290688 26122 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:26.305860 26082 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.362030 22197 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:26.332502 26053 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:26.289302 26149 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.367460 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:26.369731 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.329905 26034 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:11:26.346267 25994 consensus_meta.cc:287] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.928s	user 0.014s	sys 0.000s
W20260709 12:11:26.361707 26087 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.877s	user 0.014s	sys 0.000s
I20260709 12:11:26.360476 25954 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.386207 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.385650 26202 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.395535 22191 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:26.387458 26034 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.360810 26174 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:26.408084 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.409475 26055 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.393469 26087 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.387286 25994 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.422251 22858 raft_consensus.cc:2393] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 9: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:26.423542 25994 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:26.425630 22866 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:26.427356 26122 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.429298 25836 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.372442 26082 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.442448 26057 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.443316 26082 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.445463 25836 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:26.448948 26191 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:11:26.463532 22830 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:26.465109 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57210.9us
I20260709 12:11:26.465919 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.469498 25836 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:26.473980 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:26.474888 22197 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.463020 26118 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.475016 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:26.480742 25994 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:26.480859 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:26.505721 22190 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.470219 25836 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:26.474222 26123 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:26.473964 26117 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.471238 26202 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:26.511566 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.470952 26188 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.513808 22197 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:26.516366 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:26.510507 25836 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:26.397545 26184 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.542313 26061 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.510789 26146 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.545629 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.531740 26147 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:26.554283 26061 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:11:26.562384 22088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.014s	sys 0.007s
W20260709 12:11:26.563011 22088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.014s	sys 0.007s
I20260709 12:11:26.517913 26123 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.591332 26147 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:26.593116 26147 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.553604 26146 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:26.595683 26146 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.606827 26106 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.584923 25836 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.586073 22190 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
W20260709 12:11:26.597223 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 852680us
I20260709 12:11:26.543558 26053 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:26.624532 22088 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.262s (SENT)
I20260709 12:11:26.599828 26123 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:26.546464 25791 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.630270 25791 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:26.601568 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 56096.5us
I20260709 12:11:26.520818 26202 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.632093 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.633028 26202 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:26.633473 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:26.633760 26202 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.634367 26061 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:26.625039 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:26.635456 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:26.636577 26061 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.637102 26061 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:26.600698 26149 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.627450 26053 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.637524 26061 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:26.640901 22088 connection.cc:256] RPC call timeout handler was delayed by -1.0585483800002748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 12:11:26.642033 26106 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:26.642989 26106 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.643518 26106 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:26.644899 26187 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.447s	user 0.004s	sys 0.001s
I20260709 12:11:26.645987 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.649402 26123 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:26.655511 26149 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:26.655918 25836 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.656359 26149 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.659058 26149 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:26.650928 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.664738 26061 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.667029 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.668112 26061 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:26.669119 25456 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:26.668989 26202 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.671929 26106 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.668516 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:26.676517 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.678025 26061 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.678521 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:26.680105 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:26.689040 26202 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.689260 26061 raft_consensus.cc:2764] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:11:26.693905 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 142134us
I20260709 12:11:26.698909 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:26.702716 26061 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:26.705313 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 63809.3us
I20260709 12:11:26.714264 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:26.715183 22123 raft_consensus.cc:2410] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:26.716215 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:26.713666 26061 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:11:26.725965 25456 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:26.728420 26202 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:26.730135 26202 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:26.731106 26202 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.732213 26202 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.733546 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:26.735752 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:26.736142 26123 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.739501 25456 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.740077 25456 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:26.739318 26188 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:11:26.741256 25456 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.749114 26188 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:26.749169 26061 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:26.750766 22120 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.103s	user 0.008s	sys 0.004s
I20260709 12:11:26.750717 26061 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:26.751448 22120 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:26.751255 26176 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.752527 26164 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.753387 26164 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.756392 22193 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:26.756850 22193 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:26.757701 22193 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:26.758693 22193 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:26.762892 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.766886 22193 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:11:26.767217 22193 pending_rounds.cc:85] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 9
I20260709 12:11:26.751322 26061 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:26.767678 22193 pending_rounds.cc:107] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:11:26.768882 22193 raft_consensus.cc:2889] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.770356 25456 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:26.775411 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:26.777899 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:26.778324 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:26.778960 22268 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:26.782068 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:26.783450 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:26.781263 22193 raft_consensus.cc:2368] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14.
I20260709 12:11:26.785701 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:26.786638 22265 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:26.787849 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:26.788678 22271 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.783954 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:26.784073 22268 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:11:26.795743 25456 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:26.796661 26123 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:26.793648 26203 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:11:26.798101 26203 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:26.798566 26203 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:26.796649 26188 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 12:11:26.795928 26218 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.078s	user 0.002s	sys 0.003s
I20260709 12:11:26.799471 26203 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.801903 22236 leader_election.cc:400] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:26.802654 22236 leader_election.cc:403] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.803786 26171 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.781260 26061 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.800761 26203 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:26.814169 26061 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:26.814247 26164 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.821520 26178 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:26.823570 22271 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:26.830821 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:26.828650 26153 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.835827 25456 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.830052 26202 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:26.832933 26153 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.836840 25456 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:26.837976 25456 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.841041 26153 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.847908 22236 leader_election.cc:400] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14.
I20260709 12:11:26.848814 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:26.848851 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:26.848348 22236 leader_election.cc:403] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.851883 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:26.849134 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:26.852856 22119 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:26.850543 25456 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:26.850030 22116 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:26.854789 22122 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:26.857430 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:26.858119 22123 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:26.859941 26034 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.856534 26202 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.874434 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:26.874032 26107 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.881464 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:26.889791 26171 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.907308 26164 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:26.920295 26202 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14.
I20260709 12:11:27.020341 22118 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:27.030761 22118 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:27.086141 22117 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:27.094269 26203 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.094928 26203 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:27.096177 26202 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:27.096736 26202 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:27.097158 26203 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:27.099746 26127 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.100328 26127 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:27.101157 26202 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:27.102289 26127 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:27.117094 26202 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:27.117880 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.117846 26202 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:27.124683 25456 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:27.126238 26202 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:27.141609 26127 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.142275 26127 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:27.145044 26127 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:27.190340 22120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 1914) took 1697 ms (client timeout 1697 ms). Trace:
W20260709 12:11:27.190974 22120 rpcz_store.cc:269] 0709 12:11:25.492622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.492760 (+   138us) service_pool.cc:224] Handling call
0709 12:11:27.189999 (+1697239us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54003ad4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:27.190189 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285152640}
W20260709 12:11:27.192245 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:27.717796 26075 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:11:27.816532 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:27.817636 25837 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:27.819468 26118 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:27.820335 26118 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:27.823583 26118 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:27.835389 25837 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:27.853865 26190 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:27.855933 26190 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:27.856585 26190 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:27.852473 25837 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:27.877568 26190 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:27.899775 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2213) took 1594 ms. Trace:
I20260709 12:11:27.901038 26144 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:27.900440 22198 rpcz_store.cc:276] 0709 12:11:26.305252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.305382 (+   130us) service_pool.cc:224] Handling call
0709 12:11:26.305746 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.305980 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:26.348329 (+ 42349us) log.cc:844] Serialized 14 byte log entry
0709 12:11:27.895507 (+1547178us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b18003cf0a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a 00007fcceddcca2a
0709 12:11:27.899078 (+  3571us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:27.899133 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:27.899176 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.899309 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.899662 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42189,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":3568,"raft.queue_time_us":90,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":213,"spinlock_wait_cycles":12861312,"thread_start_us":3242,"threads_started":1,"wal-append.queue_time_us":1548527}
I20260709 12:11:27.912501 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1926) took 1064 ms. Trace:
I20260709 12:11:27.913198 22119 rpcz_store.cc:276] 0709 12:11:26.847712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.853517 (+  5805us) service_pool.cc:224] Handling call
0709 12:11:26.856289 (+  2772us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:26.857745 (+  1456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.857793 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:26.869533 (+ 11740us) log.cc:844] Serialized 52 byte log entry
0709 12:11:27.886247 (+1016714us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b1800253ea0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:11:27.899127 (+ 12880us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:27.899166 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.899312 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.902916 (+  3604us) raft_consensus.cc:1685] finished
0709 12:11:27.903054 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.912357 (+  9303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1027593,"raft.queue_time_us":13513,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":4639,"spinlock_wait_cycles":6737280,"thread_start_us":12675,"threads_started":1,"wal-append.queue_time_us":1006947}
I20260709 12:11:27.921129 26118 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.921712 26118 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:27.924247 26118 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:27.928063 26118 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:27.928719 26118 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:27.931633 26118 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:27.940618 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1922) took 1166 ms. Trace:
I20260709 12:11:27.941313 22196 rpcz_store.cc:276] 0709 12:11:26.774087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.774231 (+   144us) service_pool.cc:224] Handling call
0709 12:11:26.774690 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.775137 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.775170 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.779700 (+  4530us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.837539 (+ 57839us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:26.837598 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.849041 (+ 11443us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.940234 (+1091193us) raft_consensus.cc:1685] finished
0709 12:11:27.940271 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.940517 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1304,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":97,"thread_start_us":44949,"threads_started":1,"wal-append.queue_time_us":116040,"wal-append.run_cpu_time_us":1833,"wal-append.run_wall_time_us":1007872}
I20260709 12:11:27.955689 26144 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.956259 26144 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:27.962918 26144 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:27.972579 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:27.973532 22196 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:27.975641 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:27.978475 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:27.982697 22196 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:28.002058 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:28.006214 26248 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:28.006903 26248 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.012434 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:28.015785 22144 debug-util.cc:398] Leaking SignalData structure 0x7b0800149fe0 after lost signal to thread 20894
I20260709 12:11:28.022740 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1911) took 2578 ms. Trace:
I20260709 12:11:28.023231 22117 rpcz_store.cc:276] 0709 12:11:25.444264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.485774 (+ 41510us) service_pool.cc:224] Handling call
0709 12:11:25.486073 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.086691 (+1600618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.022420 (+935729us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400084b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:28.022653 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3679193984}
I20260709 12:11:28.028220 26246 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:28.029048 26246 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.033672 26246 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:28.036043 26248 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:28.041803 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1918) took 1752 ms. Trace:
I20260709 12:11:28.042250 22191 rpcz_store.cc:276] 0709 12:11:26.289069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.289491 (+   422us) service_pool.cc:224] Handling call
0709 12:11:26.289856 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.396072 (+106216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.041521 (+1645449us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400141ed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:28.041735 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242500864}
I20260709 12:11:28.085448 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:28.134848 22144 debug-util.cc:398] Leaking SignalData structure 0x7b080017d4e0 after lost signal to thread 22055
I20260709 12:11:28.135238 26118 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:28.136260 22144 debug-util.cc:398] Leaking SignalData structure 0x7b080031b0a0 after lost signal to thread 22147
I20260709 12:11:28.135993 26118 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.139097 26118 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:28.136634 22144 debug-util.cc:398] Leaking SignalData structure 0x7b080021c860 after lost signal to thread 22148
I20260709 12:11:28.141777 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:28.142582 22144 debug-util.cc:398] Leaking SignalData structure 0x7b080022c640 after lost signal to thread 22222
W20260709 12:11:28.143049 22144 debug-util.cc:398] Leaking SignalData structure 0x7b0800133400 after lost signal to thread 22223
I20260709 12:11:28.147680 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:28.141021 26251 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:28.148706 22198 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:28.148952 26251 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:28.150498 22144 debug-util.cc:398] Leaking SignalData structure 0x7b08003b73a0 after lost signal to thread 22296
I20260709 12:11:28.151684 26251 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:28.153225 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.161659 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:28.160037 26251 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:28.168692 26251 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.169054 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.170974 26251 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:28.172034 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:28.171960 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.174077 22270 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:28.174333 26151 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:28.174906 26151 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.176697 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.178791 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.177100 26087 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:28.183244 22272 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:11:28.184114 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.184679 22263 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:11:28.187427 26231 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.180692 26087 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.188274 26231 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.190542 26231 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:28.191428 20896 debug-util.cc:398] Leaking SignalData structure 0x7b080000ffa0 after lost signal to thread 22088
W20260709 12:11:28.191843 20896 kernel_stack_watchdog.cc:198] Thread 22088 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 309ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:11:28.192489 26151 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:28.190568 26087 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:28.193925 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.195291 26182 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.195839 26182 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.198158 26182 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:28.198714 26182 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:28.199229 26182 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.201412 26075 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:28.202049 22190 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:28.202003 26075 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.204335 26075 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:28.205368 26075 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:28.206013 26075 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.209060 26075 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:28.214987 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:28.215834 22190 raft_consensus.cc:606] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:28.216313 22190 raft_consensus.cc:614] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:28.221645 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:28.223304 22190 raft_consensus.cc:606] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:28.226753 22190 raft_consensus.cc:614] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:28.229516 26190 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:28.230177 26033 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:28.231086 26033 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.469877 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:28.472316 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:28.474655 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.234391 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.475106 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:28.476073 22857 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:28.476668 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.478266 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.479082 22196 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:28.482095 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:28.235529 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.484128 22193 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:28.236513 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.485411 22194 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:28.230129 26190 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.227111 26144 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:28.308682 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.695906 26144 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.696240 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.697041 22120 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:28.697445 26280 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:28.320924 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.698226 26280 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:28.698745 26280 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.326191 26246 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.227854 26182 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:28.339057 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:28.346480 26260 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:28.343881 26261 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.717646 22197 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.717911 26261 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.716845 26230 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:11:28.716670 26144 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:28.352842 26262 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:28.357316 22163 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:28.721165 26262 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:28.721802 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 364532us
I20260709 12:11:28.393529 22266 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:28.723472 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.724365 26262 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:28.415117 22009 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 1.489s	user 0.009s	sys 0.013s
I20260709 12:11:28.419422 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.437285 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.736297 22264 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:28.736721 22268 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:28.737440 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.438889 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.739944 22268 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:28.739979 26284 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:28.440210 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:28.446185 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:28.449429 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:28.450747 22144 debug-util.cc:398] Leaking SignalData structure 0x7b08003dbd80 after lost signal to thread 22890
I20260709 12:11:28.743101 22197 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
W20260709 12:11:28.744412 22144 debug-util.cc:398] Leaking SignalData structure 0x7b08003acde0 after lost signal to thread 26160
I20260709 12:11:28.739944 22264 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:28.453070 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:28.454583 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 219515us
I20260709 12:11:28.467190 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:28.753104 22272 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:28.468595 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:28.489842 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.496814 26087 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.497424 26069 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:28.498122 26033 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:28.498806 26251 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.500916 26164 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.501403 26176 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.507270 26002 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.508639 26107 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:28.511565 26171 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.517982 26106 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:28.541450 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 1.65998e+06us
I20260709 12:11:28.541869 26278 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:28.542671 22861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:28.803033 22861 raft_consensus.cc:606] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:28.803534 22861 raft_consensus.cc:614] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:28.600714 26264 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:28.621622 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 132419us
W20260709 12:11:28.671756 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 187330us
I20260709 12:11:28.686816 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:28.689147 26269 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.134s	user 0.004s	sys 0.000s
I20260709 12:11:28.694559 26190 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:28.696130 22192 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:11:28.821669 22192 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:28.309701 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.822865 22189 raft_consensus.cc:2393] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:28.320072 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.701155 26274 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.701300 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1922) took 1854 ms. Trace:
I20260709 12:11:28.702241 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1921) took 1856 ms. Trace:
I20260709 12:11:28.702679 22271 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:28.703770 26246 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:28.704514 26165 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:28.704687 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1928) took 1854 ms. Trace:
I20260709 12:11:28.777041 26069 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.706059 26279 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:28.706377 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.848227 22122 rpcz_store.cc:276] 0709 12:11:26.850110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.855644 (+  5534us) service_pool.cc:224] Handling call
0709 12:11:26.855899 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.857586 (+  1687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.857611 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.858164 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:11:27.889846 (+1031682us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b18002258e0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:11:27.898254 (+  8408us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:27.913270 (+ 15016us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.704250 (+790980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.704338 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.704390 (+    52us) raft_consensus.cc:1685] finished
0709 12:11:28.704505 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.704621 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1880046,"prepare.queue_time_us":29809,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":797547,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":5194,"spinlock_wait_cycles":19139328,"thread_start_us":216238,"threads_started":3,"wal-append.queue_time_us":1017513}
I20260709 12:11:28.853896 22120 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:28.706841 26275 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:28.707808 26272 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:28.709137 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.710335 26277 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.865512 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.713668 26252 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:28.715561 26254 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.717821 26260 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.357100 26263 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:28.721897 26144 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:28.370838 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:28.393723 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.724735 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:28.720643 26261 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:28.754212 22194 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:28.749274 22263 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
W20260709 12:11:28.773382 22162 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 2.222s (SENT) [suppressed 37 similar messages]
I20260709 12:11:28.761400 26087 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.762463 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:28.881244 22197 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:28.790642 26176 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.779192 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 256) took 6678 ms. Trace:
W20260709 12:11:28.779974 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.725539 26280 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:28.777202 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53979.9us
I20260709 12:11:28.787794 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.789892 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:28.810995 22272 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:28.762748 26118 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 12:11:28.818542 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 55250us
I20260709 12:11:28.899006 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.842589 22189 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:28.826143 22121 rpcz_store.cc:276] 0709 12:11:26.846171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.962037 (+115866us) service_pool.cc:224] Handling call
0709 12:11:26.962346 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.701859 (+1739513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.701893 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:28.701937 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:28.701976 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.702066 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.702181 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1543219,"raft.queue_time_us":1579096,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":195850,"threads_started":1}
I20260709 12:11:28.845319 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:28.705822 26276 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.851729 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1920) took 2005 ms. Trace:
I20260709 12:11:28.816754 26106 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.824982 22115 rpcz_store.cc:276] 0709 12:11:26.846491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.975139 (+128648us) service_pool.cc:224] Handling call
0709 12:11:26.975689 (+   550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.976020 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.976058 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.976612 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.979382 (+  2770us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:26.989450 (+ 10068us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.700962 (+1711512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.701047 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.701103 (+    56us) raft_consensus.cc:1685] finished
0709 12:11:28.701116 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.701240 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1510949,"prepare.queue_time_us":10080,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":1551725,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"thread_start_us":211990,"threads_started":3,"wal-append.queue_time_us":2786,"wal-append.run_cpu_time_us":3241,"wal-append.run_wall_time_us":1011327}
I20260709 12:11:28.760655 26284 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.859261 26190 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.813084 26107 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.912542 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:28.913232 22115 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.870383 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.786180 26251 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.884467 26144 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:28.879895 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 106564us
I20260709 12:11:28.776149 26283 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:28.880438 22269 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:28.895812 22197 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:28.898264 22116 raft_consensus.cc:2410] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:28.819428 26291 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.813397 26171 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.905460 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:28.905607 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 60426.2us
I20260709 12:11:28.855787 26165 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.910215 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.931507 22121 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:28.932554 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.892204 22017 rpcz_store.cc:276] 0709 12:11:22.084340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.120890 (+ 36550us) service_pool.cc:224] Handling call
0709 12:11:28.762010 (+6641120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:24.548629 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:24.578771 (+ 30142us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:24.578840 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:11:24.578890 (+    50us) tablet.cc:662] Decoding operations
0709 12:11:24.771581 (+192691us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:24.775614 (+  4033us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:24.779469 (+  3855us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:11:24.805881 (+ 26412us) tablet.cc:701] Row locks acquired
0709 12:11:24.805912 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:11:24.806131 (+   219us) write_op.cc:270] Start()
0709 12:11:24.806296 (+   165us) write_op.cc:276] Timestamp: P: 1783599084806057 usec, L: 0
0709 12:11:24.806331 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:11:24.807389 (+  1058us) log.cc:844] Serialized 6009 byte log entry
0709 12:11:25.280442 (+473053us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcceacb80ac 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b
0709 12:11:25.774898 (+494456us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:26.407732 (+632834us) op_driver.cc:464] REPLICATION: finished
0709 12:11:26.647336 (+239604us) write_op.cc:301] APPLY: starting
0709 12:11:26.647440 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:26.648720 (+  1280us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:26.648745 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:26.650212 (+  1467us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:26.650502 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=30
0709 12:11:26.650544 (+    42us) write_op.cc:312] APPLY: finished
0709 12:11:26.650929 (+   385us) log.cc:844] Serialized 107 byte log entry
0709 12:11:26.651185 (+   256us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:26.651391 (+   206us) write_op.cc:454] Released schema lock
0709 12:11:26.651443 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:26.690870 (+ 39427us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:26.691459 (+   589us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":80932,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":196850,"apply.run_cpu_time_us":4427,"apply.run_wall_time_us":4566,"num_ops":15,"prepare.queue_time_us":168763,"prepare.run_cpu_time_us":47565,"prepare.run_wall_time_us":823661,"raft.queue_time_us":501873,"raft.run_cpu_time_us":48870,"raft.run_wall_time_us":337850,"replication_time_us":1578199,"spinlock_wait_cycles":67803392,"thread_start_us":1036286,"threads_started":4,"wal-append.queue_time_us":637740}]]}
I20260709 12:11:28.902429 22114 rpcz_store.cc:276] 0709 12:11:26.845852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.845980 (+   128us) service_pool.cc:224] Handling call
0709 12:11:26.846359 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.682625 (+1836266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.682662 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.683264 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.740204 (+ 56940us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.780652 (+ 40448us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.819112 (+ 38460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.851314 (+ 32202us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54002e2a54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:28.851363 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.851408 (+    45us) raft_consensus.cc:1685] finished
0709 12:11:28.851492 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.851662 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1390467,"prepare.queue_time_us":40423,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":1579157,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"spinlock_wait_cycles":623516544,"thread_start_us":305931,"threads_started":4,"wal-append.queue_time_us":54000}
I20260709 12:11:28.933982 22116 raft_consensus.cc:2410] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:28.916157 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:28.919194 22122 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:28.891583 26087 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.821058 26278 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.803195 26002 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.941242 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.944022 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.942144 22265 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.929034 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:28.927740 26144 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.787395 26164 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.851935 26274 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.824347 26264 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.920037 22861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:28.971815 22861 raft_consensus.cc:606] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:28.881330 26254 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.980335 26254 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:28.949081 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.871764 26275 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:28.873303 26277 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.912273 26271 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:28.965111 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.028231 22122 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:28.939196 26289 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.912071 26276 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.966642 26151 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:28.939375 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.039008 22114 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:11:29.040307 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.041152 22114 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:28.981453 22266 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:28.982020 26284 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:28.983505 26264 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:28.984236 22191 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:28.985811 26069 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:28.986714 22119 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
W20260709 12:11:28.988153 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.988338 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.049086 22116 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:29.050083 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.890708 26263 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.918634 26190 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.990422 26260 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:28.868432 26279 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.991405 22117 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:11:28.992242 26176 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:28.871634 26272 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:28.879180 26252 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:29.013087 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 223284us
I20260709 12:11:29.026412 22265 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:28.953425 26280 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:29.033681 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.935781 26283 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:29.051381 22118 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:29.052887 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.078723 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.050709 22116 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 5.
I20260709 12:11:29.058090 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.074402 22197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4bae45452334273a1c277a0a512021f"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:29.074501 22120 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:29.027724 26295 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.077386 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:29.092332 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.079945 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.094345 22197 raft_consensus.cc:606] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:29.095105 22197 raft_consensus.cc:614] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:29.096907 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 182824us
I20260709 12:11:29.099316 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.048656 26151 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:29.123955 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:28.939412 26291 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:29.102555 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:29.133738 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 56433.1us
I20260709 12:11:29.102742 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:29.105216 26164 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:29.106483 22195 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:11:29.106643 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.108949 26106 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:29.109755 22121 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
W20260709 12:11:29.109810 22236 leader_election.cc:336] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.697s (SENT)
I20260709 12:11:29.110303 26274 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:29.148761 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.113222 26278 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:29.114161 26275 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:29.115900 26276 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:29.117120 22270 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:29.149582 22118 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:29.118589 26279 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:29.120481 26171 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:29.129310 22115 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:29.165915 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.165761 26242 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:29.166834 22115 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:29.167776 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.099642 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.125479 22122 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:29.079689 26277 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:29.172290 26283 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:29.184316 26230 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:11:29.135214 22189 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:29.133819 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.197268 22116 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:29.197729 26272 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:29.198153 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.198936 22116 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:29.199425 26087 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:29.201166 22862 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:29.201267 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.201988 22118 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:29.203117 22118 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:29.203475 26087 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:29.037009 26289 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:29.206537 26289 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:29.124545 26295 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:29.210359 26295 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:29.213454 26144 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:29.139005 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:11:29.147421 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 231314us
I20260709 12:11:29.161280 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.234570 26291 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:29.241171 22121 raft_consensus.cc:2376] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7. Re-sending same reply.
I20260709 12:11:29.121868 26118 raft_consensus.cc:476] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:29.127599 26151 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:29.242064 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:29.242658 26299 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
I20260709 12:11:29.243155 26165 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:29.070533 26292 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:29.245148 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:29.245342 26292 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:29.245981 22266 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:29.246097 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:29.128364 26254 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.246356 26292 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:29.246874 26254 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:29.247829 26283 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:29.248353 26283 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:29.244498 22861 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.118626 26252 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:29.177481 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.140038 26280 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:29.187690 26263 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:29.190177 26107 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:29.162483 26246 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:11:29.191489 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:29.257772 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 66379.3us
I20260709 12:11:29.193578 26190 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:29.129191 22009 maintenance_manager.cc:643] P 724c00f1bc7e49c9835e5c0e664b7356: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.436s	user 0.192s	sys 0.114s Metrics: {"bytes_written":30828,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":342966,"dirs.run_cpu_time_us":440,"dirs.run_wall_time_us":1119,"drs_written":1,"lbm_read_time_us":414,"lbm_reads_lt_1ms":4,"lbm_write_time_us":122455,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":160510848,"thread_start_us":318928,"threads_started":1,"update_count":29}
I20260709 12:11:29.132651 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.137735 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:29.218714 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:29.219130 26002 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:29.266965 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:29.219705 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:29.270148 22195 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.221838 26251 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:29.168150 26242 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:29.224522 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.226938 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.227674 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.231319 22857 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:29.234259 26303 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.050s	user 0.003s	sys 0.000s
I20260709 12:11:29.173414 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:29.248926 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:29.252009 26302 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:29.254647 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:29.259119 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:29.259600 22117 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
W20260709 12:11:29.265856 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 128237us
I20260709 12:11:29.266793 22189 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:11:29.285837 22219 debug-util.cc:398] Leaking SignalData structure 0x7b0800165e00 after lost signal to thread 20894
W20260709 12:11:29.281205 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 360432us
W20260709 12:11:29.288312 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 137281us
W20260709 12:11:29.328122 22219 debug-util.cc:398] Leaking SignalData structure 0x7b080016aa80 after lost signal to thread 22055
W20260709 12:11:29.329043 22219 debug-util.cc:398] Leaking SignalData structure 0x7b0800165fe0 after lost signal to thread 22088
W20260709 12:11:29.330534 22219 debug-util.cc:398] Leaking SignalData structure 0x7b0800168500 after lost signal to thread 22147
W20260709 12:11:29.330920 22219 debug-util.cc:398] Leaking SignalData structure 0x7b08001684e0 after lost signal to thread 22148
I20260709 12:11:29.328070 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:29.338173 22219 debug-util.cc:398] Leaking SignalData structure 0x7b0800368060 after lost signal to thread 22222
I20260709 12:11:29.268553 26254 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:29.338537 22219 debug-util.cc:398] Leaking SignalData structure 0x7b08001bc640 after lost signal to thread 22223
I20260709 12:11:29.249219 26283 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:29.339854 22219 debug-util.cc:398] Leaking SignalData structure 0x7b08002de340 after lost signal to thread 22296
W20260709 12:11:29.347666 22219 debug-util.cc:398] Leaking SignalData structure 0x7b08002014e0 after lost signal to thread 22890
W20260709 12:11:29.341009 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 81952.9us
I20260709 12:11:29.349560 22010 maintenance_manager.cc:419] P 724c00f1bc7e49c9835e5c0e664b7356: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9312 bytes on disk
I20260709 12:11:29.351282 26263 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.355005 22195 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:29.355530 22163 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:29.272222 26287 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:29.357276 26287 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:29.357687 26287 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.358013 26287 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:29.358377 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:29.359330 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:29.349668 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:29.361792 26075 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:29.362211 26075 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.362262 26286 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.362635 26075 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:29.362869 26286 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.363327 26286 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.342659 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.364982 26293 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:29.342054 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:29.365515 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:29.366767 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:29.368005 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:29.286854 26280 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.369050 26271 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:29.369285 26280 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:29.369724 26271 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:29.365558 26293 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:29.370525 26293 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.370982 26271 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:29.372233 26246 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:29.336828 26302 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.371609 26144 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:29.369119 26289 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:29.365114 22114 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.375319 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:29.376854 22189 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:29.383426 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:29.385227 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:29.384021 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:29.374642 26302 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:29.400516 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:29.401413 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:29.402415 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60593.7us
I20260709 12:11:29.403852 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:29.410156 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:29.411286 20896 debug-util.cc:398] Leaking SignalData structure 0x7b080000ff80 after lost signal to thread 22088
W20260709 12:11:29.443619 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 55126.2us
I20260709 12:11:29.445645 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:29.446348 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64171.6us
I20260709 12:11:29.369757 26280 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:29.450264 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.455628 22122 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:29.388588 26272 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:29.476104 22163 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:29.476528 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.477296 22865 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:29.477073 22009 maintenance_manager.cc:643] P 724c00f1bc7e49c9835e5c0e664b7356: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.066s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":475,"lbm_reads_lt_1ms":4}
I20260709 12:11:29.478034 22163 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:29.399912 26289 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:29.484174 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.410097 26246 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:29.485236 22122 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.481068 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:29.486776 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.372748 26287 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:29.453083 26290 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:29.454908 26280 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:29.498446 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.499866 22123 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:29.449460 26300 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:29.482776 26144 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:29.506083 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.485889 26285 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.504281 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.443509 26254 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:11:29.455263 26230 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:11:29.493108 26260 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:29.514846 26264 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:29.475838 26118 consensus_queue.cc:1059] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:11:29.527350 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.515002 26246 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:29.515497 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.511152 26252 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:11:29.501394 26290 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.503952 26300 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.526291 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.522389 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.492847 26261 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:29.487279 26262 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:11:29.557924 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 156159us
I20260709 12:11:29.548058 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.548416 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.552857 22123 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:29.556445 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.505702 26144 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:29.521508 26264 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:29.581683 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 54968.4us
W20260709 12:11:29.581717 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 102104us
I20260709 12:11:29.575630 22860 raft_consensus.cc:2393] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:29.577039 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.583037 22162 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:29.574054 22122 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:29.560828 22237 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:29.583375 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:29.595975 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.596685 22120 raft_consensus.cc:2376] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8. Re-sending same reply.
I20260709 12:11:29.597474 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.598484 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.599030 22120 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:29.600178 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.599752 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.605250 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.605949 22117 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:29.607327 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.608337 22122 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
W20260709 12:11:29.609426 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 261905us
I20260709 12:11:29.582319 26264 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.556761 26300 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.556594 26290 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.613229 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.618131 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.622521 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.577775 26144 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:29.629866 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.630270 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.630755 22120 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:29.631459 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.632731 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.634815 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.614702 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:29.605412 26107 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:29.637156 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.639818 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.605795 26296 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:29.586236 26182 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:11:29.658639 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.708513 22114 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:29.710386 22123 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:29.710834 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.669723 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:29.716300 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 105656us
I20260709 12:11:29.716591 22120 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:29.645619 26107 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.726227 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.727311 22120 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 5.
I20260709 12:11:29.728520 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.729698 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.731225 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.731806 22120 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:29.736562 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.737485 22114 raft_consensus.cc:2376] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9. Re-sending same reply.
I20260709 12:11:29.660315 26263 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:29.659766 26254 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:29.720589 26312 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:11:29.742479 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.660512 26118 raft_consensus.cc:3055] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:29.664579 22122 raft_consensus.cc:2393] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:29.643680 26190 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 12:11:29.726651 26107 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:29.745539 26306 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:11:29.745688 26263 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.782047 26263 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:29.782536 26307 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:11:29.788230 26287 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:29.723167 26252 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.789707 26252 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:29.791831 26252 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:29.740664 26319 consensus_queue.cc:1059] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:11:29.665691 26322 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
W20260709 12:11:29.755949 26305 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 12:11:29.779417 26310 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:11:29.757946 26002 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.760246 26118 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:29.775549 22122 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:29.823083 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.840802 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.855839 22117 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:29.856230 22120 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
W20260709 12:11:29.858354 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 192879us
I20260709 12:11:29.842869 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.888254 22122 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:11:29.850804 26316 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
W20260709 12:11:29.851258 26318 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:11:29.850306 26315 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 12:11:29.846344 26151 consensus_meta.cc:287] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.001s
I20260709 12:11:29.892226 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:29.849722 26317 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:11:29.893397 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:29.895809 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:29.839860 26291 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:29.917177 26291 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:29.919695 26291 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:29.926170 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:29.928480 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 414892us
W20260709 12:11:29.936601 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 455734us
I20260709 12:11:29.940464 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:29.930661 26286 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.000s
I20260709 12:11:29.943163 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:29.938268 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:29.928000 26087 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:11:29.944221 22190 raft_consensus.cc:2393] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:29.945694 22195 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:29.942203 22864 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:29.931582 26271 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:29.948024 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:29.948944 22195 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
W20260709 12:11:29.950212 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 225961us
I20260709 12:11:29.950917 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:29.953923 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:29.822263 26002 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:29.955345 26261 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:29.955497 26251 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:29.953181 26287 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.933061 22830 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:29.926955 26151 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:29.970705 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.975255 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:29.977897 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.976509 26251 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:29.981249 26251 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:29.981685 26033 raft_consensus.cc:993] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
W20260709 12:11:29.989245 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56318.3us
I20260709 12:11:29.984833 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.990093 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:29.991845 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:29.947263 26286 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:29.962772 26323 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:30.000309 22865 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:29.993722 22830 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:29.959754 26325 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:29.842309 26118 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:29.965373 26287 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.982422 26251 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.987900 26261 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:30.011936 26075 consensus_meta.cc:287] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.002s
I20260709 12:11:30.012094 26144 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:30.013309 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:29.982496 26033 raft_consensus.cc:1081] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:30.017180 26254 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:30.019074 26319 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:30.021242 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 90810.6us
W20260709 12:11:30.023974 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.024075 26252 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:30.024713 26322 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:30.024890 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:30.033125 26293 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.000s
I20260709 12:11:30.027555 26304 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:30.028191 26332 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:30.028277 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:30.029222 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:30.031526 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:30.032196 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.034444 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.034737 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:30.036883 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 44171.2us
I20260709 12:11:30.035382 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:30.038038 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.038331 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.038765 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.004285 26323 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.993100 26271 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:30.026001 26151 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:30.065711 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:30.116142 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:30.057843 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.060343 22860 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.120126 22194 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:30.119895 26033 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:30.120961 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.121999 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.122617 26330 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:30.122900 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.119171 22263 raft_consensus.cc:2410] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:30.065444 26261 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.074306 22865 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:30.026005 26328 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:30.067363 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 100051us
I20260709 12:11:30.065163 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:30.075461 26118 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.034938 26107 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:30.030503 26002 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:30.053783 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.130172 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.132649 22197 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:30.050941 26287 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:30.133396 22163 connection.cc:256] RPC call timeout handler was delayed by -1.357208245000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 12:11:30.061087 26324 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.272s	user 0.004s	sys 0.000s
I20260709 12:11:30.067158 26231 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:30.171820 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.173442 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.174727 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:30.175968 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.060042 26144 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:30.118894 26323 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.188787 22118 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:30.063377 26319 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:30.102041 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:30.192286 22265 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:30.158979 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.194283 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.159967 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.050720 26326 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:30.164031 22119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.010s	sys 0.017s
W20260709 12:11:30.196113 22119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.010s	sys 0.017s
I20260709 12:11:30.063247 26254 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.171993 26231 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:30.065575 26252 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.197486 22115 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:30.058123 26075 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.064857 26290 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.145367 26271 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:30.065840 26322 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.077540 26263 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.205826 22197 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:30.214771 22192 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.113389 26304 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.238916 22266 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:30.239670 22192 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:30.149631 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:30.243841 22195 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:30.062952 26264 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:30.233893 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:30.081499 26293 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:30.233011 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43783.3us
I20260709 12:11:30.145053 26300 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.208140 26231 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.187695 26165 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:30.252509 22087 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:30.201196 22860 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:30.118012 26332 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.198455 26326 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:30.271608 22272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:11:30.206740 26339 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:30.224757 22265 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:30.273646 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:30.272570 22272 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:11:30.276480 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 211358us
I20260709 12:11:30.288661 22193 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:30.290225 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:30.280656 22198 raft_consensus.cc:2368] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:30.290859 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:30.292461 22272 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.155701 26328 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:30.300947 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.247978 26295 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:30.297760 22191 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:30.263161 26296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.001s	sys 0.013s
I20260709 12:11:30.302235 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:30.331051 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:30.332299 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:30.335323 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:30.309574 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:30.299186 26283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.017s	sys 0.021s
I20260709 12:11:30.289068 26331 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.275627 26246 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:30.275745 26326 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.301841 26292 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:30.337606 26296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.001s	sys 0.013s
I20260709 12:11:30.360442 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:30.350405 26283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.018s	sys 0.021s
W20260709 12:11:30.366107 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 56673.1us
W20260709 12:11:30.348992 26336 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:11:30.377307 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:30.374050 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:30.371264 26296 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:30.379670 22087 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:30.287595 26165 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:30.388135 22272 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:30.404470 22114 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.369341 26002 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:30.300033 26339 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:30.431982 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 183771us
I20260709 12:11:30.376107 26286 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:30.386304 26304 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:30.447714 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.370452 26246 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.413050 26283 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.428224 26321 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:30.444723 26302 consensus_meta.cc:287] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.995s	user 0.017s	sys 0.004s
W20260709 12:11:30.548388 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 208438us
I20260709 12:11:30.404795 26331 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:30.372426 26271 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:30.278929 26319 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:30.640389 22272 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:30.482628 26296 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.441582 26358 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:30.646512 22195 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:30.671095 22830 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:30.672037 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 375950us
W20260709 12:11:30.674834 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 339567us
W20260709 12:11:30.642588 26343 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.341s	user 0.000s	sys 0.008s
W20260709 12:11:30.699164 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 325149us
W20260709 12:11:30.705785 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 326187us
I20260709 12:11:30.712476 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:30.642758 26350 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:30.667510 26337 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:30.721544 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:30.732641 26331 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:30.711151 26349 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.231s	user 0.001s	sys 0.007s
I20260709 12:11:30.667801 26304 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:30.734398 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:30.676328 26107 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:30.711345 26345 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.271s	user 0.005s	sys 0.003s
W20260709 12:11:30.725641 26314 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.013s	user 0.000s	sys 0.011s
W20260709 12:11:30.768291 26357 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:11:30.703605 26263 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:30.703783 26302 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:30.735059 26337 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:30.703958 26242 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:30.777529 26364 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:11:30.728811 26289 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:30.979877 26002 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:30.969656 26339 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:30.970427 26290 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:30.970896 26358 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:30.971516 26231 consensus_meta.cc:287] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.676s	user 0.021s	sys 0.037s
I20260709 12:11:30.972119 26264 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:30.972987 26165 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:30.731563 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:31.100914 26352 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.980248 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1948) took 1039 ms. Trace:
W20260709 12:11:30.727819 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.101774 26328 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:31.101392 26165 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:31.101529 22189 rpcz_store.cc:276] 0709 12:11:29.940355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.942233 (+  1878us) service_pool.cc:224] Handling call
0709 12:11:29.951540 (+  9307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.952219 (+   679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.952267 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.956222 (+  3955us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.078333 (+122111us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:30.078372 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.078444 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.980006 (+901562us) raft_consensus.cc:1685] finished
0709 12:11:30.980026 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.980181 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1370,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":116,"thread_start_us":120501,"threads_started":1,"wal-append.queue_time_us":287395}
I20260709 12:11:31.104928 26264 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:11:31.105286 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 373779us
I20260709 12:11:31.105721 26264 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.106313 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:31.106987 26252 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:31.108286 26264 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.109572 22163 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:31.111019 26326 consensus_meta.cc:287] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.735s	user 0.006s	sys 0.010s
I20260709 12:11:31.111630 26182 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.113422 26002 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.114828 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1947) took 1175 ms. Trace:
I20260709 12:11:31.115288 22198 rpcz_store.cc:276] 0709 12:11:29.939957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.940138 (+   181us) service_pool.cc:224] Handling call
0709 12:11:31.114544 (+1174406us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54002369d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:31.114721 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780038912}
I20260709 12:11:31.115952 26002 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:31.042933 26337 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.112502 26182 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.120893 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 2369) took 1096 ms. Trace:
I20260709 12:11:31.120884 26355 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:31.043031 26254 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:31.121461 22266 rpcz_store.cc:276] 0709 12:11:30.024838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.035155 (+ 10317us) service_pool.cc:224] Handling call
0709 12:11:31.120610 (+1085455us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54002274d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:31.120752 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277986176}
I20260709 12:11:31.120086 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2374) took 1093 ms. Trace:
I20260709 12:11:31.073926 26332 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:31.073608 26300 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.043292 26107 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:11:31.119949 26182 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:30.995335 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.136157 22271 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
W20260709 12:11:30.973205 26323 consensus_meta.cc:287] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.765s	user 0.008s	sys 0.011s
I20260709 12:11:31.143214 26323 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.145007 22197 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:31.145942 26322 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:31.146471 26323 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.123787 26302 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.021276 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:31.147953 22119 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.152302 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 1934) took 1554 ms. Trace:
W20260709 12:11:30.986490 26280 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.474s	user 0.028s	sys 0.000s
I20260709 12:11:31.153147 26280 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.156170 26280 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.157132 22116 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:31.152349 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:31.158495 22120 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:31.003050 26118 consensus_meta.cc:287] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.829s	user 0.019s	sys 0.007s
I20260709 12:11:31.159121 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:31.159920 22268 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:31.160642 22268 pending_rounds.cc:85] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 9
I20260709 12:11:31.160890 22268 pending_rounds.cc:107] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:31.159916 22116 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:31.003965 26287 consensus_meta.cc:287] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.816s	user 0.016s	sys 0.002s
I20260709 12:11:31.147989 26182 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:31.161710 26287 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.163053 22196 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:31.163991 26287 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.163141 26182 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:30.967972 26331 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:31.013201 26251 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.946s	user 0.013s	sys 0.007s
I20260709 12:11:31.081624 22122 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:31.099666 26231 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.165333 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 2227) took 1128 ms. Trace:
I20260709 12:11:31.164935 26331 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.167484 26231 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:31.100378 26348 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.367s	user 0.000s	sys 0.007s
I20260709 12:11:31.165779 22196 rpcz_store.cc:276] 0709 12:11:30.036895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.037101 (+   206us) service_pool.cc:224] Handling call
0709 12:11:31.164845 (+1127744us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540011b554. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:31.165252 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2401659776}
I20260709 12:11:31.169425 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 861) took 1148 ms. Trace:
I20260709 12:11:31.152815 22114 rpcz_store.cc:276] 0709 12:11:29.598406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.738228 (+139822us) service_pool.cc:224] Handling call
0709 12:11:29.753255 (+ 15027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.405687 (+652432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.152075 (+746388us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54003ad4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:31.152243 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497174784}
I20260709 12:11:31.169924 22270 rpcz_store.cc:276] 0709 12:11:30.020879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.021928 (+  1049us) service_pool.cc:224] Handling call
0709 12:11:30.022344 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.022704 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.022738 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.023305 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.215299 (+191994us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:30.215340 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.215410 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.169178 (+953768us) raft_consensus.cc:1685] finished
0709 12:11:31.169200 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.169363 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":466,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"thread_start_us":191557,"threads_started":1,"wal-append.queue_time_us":388999}
W20260709 12:11:30.993569 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 322563us
I20260709 12:11:30.995841 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:31.119232 26264 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:31.124145 22264 rpcz_store.cc:276] 0709 12:11:30.026323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.030765 (+  4442us) service_pool.cc:224] Handling call
0709 12:11:30.030999 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.031173 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:30.381569 (+350396us) log.cc:844] Serialized 14 byte log entry
0709 12:11:31.119522 (+737953us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b18002b0a20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fcceddba060 00007fcceddcc716 00007fccedddd287
0709 12:11:31.119631 (+   109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.119687 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:31.119742 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.119828 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.119978 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86604,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":274290,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":24298,"spinlock_wait_cycles":3449600,"thread_start_us":914465,"threads_started":3}
I20260709 12:11:31.172468 22860 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:31.172922 22860 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:31.174256 26264 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:31.174813 26264 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:31.141470 26283 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.176179 26283 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:31.175693 26264 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.177081 26283 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.177623 26264 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.178512 26283 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.178982 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2379) took 1145 ms. Trace:
I20260709 12:11:31.179463 22267 rpcz_store.cc:276] 0709 12:11:30.033914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.126642 (+ 92728us) service_pool.cc:224] Handling call
0709 12:11:30.126877 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.333067 (+206190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.333094 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:30.333133 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:30.333163 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.178645 (+845482us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54003b2ed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:31.178696 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.178877 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473713408}
I20260709 12:11:31.111553 26326 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.181643 26330 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:31.181865 22861 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.183200 22189 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:30.980212 26319 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.173911 22860 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.142328 26387 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:31.184854 22860 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.186655 26387 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:31.188831 26330 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:31.189417 26330 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:31.189327 26332 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:31.161273 22268 raft_consensus.cc:2889] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:31.190449 26332 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.181782 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 775) took 1049 ms. Trace:
I20260709 12:11:31.192301 22191 rpcz_store.cc:276] 0709 12:11:30.132604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.176863 (+ 44259us) service_pool.cc:224] Handling call
0709 12:11:30.177154 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.325773 (+148619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.181308 (+855535us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400142dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:31.181703 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276740480}
I20260709 12:11:31.194242 26330 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.194532 26033 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:31.196543 26251 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.197193 26251 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.199362 26251 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:31.205396 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:31.207705 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2328) took 1239 ms. Trace:
I20260709 12:11:31.208225 22117 rpcz_store.cc:276] 0709 12:11:29.968079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.973810 (+  5731us) service_pool.cc:224] Handling call
0709 12:11:29.976823 (+  3013us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.000469 (+ 23646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.000499 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.001014 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.251177 (+250163us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:30.251237 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.207238 (+956001us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b5400129dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:31.207295 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.207348 (+    53us) raft_consensus.cc:1685] finished
0709 12:11:31.207363 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.207632 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7041,"spinlock_wait_cycles":53539200,"thread_start_us":233698,"threads_started":1,"wal-append.queue_time_us":349612}
I20260709 12:11:31.212119 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:31.220687 26337 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.221851 26332 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:31.196259 26330 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.227761 26293 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:31.228822 26328 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:31.229404 26328 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.232345 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 772) took 1109 ms. Trace:
I20260709 12:11:31.233832 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 862) took 1193 ms. Trace:
I20260709 12:11:31.232426 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:31.236359 22265 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.236135 22268 rpcz_store.cc:276] 0709 12:11:30.040755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.141353 (+100598us) service_pool.cc:224] Handling call
0709 12:11:30.141772 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.191371 (+1049599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.233398 (+ 42027us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540029c2d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:31.233760 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340651264}
I20260709 12:11:31.233784 22190 rpcz_store.cc:276] 0709 12:11:30.123089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.131397 (+  8308us) service_pool.cc:224] Handling call
0709 12:11:30.131783 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.143338 (+ 11555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.143391 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.144184 (+   793us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.389773 (+245589us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:30.389812 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.389883 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.232103 (+842220us) raft_consensus.cc:1685] finished
0709 12:11:31.232125 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.232274 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":29915,"thread_start_us":200064,"threads_started":1,"wal-append.queue_time_us":1085918}
W20260709 12:11:31.238885 22115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 615) took 1638 ms (client timeout 1972 ms). Trace:
I20260709 12:11:31.239723 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2381) took 1205 ms. Trace:
I20260709 12:11:31.241106 26075 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.241285 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2241) took 1102 ms. Trace:
I20260709 12:11:31.241672 26328 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:31.240213 22269 rpcz_store.cc:276] 0709 12:11:30.034430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.128787 (+ 94357us) service_pool.cc:224] Handling call
0709 12:11:30.129055 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.291821 (+162766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.291852 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.292310 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.403143 (+110833us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:30.403192 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.403428 (+   236us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.239515 (+836087us) raft_consensus.cc:1685] finished
0709 12:11:31.239537 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.239664 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100617,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":16373,"thread_start_us":223188,"threads_started":2,"wal-append.queue_time_us":934574}
W20260709 12:11:31.239418 22115 rpcz_store.cc:269] 0709 12:11:29.600639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.639544 (+ 38905us) service_pool.cc:224] Handling call
0709 12:11:31.238585 (+1599041us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54002adad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:31.238746 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280407808}
I20260709 12:11:31.241853 22197 rpcz_store.cc:276] 0709 12:11:30.139065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.237315 (+ 98250us) service_pool.cc:224] Handling call
0709 12:11:30.237749 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.145502 (+907753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.240714 (+ 95212us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54002e7cd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:31.241198 (+   484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2085981952}
I20260709 12:11:31.249696 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:31.254604 22116 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:31.274976 22119 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
W20260709 12:11:31.263988 22162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.015s	sys 0.037s
I20260709 12:11:31.269023 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:31.280094 22162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.015s	sys 0.037s
I20260709 12:11:31.275544 22265 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:31.279356 22860 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:31.254869 22120 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:31.284475 22197 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:31.286047 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:31.295228 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:31.296732 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:31.297509 22118 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.301241 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:31.303325 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 175513us
W20260709 12:11:31.305962 22088 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.578s (SENT)
I20260709 12:11:31.308211 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:31.309913 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:31.312194 22117 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:31.310009 22116 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:31.220232 26331 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:31.311257 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:31.314841 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.320178 22119 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.318032 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:31.253033 26326 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.326733 22120 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.263445 26246 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:31.332727 22118 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
W20260709 12:11:31.339083 26361 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:11:31.309309 26287 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:31.341730 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 622) took 1196 ms. Trace:
I20260709 12:11:31.342286 22121 rpcz_store.cc:276] 0709 12:11:30.145184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.145313 (+   129us) service_pool.cc:224] Handling call
0709 12:11:30.145631 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.146061 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.146116 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.179372 (+ 33256us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.693447 (+514075us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:30.727032 (+ 33585us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.727474 (+   442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.727608 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.196806 (+469198us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b180031a320. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:11:31.322333 (+125527us) raft_consensus.cc:1685] finished
0709 12:11:31.341447 (+ 19114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.341655 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1138,"prepare.queue_time_us":33224,"prepare.run_cpu_time_us":5971,"prepare.run_wall_time_us":223940,"raft.queue_time_us":2129,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":24181,"spinlock_wait_cycles":12270336,"thread_start_us":461462,"threads_started":1,"wal-append.queue_time_us":1030945}
I20260709 12:11:31.345629 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 623) took 1161 ms. Trace:
I20260709 12:11:31.346194 26334 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.347250 26334 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.351296 26359 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:31.352527 26267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.005s	sys 0.051s
W20260709 12:11:31.353096 26267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.006s	sys 0.051s
I20260709 12:11:31.365216 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2378) took 1337 ms. Trace:
I20260709 12:11:31.365697 22263 rpcz_store.cc:276] 0709 12:11:30.033624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.124094 (+ 90470us) service_pool.cc:224] Handling call
0709 12:11:30.124380 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.372957 (+248577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.372994 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.373557 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.698393 (+324836us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:30.698451 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.698557 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.364891 (+666334us) raft_consensus.cc:1685] finished
0709 12:11:31.364927 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.365133 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11019,"raft.queue_time_us":107714,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":8474,"thread_start_us":506767,"threads_started":2,"wal-append.queue_time_us":791252}
W20260709 12:11:31.367158 22122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 2325) took 1400 ms (client timeout 1548 ms). Trace:
W20260709 12:11:31.367590 22122 rpcz_store.cc:269] 0709 12:11:29.966971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.974936 (+  7965us) service_pool.cc:224] Handling call
0709 12:11:31.366938 (+1392002us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400311fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:31.367100 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2541718272}
I20260709 12:11:31.329638 26289 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:31.322860 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:31.346271 22123 rpcz_store.cc:276] 0709 12:11:30.183987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.184456 (+   469us) service_pool.cc:224] Handling call
0709 12:11:30.184869 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.185375 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.185418 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.185963 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.353150 (+167187us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:30.353196 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.353276 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.345221 (+991945us) raft_consensus.cc:1685] finished
0709 12:11:31.345254 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.345527 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":9358,"thread_start_us":121395,"threads_started":1,"wal-append.queue_time_us":1044989}
W20260709 12:11:31.377511 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 54733.2us
W20260709 12:11:31.377959 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 54193us
W20260709 12:11:31.381017 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57388.6us
I20260709 12:11:31.383149 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:31.383534 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:31.384109 22860 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:31.320278 26337 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:31.388824 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:31.387898 22163 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:31.391283 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:31.385910 26262 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.390803 26285 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 12:11:31.394137 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 410396us
W20260709 12:11:31.398279 22236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.008s	sys 0.022s
W20260709 12:11:31.399578 22236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.008s	sys 0.022s
W20260709 12:11:31.401242 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 688788us
I20260709 12:11:31.404441 22119 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:31.408236 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:31.412000 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:31.410496 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:31.419629 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.422554 22120 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:31.423939 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:31.419921 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:31.432607 22123 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.432842 22122 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.436697 22119 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:31.426411 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 400759us
I20260709 12:11:31.430507 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:31.441602 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:31.443660 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:31.386178 26363 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:11:31.449548 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:31.457362 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:31.415544 26075 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:31.459568 22123 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:31.460742 22122 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:31.409476 26283 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:11:31.470213 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 62060.7us
I20260709 12:11:31.406997 26331 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:11:31.470315 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.480921 26365 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:31.481424 22263 raft_consensus.cc:2393] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:31.481920 26374 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.447800 26328 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.447494 26332 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:31.473824 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 63407.6us
I20260709 12:11:31.488092 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:31.490191 26293 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:31.490761 26293 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:31.491742 26293 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.495445 22861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 667) took 1428 ms. Trace:
I20260709 12:11:31.496002 22861 rpcz_store.cc:276] 0709 12:11:30.067135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.067353 (+   218us) service_pool.cc:224] Handling call
0709 12:11:30.067703 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.182604 (+1114901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.495128 (+312524us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400570154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:31.495364 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2561832704}
I20260709 12:11:31.508870 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.509168 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.446406 26295 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:31.515204 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.516420 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.472033 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.473251 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.473780 26289 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:31.461457 26242 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:31.477069 26285 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:31.477442 26283 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:31.477097 26262 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:31.477895 22270 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.497265 26075 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:31.498104 26334 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.501648 22831 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:31.470780 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:31.454934 26380 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:31.426425 26271 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:31.447670 26251 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:31.557380 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 55856.9us
I20260709 12:11:31.511391 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.519160 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.518008 22267 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:31.535655 26283 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:31.523590 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:31.537557 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.471446 26356 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:31.573822 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.559712 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.521056 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:31.559352 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 185183us
I20260709 12:11:31.566205 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.575601 22264 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:31.582012 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:31.576205 22237 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:31.575510 22267 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:31.539808 26386 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:31.587373 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.594619 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:31.540635 26262 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:31.595604 26262 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.595667 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:31.596053 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:31.598315 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.599252 22267 raft_consensus.cc:2410] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:31.602767 22267 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:31.533064 26289 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.588789 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:31.589659 26075 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.541920 26285 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:31.562654 26271 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.617573 26285 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.521214 26295 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.619649 26271 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.604040 26395 consensus_queue.cc:1059] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:11:31.620529 26295 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:31.574780 26393 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.621519 26393 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:31.593669 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:31.621984 26393 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:31.622598 26342 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.285s	user 0.004s	sys 0.009s
I20260709 12:11:31.593860 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:31.624465 26283 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.624854 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:31.625417 26230 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:31.625717 26283 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.625949 26230 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:31.579664 26382 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:11:31.627135 26230 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.539196 26242 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:31.481559 26365 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.629315 26325 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:31.629863 26325 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.631224 26365 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.632395 26325 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:31.609026 22863 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:31.610826 26289 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:31.611795 26363 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:31.621093 26395 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.607177 26386 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.633358 26242 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.605213 26380 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:31.637956 26296 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:31.639735 26395 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:31.641757 26390 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:31.647372 26380 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:31.650420 26296 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:31.663901 26386 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:31.654311 26390 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:31.666919 26390 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.668632 26390 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.669378 26395 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.671787 26395 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.643999 26363 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.676280 26380 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.681335 26296 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:31.683059 26296 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.692082 26393 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:31.763616 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:31.769713 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:31.592620 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:31.604907 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.775409 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:31.776206 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.778003 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.779467 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.780321 22264 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:31.781553 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:30.664007 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:31.783053 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.772269 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:31.634994 22861 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:31.592535 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:31.784731 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.788652 22197 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:31.811409 22115 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:31.809496 22269 raft_consensus.cc:2410] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:31.809711 22263 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:31.786502 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:31.807762 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.788969 22267 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:31.785899 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:31.807469 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.801905 22265 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:31.866325 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:31.872036 22123 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:31.873345 26396 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.873004 26295 consensus_queue.cc:1059] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:31.877431 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.802548 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:31.934630 22858 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:31.949697 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.947670 22264 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:31.956053 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.962368 26396 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:31.955180 26395 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.970554 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:31.966105 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:31.974251 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.977614 22116 raft_consensus.cc:2410] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:31.974179 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.981514 22268 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:31.952600 22194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 2232) took 1772 ms (client timeout 1920 ms). Trace:
I20260709 12:11:31.997511 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:31.999436 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:32.000329 22267 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.000641 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:32.000906 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:32.001338 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:32.002267 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:32.002995 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:32.004062 22263 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:11:31.984216 22194 rpcz_store.cc:269] 0709 12:11:30.039921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.122680 (+ 82759us) service_pool.cc:224] Handling call
0709 12:11:31.800362 (+1677682us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400177d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:31.811807 (+ 11445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2956352256}
I20260709 12:11:32.002267 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:32.008982 26321 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.009481 22270 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:32.009282 26395 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:32.009853 26321 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.010906 22266 raft_consensus.cc:2410] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:32.003893 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:31.994056 26289 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:32.025652 22269 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 6: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:32.061666 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:32.012382 26395 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:31.976543 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 154479us
I20260709 12:11:32.039075 22268 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
W20260709 12:11:32.030722 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 164830us
I20260709 12:11:32.066110 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:32.024502 22830 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:32.069897 22267 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:32.019310 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:32.051851 26286 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:32.071951 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:32.028365 26289 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.031250 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:32.074792 22120 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.075809 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:32.012596 26321 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:32.033376 26165 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:32.077518 26165 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:32.077842 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:32.043133 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:32.079058 22117 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:32.079262 22265 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:32.080588 22117 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:11:32.089202 26410 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:11:32.089502 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:32.049015 22270 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:32.038233 26230 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.104658 22120 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:32.107659 22266 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:32.041436 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:32.107995 22264 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:31.978377 26396 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:32.111311 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.112262 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.068749 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:32.042172 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:32.121207 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 97010.2us
I20260709 12:11:32.030051 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:32.146323 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:32.148605 26151 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:32.149366 26151 raft_consensus.cc:697] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:32.149590 26321 consensus_queue.cc:1059] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:32.155598 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.152073 22118 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:32.154006 26321 raft_consensus.cc:3055] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:32.158682 26321 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:32.045378 26393 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:32.213371 22121 raft_consensus.cc:2410] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:32.198284 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:32.224833 26321 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.225530 26396 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:32.226693 26321 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:32.226945 26271 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.227802 26271 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:32.228960 26271 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.229378 26151 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.229770 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:32.232916 26283 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:32.233721 26283 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.241434 22271 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:11:32.226603 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 71614.1us
I20260709 12:11:32.246608 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:32.247501 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:32.247793 26292 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.248600 22114 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:32.254719 22266 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:32.256361 26285 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:32.256891 26285 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:32.257301 26285 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:32.260874 26395 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:32.261145 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:32.261624 26395 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.263981 26283 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:32.269340 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:32.279982 26118 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:32.280505 26406 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:32.281095 26118 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.282698 26289 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:32.280433 22268 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:32.306967 22019 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:32.280016 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:32.271008 26395 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:32.328599 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48850.7us
I20260709 12:11:32.330267 22118 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:32.333850 22020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 236) took 20954 ms (client timeout 15000 ms). Trace:
I20260709 12:11:32.323278 26363 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:32.339018 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:32.325673 26118 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:32.337325 22020 rpcz_store.cc:269] 0709 12:11:11.355661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.355999 (+   338us) service_pool.cc:224] Handling call
0709 12:11:32.308990 (+20952991us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2473,"reported_tablets":51}
I20260709 12:11:32.370183 22271 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:32.362186 26286 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:32.381953 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 46669.5us
I20260709 12:11:32.381974 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:32.379942 22271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 2390) took 1147 ms (client timeout 1511 ms). Trace:
W20260709 12:11:32.387077 22271 rpcz_store.cc:269] 0709 12:11:31.232750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.018558 (+785808us) service_pool.cc:224] Handling call
0709 12:11:32.379868 (+361310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:32.414172 26334 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:32.414912 26334 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:32.425508 26419 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:11:32.433634 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:32.434422 22198 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:32.445205 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:32.389843 26286 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:32.416024 26334 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.463269 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:32.482510 22122 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:32.482318 26283 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:32.483366 26283 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.484440 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:32.485764 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:32.486129 26283 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:32.489073 22114 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:32.491238 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:32.499114 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:32.506739 22858 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:32.457445 26289 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.520320 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:32.516953 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:32.519776 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:32.552366 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50448.4us
I20260709 12:11:32.498297 26395 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:32.554033 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:11:32.563339 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.507603 26289 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:32.568480 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:32.570313 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:32.552270 26118 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:32.576575 22122 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:32.581899 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:32.585443 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:32.591163 26262 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.956s	user 0.007s	sys 0.015s
I20260709 12:11:32.591837 26262 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:32.600468 26400 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
W20260709 12:11:32.601606 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 110677us
I20260709 12:11:32.603060 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:32.604882 26323 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:32.605146 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.586732 26395 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.605515 26323 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:32.606550 26323 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:32.607803 22865 raft_consensus.cc:2410] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 12:11:32.611629 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.614195 22121 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:32.619050 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:32.613258 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:32.621613 26293 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.622298 26293 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:32.623416 26293 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:32.625108 26118 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.625581 26118 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:32.625310 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 196481us
I20260709 12:11:32.626268 26118 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.618587 26286 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:32.630666 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.631225 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.632827 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 111644us
I20260709 12:11:32.617408 22118 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:32.645535 22117 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:32.647118 26285 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:32.656019 26262 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:32.657562 26285 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:32.665129 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:32.680662 22863 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:32.684975 26230 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.685564 26230 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:32.686009 26230 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.652432 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:32.706347 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:32.707903 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 76086.9us
I20260709 12:11:32.691234 26283 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:32.712370 26283 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.712636 26165 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.713841 26165 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:32.716531 26283 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:32.725064 26262 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:32.725666 26262 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.726039 26262 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:32.730777 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 2168) took 1219 ms. Trace:
I20260709 12:11:32.731326 22272 rpcz_store.cc:276] 0709 12:11:31.510974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.511132 (+   158us) service_pool.cc:224] Handling call
0709 12:11:32.730286 (+1219154us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54002c2ed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:32.730499 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903742336}
I20260709 12:11:32.735036 22831 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:32.736937 26296 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.015s	user 0.017s	sys 0.005s
I20260709 12:11:32.738152 26395 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:32.739885 26415 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.583s	user 0.000s	sys 0.003s
I20260709 12:11:32.745432 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:32.762722 26285 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:32.768589 22190 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
W20260709 12:11:32.771437 26413 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.613s	user 0.002s	sys 0.001s
W20260709 12:11:32.770006 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.788465 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44463.8us
I20260709 12:11:32.789074 22865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 675) took 1207 ms. Trace:
I20260709 12:11:32.790918 22865 rpcz_store.cc:276] 0709 12:11:31.581424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.592224 (+ 10800us) service_pool.cc:224] Handling call
0709 12:11:32.788741 (+1196517us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b5400840b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:32.788975 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516552448}
I20260709 12:11:32.784015 26393 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:32.803702 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 106685us
I20260709 12:11:32.794013 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:32.807013 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:32.804728 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:32.820366 26414 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.663s	user 0.003s	sys 0.000s
W20260709 12:11:32.823328 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 218873us
I20260709 12:11:32.786451 26165 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:32.827123 26283 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:32.840507 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 65633.8us
W20260709 12:11:32.842639 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 194738us
I20260709 12:11:32.843865 26144 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.826102 26285 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.844658 26289 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:32.848898 26383 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.849357 26190 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:11:32.849980 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:32.850598 26382 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.851104 22236 leader_election.cc:400] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:32.859891 22236 leader_election.cc:403] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:32.851933 26230 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.829327 26118 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:32.867789 22858 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.867563 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 876) took 1083 ms. Trace:
I20260709 12:11:32.857863 26285 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.855340 26165 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.860025 26283 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:32.874581 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 2250) took 1127 ms. Trace:
I20260709 12:11:32.875025 22190 rpcz_store.cc:276] 0709 12:11:31.747429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.762867 (+ 15438us) service_pool.cc:224] Handling call
0709 12:11:32.874397 (+1111530us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54001090d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:32.874519 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235565312}
I20260709 12:11:32.876057 26283 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:32.869182 26118 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:32.886286 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:32.964869 26263 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:32.965678 26263 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:32.967104 26263 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.971761 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:32.972709 22190 raft_consensus.cc:606] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:32.976922 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:32.977509 22190 raft_consensus.cc:606] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:32.977892 22190 raft_consensus.cc:614] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:32.987005 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 137137us
I20260709 12:11:32.964361 26242 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9.
I20260709 12:11:32.957782 26289 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:32.993523 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 109886us
W20260709 12:11:32.977560 26432 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 12:11:32.993659 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 151643us
W20260709 12:11:32.998221 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 193550us
W20260709 12:11:33.000535 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.001098 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.002177 22191 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:33.002177 26190 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:32.961081 26283 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:33.018460 26118 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:33.019269 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:33.021023 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.021572 26325 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:11:33.014705 26283 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.031023 26283 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:33.028937 26292 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.031731 26292 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.033797 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:33.034713 26292 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:33.035203 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:33.037003 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 208842us
I20260709 12:11:33.036679 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.008019 26190 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:11:33.046201 26396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.021s	sys 0.016s
W20260709 12:11:33.049259 26396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.021s	sys 0.016s
I20260709 12:11:33.036659 26283 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.035290 26292 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.037158 26395 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:33.037817 26285 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:33.040580 26230 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:33.039093 26295 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.046015 26190 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:33.093145 26405 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:33.096890 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:33.097875 22860 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:33.098585 26380 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.099117 26380 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:33.099169 22263 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:33.099489 26444 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.099689 26380 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.100029 26444 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.092469 26449 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:11:33.099169 22865 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:33.105253 22272 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:33.060001 26289 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.060238 26283 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:33.068445 26165 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:33.080265 26395 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:33.128823 26444 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:33.128926 26321 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:33.129881 26321 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.109378 26393 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.137557 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:33.138357 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 101790us
I20260709 12:11:33.089444 26118 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:11:33.123800 26283 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:33.147949 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 78227.4us
W20260709 12:11:33.150456 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 86489.3us
I20260709 12:11:33.143766 26296 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 12:11:33.151953 26441 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:11:33.153472 22190 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:33.154480 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.155660 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.156505 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.158242 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:33.159142 22197 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:33.159441 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.160207 22195 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:11:33.166755 26438 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.098s	user 0.001s	sys 0.002s
I20260709 12:11:33.167840 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.141912 26393 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:32.869205 22265 rpcz_store.cc:276] 0709 12:11:31.784546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.081470 (+296924us) service_pool.cc:224] Handling call
0709 12:11:32.081878 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:32.082343 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:32.310791 (+228448us) log.cc:844] Serialized 14 byte log entry
0709 12:11:32.862716 (+551925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:32.862775 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:32.863233 (+   458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.863305 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:32.863426 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":420889,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":10564,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":4296,"thread_start_us":686736,"threads_started":2}
I20260709 12:11:33.171249 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.132166 26230 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:11:33.178493 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:33.180959 22191 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.184602 22190 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:33.185052 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.186363 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.186856 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:33.188735 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 81863.2us
I20260709 12:11:33.185979 22194 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:33.200754 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.201900 26262 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.204567 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:33.205370 26452 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:11:33.206022 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.209625 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.211421 26439 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:33.213580 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.214162 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:33.240631 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45304.2us
I20260709 12:11:33.241180 22263 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:33.214866 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.182643 26393 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:33.217126 22865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863b392474d94720808349fe27669b5b"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:33.221251 26395 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.209625 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.238036 22191 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:33.239986 22192 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:33.246410 26190 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.248234 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:33.254814 22865 raft_consensus.cc:606] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:33.261256 22865 raft_consensus.cc:614] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:33.262193 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.262485 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.209641 26321 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:33.264088 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.265383 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:33.266357 26435 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 12:11:33.266534 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.267347 22189 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:33.268132 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.270502 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:33.271648 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.272495 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:33.272698 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:33.273766 26451 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
I20260709 12:11:33.274030 22189 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:33.275493 26447 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:11:33.275506 22189 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:33.277590 26262 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:33.277880 22189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:33.273864 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.278127 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:33.280673 22189 raft_consensus.cc:606] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.289702 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:33.290611 26449 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:33.291225 26449 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:33.293210 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:33.293715 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:33.295408 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.296096 22268 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:33.297096 22269 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:11:33.301661 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.302345 22119 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:33.305213 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.306336 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.309980 22863 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:33.315228 22115 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:33.317394 22123 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:33.258713 26118 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:33.317767 22263 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:11:33.316870 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 115905us
I20260709 12:11:33.325639 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.327641 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.328423 22271 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:33.332520 22114 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:33.332953 22114 pending_rounds.cc:85] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 6
I20260709 12:11:33.292371 26449 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.322748 26271 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.344995 22263 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:33.345463 22263 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:33.339699 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.324415 26295 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:33.333189 22114 pending_rounds.cc:107] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:33.301949 26283 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.347429 22114 raft_consensus.cc:2889] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.347496 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:33.347853 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 99746.7us
I20260709 12:11:33.349421 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.349663 26380 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.330155 26118 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.351527 26448 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:33.353837 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:33.352699 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:33.357218 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 163568us
I20260709 12:11:33.345208 26395 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.373561 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.373557 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:33.325472 26393 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:33.374545 22263 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.378623 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.379771 22263 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.380115 22270 raft_consensus.cc:2393] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:33.380384 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:33.380946 22121 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:33.383813 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:33.386472 22860 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:33.386816 22118 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:33.385398 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:33.387655 22123 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.387951 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.388991 22268 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:33.353368 26271 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.392045 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.392966 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:33.377924 26444 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.401427 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.379037 26295 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:33.404452 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.390498 26144 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:11:33.421272 26118 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:33.422915 26380 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:33.423341 26292 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.423684 22865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:33.424463 22865 raft_consensus.cc:606] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.411471 26165 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:33.412161 26283 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:33.412650 26456 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.413420 26190 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:33.396087 26444 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.374473 26448 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.413911 26271 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:33.415827 22087 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:33.418084 22088 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.423907 26292 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:33.408192 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.439121 22263 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:33.457260 22263 pending_rounds.cc:85] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 6
I20260709 12:11:33.457551 22263 pending_rounds.cc:107] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:33.457892 22263 raft_consensus.cc:2889] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:33.450877 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 84139.2us
I20260709 12:11:33.453214 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.402566 26396 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.462368 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.454114 26444 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.464960 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:33.467250 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:33.468377 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:33.470608 26448 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:33.472730 26295 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.474191 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.483512 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.491864 26406 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.497129 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.497822 26190 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.498716 26190 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.501765 26230 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.502513 26230 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.461181 26292 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.489085 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:33.517375 22119 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:33.515559 26285 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:33.519526 26285 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.520471 26396 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:33.521328 26396 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.521822 26396 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.524201 26190 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:33.526185 26230 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:33.529135 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.529757 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.468443 26264 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:11:33.563957 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.483393 26289 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:33.498826 26463 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:11:33.581040 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 208824us
I20260709 12:11:33.485913 26456 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:33.582911 22266 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:33.583609 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:33.590934 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:33.601996 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:33.599188 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 115766us
I20260709 12:11:33.606068 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.609030 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:33.614953 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 196976us
I20260709 12:11:33.617134 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.619230 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.620340 22265 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:33.622305 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.622383 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:33.623803 22119 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 7.
I20260709 12:11:33.628695 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.629647 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:33.630235 22119 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:33.631147 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:33.631697 22119 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:33.569638 26380 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:11:33.627270 22264 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:33.579102 26118 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:11:33.639483 22119 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:33.647260 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.646317 22117 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:33.651818 26456 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.652346 26470 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:33.653072 26470 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.655382 26470 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:33.668457 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:33.633226 26230 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.628443 26448 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:11:33.670666 26470 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:33.679276 26470 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.644116 26264 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:33.646639 26293 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:11:33.665627 26242 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:33.666671 26118 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:33.668061 26380 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:33.685554 22121 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:33.705281 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:33.716454 22268 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:33.670991 26230 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:33.644506 26289 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:11:33.724992 26436 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:33.725615 26469 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:33.726215 26469 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.727440 26475 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:33.728338 26469 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:33.698328 26118 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:33.712976 26380 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.731600 26380 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:33.650157 26444 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.733917 22858 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 9: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:33.734763 26444 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:33.670228 26292 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.712277 26395 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:33.696156 26242 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:33.713996 26263 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:11:33.740883 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:33.719286 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 79122.7us
I20260709 12:11:33.721905 26230 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.750519 22271 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:33.750469 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 103005us
I20260709 12:11:33.755703 26487 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.761216 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:33.762605 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:33.717693 26439 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:33.765976 22263 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:33.773659 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.774494 22265 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:33.777174 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.782282 26144 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.783519 26285 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:33.784665 26470 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:33.785266 26436 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.786132 26292 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:33.791651 26454 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:33.790789 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:33.826241 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 65143.1us
I20260709 12:11:33.827195 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:33.773748 26439 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:33.828954 22269 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:11:33.829334 22269 pending_rounds.cc:85] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 5
I20260709 12:11:33.829547 22269 pending_rounds.cc:107] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:33.829782 22269 raft_consensus.cc:2889] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.830615 26439 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:33.831308 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 55021.8us
I20260709 12:11:33.832001 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:33.832749 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 62970.4us
I20260709 12:11:33.833046 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:33.832656 26286 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:33.834019 26286 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.834367 26286 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.834699 26286 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.834923 26448 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:33.836164 26334 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:33.837337 26476 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:33.839067 26264 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:33.841909 22193 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.842303 22192 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:33.843225 22189 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:33.843568 22865 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:33.843861 22860 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:11:33.844295 22860 pending_rounds.cc:85] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Aborting all ops after (but not including) 8
I20260709 12:11:33.844545 22860 pending_rounds.cc:107] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 11.9
I20260709 12:11:33.844918 22860 raft_consensus.cc:2917] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Aborting config change with OpId 11.9: Aborted: Op aborted by new leader
I20260709 12:11:33.845257 26396 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:33.845455 22860 raft_consensus.cc:2889] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.845657 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:33.846206 22860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45124 (request call id 1) took 3913 ms. Trace:
I20260709 12:11:33.847545 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:33.760089 26395 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.849654 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.845623 26286 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:33.851191 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 60514.4us
I20260709 12:11:33.855901 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:33.856079 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:33.856622 22189 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:33.857141 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:33.857890 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:33.858304 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:33.856119 22117 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:33.859457 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:33.846575 22860 rpcz_store.cc:276] 0709 12:11:29.932891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.937185 (+  4294us) service_pool.cc:224] Handling call
0709 12:11:29.956200 (+ 19015us) log.cc:844] Serialized 508 byte log entry
0709 12:11:31.199569 (+1243369us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4c00015700. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec08ea20 00007fccec09fa29 00007fccec0a013f 00007fccec0642ab 00007fccec091f3c 00007fccec0923fe 00007fccec31f50b 00007fccedd1e381 00007fccedd1c26b 00007fccedd22d53 00007fccedd22cd9
0709 12:11:31.621691 (+422122us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:33.846091 (+2224400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2862,"raft.queue_time_us":16236,"raft.run_cpu_time_us":4831,"raft.run_wall_time_us":1019909,"spinlock_wait_cycles":52264832,"thread_start_us":202628,"threads_started":1,"wal-append.queue_time_us":306830,"wal-append.run_cpu_time_us":16279,"wal-append.run_wall_time_us":2353133}
I20260709 12:11:33.859779 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:33.861896 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:33.862512 22269 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:33.862708 22271 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:33.850857 26454 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:33.851434 26439 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:33.857069 26475 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.883266 22007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f1b154b48c54be6b421b01ed436bf21 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 12:11:33.865667 26292 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.871235 26470 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.887830 26292 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.897270 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:33.856828 26263 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:11:33.894366 26292 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.901687 26453 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.902271 26453 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.902607 26453 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.902762 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:33.893730 26450 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 12:11:33.904335 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.905012 26482 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:33.905422 26482 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:33.885823 26456 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.907756 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:33.893730 26446 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:11:33.924717 22121 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:33.924937 22122 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:33.906219 26144 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:11:33.928623 26295 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.927832 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:33.938265 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:33.939571 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.898577 26383 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:33.947588 22193 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:33.900135 26470 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.937916 26295 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:33.887630 26242 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:33.957551 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.951408 26396 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.958395 26295 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.963722 26325 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.009016 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:33.984571 26395 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:34.025619 26470 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:33.978663 26473 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.026185 26456 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.930418 26482 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.026625 26456 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.027338 26482 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.028154 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:34.037523 26449 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:34.038059 26449 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:34.039147 26449 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.041827 26325 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:34.042486 26325 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.044245 22266 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.887442 26475 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.046918 26475 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:34.051120 26396 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:34.052122 22121 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:34.055105 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.055904 22266 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:33.983259 26286 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:34.069317 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 201454us
W20260709 12:11:34.088316 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.100292 22123 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:11:34.101233 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 222871us
W20260709 12:11:34.103145 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 113737us
I20260709 12:11:34.103739 22860 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:34.104038 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.106400 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:34.102633 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:34.102008 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 215094us
W20260709 12:11:34.133461 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.136036 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:34.094046 26406 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:34.149020 26436 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
W20260709 12:11:34.150213 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46275.4us
I20260709 12:11:34.106837 26449 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.158892 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:34.066702 26264 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:11:34.066340 26296 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
W20260709 12:11:34.158448 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51016.2us
I20260709 12:11:34.137717 26475 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.165174 22163 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:34.106105 26482 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:34.141831 26444 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:34.168015 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 94108.7us
I20260709 12:11:34.175580 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:34.163143 26470 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:34.184607 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.181680 26292 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.178181 26406 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:34.225898 26406 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.220438 26450 raft_consensus.cc:993] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:34.175994 26286 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:34.187978 26436 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.187780 26494 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.247313 26494 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:34.247877 26494 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.186806 26444 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:34.187520 26165 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:34.228179 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52712.3us
W20260709 12:11:34.243934 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 85722.8us
I20260709 12:11:34.221532 26230 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:34.227732 26485 log.cc:927] Time spent T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.442s	user 0.003s	sys 0.001s
I20260709 12:11:34.263414 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:34.270668 22858 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:34.270884 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 86341.3us
I20260709 12:11:34.277563 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:34.279139 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:34.279937 26469 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:34.272064 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.280939 26500 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:34.280602 26469 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:34.304441 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 144813us
I20260709 12:11:34.331593 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:34.221856 26325 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.268708 26448 raft_consensus.cc:1081] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
W20260709 12:11:34.347177 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.289350 26230 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:34.262878 26453 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.282064 26295 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.281911 26292 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:34.412012 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 61499us
W20260709 12:11:34.385076 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 158983us
I20260709 12:11:34.303335 26165 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:34.341169 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 62077.5us
I20260709 12:11:34.418151 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:34.419544 26325 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:34.363157 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 91221.5us
I20260709 12:11:34.351053 26151 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:11:34.395910 26502 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:34.334216 26242 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.425745 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:34.435351 26478 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.396555 26469 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.363443 26283 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:34.437310 26456 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.438051 26453 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:34.394353 26444 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.443568 26334 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:34.450564 26499 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:34.453604 22119 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.454725 26395 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:34.462535 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44469.7us
I20260709 12:11:34.455844 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:34.387676 26505 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.207s
I20260709 12:11:34.459187 26478 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.471226 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:34.506435 22272 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 9: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:11:34.507210 26498 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.340s	user 0.002s	sys 0.000s
I20260709 12:11:34.462232 26476 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:11:34.455901 26151 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.478653 26118 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.479305 26436 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.480844 26295 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:34.468693 26494 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:34.486821 26497 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.329s	user 0.003s	sys 0.000s
I20260709 12:11:34.500022 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:34.474828 26456 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:34.458709 26283 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:34.494089 26499 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:34.516055 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.521914 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:34.528846 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:34.529073 22122 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.518184 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:34.492635 26334 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:34.521245 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:34.531514 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:34.532125 22118 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.459306 26469 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.505025 26165 raft_consensus.cc:2764] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:11:34.526481 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 104631us
I20260709 12:11:34.529954 22123 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.535456 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:34.514999 22268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45844
I20260709 12:11:34.541018 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.541384 22268 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:34.541822 22268 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:34.544257 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.531726 26118 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:34.552376 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52488.1us
I20260709 12:11:34.555297 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:34.556442 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:34.559278 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.542963 26395 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.561463 22236 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:34.527174 26264 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:11:34.546164 26295 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.563848 22268 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:34.573192 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47614.2us
I20260709 12:11:34.574723 26494 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:34.575160 26283 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.576754 26283 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.621532 22268 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:34.621694 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53232.5us
I20260709 12:11:34.622499 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:34.557379 26242 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:34.631896 26477 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.008s	sys 0.021s
W20260709 12:11:34.633487 26477 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.008s	sys 0.021s
I20260709 12:11:34.565184 26487 raft_consensus.cc:2764] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:34.570192 26165 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:34.572599 26500 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:34.648949 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 89772.3us
I20260709 12:11:34.655740 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.649669 26395 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:34.676134 26151 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:34.677989 26469 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:34.678381 26478 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:34.681671 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:34.681982 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.682520 22115 raft_consensus.cc:2368] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9.
W20260709 12:11:34.683228 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.686800 22122 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:34.689319 22123 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:34.571807 26334 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.690831 22118 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:34.662513 26487 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:11:34.689414 26500 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.691483 22119 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:34.693501 26475 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.694144 26487 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:34.694608 26487 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:34.694828 26499 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.695497 26487 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.696800 26487 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:34.695953 26499 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.692698 26500 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.686349 26165 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:34.703372 26500 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:34.703493 26506 raft_consensus.cc:993] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:34.704414 26506 raft_consensus.cc:1081] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
W20260709 12:11:34.704710 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53196.8us
I20260709 12:11:34.705680 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.705695 26380 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:34.706308 26380 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:34.707129 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.707289 26380 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.708069 26295 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.708501 26380 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:34.708904 26295 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:34.710930 26521 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:11:34.718683 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:34.719439 22264 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.721552 22263 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:34.725279 26491 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:34.726418 26491 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:34.735761 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:34.738756 22860 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.736438 26383 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.743386 26383 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.737607 26491 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:34.745795 26491 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.747222 26491 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.749538 22123 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:34.751194 22264 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:34.759373 22858 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:34.759696 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:34.761005 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.762120 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.765502 22863 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:34.769349 22863 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:34.772475 22270 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:34.774236 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.777580 22271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:11:34.778277 22271 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:34.778787 22271 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.779101 22830 leader_election.cc:400] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9.
I20260709 12:11:34.779443 22830 leader_election.cc:403] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:34.763037 26295 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:34.765902 26396 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:34.765772 26165 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:34.791618 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:34.782670 26505 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:34.799855 26454 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.809562 22268 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:34.810714 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:34.800048 22190 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:34.786466 26271 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.786362 26405 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:11:34.802078 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:34.776358 26263 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:11:34.805055 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:34.812865 26454 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:34.818449 26454 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.812537 22265 pending_rounds.cc:85] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 5
I20260709 12:11:34.818964 22265 pending_rounds.cc:107] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:34.819262 22265 raft_consensus.cc:2889] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:34.803637 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:34.821382 22264 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:34.822336 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:34.805478 26334 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.823959 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:34.815975 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:34.821399 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:34.826647 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 660139us
I20260709 12:11:34.828123 22272 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:34.815318 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:34.816619 22863 raft_consensus.cc:2368] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:34.818128 22858 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:34.814694 22268 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:34.822405 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:34.806420 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:34.792225 26396 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:34.785722 26482 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:11:34.839571 26396 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.830435 26383 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:34.839326 26295 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:34.845379 26482 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:34.845662 26295 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.846184 26482 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:34.849350 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:34.851126 26478 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.851470 26405 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:34.852967 26467 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:34.853860 26476 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:34.857559 26476 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:34.872687 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:34.874130 26283 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.874287 26292 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:34.874702 26283 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.875767 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:34.876375 22267 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:34.876829 26283 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:34.874784 26292 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:34.876567 22236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.861s (SENT) [suppressed 32 similar messages]
I20260709 12:11:34.879112 26292 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:34.881789 26283 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:34.882323 26283 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.884374 26283 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:34.885629 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:34.886065 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:34.886716 22119 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.887852 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:34.888276 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:34.836889 26165 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.893111 26165 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:34.895340 26165 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:34.904145 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:34.848021 26295 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:34.905344 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:34.932928 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.934839 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:34.936424 22122 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.937794 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:34.939468 22122 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:34.941308 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:34.942055 22190 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:34.944317 22118 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:34.950320 22119 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:34.954746 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49471.9us
I20260709 12:11:34.892946 26450 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 12:11:34.957269 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 80748.2us
I20260709 12:11:34.957978 22268 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:34.954243 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 60793.9us
I20260709 12:11:34.847743 26482 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.958871 22271 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:34.965057 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:34.986403 22193 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:34.945845 26446 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:35.002229 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.900995 26263 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:11:34.957031 26436 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.014636 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:35.015142 22271 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:35.041577 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.054597 22118 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:11:35.021996 26520 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:35.056460 22115 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:35.058805 22271 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:35.044874 26482 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.066854 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:35.044335 26446 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:35.086267 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.073441 22263 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:35.092962 22271 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:11:35.093592 22271 pending_rounds.cc:85] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 3
I20260709 12:11:35.093905 22271 pending_rounds.cc:107] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:11:35.094244 22271 raft_consensus.cc:2889] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:35.042635 26444 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:35.054625 26453 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:11:35.048141 26436 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:35.118099 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:35.123677 22021 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:35.006999 26476 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:35.125380 26523 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:35.125861 26476 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.125939 26523 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:35.130939 26323 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.131099 26478 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.131721 26323 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:35.092320 26271 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9.
I20260709 12:11:35.128201 26523 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:35.128145 26454 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:35.134720 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.135658 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.139021 26445 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:35.158270 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.156512 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.168169 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.168169 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:35.170164 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.134588 26458 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:35.172529 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.173758 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.179955 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.180743 22194 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:35.182200 22194 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:35.183310 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.184465 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.188308 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.190191 22121 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:11:35.188314 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.189739 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.193292 22189 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:35.194293 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.195869 22190 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:35.196702 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.199522 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.200336 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:35.199837 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.202095 22196 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:35.202714 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:35.202904 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:35.204027 22194 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:35.204979 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.205669 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.208477 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.202495 22196 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:35.210074 22195 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:35.218788 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 254536us
I20260709 12:11:35.221805 22115 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:35.175608 26445 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:35.185213 26539 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:35.232125 22190 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:35.241719 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 271949us
I20260709 12:11:35.189270 26458 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:11:35.254442 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.255904 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.232412 26500 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:35.282308 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.237192 22196 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:35.282814 22831 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:11:35.286686 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 75698.5us
W20260709 12:11:35.283456 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 349302us
I20260709 12:11:35.286044 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:11:35.281718 26491 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.002s
I20260709 12:11:35.307494 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:35.313951 22115 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:35.268486 26500 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.235404 26165 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:11:35.181959 26446 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:35.326258 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:35.331943 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:35.315961 26380 consensus_meta.cc:287] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.008s
W20260709 12:11:35.354240 26530 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.298s	user 0.001s	sys 0.001s
W20260709 12:11:35.355374 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.358738 26262 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:35.363180 26450 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:11:35.365521 26546 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:11:35.365351 26458 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:35.298009 26487 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:35.369051 26393 raft_consensus.cc:3055] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:35.370039 26436 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:35.371512 26323 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:35.333163 26456 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:35.255270 26539 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:35.332592 26500 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.374027 26552 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:35.376968 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.388891 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:35.390458 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:35.440388 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50017.6us
I20260709 12:11:35.388849 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:35.391783 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:35.394156 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:35.298820 26271 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:11:35.400918 22194 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:35.402949 22192 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:35.403842 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:35.389779 26541 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.437196 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:35.443388 22198 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:11:35.393570 26292 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:35.394508 26380 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:35.403044 26393 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:35.311882 26445 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:35.401980 26165 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:35.449105 22121 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.457713 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:35.478227 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.449556 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.434799 26396 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.001s
W20260709 12:11:35.536691 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 109462us
I20260709 12:11:35.449028 26436 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.406309 26487 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:35.429139 26456 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.431226 26491 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:35.479717 26454 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:35.581861 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 124254us
W20260709 12:11:35.586167 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 197451us
I20260709 12:11:35.587226 22088 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:35.588883 22088 leader_election.cc:400] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:35.589231 22088 leader_election.cc:403] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:35.450467 26541 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:35.593731 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.564953 26295 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.597514 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.483877 26292 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:35.600033 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.521868 26380 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:35.619112 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.582084 26456 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.585708 26118 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.635352 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:35.603927 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 212217us
W20260709 12:11:35.640290 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44888.3us
W20260709 12:11:35.643501 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.583824 26396 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:35.661412 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:35.664005 22121 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:35.634239 26454 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:35.592731 26491 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:35.686121 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:35.600348 26165 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:35.711380 26165 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:35.713156 26380 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:35.626950 26393 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:35.696843 22116 raft_consensus.cc:2410] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:35.708758 26539 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:35.709422 26487 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:35.732081 22120 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:35.765556 22121 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:35.766921 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 115719us
I20260709 12:11:35.698913 26295 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.734542 26454 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:35.746031 26544 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.434s	user 0.002s	sys 0.000s
W20260709 12:11:35.785657 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.751382 26165 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:35.840085 22163 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:35.745708 26552 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:11:35.865149 22861 consensus_meta.cc:287] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.694s	user 0.007s	sys 0.006s
I20260709 12:11:35.865795 22861 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:35.872694 26567 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:11:35.870951 26295 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:35.883060 26557 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 12:11:35.883965 26556 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
W20260709 12:11:35.885119 26558 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:11:35.894156 26487 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.897912 26490 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:35.914108 26560 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:11:35.916795 26551 log.cc:927] Time spent T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 12:11:35.965412 26264 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:35.926090 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:35.945968 22831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.013s	sys 0.018s
I20260709 12:11:35.950012 22196 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:36.001622 22831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.013s	sys 0.018s
W20260709 12:11:36.002362 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 719629us
I20260709 12:11:36.004065 22831 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:35.951601 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 362903us
I20260709 12:11:36.005511 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:36.006743 26406 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:36.006893 26118 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:36.007239 26406 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:36.007436 26118 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:35.830754 26564 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:11:36.011096 26564 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:36.011510 26564 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:11:35.959831 22829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.020s
W20260709 12:11:36.012969 22829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.013s	sys 0.020s
I20260709 12:11:36.009660 26118 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:36.014343 26118 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:36.014801 26118 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.016189 26283 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:36.016989 26118 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:36.017709 26446 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:35.967650 26165 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:35.975222 22830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.010s	sys 0.018s
W20260709 12:11:36.024266 22830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.010s	sys 0.018s
W20260709 12:11:36.024613 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 590174us
I20260709 12:11:35.922796 26380 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.917917 26565 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:35.981700 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 398583us
I20260709 12:11:36.032049 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:36.033309 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:35.963007 26405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.020s
I20260709 12:11:35.874593 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:35.983053 22115 consensus_meta.cc:287] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.662s	user 0.013s	sys 0.000s
I20260709 12:11:36.110752 22115 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:35.961556 26292 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:35.877034 26454 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.878340 26566 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:36.048377 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.111166 22270 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 12:11:36.112141 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 78906.6us
I20260709 12:11:36.112939 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:36.138383 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 263937us
I20260709 12:11:36.140004 22163 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:36.140031 22122 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:36.142449 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.144408 22263 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:36.016628 26283 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:35.996639 26567 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:36.143324 22116 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:36.020287 26541 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:36.136746 26405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.004s	sys 0.021s
I20260709 12:11:36.012452 26564 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.175087 26564 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.138944 26118 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:36.178246 26118 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:36.178874 26118 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.179324 26118 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.180949 26566 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:36.159053 26292 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:11:36.156975 26446 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:36.111966 26165 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.183190 26446 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.184931 26165 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:36.185659 26165 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:36.173074 26567 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.148046 26491 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:35.993631 26295 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.182035 26292 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.164121 26490 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.044726 26396 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:36.200946 22122 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:36.209860 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:36.184641 22196 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:36.204945 22865 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:36.198179 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 172776us
I20260709 12:11:36.153776 26285 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:36.222102 26285 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.222606 26285 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:36.225119 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.208879 26491 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.001134 26552 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:35.997967 26487 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.228386 26506 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:36.220255 26575 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.205148 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:36.229485 22858 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:36.229856 22858 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:36.182072 26566 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.198484 26334 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:11:36.230592 26487 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:36.230563 22858 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.232108 26144 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:36.232995 22858 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.186169 26165 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:36.238400 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.238526 26165 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:36.023173 26264 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.241014 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1986) took 1063 ms. Trace:
I20260709 12:11:36.243005 22858 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:36.215695 26292 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.155884 26565 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:36.245515 26557 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:36.247213 26567 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:36.139261 26380 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:36.249409 26482 consensus_meta.cc:287] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.167s	user 0.013s	sys 0.003s
I20260709 12:11:36.233023 26144 consensus_queue.cc:1243] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:36.253126 26491 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:36.277447 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 164568us
W20260709 12:11:36.282681 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 277238us
I20260709 12:11:36.287022 26579 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:36.261415 22196 rpcz_store.cc:276] 0709 12:11:35.177731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.177891 (+   160us) service_pool.cc:224] Handling call
0709 12:11:35.927319 (+749428us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b58004703d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd1e0aa 00007fccedda0447 00007fcceddb8fe7 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c
0709 12:11:36.240943 (+313624us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191017728}
I20260709 12:11:36.295001 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:36.302241 22264 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:36.305100 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:36.298949 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:36.307260 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:36.308964 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:36.310585 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2435) took 1123 ms. Trace:
I20260709 12:11:36.311015 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:36.311600 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:36.312494 22266 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:36.311087 22119 rpcz_store.cc:276] 0709 12:11:35.186793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.186967 (+   174us) service_pool.cc:224] Handling call
0709 12:11:35.187378 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:35.199791 (+ 12413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.199834 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:35.200440 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 12:11:35.404803 (+204363us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:35.448158 (+ 43355us) log.cc:844] Serialized 14 byte log entry
0709 12:11:35.578673 (+130515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.578758 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.310185 (+731427us) raft_consensus.cc:1685] finished
0709 12:11:36.310217 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.310455 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22192,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":1230,"raft.queue_time_us":216356,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":27716,"thread_start_us":238021,"threads_started":2,"wal-append.queue_time_us":409870}
I20260709 12:11:36.315927 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:36.318681 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:36.330209 22115 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:36.319942 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:36.337989 26334 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.301326 26583 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.338551 26334 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.338711 26583 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:36.338860 26589 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:11:36.338967 26334 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.326141 26144 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.342061 26144 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:36.342469 26456 consensus_meta.cc:287] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.000s
I20260709 12:11:36.343216 26456 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:36.343765 26563 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.361s	user 0.000s	sys 0.004s
I20260709 12:11:36.326097 26567 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 12:11:36.342573 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.317433 26582 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.359539 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:36.313706 26118 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:36.364670 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:36.368695 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:36.370435 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:36.318643 26487 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:36.356300 26586 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:11:36.373538 26490 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:36.342482 26144 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.318516 26570 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.315505 26579 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.346591 26539 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.304370 26491 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:36.366663 26500 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.913s	user 0.009s	sys 0.005s
I20260709 12:11:36.283803 26283 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.371773 22237 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:36.407290 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:36.378557 26581 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.374469 26575 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.371258 26165 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.379539 26583 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:36.379474 26506 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:11:36.408290 26568 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:36.459455 26568 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.462165 26568 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:36.464063 26541 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.464686 26578 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.467057 26579 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:36.468849 26292 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:36.471925 26380 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:36.473057 26565 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:36.473912 26491 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:36.427150 26490 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.483225 26295 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:36.430634 26581 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.487414 26581 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:36.490144 26570 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.490931 26570 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.490728 26454 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.464123 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2439) took 1268 ms. Trace:
I20260709 12:11:36.494763 22120 rpcz_store.cc:276] 0709 12:11:35.195900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.197572 (+  1672us) service_pool.cc:224] Handling call
0709 12:11:35.199024 (+  1452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:35.732757 (+533733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.463687 (+730930us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b5400084154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:36.464046 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225280768}
I20260709 12:11:36.464709 26541 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.497306 26456 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:36.498826 26541 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:36.506628 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.407474 26500 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.509864 26380 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:36.514247 22118 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:36.517611 22861 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 651) took 1696 ms (client timeout 2008 ms). Trace:
I20260709 12:11:36.405658 26539 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.446455 26487 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:36.527769 22861 rpcz_store.cc:269] 0709 12:11:34.821459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.823705 (+  2246us) service_pool.cc:224] Handling call
0709 12:11:36.517377 (+1693672us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54006a0254. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:36.517528 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784717184}
I20260709 12:11:36.536563 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:36.539186 22190 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:36.539286 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 215555us
I20260709 12:11:36.542616 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.547500 22198 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:11:36.548157 22198 pending_rounds.cc:85] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 8
I20260709 12:11:36.547472 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:36.548447 22198 pending_rounds.cc:107] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:36.548804 22198 raft_consensus.cc:2889] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:36.554404 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:36.556331 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:36.527151 26581 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:36.584322 22190 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:36.509259 26334 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.586057 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:36.588629 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.595263 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.544539 26487 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:36.621001 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.621631 22123 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:36.621794 26487 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.622999 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 1989) took 1443 ms. Trace:
I20260709 12:11:36.623827 26500 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:36.624513 26581 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.626623 26581 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:36.627583 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2445) took 1240 ms. Trace:
I20260709 12:11:36.510967 26456 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:11:36.596746 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:36.598032 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:36.598784 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:36.553619 26506 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:11:36.535316 26380 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.600602 26539 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:36.594795 26566 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:36.599915 26406 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.602453 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:11:36.659569 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57224.9us
I20260709 12:11:36.595877 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2441) took 1215 ms. Trace:
I20260709 12:11:36.662232 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:36.612084 26594 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:36.613473 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.614538 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.618503 22115 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:11:36.663789 22117 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 12: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:36.647061 26500 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:36.664888 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.665591 22115 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:36.661405 22121 rpcz_store.cc:276] 0709 12:11:35.380725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.795679 (+414954us) service_pool.cc:224] Handling call
0709 12:11:35.796004 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:35.796207 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:35.796553 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 12:11:36.503671 (+707118us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b18003e9200. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a 00007fcceddcca2a
0709 12:11:36.595528 (+ 91857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:36.595585 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:36.595640 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.595704 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.595821 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":837,"prepare.queue_time_us":132,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":7206,"raft.queue_time_us":3592,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"spinlock_wait_cycles":3647872,"thread_start_us":90486,"threads_started":1,"wal-append.queue_time_us":812687}
I20260709 12:11:36.668140 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.614598 26334 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:36.670287 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:36.620023 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:36.672456 22122 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.672601 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:36.553681 26583 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.629357 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.675045 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.629819 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:36.629997 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.630625 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:36.616750 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.677138 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.677871 22119 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:36.678881 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.627920 22114 rpcz_store.cc:276] 0709 12:11:35.387587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.014476 (+626889us) service_pool.cc:224] Handling call
0709 12:11:36.014753 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.295304 (+280551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.295335 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:36.295380 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:36.295420 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.627382 (+331962us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400327b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:36.627421 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.627531 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644721920}
I20260709 12:11:36.623412 22191 rpcz_store.cc:276] 0709 12:11:35.179886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.180033 (+   147us) service_pool.cc:224] Handling call
0709 12:11:35.180388 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:35.479477 (+299089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.479533 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:35.479605 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:35.479669 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.622770 (+1143101us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54002a03d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:36.622815 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.622922 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687030016}
I20260709 12:11:36.680074 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.680140 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:36.638981 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 267278us
I20260709 12:11:36.676519 22123 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:36.680751 22194 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
W20260709 12:11:36.642562 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.640331 22264 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:36.610021 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:36.675691 22115 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:36.640501 26118 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:36.670956 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:36.619967 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:36.688653 22121 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:36.637806 26581 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:36.647502 26393 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.694041 26118 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.675357 26566 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.698843 26566 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:36.702878 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.675535 22116 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:36.629671 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:36.687160 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.683270 22269 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:36.687248 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:36.705099 22270 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.697063 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:36.671993 22263 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:36.706147 22267 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:36.688791 22266 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.688150 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:36.693035 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.692206 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.707274 22198 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:36.693656 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:36.683950 22265 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:36.691433 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.693454 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:36.707520 22190 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:36.640156 26285 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.713249 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.713639 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.714167 22196 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:11:36.714314 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.716365 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:36.673635 26406 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.673444 26165 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:36.717710 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:36.717990 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.718587 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.723831 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.680435 26594 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:36.748095 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.757485 22122 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:36.714443 22193 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:36.763499 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:36.772051 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 99516.5us
W20260709 12:11:36.774673 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 87083.5us
I20260709 12:11:36.680719 26445 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:36.713758 26566 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:36.686131 26500 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.860016 22194 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:36.691288 26151 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
W20260709 12:11:36.967859 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 274667us
I20260709 12:11:36.866395 22266 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:36.704681 26581 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:36.851846 26541 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.006340 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:37.026178 22194 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:36.758713 26450 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.027751 22270 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
W20260709 12:11:37.073158 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 315697us
I20260709 12:11:36.883088 26564 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:37.039747 26541 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:37.097540 26564 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:37.098718 26606 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:37.096740 26602 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:37.100627 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 94352.5us
I20260709 12:11:36.979561 26264 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:37.103363 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:37.040524 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56559.1us
I20260709 12:11:37.105847 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:36.852451 26600 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:36.977777 26608 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:37.112105 22121 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:37.117034 22189 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:11:37.117506 22189 pending_rounds.cc:85] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 8
I20260709 12:11:37.117738 22189 pending_rounds.cc:107] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:11:37.118037 22189 raft_consensus.cc:2889] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:36.844940 26285 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:36.975821 26607 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.125208 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:37.134271 26541 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:37.134640 26607 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:37.135066 26607 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.132894 26600 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:37.102990 26606 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:37.137039 26380 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:37.139498 26606 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:37.141423 26600 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:37.131696 26445 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:37.142802 26445 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:37.143208 26562 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 12:11:37.144259 26144 consensus_meta.cc:287] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.001s
I20260709 12:11:37.132247 26500 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:37.141479 26581 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:36.922413 26165 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:37.145768 26603 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:11:37.146122 22116 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:37.135370 26607 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.143535 26564 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:37.149161 26564 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:37.149639 26564 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:37.150997 22195 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:37.151837 26564 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:37.153468 26595 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
I20260709 12:11:36.770228 26570 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:37.133037 26601 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.958685 26584 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.847901 26334 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.280s
I20260709 12:11:37.144691 26144 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:36.918205 26566 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:37.166868 22116 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:37.171401 22118 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:11:37.177501 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:37.184192 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 240472us
I20260709 12:11:37.163767 26612 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.187518 22197 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:37.187701 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:37.188091 22267 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:37.181721 26571 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:11:37.189215 26613 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.189803 26613 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:37.191555 26144 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:37.192229 26613 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:37.193782 26606 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:37.199743 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:37.202466 26607 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:37.203719 22264 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:37.206708 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:37.208935 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 113467us
I20260709 12:11:37.209553 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:37.212064 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:37.215478 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:37.217835 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:37.218693 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:37.218784 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:37.218878 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:37.219676 22119 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:37.220966 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:37.221021 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:37.225057 26564 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.225718 26165 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:37.233529 26618 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:37.194396 26606 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:37.234503 26575 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:37.239773 26566 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:37.184069 26601 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:37.240906 26500 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:37.241442 26500 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:37.241822 26500 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:37.128609 26608 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:37.223881 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:11:37.251766 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.244341 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:37.255571 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:37.255798 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 44655.2us
I20260709 12:11:37.236527 26606 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:37.243782 26600 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.213976 26607 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:37.261368 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:37.262257 22269 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:11:37.274708 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:37.276285 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.281093 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:37.256804 26566 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:37.287063 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:37.287899 22270 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:37.240759 26601 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:37.308717 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:37.263180 26618 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.261317 26600 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:37.209903 26612 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:37.352090 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 93994.7us
I20260709 12:11:37.254989 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:37.290217 26566 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:37.377385 26621 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.354938 26618 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.379462 26621 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.379740 26618 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.379875 26621 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.370322 26600 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.186517 26594 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:37.375432 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 120212us
I20260709 12:11:37.386121 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:37.396250 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:37.396390 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 216694us
W20260709 12:11:37.408293 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 228073us
I20260709 12:11:37.389599 26566 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.410818 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:37.412192 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:37.421446 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:37.423624 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:37.425166 26564 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:37.430128 26582 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:37.430575 26582 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:37.430971 26582 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:37.432969 26165 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:37.433408 26165 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:37.433784 26165 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:37.435956 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:37.439662 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:37.441257 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:37.442152 22264 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:11:37.446182 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.448141 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:37.449214 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:37.411726 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:37.543354 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 131676us
I20260709 12:11:37.408912 26263 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.581872 26539 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:37.542636 26629 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:37.411913 26575 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.171s
I20260709 12:11:37.477803 26615 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:37.389145 26285 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:37.405603 26565 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:37.412408 26607 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:37.674501 26604 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:37.701483 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:37.726773 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 309985us
I20260709 12:11:37.682885 26629 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.677088 26263 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.725867 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:37.739161 22192 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:37.687126 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:37.700086 26565 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:37.698469 26539 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:37.702664 26615 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:37.742563 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 55529.7us
I20260709 12:11:37.757822 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:37.745735 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:37.726541 26608 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:37.766856 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.741315 26263 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.740116 26629 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.747915 26565 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.772953 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:37.770123 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 288571us
I20260709 12:11:37.802748 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:37.802615 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:37.748029 26570 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:37.840444 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:37.889073 22192 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:37.774288 26581 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:37.891695 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 443695us
I20260709 12:11:37.893743 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:37.729043 26607 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:37.907202 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:37.824069 26577 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.641s	user 0.006s	sys 0.004s
I20260709 12:11:37.912266 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:37.909192 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:37.913735 22190 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:37.750377 26165 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:37.889511 26494 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.739742 26604 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:37.895265 26581 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:37.952819 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 253848us
I20260709 12:11:37.988281 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:37.989343 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:37.989527 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 261122us
I20260709 12:11:37.961127 26581 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:38.050559 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 62388.4us
I20260709 12:11:38.052418 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:38.007912 26630 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:11:37.959141 26608 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.947683 26570 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:37.958194 26601 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:37.948632 26494 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:38.002251 26582 consensus_meta.cc:287] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.003s
W20260709 12:11:38.001487 26626 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.328s	user 0.001s	sys 0.001s
I20260709 12:11:37.937354 26539 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:38.018734 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.993309 26635 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.093794 26635 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:38.010627 26600 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.630s	user 0.004s	sys 0.009s
I20260709 12:11:38.094666 26600 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:38.046190 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 273325us
I20260709 12:11:38.097136 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.063472 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:38.004505 26643 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.104442 22264 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:38.072305 22196 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:38.071835 26608 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.082289 26283 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.090570 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:38.091092 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:38.091550 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:38.077456 26575 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:38.089277 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:38.085228 26523 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:38.107623 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.091988 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:38.085253 26646 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.111328 22115 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:38.115971 26638 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:38.116444 26622 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.326s	user 0.001s	sys 0.001s
I20260709 12:11:38.108676 26635 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:38.121706 22123 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:38.075157 22087 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:38.129056 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.116921 26637 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:38.112746 26608 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.119661 26491 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.137548 26615 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.138700 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:38.163550 22121 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:38.164063 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.138064 26600 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.165226 26600 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:38.165490 26615 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.165665 26600 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.166067 26600 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:38.121081 26601 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:38.145437 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 849) took 1037 ms. Trace:
I20260709 12:11:38.169898 22194 rpcz_store.cc:276] 0709 12:11:37.108451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.108703 (+   252us) service_pool.cc:224] Handling call
0709 12:11:37.109077 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.174312 (+ 65235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.174344 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:37.181587 (+  7243us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.307133 (+125546us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:37.308529 (+  1396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.308643 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.145078 (+836435us) raft_consensus.cc:1685] finished
0709 12:11:38.145112 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.145345 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116535,"raft.queue_time_us":67866,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5830,"thread_start_us":118557,"threads_started":1,"wal-append.queue_time_us":224617}
I20260709 12:11:38.155328 22114 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:38.173413 26283 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.174175 26283 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.180060 26642 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:38.146613 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 71590.6us
I20260709 12:11:38.116930 26285 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:38.130025 26638 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:38.086112 26570 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.184618 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:38.134544 26487 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.079406 26582 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.191855 26642 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.161068 26405 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.144543 26575 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.228837 26575 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.234304 26642 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.181258 26165 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:38.197209 26639 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:11:38.162850 26607 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.199254 26634 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.236110 26118 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.132581 26646 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.249572 26634 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.250759 26649 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.197964 26636 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.253086 26570 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.253198 26636 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.130607 26523 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.199740 26547 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 12:11:38.114625 26643 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.214915 26494 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.190465 26285 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.193246 26487 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.235708 26617 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:38.272524 26604 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.274874 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:38.155715 26635 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.277745 22198 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.275732 26165 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.236507 26405 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.325075 26575 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.325752 26575 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:38.279645 26646 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.281919 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:38.241969 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 77980.2us
I20260709 12:11:38.280609 26285 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:38.317914 26650 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:11:38.320297 26283 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.256155 26638 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.322546 26565 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.280305 26645 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.327613 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.276026 26487 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.266274 26448 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.338110 26454 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.341707 22267 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:38.346040 26490 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.349871 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.351101 22123 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:38.353223 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.355340 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.355934 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:38.356269 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.317929 26500 consensus_meta.cc:287] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.076s	user 0.015s	sys 0.000s
I20260709 12:11:38.385040 26500 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.386626 26594 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:38.386868 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 59345.5us
I20260709 12:11:38.387403 26500 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:38.376017 26566 consensus_meta.cc:287] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.894s	user 0.009s	sys 0.004s
I20260709 12:11:38.390977 26566 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.393463 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:38.393939 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.396698 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:38.308189 26621 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.903s	user 0.010s	sys 0.005s
W20260709 12:11:38.328469 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46727.6us
I20260709 12:11:38.276357 26617 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:38.372928 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:38.374838 22120 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:38.376099 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:38.398824 22122 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:38.320322 26642 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.388283 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.370543 26537 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:38.370734 26575 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:38.413668 22236 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.413668 22237 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.417398 26646 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.418242 22118 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:38.419243 22237 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:38.421211 26500 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.421911 26500 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:38.422197 26618 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.042s	user 0.011s	sys 0.002s
I20260709 12:11:38.422823 26618 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:38.423448 26629 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 12:11:38.423991 26629 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.424642 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 1996) took 1745 ms. Trace:
I20260709 12:11:38.397948 26621 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.425034 22197 rpcz_store.cc:276] 0709 12:11:36.679031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.679151 (+   120us) service_pool.cc:224] Handling call
0709 12:11:38.424436 (+1745285us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54002e7cd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:38.424580 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112536832}
I20260709 12:11:38.429767 22237 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:38.430573 26584 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:38.430855 26491 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.431217 26584 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.433846 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 694) took 1323 ms. Trace:
I20260709 12:11:38.434484 26661 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:38.434394 22116 rpcz_store.cc:276] 0709 12:11:37.110657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.110859 (+   202us) service_pool.cc:224] Handling call
0709 12:11:37.111128 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.171091 (+ 59963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.433581 (+1262490us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b54002e2a54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:38.433774 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80196992}
I20260709 12:11:38.435083 26661 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.435715 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.436620 22268 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:38.360718 26405 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.437052 26646 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.437422 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:38.438015 22268 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.433952 26643 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.439445 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.437630 26646 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.441635 22272 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:38.442090 26606 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:38.442643 26565 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.379149 26578 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.443472 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.443846 26578 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.444310 26604 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.437084 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.445112 26618 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.446190 26578 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.442890 26646 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.427006 26621 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.447028 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:38.447870 22270 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:38.445894 26604 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.448871 26636 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.450245 26604 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.450591 26582 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.433959 22267 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:38.442596 26606 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.382807 26583 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:38.399782 26448 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.383201 26649 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:11:38.409255 26490 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.471735 22116 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:38.415328 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.410267 26634 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.452325 26537 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:38.477175 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 852) took 1352 ms. Trace:
I20260709 12:11:38.479817 22193 rpcz_store.cc:276] 0709 12:11:37.124656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.124943 (+   287us) service_pool.cc:224] Handling call
0709 12:11:37.128918 (+  3975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.140343 (+ 11425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.140373 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:37.140415 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:37.140447 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.476956 (+1336509us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5400078d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:38.477008 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.477122 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25798016}
W20260709 12:11:38.482800 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 273762us
I20260709 12:11:38.465107 26466 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.476186 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:38.479328 26405 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.383821 26645 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.496853 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:38.475485 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60258.4us
I20260709 12:11:38.487821 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.499251 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.499897 22270 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:38.500406 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.500989 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.487850 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:38.493491 22860 raft_consensus.cc:1217] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Deduplicated request from leader. Original: 9.10->[10.11-10.11]   Dedup: 10.11->[]
I20260709 12:11:38.502440 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.503098 22860 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:11:38.505225 22268 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:38.495468 26405 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.492614 26537 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.507541 26537 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.476688 26490 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.509132 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:38.509776 22267 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.510540 26490 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.512718 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.512964 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.514111 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.514382 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.514771 26448 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.515147 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.515466 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.476491 26604 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:36.448037 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:38.525951 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.526661 22270 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:38.526969 22021 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.483556 26600 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.508425 26405 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:38.477241 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 426015us
I20260709 12:11:38.546746 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:38.506604 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:38.548385 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 63673us
I20260709 12:11:38.549175 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:38.549921 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.536054 22267 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:38.537801 22270 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:38.554893 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:38.538338 26600 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.538864 26663 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.540805 26606 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.542641 26612 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.545302 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:38.546015 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.556294 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.556659 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.557328 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.580914 22192 raft_consensus.cc:2410] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:38.490998 26436 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.528633 22021 catalog_manager.cc:5697] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 7 to 8, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 8 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.547366 22117 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:38.561094 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.591347 22192 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:38.591923 22190 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:38.592308 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:38.594262 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:38.594867 22117 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:38.564990 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.567886 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.569346 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.569756 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:38.570096 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.564522 26295 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:38.597199 26295 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:38.597730 26295 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.598626 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:38.599421 26600 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.599574 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.600059 26600 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.567279 26635 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.575353 26661 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.566675 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.600994 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:38.601490 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.602687 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:38.603286 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:38.603511 26661 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:38.603973 26661 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:38.604089 26490 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.604408 26661 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:38.604462 26490 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.498692 26584 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.604885 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:38.604947 26490 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.605759 22193 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:38.579480 22119 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.582360 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.606611 22266 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:38.602689 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:38.584736 26569 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:38.607967 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:38.585377 26662 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 12:11:38.613060 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 56816.8us
I20260709 12:11:38.590029 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.580826 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:38.577255 26564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.034s	sys 0.011s
I20260709 12:11:38.558092 22863 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:11:38.577790 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:38.609728 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:38.591171 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.580490 26673 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.576086 26604 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.616348 26571 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:11:38.578121 26583 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.622323 26583 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.623723 26608 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.532158 26581 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.602990 26448 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.616967 22269 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:38.617626 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.619297 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.626961 22271 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:38.616710 22272 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:38.627516 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:38.633375 22192 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:38.630055 22116 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:38.625155 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.505592 26466 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.636643 22119 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:38.578503 26652 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.653021 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.578299 26663 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.637571 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:38.628619 26564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.034s	sys 0.012s
I20260709 12:11:38.631038 26612 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:11:38.675429 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:38.658592 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:38.673249 22196 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:11:38.626578 26581 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.606257 26450 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:11:38.627136 26566 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.681990 22198 raft_consensus.cc:2410] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:38.676232 26663 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.620424 26645 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.499353 26617 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:38.689347 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.624691 26583 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.674014 26285 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.674510 26564 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:11:38.738205 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 104113us
I20260709 12:11:38.619524 26604 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:38.759506 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 70579.6us
I20260709 12:11:38.760247 22114 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:38.761152 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:38.672734 26652 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.692239 26606 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:38.734666 26566 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:38.758500 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.735055 26670 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.688266 26635 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:38.762279 26645 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.770107 26263 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.928s	user 0.011s	sys 0.003s
I20260709 12:11:38.740329 26617 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.775050 26295 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.776062 26604 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.765618 26363 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:11:38.777990 26652 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.821593 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:38.778131 26564 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.778810 22117 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:38.782678 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:38.783299 26405 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.689244 26673 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:38.789968 22272 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:38.753976 26515 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.792323 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 940) took 2106 ms. Trace:
I20260709 12:11:38.839622 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:38.790813 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 45504us
W20260709 12:11:38.840739 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 58129.7us
I20260709 12:11:38.841471 22162 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:38.754305 26583 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:38.799116 26466 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.801815 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 840) took 2338 ms. Trace:
I20260709 12:11:38.803004 26608 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.804922 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.805603 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:38.807086 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.845124 22195 rpcz_store.cc:276] 0709 12:11:36.463217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.465087 (+  1870us) service_pool.cc:224] Handling call
0709 12:11:36.465447 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.151434 (+685987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.801538 (+1650104us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400142dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:38.801738 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575639424}
I20260709 12:11:38.821022 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.757232 26445 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:11:38.822904 22268 raft_consensus.cc:2368] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:38.788276 26661 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.824600 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.829170 26575 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.829984 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:38.835148 26634 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.836311 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:38.836051 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:38.840457 22272 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:38.793350 26645 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.842357 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:38.839588 22263 rpcz_store.cc:276] 0709 12:11:36.684240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.706453 (+ 22213us) service_pool.cc:224] Handling call
0709 12:11:36.749310 (+ 42857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.917074 (+167764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.917125 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:36.917187 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:36.917236 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.790171 (+1872935us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400331dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:38.790218 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.790353 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385139712}
I20260709 12:11:38.847189 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:38.848510 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.851939 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:38.854866 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.907933 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.908962 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.909860 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:38.848183 26323 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:38.912694 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 76475.5us
I20260709 12:11:38.914794 22088 leader_election.cc:400] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:38.915201 22088 leader_election.cc:403] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:38.918745 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:38.921109 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 78808.4us
I20260709 12:11:38.925770 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:38.929697 22268 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:38.840029 26405 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.793169 26566 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.792891 26487 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.849532 26614 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:38.940804 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:38.743283 26613 consensus_queue.cc:1175] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" responder_term: 12 status { last_received { term: 11 index: 7 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:38.950098 26295 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.847985 26673 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.796254 26635 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.936519 26621 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:38.959259 26635 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.936329 26405 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.912679 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:38.965814 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:38.966611 26608 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:38.917979 26323 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:38.967103 26608 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:38.967751 26608 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:38.965056 26264 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:38.968437 26264 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:38.937366 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2007) took 1123 ms. Trace:
I20260709 12:11:38.797016 26263 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:38.969404 26678 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:38.970068 22190 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:11:38.970119 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57628.5us
I20260709 12:11:38.936604 26652 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.971278 26263 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:38.795961 26670 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.974100 26670 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.975018 22117 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:38.977399 22858 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:38.979171 26645 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.979936 26673 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.938004 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.982637 22264 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:38.839264 26636 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:38.983754 26636 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.853899 26583 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:38.986295 26636 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.967192 26323 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.988440 26583 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.991820 26661 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:38.969036 22198 rpcz_store.cc:276] 0709 12:11:37.803215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.008938 (+205723us) service_pool.cc:224] Handling call
0709 12:11:38.926130 (+917192us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54003b56d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:38.926280 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413321984}
I20260709 12:11:38.994748 26487 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:38.995920 22265 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:38.931576 26662 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:39.009485 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 93574.2us
I20260709 12:11:38.934912 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:38.935269 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:39.024473 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 89491.8us
I20260709 12:11:39.025503 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.027062 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:38.967562 26490 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.937175 26515 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:38.920305 26665 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.148s
W20260709 12:11:39.072376 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 61770.1us
I20260709 12:11:39.001389 26614 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:39.080955 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53988.7us
I20260709 12:11:39.092363 26673 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:38.904438 26466 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.146s
I20260709 12:11:39.097954 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.082983 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:39.032343 26662 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:39.109228 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.051054 26636 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.110980 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.099921 22831 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:38.920763 26575 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.933110 26634 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.117892 26670 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.125000 26670 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.125355 26670 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.102769 26614 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:39.135661 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:39.139084 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:39.141264 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:39.144018 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:39.145236 26647 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.146757 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:39.144543 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:39.152163 22197 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:11:39.148965 22198 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:39.119889 26515 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:39.155308 26515 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:38.969426 26264 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.158272 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:39.159495 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48629.5us
I20260709 12:11:39.164700 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:39.166646 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.170056 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:39.170883 22196 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.127851 26144 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:39.174532 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.150648 26663 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:39.149159 26635 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:39.176730 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.150981 26652 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.151572 26647 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:39.187213 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.188905 26662 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.187888 26663 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:39.163190 26673 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.192444 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.189774 26264 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:39.184453 26636 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:39.194132 26647 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.224882 26663 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:39.231963 26634 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:39.183336 26144 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:39.240439 22863 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:39.247406 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.247880 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.248704 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.249446 22263 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:39.250275 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.251416 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.251984 22268 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:39.253917 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.254791 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.255591 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:39.255728 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.256412 26636 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.256837 26636 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.257157 26636 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.257277 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.257812 22194 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:39.258894 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:39.253448 22196 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:39.261782 22198 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:39.261053 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:39.263913 22196 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:39.258836 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.265700 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:39.267534 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:39.261232 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:39.269846 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:39.273763 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:39.278206 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.276609 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:39.285346 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 425716us
W20260709 12:11:39.290019 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.296689 22120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 686) took 2770 ms (client timeout 1755 ms). Trace:
W20260709 12:11:39.297309 22120 rpcz_store.cc:269] 0709 12:11:36.506106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.506256 (+   150us) service_pool.cc:224] Handling call
0709 12:11:39.276023 (+2769767us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54002adad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:39.276147 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4290603392}
I20260709 12:11:39.300617 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:39.273474 26635 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:39.305442 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.272763 26634 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:39.275760 26583 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.275246 26661 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.309264 22118 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:39.288082 26566 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:39.314471 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.327538 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.310336 26604 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:39.307852 26635 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.337761 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.349458 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.350559 22120 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:39.350932 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.357885 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.355468 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.325909 26575 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:39.312090 26634 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:39.364261 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.369791 22198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:39.337869 26635 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.364934 22114 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.338792 26667 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:39.320057 26405 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.373638 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.390657 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:39.366242 26629 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:39.369509 22237 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:39.410491 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.373679 26323 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.369445 26406 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.329761 26661 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:39.420367 26614 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.403005 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.433159 26661 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:39.434206 26661 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.364383 26634 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:39.410012 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.374642 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.437155 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.354533 26523 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:39.412206 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:39.414153 26264 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.439210 22195 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:39.422053 26144 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:39.372527 26636 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:39.439769 22198 raft_consensus.cc:606] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.440241 22198 raft_consensus.cc:614] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:39.441220 26614 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:39.386111 26608 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.441912 26636 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:39.425557 26584 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:39.443177 26584 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:39.407686 26363 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:39.405380 26667 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:39.353433 26604 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:39.445202 26667 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:39.446286 26604 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.427737 22237 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:39.450662 26617 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.003s
I20260709 12:11:39.450990 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:39.451397 22191 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:11:39.424401 26405 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:39.402832 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 65726us
I20260709 12:11:39.452692 26629 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:39.452948 26638 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:39.455148 26490 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:39.434561 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.455441 26523 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:39.456650 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:39.456881 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.457267 26613 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:39.457559 22117 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:39.457690 26613 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:39.352880 26609 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:11:39.458606 26613 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.459894 26613 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:39.461680 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 951) took 1128 ms. Trace:
I20260709 12:11:39.462062 22271 rpcz_store.cc:276] 0709 12:11:38.333075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.333257 (+   182us) service_pool.cc:224] Handling call
0709 12:11:38.333679 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.632652 (+298973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.461420 (+828768us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54003c9bd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:39.461599 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674054016}
I20260709 12:11:39.462630 26609 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:39.463013 26609 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:39.464345 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.443737 26608 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:39.467504 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:39.469005 26636 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.469473 22088 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:39.475694 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.477032 22115 raft_consensus.cc:2410] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:39.478369 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.480988 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.481014 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:39.486136 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.486975 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.488071 22116 raft_consensus.cc:2368] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13.
I20260709 12:11:39.481151 26636 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.464403 26583 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:39.492954 22114 raft_consensus.cc:2410] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:39.490119 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.491089 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.443778 26584 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:39.479754 26621 consensus_meta.cc:287] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.001s
I20260709 12:11:39.463943 26609 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:39.496476 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.497855 22116 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 12: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:39.499323 22267 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:39.495712 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:39.503057 22267 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:39.501163 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.502965 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.506884 22116 raft_consensus.cc:2393] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:39.491600 26406 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:39.507900 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:39.491739 26634 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.496076 26575 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:39.511432 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.527031 22116 raft_consensus.cc:2368] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13.
I20260709 12:11:39.512264 22115 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:11:39.501080 26621 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:39.528393 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.492749 26393 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:11:39.506925 26649 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.507628 26636 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:39.507365 26144 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:39.510537 26645 consensus_queue.cc:1175] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cc9b9c8894084021a0c6ddaf659d222e" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 9 index: 9 } }
I20260709 12:11:39.512640 26406 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:39.548647 26406 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:39.562410 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2472) took 1469 ms. Trace:
I20260709 12:11:39.562894 22121 rpcz_store.cc:276] 0709 12:11:38.092880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.164324 (+ 71444us) service_pool.cc:224] Handling call
0709 12:11:39.276262 (+1111938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.276479 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.276508 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:39.276554 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:39.276589 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.276668 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.562205 (+285537us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002adad0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:39.562336 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2556231424}
I20260709 12:11:39.564431 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.569769 22121 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.511519 26670 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.566267 26625 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:39.567741 26323 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:39.534425 26633 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:11:39.547583 26144 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:39.573062 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.583710 22115 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:39.588804 22116 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:11:39.603066 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 302535us
I20260709 12:11:39.604453 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:39.608891 26647 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:39.612407 22198 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:39.612470 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.613265 22115 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.575367 22119 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:39.578547 26625 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:39.624042 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.624845 22117 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:39.626091 22162 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:39.627183 26612 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:39.627461 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 127300us
I20260709 12:11:39.627872 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:39.628214 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:39.628960 26583 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.629050 26612 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:39.629465 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:39.630941 26612 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.631839 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:39.633109 26583 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.631352 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:39.636948 26661 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:39.636703 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:39.643355 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:39.644451 26583 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:39.645170 26583 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:39.653232 22860 raft_consensus.cc:2393] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:39.657895 26625 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.665658 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:39.667723 22121 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:39.610751 26638 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:39.675560 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.678027 22115 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:39.710028 22194 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:39.706507 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:39.698392 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 192941us
I20260709 12:11:39.714020 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.694077 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:39.692188 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.710044 22198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:39.717911 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:39.718672 22266 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.718205 22268 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:39.683709 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.709772 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.680555 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:39.722055 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:39.723619 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:39.724409 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.725309 22272 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.726008 22265 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:39.727073 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:39.730058 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2479) took 1318 ms. Trace:
I20260709 12:11:39.722381 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:39.691855 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.813941 22118 rpcz_store.cc:276] 0709 12:11:38.411465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.419145 (+  7680us) service_pool.cc:224] Handling call
0709 12:11:38.419432 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.313105 (+893673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.729803 (+416698us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400084154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:39.729991 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045927296}
I20260709 12:11:39.878818 22196 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
W20260709 12:11:39.879853 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 199380us
I20260709 12:11:39.881541 22236 leader_election.cc:400] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13.
I20260709 12:11:39.878659 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.883631 22271 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:39.885809 22266 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:39.886808 22270 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:39.887952 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.683142 26625 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.882663 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:39.886886 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 79088.9us
I20260709 12:11:39.895864 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.697191 26636 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:39.910173 26636 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.910662 22123 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:39.897709 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.912740 22123 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:39.917387 22123 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:39.721300 26144 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:39.921582 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.922500 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.682629 26583 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:39.923015 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.922736 22121 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:39.923285 22272 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:39.900089 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:39.903563 26689 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.905072 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 659) took 1081 ms. Trace:
W20260709 12:11:39.908828 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.890357 26690 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:39.925661 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:39.891525 26686 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.210s	user 0.000s	sys 0.018s
I20260709 12:11:39.925047 22858 rpcz_store.cc:276] 0709 12:11:38.823650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.828647 (+  4997us) service_pool.cc:224] Handling call
0709 12:11:38.828975 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.977855 (+148880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.904833 (+926978us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54006a0254. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:39.904986 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340267264}
I20260709 12:11:39.912518 26636 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:39.937170 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:39.913435 26670 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:39.894999 26576 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.943959 26576 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:39.946503 26576 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:39.947142 22866 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:39.914026 26151 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:39.950327 26151 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:39.941442 26638 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:39.941192 22021 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.950701 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:39.951668 22272 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:39.951735 22021 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 5 to 7, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 7 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:39.929068 26608 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.953398 22021 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 6 to 7, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 7 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:39.954799 22021 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 7 to 9, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 9 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.913565 26550 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:39.957178 26550 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:39.958105 26635 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.001s
I20260709 12:11:39.958276 26690 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:39.958139 26550 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.950748 26151 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:39.959611 26647 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:39.993310 26151 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:39.995923 26151 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:39.996531 22019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 225) took 26989 ms (client timeout 15000 ms). Trace:
W20260709 12:11:39.999059 26688 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.318s	user 0.002s	sys 0.000s
I20260709 12:11:39.961544 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:39.995947 26406 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:39.972920 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 72871.8us
I20260709 12:11:40.013430 26670 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.975847 22269 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.967095 26635 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:39.976711 26689 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:39.981320 26286 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:39.984889 26550 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:39.985914 26667 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.987605 26584 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:39.956342 22021 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 10 to 11, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 11 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:40.027943 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:40.018745 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.031424 22114 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:39.975520 26638 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:40.024240 22236 leader_election.cc:400] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13.
I20260709 12:11:40.013228 26690 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.034199 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:39.966610 26263 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.027865 26323 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:11:40.029826 26689 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.039569 22021 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 9 to 10, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 10 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:40.047484 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:40.046603 22120 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:40.051481 26612 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:40.054126 26645 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.054533 26645 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.054901 26645 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.056385 26635 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:40.036972 26583 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:40.049134 26661 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:40.057232 26583 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.057509 26661 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.059991 26583 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:40.049170 26647 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:11:40.062124 26690 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:40.014104 26670 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.037562 22236 leader_election.cc:403] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:40.049579 22272 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:40.050536 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.007094 26406 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:40.069347 22264 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:40.070804 22198 raft_consensus.cc:606] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:40.074623 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:11:40.077101 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 53008us
I20260709 12:11:40.052666 22021 catalog_manager.cc:5697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:40.082072 22198 raft_consensus.cc:614] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:40.082490 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:40.080889 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:40.047788 26608 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.087774 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:40.090340 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 64607us
I20260709 12:11:40.091773 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:40.102632 22269 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:40.097036 22272 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:40.045351 26638 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:40.104635 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.075261 26584 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:40.111554 26670 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:40.090077 26690 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13.
I20260709 12:11:40.084885 26612 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:40.105360 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:11:40.121290 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.124806 26638 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:39.997043 22019 rpcz_store.cc:269] 0709 12:11:13.006723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.011022 (+  4299us) service_pool.cc:224] Handling call
0709 12:11:39.996429 (+26985407us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:33.009077 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:33.093464 (+ 84387us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:33.093533 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:11:33.093580 (+    47us) tablet.cc:662] Decoding operations
0709 12:11:33.144102 (+ 50522us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:33.160805 (+ 16703us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:33.175353 (+ 14548us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:33.215158 (+ 39805us) tablet.cc:701] Row locks acquired
0709 12:11:33.215213 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:11:33.215413 (+   200us) write_op.cc:270] Start()
0709 12:11:33.215581 (+   168us) write_op.cc:276] Timestamp: P: 1783599093215333 usec, L: 0
0709 12:11:33.215604 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:11:33.216373 (+   769us) log.cc:844] Serialized 540 byte log entry
0709 12:11:33.775707 (+559334us) op_driver.cc:464] REPLICATION: finished
0709 12:11:34.553940 (+778233us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcceacb80ac 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fccf17f8ef0
0709 12:11:34.630487 (+ 76547us) write_op.cc:301] APPLY: starting
0709 12:11:34.630637 (+   150us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:34.638346 (+  7709us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:34.638408 (+    62us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:34.639879 (+  1471us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:34.640249 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:11:34.640322 (+    73us) write_op.cc:312] APPLY: finished
0709 12:11:34.640742 (+   420us) log.cc:844] Serialized 25 byte log entry
0709 12:11:34.666972 (+ 26230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:34.667059 (+    87us) write_op.cc:454] Released schema lock
0709 12:11:34.667111 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:34.667682 (+   571us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:34.667727 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2770577,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":850076,"apply.run_cpu_time_us":14622,"apply.run_wall_time_us":37134,"cfile_cache_hit":2,"cfile_cache_hit_bytes":2091,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":1774,"lbm_reads_lt_1ms":12,"mutex_wait_us":1227,"num_ops":1,"prepare.queue_time_us":429744,"prepare.run_cpu_time_us":21606,"prepare.run_wall_time_us":344478,"raft.queue_time_us":213684,"raft.run_cpu_time_us":30544,"raft.run_wall_time_us":912352,"replication_time_us":535782,"spinlock_wait_cycles":16841216,"thread_start_us":1286160,"threads_started":5,"wal-append.queue_time_us":264701,"wal-append.run_cpu_time_us":10140,"wal-append.run_wall_time_us":2309897}]]}
I20260709 12:11:40.130362 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:40.137641 26448 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:40.094251 26665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.019s	sys 0.018s
I20260709 12:11:40.149292 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:40.089658 26363 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:11:40.128405 26583 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.126425 26625 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:40.128294 26608 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.121762 26689 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:40.166585 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:40.172804 26665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.020s	sys 0.018s
I20260709 12:11:40.167718 26583 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:40.231999 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:40.167462 26661 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:40.169953 26406 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:40.203394 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.244988 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.240163 22861 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:40.229404 26629 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.248907 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:40.242765 26583 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.246796 26363 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.277897 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:40.231693 26612 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:40.291947 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 204243us
I20260709 12:11:40.295303 22116 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.303256 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:40.304474 22116 raft_consensus.cc:2393] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:40.306241 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:40.315292 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:40.329762 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 151775us
W20260709 12:11:40.338438 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 171980us
I20260709 12:11:40.340647 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:40.345397 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:40.347077 22263 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:40.326223 26689 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:11:40.335026 26690 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.349102 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:40.351136 22263 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:40.352643 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:40.355022 22263 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:40.345856 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:40.362915 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:40.364293 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:40.364822 22195 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:40.365311 22192 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:40.342985 26406 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.366168 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:40.326829 26604 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:40.379284 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:40.380065 22263 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:40.348677 26584 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.382784 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:40.350066 26606 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:40.385286 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:40.387115 22271 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:40.389148 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:40.413054 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:40.412717 22195 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:40.384635 26296 raft_consensus.cc:2764] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:40.420223 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:40.429154 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:40.427395 22271 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:40.388296 26606 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.387105 26711 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:40.387761 26584 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.438299 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:40.439695 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:40.468001 22198 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:40.451507 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:40.450016 22120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 2498) took 1434 ms (client timeout 1852 ms). Trace:
I20260709 12:11:40.469735 22195 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.453749 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 2311) took 1284 ms. Trace:
I20260709 12:11:40.471118 22196 rpcz_store.cc:276] 0709 12:11:39.169397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.267298 (+ 97901us) service_pool.cc:224] Handling call
0709 12:11:40.453563 (+1186265us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400078d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:40.453688 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076974464}
I20260709 12:11:40.450549 22860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 664) took 1197 ms. Trace:
I20260709 12:11:40.472975 22860 rpcz_store.cc:276] 0709 12:11:39.253563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.253691 (+   128us) service_pool.cc:224] Handling call
0709 12:11:40.450367 (+1196676us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54006fc7d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:40.450492 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916440832}
I20260709 12:11:40.468451 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:40.475274 22190 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
W20260709 12:11:40.469406 22120 rpcz_store.cc:269] 0709 12:11:39.016078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.357606 (+341528us) service_pool.cc:224] Handling call
0709 12:11:40.449775 (+1092169us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54002549d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:40.449924 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1581935360}
I20260709 12:11:40.486340 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:40.488341 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:40.440341 26706 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:11:40.439297 26707 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:11:40.492012 22163 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:40.496277 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:40.498481 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:40.391152 26720 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 12:11:40.527069 22190 raft_consensus.cc:606] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:40.527657 22190 raft_consensus.cc:614] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:40.440752 26611 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:40.503773 22263 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:40.451203 26690 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:40.497560 26608 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:40.449003 26645 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:40.534956 26611 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:40.542179 26690 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:40.551525 26609 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.551738 26448 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:40.572090 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.496088 26665 raft_consensus.cc:2955] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 3 to 8, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:40.481264 26711 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.504030 26714 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:11:40.583292 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:40.594485 22860 raft_consensus.cc:606] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:40.594920 22860 raft_consensus.cc:614] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:40.577677 26448 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:40.577857 26705 log.cc:927] Time spent T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.235s	user 0.000s	sys 0.002s
I20260709 12:11:40.599072 26286 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.605280 26286 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.606307 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2021) took 1467 ms. Trace:
I20260709 12:11:40.606740 22191 rpcz_store.cc:276] 0709 12:11:39.138646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.138813 (+   167us) service_pool.cc:224] Handling call
0709 12:11:40.606116 (+1467303us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54000fb9d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:40.606236 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695374080}
I20260709 12:11:40.607478 26583 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:40.570540 26608 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:11:40.619166 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:40.620361 22190 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:40.623152 22194 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:40.608743 26448 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:40.630007 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 133799us
W20260709 12:11:40.637184 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.587893 26625 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:40.638306 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 105084us
W20260709 12:11:40.617600 26550 consensus_meta.cc:287] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.003s
I20260709 12:11:40.569617 26690 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.663972 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:40.664880 22190 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.694291 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:40.704355 22194 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:40.705909 22189 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:40.573139 26611 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:40.644167 26714 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:40.723109 22195 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:11:40.716198 22190 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
W20260709 12:11:40.721848 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59645.7us
I20260709 12:11:40.715466 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2309) took 1571 ms. Trace:
W20260709 12:11:40.728956 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.700238 26645 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:40.725721 22193 rpcz_store.cc:276] 0709 12:11:39.144529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.144888 (+   359us) service_pool.cc:224] Handling call
0709 12:11:39.145281 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.162961 (+ 17680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.162991 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.165247 (+  2256us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.909467 (+744220us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b18000862c0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:11:40.215929 (+306462us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:40.216001 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.216119 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.705669 (+489550us) raft_consensus.cc:1685] finished
0709 12:11:40.705690 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.715367 (+  9677us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22110,"raft.queue_time_us":19934,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":5447,"spinlock_wait_cycles":11151232,"thread_start_us":304276,"threads_started":1,"wal-append.queue_time_us":1119558}
I20260709 12:11:40.715906 26584 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:40.641605 26728 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:11:40.724812 26690 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:40.723580 26714 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:40.759392 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 55740us
W20260709 12:11:40.759562 22119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2031) took 1534 ms (client timeout 1819 ms). Trace:
I20260709 12:11:40.737885 26712 raft_consensus.cc:476] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:40.739097 26733 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:40.760741 22119 rpcz_store.cc:269] 0709 12:11:39.225243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.436870 (+211627us) service_pool.cc:224] Handling call
0709 12:11:40.759345 (+1322475us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54002544d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:40.759488 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246464256}
I20260709 12:11:40.735155 26711 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:40.726219 26383 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:40.768375 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:40.758368 26714 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:40.707417 26727 consensus_queue.cc:1175] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7d3f536360b444b1886777f4776be22c" responder_term: 8 status { last_received { term: 6 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:11:40.793334 26729 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:11:40.765152 26733 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:40.770754 26144 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:40.809135 22162 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.852s (SENT) [suppressed 6 similar messages]
W20260709 12:11:40.810024 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 71524.2us
I20260709 12:11:40.799482 26325 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:40.816929 26614 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:40.817417 26614 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:40.818444 26614 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.819597 26614 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:40.811807 26144 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:40.823496 26144 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:40.826507 26689 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:40.827006 26689 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:40.827913 26689 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.833272 26583 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:40.834133 22268 raft_consensus.cc:2955] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 3 to 8, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:40.836272 22270 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:40.836961 26733 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.838023 26733 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.838191 26606 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:40.766088 26625 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.839955 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 2526) took 1117 ms. Trace:
I20260709 12:11:40.808460 26263 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.847664 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:40.855386 22270 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.847776 22190 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:40.849153 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 714) took 1988 ms. Trace:
I20260709 12:11:40.840516 22269 rpcz_store.cc:276] 0709 12:11:39.722040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.723398 (+  1358us) service_pool.cc:224] Handling call
0709 12:11:40.839756 (+1116358us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54001509d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:40.839882 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576536320}
W20260709 12:11:40.859660 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 544485us
I20260709 12:11:40.857049 22117 rpcz_store.cc:276] 0709 12:11:38.860546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.636241 (+775695us) service_pool.cc:224] Handling call
0709 12:11:39.636541 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.636728 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:39.886334 (+249606us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.093997 (+207663us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.848634 (+754637us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b180044ddc0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceac4fc0a 00007fccf438f219 00007fcceacd7a40 00007fcceacd24e4 00007fcceacd2455 00007fcceddba060 00007fcceddcc716 00007fccedddd287 00007fccedddd208
0709 12:11:40.848811 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:40.848861 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:40.848923 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.848986 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.849099 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":734536,"prepare.queue_time_us":269570,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":766840,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":12503,"spinlock_wait_cycles":7068544,"thread_start_us":447725,"threads_started":2,"wal-append.queue_time_us":191803}
I20260709 12:11:40.861074 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:40.862231 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 861) took 1694 ms. Trace:
W20260709 12:11:40.859880 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47615.8us
I20260709 12:11:40.869712 22119 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:40.874271 26670 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:40.874845 26635 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:40.871847 26566 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.875380 26635 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:40.875495 26566 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.877456 26635 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:40.877772 26575 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.882167 26670 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:40.883344 26611 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.883142 26670 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.885659 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:40.886404 22115 raft_consensus.cc:2368] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13.
I20260709 12:11:40.886475 26665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45124 (request call id 2) took 1653 ms. Trace:
I20260709 12:11:40.886915 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:40.889077 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:40.890055 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:40.890829 22119 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:40.898851 22118 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:40.854068 26689 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.862668 22197 rpcz_store.cc:276] 0709 12:11:39.168222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.168411 (+   189us) service_pool.cc:224] Handling call
0709 12:11:39.189674 (+ 21263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.196713 (+  7039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.196742 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:40.391052 (+1194310us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b2c00000448. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:11:40.391680 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 12:11:40.806894 (+415214us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:40.806941 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.807050 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.858597 (+ 51547us) raft_consensus.cc:1685] finished
0709 12:11:40.858614 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.862101 (+  3487us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6492,"raft.queue_time_us":6973,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":15662,"spinlock_wait_cycles":7887616,"thread_start_us":411211,"threads_started":1,"wal-append.queue_time_us":416578}
I20260709 12:11:40.900362 22270 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:11:40.915016 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:40.902261 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:40.848224 26325 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:40.912927 22123 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:40.840741 26606 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:40.872010 26636 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:40.922840 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57048.9us
I20260709 12:11:40.877476 26566 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:40.884023 26714 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:40.941692 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:11:40.949945 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.964622 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 103610us
I20260709 12:11:40.969937 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:40.971140 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:40.972095 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:40.979686 22831 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:40.990154 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 181026us
I20260709 12:11:41.000648 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.006108 22190 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:41.006511 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.006978 22264 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:40.976517 22193 raft_consensus.cc:2955] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 3 to 8, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:41.008427 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:41.008643 22190 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:41.010560 22269 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:40.916265 26576 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:11:41.044066 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:40.976122 26635 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:41.016317 22196 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:41.011018 22265 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:41.018792 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:41.012930 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:41.047567 22194 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.044737 22271 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:41.033914 26286 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.052820 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.053767 22197 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:40.993198 26647 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:41.054435 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:40.976454 26456 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:11:40.944408 26636 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.067619 22265 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:41.049717 26635 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.083019 22123 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:41.083547 22123 pending_rounds.cc:85] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 5
I20260709 12:11:41.083858 22123 pending_rounds.cc:107] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:41.084183 22123 raft_consensus.cc:2889] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:41.087880 22266 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:11:41.088469 22266 pending_rounds.cc:85] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 5
I20260709 12:11:41.088702 22266 pending_rounds.cc:107] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 7.6
W20260709 12:11:41.087863 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 110400us
I20260709 12:11:41.089108 22266 raft_consensus.cc:2889] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:41.090699 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:41.093194 22194 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:11:41.060010 26625 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:41.106564 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:41.111675 22236 leader_election.cc:400] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13.
I20260709 12:11:41.112218 22236 leader_election.cc:403] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:41.114331 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:41.088047 26709 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.811s	user 0.006s	sys 0.000s
I20260709 12:11:41.110500 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.123315 26735 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:41.127089 26754 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:41.127470 22271 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:11:41.121470 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:41.087174 26635 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:41.143469 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.105934 26608 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.108318 26575 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:40.887190 26665 rpcz_store.cc:276] 0709 12:11:39.233235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.233372 (+   137us) service_pool.cc:224] Handling call
0709 12:11:39.254463 (+ 21091us) log.cc:844] Serialized 508 byte log entry
0709 12:11:39.931037 (+676574us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b18003d9360. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:11:40.886322 (+955285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54316,"raft.queue_time_us":52006,"raft.run_cpu_time_us":626,"raft.run_wall_time_us":627,"spinlock_wait_cycles":49329536,"thread_start_us":340355,"threads_started":2,"wal-append.queue_time_us":333255}
I20260709 12:11:41.109033 26636 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.105973 26647 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:41.113380 26690 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:41.121333 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 149312us
I20260709 12:11:41.113020 26712 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13.
I20260709 12:11:41.153793 26575 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:41.162014 26575 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.163064 26466 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:41.163553 26466 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:41.150370 26576 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.165133 26576 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.167589 26576 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.063210 26325 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.106587 26720 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 12:11:41.156927 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 172874us
I20260709 12:11:41.137629 26727 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:41.172250 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:41.163415 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:41.116933 26745 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.175560 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:41.184155 22123 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.192107 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.192830 22266 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:41.150583 26735 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:11:41.202322 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 90533.4us
I20260709 12:11:41.212926 26625 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:41.214316 26625 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.216151 26609 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:41.218137 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45989us
I20260709 12:11:41.219267 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:41.220631 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:41.195901 22860 raft_consensus.cc:606] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:41.172901 26690 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:41.223352 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.203043 22007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f86b841ece254f9bbfd1bd07c08f7004 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 12:11:41.185693 26711 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.156286 26608 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.190114 26757 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.240154 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:41.235033 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 155174us
I20260709 12:11:41.253485 26754 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.256285 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:41.226863 26751 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.227558 26690 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:41.263819 26744 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:11:41.266937 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 719) took 1002 ms. Trace:
W20260709 12:11:41.270067 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 94577us
I20260709 12:11:41.267493 22114 rpcz_store.cc:276] 0709 12:11:40.264990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.265146 (+   156us) service_pool.cc:224] Handling call
0709 12:11:40.265552 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:40.859202 (+593650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:40.859223 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:40.878250 (+ 19027us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.023453 (+145203us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:41.023504 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.023588 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:41.266649 (+243061us) raft_consensus.cc:1685] finished
0709 12:11:41.266677 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.266858 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":593225,"raft.queue_time_us":595000,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4730,"thread_start_us":144757,"threads_started":1,"wal-append.queue_time_us":268338}
I20260709 12:11:41.242619 22123 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:41.194113 26725 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:11:41.164647 26466 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.237447 26745 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.262593 26751 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.295718 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:41.295918 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:41.296468 26566 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:41.297405 26747 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:41.297240 26566 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.245463 26636 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:11:41.299044 26737 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.299590 26737 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.300222 26566 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.294235 26638 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:41.301079 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:41.301550 26638 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.302851 26751 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.243717 26741 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.306048 26741 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.308195 26741 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.261317 26757 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.310524 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:41.310904 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 715) took 1074 ms. Trace:
I20260709 12:11:41.311324 22117 raft_consensus.cc:2376] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9. Re-sending same reply.
I20260709 12:11:41.313014 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:41.316742 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:41.318674 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:41.320760 22118 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:41.225296 26609 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:41.321063 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 81032us
I20260709 12:11:41.321664 22117 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:41.311685 22122 rpcz_store.cc:276] 0709 12:11:40.236289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.246652 (+ 10363us) service_pool.cc:224] Handling call
0709 12:11:40.256255 (+  9603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:40.880991 (+624736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:40.881032 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:40.881530 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.047060 (+165530us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:41.243062 (+196002us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.293306 (+ 50244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.293427 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:41.310528 (+ 17101us) raft_consensus.cc:1685] finished
0709 12:11:41.310556 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.310731 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":656926,"prepare.queue_time_us":116736,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":701392,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5358,"thread_start_us":291937,"threads_started":2,"wal-append.queue_time_us":271935}
I20260709 12:11:41.329658 26727 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:41.331522 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:41.358289 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.363688 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.364720 22266 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:41.365085 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:41.366882 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 77365.1us
I20260709 12:11:41.375227 26637 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:41.375754 26637 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:41.376005 26757 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.377777 26757 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.378294 26757 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.369441 26636 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:41.379899 26637 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.380633 26636 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:41.381224 26637 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.381654 26636 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:41.384976 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59994.9us
I20260709 12:11:41.386106 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.388973 26714 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:41.389910 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.390864 22272 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:41.392500 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:41.397255 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.256623 26711 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.438863 22120 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:41.333348 26712 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:41.441025 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:41.364549 26727 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:41.428930 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.364365 26566 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:41.448817 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:41.411561 26757 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.388286 26690 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.454038 22117 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:41.458815 22118 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:41.389793 26617 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:41.417621 26286 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:41.470723 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65288.4us
I20260709 12:11:41.414152 26735 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:41.419596 26629 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.290078 26647 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:41.463696 26611 consensus_meta.cc:287] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.580s	user 0.013s	sys 0.001s
I20260709 12:11:41.454268 26727 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:41.444679 26758 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:41.391054 26718 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:11:41.463975 26745 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.470227 26617 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.514278 22866 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:41.474822 26738 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:41.530331 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.531252 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:41.507601 26764 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:41.538013 26738 raft_consensus.cc:993] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
W20260709 12:11:41.538434 26760 log.cc:927] Time spent T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 12:11:41.538826 26754 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.541867 26763 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.514330 26263 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:41.546907 26383 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.522289 26745 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.524745 26617 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.489279 26629 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.488545 26286 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:41.553457 26733 consensus_meta.cc:287] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.006s
I20260709 12:11:41.485476 26735 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.585253 22272 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:41.564136 26363 raft_consensus.cc:1081] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:41.589254 26609 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.575472 26263 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:41.577536 26689 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.005s
W20260709 12:11:41.594806 26767 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:11:41.564697 26764 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.595763 26629 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.596356 26690 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:41.566196 26383 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.597043 26383 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.566491 26745 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.563057 26712 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.599526 26712 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.600843 26286 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.600972 26711 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:41.604173 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.605389 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:41.571907 26754 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.613740 26754 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.572330 26727 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.615386 26727 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.572714 26763 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.547998 26323 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:11:41.612515 26263 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.574811 26714 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:41.612568 26575 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.622283 26714 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.622646 26751 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.624050 26575 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.624389 26714 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:41.605502 26733 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:41.626086 26733 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.626982 26617 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:41.646653 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 187453us
I20260709 12:11:41.620607 26763 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.651557 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:41.654783 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:41.656178 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:41.656948 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 264529us
W20260709 12:11:41.662530 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.662755 22263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:11:41.663437 22263 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:41.663810 22263 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.671953 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.672945 22270 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:41.675009 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.675800 22270 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:41.681505 26617 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.667801 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.683580 26383 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.686190 26566 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:41.688915 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.689802 26733 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:41.650363 26635 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.693153 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.693866 22271 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:41.598795 26764 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.696099 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:41.696357 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:41.696924 22123 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:41.665102 26751 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.688524 26638 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.694197 26712 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.708798 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.726459 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:41.726244 22263 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.727402 22267 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.702316 26764 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.729846 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:41.729765 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:41.730522 22860 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:41.730783 22264 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:41.698860 26780 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:41.737442 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:41.708137 26635 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.750504 22271 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.754881 22263 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.756131 26789 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.749701 22237 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:41.735430 26764 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.761471 26782 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:41.762115 26782 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.762943 26764 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.764307 26782 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.767062 26712 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:41.767517 26712 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.767856 26712 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:41.770002 26753 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.567s	user 0.000s	sys 0.004s
I20260709 12:11:41.785753 26608 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:41.789925 22271 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:11:41.793949 26383 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.795312 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:41.795974 22860 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:41.796357 22860 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:41.797308 22860 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.798522 22860 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.768476 26735 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:41.807902 22265 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:41.810591 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.756834 26789 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.813766 26789 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.819092 22267 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
W20260709 12:11:41.819787 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 399707us
W20260709 12:11:41.826231 26761 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.568s	user 0.003s	sys 0.002s
I20260709 12:11:41.826422 26782 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:41.827139 26782 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.758490 26780 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.831719 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.830653 26764 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:41.833321 26782 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.834597 26780 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.817034 26635 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:41.855319 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.869695 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:41.870530 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:41.871225 22116 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.872303 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:41.873005 22267 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.881026 26741 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:41.881883 26741 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:41.883040 26741 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.865098 26635 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.886435 26635 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.892099 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:41.893790 26733 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.894568 26745 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.896159 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:41.897320 26733 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:41.897832 26733 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:41.898321 26733 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.858587 26325 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.906700 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:41.915027 22117 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:41.934321 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.915511 22860 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:41.914389 26635 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.859869 26286 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:11:41.940903 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:41.926431 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:41.941803 22866 raft_consensus.cc:1813] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Handling vote request from an unknown peer ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:41.942024 22192 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:41.901741 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:41.943186 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.944010 22198 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:41.946066 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:41.946511 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:41.949584 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:41.950307 22268 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.860510 26764 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.953073 26776 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.953253 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.953383 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:41.953653 26776 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.954262 26780 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.954474 26764 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.955354 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.955874 26776 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.956532 26712 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:41.959226 26712 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:41.930997 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:41.961133 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.932093 22115 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:41.933017 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.933393 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.963136 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:41.963310 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:41.937985 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.938279 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:41.964072 22190 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:41.964372 22117 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:41.922410 26745 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:41.939994 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:41.972087 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:41.960986 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.961067 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:41.936007 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.926142 22116 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:41.973500 22194 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:41.964974 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:41.974251 22190 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.974551 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:41.975214 22194 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.964629 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.980007 22197 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:41.965655 22866 raft_consensus.cc:2393] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:41.966308 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.967262 22114 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:41.967545 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:41.967897 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:41.984701 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:41.987679 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 109211us
I20260709 12:11:41.988534 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:41.989914 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:41.991868 22267 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:41.994716 22237 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:41.971175 22268 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:41.972013 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:41.997542 22087 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:42.000962 22272 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:42.001726 22190 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:41.956511 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:41.936312 22196 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:42.004792 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:42.005458 22865 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:42.005542 22189 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:42.007017 22121 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:42.008829 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:42.020179 22194 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:11:41.966925 26635 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:41.986924 26782 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.004390 26745 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.002862 26751 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:42.044922 26751 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.045349 26751 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:42.004949 26566 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:42.049355 26566 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:42.049845 26566 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:42.052094 22192 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:42.003113 26636 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.041057 26727 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:42.055065 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50373.3us
I20260709 12:11:42.055230 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:42.055719 22865 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:42.056145 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:42.003872 26638 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:11:42.072304 22237 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:42.070019 26735 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:42.074692 26735 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.075897 26737 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:42.074741 26608 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:42.083755 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:42.003750 26712 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:42.086673 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.090454 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.035859 26645 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:11:42.067970 26727 raft_consensus.cc:2764] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:11:42.094926 22192 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:42.094471 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.053527 26789 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.115943 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.116307 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:42.117280 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.118675 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.124075 22192 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.075897 26788 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.095888 26608 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:42.103292 26784 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:11:42.141254 26727 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.142315 26788 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:42.164129 26635 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.159696 26727 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:42.183856 26793 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:11:42.179955 26788 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.173619 26608 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.210784 26727 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:42.218200 22861 raft_consensus.cc:2393] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:42.097038 26712 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:42.233134 26712 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.241746 26789 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.258803 26751 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.262744 26751 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.336813 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:42.340559 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:42.352483 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:42.354265 22114 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.354885 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:42.355942 22121 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:42.358672 22117 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:42.383133 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:42.270954 26566 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.277695 26733 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:42.434886 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:42.453953 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 62483.3us
I20260709 12:11:42.501962 26727 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.502070 26635 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:42.503101 26727 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.504928 26638 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:42.514119 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:42.522727 22268 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:42.536478 26629 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:42.538787 26741 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.541549 22114 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:42.541378 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:42.546351 26608 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:42.541963 26745 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.544668 22162 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:42.547358 26608 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.551154 26805 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:42.550706 26617 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:42.551734 26805 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.552248 26805 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:42.553045 26733 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:42.553457 26741 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:42.555547 26718 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:42.555964 26718 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:42.551043 26566 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.562458 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:42.581534 26782 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:42.582742 26782 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.588192 26718 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.593330 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:42.601622 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 145452us
I20260709 12:11:42.604040 26712 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:42.605129 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 133141us
I20260709 12:11:42.605898 26737 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.606140 26782 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.617916 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:42.604403 26718 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.561894 26635 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:42.645458 26734 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:42.646044 26734 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.646413 26635 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.647481 22114 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:42.607738 26608 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:42.614197 26751 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:42.615311 26809 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.615511 26638 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:42.591614 26808 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:42.613696 26566 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:42.631098 26775 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.091s	user 0.024s	sys 0.022s
W20260709 12:11:42.661095 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.661543 26751 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.630915 26712 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.616864 26144 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:11:42.632967 22267 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.636170 26733 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.677305 26733 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:42.617072 26636 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.012s
I20260709 12:11:42.680989 26636 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.654989 26809 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.684016 26809 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.639508 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:42.685045 22192 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.560s	user 0.015s	sys 0.000s
W20260709 12:11:42.685247 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46002.4us
I20260709 12:11:42.685489 22192 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:42.684019 22268 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:42.689122 26608 raft_consensus.cc:2764] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:11:42.680402 26733 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:42.668308 26751 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.654783 26638 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:42.719380 26783 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.720237 26783 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.720332 26638 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.722127 26638 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:42.706984 26801 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
I20260709 12:11:42.668912 26782 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:42.673127 26812 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:42.692378 26566 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.697026 26808 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.698180 26791 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:42.702296 26805 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:42.705701 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.646431 26734 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.706760 26712 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:42.684674 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:42.714569 26758 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:42.715799 26606 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:42.717077 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:42.750798 26812 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.744621 26733 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:42.758730 26774 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.001s	user 0.019s	sys 0.030s
I20260709 12:11:42.758947 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.758981 26808 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:42.760923 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:42.760732 26809 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.762002 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.763350 26791 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.764462 26803 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:42.765682 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:42.765995 26566 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.803752 26783 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:42.767405 26735 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:42.768167 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.768435 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.822278 22271 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:42.773701 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:42.823935 22197 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.826381 26805 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.827116 22191 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:42.787437 22267 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:42.752346 26737 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.831041 26737 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.767422 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:42.804237 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 141551us
I20260709 12:11:42.834956 26812 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.835762 26803 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.837357 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:42.839260 26791 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:42.841223 26737 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:42.809404 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.748749 26608 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:42.813032 26751 raft_consensus.cc:2764] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:42.788467 26745 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:42.751197 26782 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.843322 22198 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:42.843039 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:42.844070 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:42.844736 26812 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.808255 26606 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.793015 26758 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.817516 26712 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.842555 22194 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:42.868660 26745 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.852903 26791 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:11:42.873224 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:42.874540 26791 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:42.875267 26791 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:42.877079 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:42.878027 22267 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:42.879249 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:42.880162 22270 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:42.882630 22194 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:42.863142 26808 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:42.884081 26808 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.884897 26733 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.885802 22265 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:42.886330 26808 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.886916 26733 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:42.887544 26782 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.888382 26782 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:42.888458 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:42.889643 22263 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:42.889487 26782 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.892395 26782 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:42.890102 26803 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:42.904345 22195 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:42.937120 22118 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:42.899791 26566 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:42.910290 26805 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.939662 26805 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.941325 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:42.876696 26791 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:42.904001 26734 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.905766 26712 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:42.903692 26608 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:42.961305 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 112729us
I20260709 12:11:42.965652 22858 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:42.969875 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 126033us
I20260709 12:11:42.975881 26805 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:42.977931 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:42.978756 22270 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:42.985885 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:42.986805 22122 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:42.998024 26606 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:42.998643 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.003136 22861 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:42.978814 22265 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:43.003567 22865 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:43.018630 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.019546 22267 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:43.019250 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:43.029559 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.033686 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:43.034724 22192 raft_consensus.cc:2368] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:43.031988 26825 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:43.041782 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.042042 26825 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.040730 22191 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:43.031934 26735 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:43.039382 26809 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:43.059633 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.062927 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:43.072134 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.076716 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.084254 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:43.087582 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.090281 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:43.091182 26824 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:43.091849 26824 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.078409 26745 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:43.094507 26824 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:43.095335 26824 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:43.095979 26824 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:43.096827 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.098192 22190 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:43.096840 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:43.099941 26456 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:43.100039 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:43.100405 26456 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.100751 26456 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.061578 26737 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:11:43.112341 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:43.112583 26608 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:43.113332 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.114789 26825 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:43.117517 22197 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:43.107578 26727 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:43.126616 26823 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:11:43.128918 26665 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.130218 26712 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:43.118810 26734 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:43.140201 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 82771.2us
I20260709 12:11:43.129097 22116 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:43.081928 26735 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:43.148155 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 183391us
I20260709 12:11:43.148451 22858 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:43.149058 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:43.149936 26811 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:43.150439 26811 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:43.150898 26811 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:43.151306 26822 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:11:43.149585 26780 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:43.146458 26608 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.154500 26608 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:43.159053 26734 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.163038 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:43.163969 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:43.166265 22021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 140) took 14728 ms (client timeout 15000 ms). Trace:
I20260709 12:11:43.164011 26734 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:11:43.149652 26735 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:43.181228 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.170310 26758 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.188740 22115 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:43.194803 26609 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:43.184695 26466 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.185572 26758 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:43.206023 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:43.209995 22191 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:43.238183 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.220233 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:43.248755 22195 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:11:43.249892 22121 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:43.248062 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.253270 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.216293 26832 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.255877 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.217123 26745 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:43.265094 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64443.6us
I20260709 12:11:43.211182 26617 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:11:43.263101 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.267976 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.270391 22190 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:43.268654 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.274180 22087 leader_election.cc:400] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:43.274537 22087 leader_election.cc:403] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:43.277307 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.277415 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.216910 26780 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:11:43.288668 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:43.262651 26824 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:43.290637 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:43.290367 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.293980 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:43.170307 22021 rpcz_store.cc:269] 0709 12:11:28.438124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.438314 (+   190us) service_pool.cc:224] Handling call
0709 12:11:43.165971 (+14727657us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:40.436933 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:40.439078 (+  2145us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:40.439118 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:11:40.439133 (+    15us) tablet.cc:662] Decoding operations
0709 12:11:40.440316 (+  1183us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:40.440373 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:40.440408 (+    35us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:11:40.454529 (+ 14121us) tablet.cc:701] Row locks acquired
0709 12:11:40.454559 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:11:40.454825 (+   266us) write_op.cc:270] Start()
0709 12:11:40.455024 (+   199us) write_op.cc:276] Timestamp: P: 1783599100454742 usec, L: 0
0709 12:11:40.455054 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:11:40.456155 (+  1101us) log.cc:844] Serialized 4078 byte log entry
0709 12:11:41.074439 (+618284us) op_driver.cc:464] REPLICATION: finished
0709 12:11:41.556576 (+482137us) write_op.cc:301] APPLY: starting
0709 12:11:41.556693 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:41.780680 (+223987us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:41.807168 (+ 26488us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:41.920620 (+113452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:41.922980 (+  2360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:11:41.923042 (+    62us) write_op.cc:312] APPLY: finished
0709 12:11:41.923403 (+   361us) log.cc:844] Serialized 97 byte log entry
0709 12:11:41.924408 (+  1005us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:41.924594 (+   186us) write_op.cc:454] Released schema lock
0709 12:11:41.924674 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:41.925130 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:41.925187 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5103413,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":452754,"apply.run_cpu_time_us":16417,"apply.run_wall_time_us":376923,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45947,"num_ops":10,"prepare.queue_time_us":189335,"prepare.run_cpu_time_us":90663,"prepare.run_wall_time_us":298728,"raft.queue_time_us":157209,"raft.run_cpu_time_us":34899,"raft.run_wall_time_us":478784,"replication_time_us":602064,"thread_start_us":855421,"threads_started":4,"wal-append.queue_time_us":311710,"wal-append.run_cpu_time_us":12993,"wal-append.run_wall_time_us":2198061}]]}
I20260709 12:11:43.285887 26832 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:43.302960 26777 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:11:43.305006 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:43.305665 22120 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.306710 22020 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 10, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 10 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:43.308840 22020 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 10, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 10 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:43.313136 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:43.313336 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:43.307152 26811 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:43.311098 22020 catalog_manager.cc:5697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:43.318408 26832 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:43.319845 26831 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:11:43.321226 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:43.324646 26835 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:11:43.331532 26826 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.238s	user 0.004s	sys 0.000s
I20260709 12:11:43.332998 22272 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:11:43.333777 26827 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.235s	user 0.001s	sys 0.003s
I20260709 12:11:43.335496 26825 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:43.338495 26608 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:43.333428 22120 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
W20260709 12:11:43.347476 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 128369us
I20260709 12:11:43.316427 26811 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:43.315830 22020 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:43.361681 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 48668.9us
I20260709 12:11:43.365710 26151 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:11:43.385453 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:43.391745 26813 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:43.392699 26813 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:43.387238 22163 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:43.388919 22020 catalog_manager.cc:5697] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:43.394843 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:43.411129 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 138956us
I20260709 12:11:43.398715 26606 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:43.420763 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44416.9us
I20260709 12:11:43.396759 26638 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.422109 22861 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:11:43.422168 26606 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:43.435915 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:43.430421 26780 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:43.407186 26456 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:43.449295 26263 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:43.450117 26325 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.450764 26325 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:43.456854 26813 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.441602 26606 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.442947 26811 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:43.431922 22020 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 9 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:43.481056 22121 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:43.445350 26638 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.472949 26780 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:11:43.495242 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.473137 26842 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:43.506224 26638 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:43.521261 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 88511.8us
I20260709 12:11:43.510128 22020 catalog_manager.cc:5697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:43.516503 22162 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:43.483752 26745 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:43.526386 22020 catalog_manager.cc:5697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 9 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:43.527534 26638 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:43.532598 22117 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:43.492789 26832 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.515476 26617 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:43.540678 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.539973 22020 catalog_manager.cc:5697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 9, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 9 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:43.542738 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:43.542547 22020 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 9 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:43.544473 26780 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.546041 26849 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.515523 26840 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:43.549914 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:43.544222 22020 catalog_manager.cc:5697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:43.537865 26842 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:43.553295 26609 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:11:43.564419 26286 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:43.551126 26840 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:43.605227 22195 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:43.605834 22195 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:43.605885 26840 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.564919 26606 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.607318 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.607726 22194 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:43.607992 22191 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:11:43.569067 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.579113 26325 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:43.579831 26719 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:43.609032 22197 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:43.581462 22192 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:43.584367 22116 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:43.589121 26825 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.610466 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:43.610653 26825 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.611932 26833 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.612370 26833 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.591835 26456 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:43.612727 26833 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.613315 26825 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:43.606963 22195 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:43.594720 22119 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:43.593506 22020 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 10 to 11, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:43.601660 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.539311 26617 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:43.572201 26832 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.557653 26263 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:11:43.616320 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.593489 26842 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.649170 26849 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:43.649813 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:43.651135 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.652186 22119 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:43.617570 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:43.617930 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.653282 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.621610 22117 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:43.622372 26812 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:43.610404 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.647706 26788 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:43.640225 22116 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:11:43.621012 26638 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:43.637974 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:43.653530 22195 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:43.654107 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.653105 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:43.641377 26286 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:43.661162 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:43.662128 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:43.662628 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:43.675141 22194 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:11:43.649252 22020 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:43.629613 26833 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.608749 26606 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:43.679733 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:43.688180 26608 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.690744 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.695387 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.696488 22119 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:43.698062 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:43.663678 26712 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:43.705070 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:43.709240 22263 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:11:43.716073 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.715489 26286 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:43.768365 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.684100 26813 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:43.680322 26737 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.773025 22020 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 9 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
W20260709 12:11:43.782593 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 145879us
I20260709 12:11:43.783854 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:43.784502 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.717125 26712 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:43.786165 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.786360 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.786681 26712 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.786854 26638 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:43.776759 26831 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:11:43.787449 26638 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.787863 26638 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.789028 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.773598 26813 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:43.807138 22020 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 12 to 14, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 14 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:43.808948 22831 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:43.825137 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.809384 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.776306 26737 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.812059 22088 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:43.807960 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 116624us
I20260709 12:11:43.856608 22020 catalog_manager.cc:5697] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:43.861644 22020 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 10 to 12, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 12 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:11:43.865751 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 71747.7us
I20260709 12:11:43.869100 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.871752 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:43.872602 22272 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:43.826186 26832 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:43.875809 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.876180 22114 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 14: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:43.811452 26840 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.877605 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.882426 22120 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:11:43.878119 26151 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.886809 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:43.868037 26811 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:11:43.878391 26789 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:11:43.879155 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 67235.2us
I20260709 12:11:43.879842 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.854202 26737 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.822326 26833 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:43.890339 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 210680us
I20260709 12:11:43.885958 22270 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:43.886241 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.889802 22271 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:43.893364 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:43.905944 22195 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:43.906620 22195 pending_rounds.cc:85] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 7
I20260709 12:11:43.876371 26635 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:43.889218 26151 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.889042 26745 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:43.921911 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:43.922508 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55090.2us
I20260709 12:11:43.883074 26809 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:43.920092 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:43.917919 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:43.907155 22195 pending_rounds.cc:107] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:43.927093 22268 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.927500 22195 raft_consensus.cc:2889] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.007900 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:43.910060 26832 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:43.922649 26151 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.024812 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:44.003239 26738 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.032485 22265 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:44.032332 26616 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 12:11:44.040380 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 129829us
I20260709 12:11:43.954581 26833 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:11:43.912866 26789 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:44.047645 22860 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:43.927955 26635 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:44.045359 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:43.941464 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:44.071497 22272 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
W20260709 12:11:44.073539 26323 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:11:44.075656 26635 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:44.026721 26809 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:44.096690 22268 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:44.028303 26832 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:44.040465 26738 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:44.106362 22123 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
W20260709 12:11:44.110620 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 65370us
I20260709 12:11:44.100536 26751 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:44.120106 22122 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:44.131945 22088 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:44.137722 26617 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:44.140182 26617 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.134250 26745 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:44.142625 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:44.143313 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:44.152551 26789 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:44.153419 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:44.156447 26809 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:44.161561 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:44.162246 22268 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.165505 26738 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:44.147970 26151 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:44.171281 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 229920us
I20260709 12:11:44.103139 26638 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:44.173419 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.172565 22865 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:44.177047 22268 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
W20260709 12:11:44.180049 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48209.2us
I20260709 12:11:44.181196 26727 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:44.181782 26727 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:44.181918 26865 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:11:44.182243 26727 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.181401 26825 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:44.191155 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:44.192292 22267 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:44.208688 26638 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:44.226666 22866 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
W20260709 12:11:44.915035 26737 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.001s	user 0.009s	sys 0.000s
I20260709 12:11:45.154098 26737 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:45.557307 26712 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.770s	user 0.011s	sys 0.004s
I20260709 12:11:45.609517 26151 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:45.610370 26737 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:45.611588 26840 consensus_meta.cc:287] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.724s	user 0.006s	sys 0.006s
W20260709 12:11:45.613823 22865 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 728) took 1686 ms (client timeout 1574 ms). Trace:
W20260709 12:11:45.614198 22865 rpcz_store.cc:269] 0709 12:11:43.928664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.928879 (+   215us) service_pool.cc:224] Handling call
0709 12:11:45.613615 (+1684736us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400434754. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:45.613724 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284632448}
W20260709 12:11:45.615876 26727 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.433s	user 0.010s	sys 0.000s
I20260709 12:11:45.605882 26712 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:45.616293 26727 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:45.634352 26712 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:45.638871 26727 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:45.737818 26813 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:45.739215 26813 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.749402 26832 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:45.811307 22115 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 12: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:45.818958 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 1062) took 1647 ms. Trace:
I20260709 12:11:45.819587 22264 rpcz_store.cc:276] 0709 12:11:44.171719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.172070 (+   351us) service_pool.cc:224] Handling call
0709 12:11:44.177430 (+  5360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.803323 (+1625893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.803358 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:45.804011 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 12:11:45.817098 (+ 13087us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:45.817141 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.817230 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.818462 (+  1232us) raft_consensus.cc:1685] finished
0709 12:11:45.818485 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.818710 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9296,"raft.queue_time_us":1622121,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":12596,"threads_started":1,"wal-append.queue_time_us":11791}
W20260709 12:11:45.843673 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.845541 26880 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:45.846742 26881 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:45.848946 26880 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:45.849081 26881 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:45.849594 26882 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:45.850365 26882 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:45.851696 26880 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:45.851779 26881 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:45.852602 26880 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:45.852689 26881 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:45.852641 26882 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:45.853725 26881 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:45.853677 26880 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:45.855645 26881 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:45.856475 26880 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:45.857671 26880 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:45.858206 26880 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:45.860080 26880 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:45.913049 26874 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.287s	user 0.006s	sys 0.000s
W20260709 12:11:45.969288 22238 connection.cc:256] RPC call timeout handler was delayed by -1.0786224260000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:11:45.976509 22866 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 682) took 1853 ms (client timeout 1526 ms). Trace:
W20260709 12:11:45.977077 22866 rpcz_store.cc:269] 0709 12:11:44.123342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.132586 (+  9244us) service_pool.cc:224] Handling call
0709 12:11:45.976203 (+1843617us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b5400840b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:45.976411 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93658880}
I20260709 12:11:45.977813 26884 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:45.987989 26866 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.890s	user 0.008s	sys 0.008s
I20260709 12:11:45.996083 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 753) took 2416 ms. Trace:
I20260709 12:11:45.978466 26884 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:45.997655 22118 rpcz_store.cc:276] 0709 12:11:43.580077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.766171 (+186094us) service_pool.cc:224] Handling call
0709 12:11:43.766489 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:43.766884 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.766910 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:43.767385 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.891537 (+124152us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:43.891577 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.891637 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.987257 (+2095620us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:45.992937 (+  5680us) raft_consensus.cc:1685] finished
0709 12:11:45.992969 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.995970 (+  3001us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1267,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":9519,"spinlock_wait_cycles":4058880,"thread_start_us":123796,"threads_started":1,"wal-append.queue_time_us":259767}
I20260709 12:11:45.999931 26884 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:46.000556 26884 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.001060 26884 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.003137 26884 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.003592 26884 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.004020 26884 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.006053 26884 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.006538 26884 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.006985 26884 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.011101 26884 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.015789 26880 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.016714 26880 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.018637 26727 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:46.013183 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 1.8284e+06us
W20260709 12:11:46.022414 22236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.581s (SENT) [suppressed 3 similar messages]
I20260709 12:11:46.019398 26727 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.022923 26882 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.030519 26824 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.030853 26882 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.031127 26824 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.031507 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:46.023492 26881 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.032534 22118 raft_consensus.cc:2410] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:46.033116 26881 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.035590 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:46.036178 26881 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.019447 26886 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.037101 26886 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.038146 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:46.025688 26825 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.040127 26825 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:46.027601 22123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2073) took 2217 ms (client timeout 1863 ms). Trace:
W20260709 12:11:46.042244 22123 rpcz_store.cc:269] 0709 12:11:43.809667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.859976 (+ 50309us) service_pool.cc:224] Handling call
0709 12:11:46.027279 (+2167303us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400214b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:46.027439 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496707456}
I20260709 12:11:46.044584 26886 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.047814 26881 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.048527 26881 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.050381 26825 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.051070 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 758) took 2437 ms. Trace:
I20260709 12:11:46.057813 22114 rpcz_store.cc:276] 0709 12:11:43.613512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.904300 (+290788us) service_pool.cc:224] Handling call
0709 12:11:43.921105 (+ 16805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.006767 (+ 85662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.006800 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:44.023171 (+ 16371us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:44.023226 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.050657 (+2027431us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b5400084654. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:46.050766 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.050983 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196117760}
I20260709 12:11:46.049607 26882 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.061890 26727 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.030092 26880 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.065203 26825 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.062975 26824 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.067327 26825 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.071277 26888 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.071905 26888 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.074582 26863 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.075222 26863 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.062465 26882 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.077113 26882 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.078284 26833 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.079084 26833 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.080156 26712 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.081137 26824 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.082185 26824 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.083307 26812 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.084628 26813 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.085180 26737 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.085419 26813 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.086246 26737 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.063549 26886 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.089329 26813 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.089800 26886 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.090176 26813 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.080852 26712 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:46.097045 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.066444 26880 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.091854 26832 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.099267 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.102774 26825 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:46.107851 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.091967 26813 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.111960 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2064) took 2500 ms. Trace:
I20260709 12:11:46.112421 22115 rpcz_store.cc:276] 0709 12:11:43.611109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.773855 (+162746us) service_pool.cc:224] Handling call
0709 12:11:46.111739 (+2337884us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b5400152a54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:46.111894 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4641285888}
I20260709 12:11:46.115471 26825 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:46.097463 26812 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.124151 26824 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:46.130018 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2595) took 1968 ms. Trace:
I20260709 12:11:46.130607 22272 rpcz_store.cc:276] 0709 12:11:44.161506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.164904 (+  3398us) service_pool.cc:224] Handling call
0709 12:11:44.165228 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:44.171228 (+  6000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.171266 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:44.176176 (+  4910us) log.cc:844] Serialized 26 byte log entry
0709 12:11:46.093503 (+1917327us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:46.125223 (+ 31720us) log.cc:844] Serialized 14 byte log entry
0709 12:11:46.129629 (+  4406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.129762 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.129809 (+    47us) raft_consensus.cc:1685] finished
0709 12:11:46.129819 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.129951 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1633521,"raft.queue_time_us":11844,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":1328,"thread_start_us":56492,"threads_started":2,"wal-append.queue_time_us":1878245}
I20260709 12:11:46.130355 26884 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.105618 26880 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.106338 26832 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.151827 26880 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.152410 26880 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.141377 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.145066 26886 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.145917 26833 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.146817 26882 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.154997 26882 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.155534 26882 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.157763 26882 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.158258 26882 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.158710 26882 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.147361 26737 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.147837 26881 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.148931 26712 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:46.149724 26890 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.161829 26890 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:46.163872 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 2.34168e+06us
I20260709 12:11:46.163980 26890 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.180809 26880 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.160725 26882 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.246495 26890 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:46.246389 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 52486.1us
I20260709 12:11:46.247222 26890 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.249745 26890 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.250284 26832 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.251633 26813 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.260113 26883 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.261586 26886 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.262579 26892 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.263150 26892 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.266173 26892 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.266698 26892 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.267280 26848 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:46.267150 26892 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.267803 26848 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.271113 26888 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.275125 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:46.275686 26882 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.276018 22266 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:46.276235 26882 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.278090 26791 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.278854 26791 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:46.281230 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 112879us
I20260709 12:11:46.283016 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.246261 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.293407 26863 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:46.294405 26456 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.294674 26812 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.292296 26665 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:45.940119 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:46.323549 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.278712 26882 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:46.345682 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 99533.3us
I20260709 12:11:46.330888 26813 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.348388 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.338251 26863 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.369233 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.370167 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.371048 22860 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:11:46.371768 22020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 257) took 12975 ms (client timeout 15000 ms). Trace:
I20260709 12:11:46.371837 26884 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:46.372534 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:46.373449 22271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.192s	user 0.022s	sys 0.017s
W20260709 12:11:46.373836 22271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.192s	user 0.022s	sys 0.017s
I20260709 12:11:46.373870 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.298746 26883 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.381501 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 2596) took 2213 ms. Trace:
I20260709 12:11:46.338652 26665 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:46.372439 22020 rpcz_store.cc:269] 0709 12:11:33.382386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.388889 (+  6503us) service_pool.cc:224] Handling call
0709 12:11:46.357244 (+12968355us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:44.128480 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:44.129206 (+   726us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:44.129261 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:11:44.129279 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:44.130769 (+  1490us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:44.130908 (+   139us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:44.130938 (+    30us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:11:44.132386 (+  1448us) tablet.cc:701] Row locks acquired
0709 12:11:44.168430 (+ 36044us) write_op.cc:260] PREPARE: finished
0709 12:11:44.168600 (+   170us) write_op.cc:270] Start()
0709 12:11:44.168798 (+   198us) write_op.cc:276] Timestamp: P: 1783599104168536 usec, L: 0
0709 12:11:44.168838 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:11:44.900307 (+731469us) log.cc:844] Serialized 6766 byte log entry
0709 12:11:45.651626 (+751319us) op_driver.cc:464] REPLICATION: finished
0709 12:11:45.653405 (+  1779us) write_op.cc:301] APPLY: starting
0709 12:11:45.653523 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:45.665941 (+ 12418us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:45.666059 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:45.677278 (+ 11219us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:45.677666 (+   388us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:11:45.677776 (+   110us) write_op.cc:312] APPLY: finished
0709 12:11:45.678249 (+   473us) log.cc:844] Serialized 156 byte log entry
0709 12:11:45.678803 (+   554us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:45.679007 (+   204us) write_op.cc:454] Released schema lock
0709 12:11:45.679101 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:45.679467 (+   366us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:45.679493 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14025,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":1331,"apply.run_cpu_time_us":20671,"apply.run_wall_time_us":26112,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75221,"num_ops":17,"prepare.queue_time_us":90451,"prepare.run_cpu_time_us":18593,"prepare.run_wall_time_us":1491937,"raft.queue_time_us":3477,"raft.run_cpu_time_us":1514,"raft.run_wall_time_us":1688,"replication_time_us":1482582,"thread_start_us":318256,"threads_started":4,"wal-append.queue_time_us":664301}]]}
I20260709 12:11:46.395254 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.381492 26892 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.383153 26863 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:46.406315 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.398141 22866 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:11:46.412273 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.413008 22865 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
W20260709 12:11:46.409832 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 150324us
I20260709 12:11:46.354841 26813 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.383381 22271 rpcz_store.cc:276] 0709 12:11:44.161840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.165588 (+  3748us) service_pool.cc:224] Handling call
0709 12:11:44.165858 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.166079 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:44.179275 (+ 13196us) log.cc:844] Serialized 14 byte log entry
0709 12:11:45.912317 (+1733042us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:46.375070 (+462753us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:46.375120 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:46.375178 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.375245 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.375354 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4720,"prepare.queue_time_us":13187,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":114,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":3675392,"thread_start_us":2193530,"threads_started":1,"wal-append.queue_time_us":1444502}
I20260709 12:11:46.417847 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:46.421128 26898 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:46.421622 26898 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.421782 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.423158 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.424077 26813 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.424350 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.426923 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.392891 26791 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:46.422005 26898 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.436023 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:46.439499 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 156735us
I20260709 12:11:46.440465 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.437337 26737 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.441159 22865 raft_consensus.cc:1813] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Handling vote request from an unknown peer ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.441242 26737 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.443100 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.444136 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:46.444391 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.444813 26833 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.445833 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.446981 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.446885 22017 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 6 to 7, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:46.448339 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.449059 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.449425 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.449702 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.451210 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:46.454221 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.454442 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.444988 22857 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:46.441782 22865 raft_consensus.cc:2410] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:46.456485 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.454896 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:46.421804 26884 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:46.461354 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:46.431799 26832 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:46.436930 26712 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.452129 22017 catalog_manager.cc:5697] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 4 to 6, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 6 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.452092 26824 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.470999 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:46.470999 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.476022 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:46.477010 22123 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.458516 26665 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.458822 26848 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.463759 26863 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.463743 26813 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:46.489552 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:46.488818 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.491329 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.492990 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.494143 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.469808 26895 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.477787 26880 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.502573 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.500613 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:46.513144 22864 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:11:46.523084 22017 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:46.525418 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.526094 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.537058 26323 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.537717 26323 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.538309 22017 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 7 to 8, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 8 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.543741 26606 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:46.540081 22017 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 6 to 7, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 7 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.545521 26883 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:46.551301 26900 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:11:46.530503 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.505757 26895 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.553041 26895 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.489029 26832 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:46.557178 26832 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:46.492245 26813 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.558147 26813 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.558224 26832 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.529814 22088 leader_election.cc:400] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:11:46.560945 22088 leader_election.cc:403] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:46.562346 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:46.601042 22123 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:11:46.544494 26606 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.621272 22017 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 7 to 10, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 10 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:46.626156 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.628003 22017 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 5 to 7, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 7 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.540081 26323 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.616844 26825 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.612920 26880 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
W20260709 12:11:46.636339 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.619601 26151 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:46.551340 26898 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.645970 26737 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.650241 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:46.654451 22163 connection.cc:256] RPC call timeout handler was delayed by -1.0314015609999387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 12:11:46.655066 26901 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:46.655622 26777 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.656054 26263 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.656108 26906 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.656677 26617 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.641816 26902 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.690548 22863 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:46.687958 26833 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.684556 26263 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.702951 26263 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.684564 26777 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.706248 26777 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.686738 26617 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.709123 26617 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:46.666797 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 205504us
W20260709 12:11:46.669335 22163 connection.cc:256] RPC call timeout handler was delayed by -1.0314015609999387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 12:11:46.659821 26323 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.717137 26323 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.659591 26840 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.661809 26286 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.669871 26151 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.685767 26906 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.685912 26901 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:46.746078 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 107893us
I20260709 12:11:46.719806 26323 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.755795 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:46.757583 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.722218 26151 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.691319 26902 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.720607 26840 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.754352 26805 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.765508 26718 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:46.778633 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51624.8us
I20260709 12:11:46.781426 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.765877 26323 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:46.785614 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:46.786504 22267 raft_consensus.cc:2368] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:46.787016 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.787554 22263 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:46.785754 22270 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:46.787815 22271 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:46.720959 26286 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:46.795593 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45197.2us
I20260709 12:11:46.795944 26909 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:46.796416 26909 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:46.780567 26718 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.796967 26909 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.809620 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.810722 22271 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:11:46.775375 22197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:46.815178 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.789594 26916 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.822266 22271 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:46.823314 22270 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:46.824303 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.779242 26805 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.797816 26323 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.828446 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:46.829428 22192 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.826601 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.831028 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.831629 22195 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:46.830248 22271 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:46.838397 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.835525 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.821127 26606 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.840921 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.849903 22191 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:46.849692 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.853546 22196 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:46.855857 22198 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:46.817332 26813 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:46.857287 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.850468 22271 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:46.858799 22189 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:11:46.836221 26898 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.862288 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.862573 26805 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:46.862884 22887 debug-util.cc:398] Leaking SignalData structure 0x7b08001136e0 after lost signal to thread 20894
I20260709 12:11:46.863595 26286 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.864262 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.864903 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.862229 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.865866 22263 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:46.867399 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:46.868637 22887 debug-util.cc:398] Leaking SignalData structure 0x7b080005a1c0 after lost signal to thread 22055
I20260709 12:11:46.870108 22192 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:11:46.873517 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.876543 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:46.878381 22887 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2d80 after lost signal to thread 22147
W20260709 12:11:46.878980 22887 debug-util.cc:398] Leaking SignalData structure 0x7b08000f67a0 after lost signal to thread 22148
W20260709 12:11:46.880472 22887 debug-util.cc:398] Leaking SignalData structure 0x7b08003034c0 after lost signal to thread 22222
W20260709 12:11:46.885672 22887 debug-util.cc:398] Leaking SignalData structure 0x7b08003034a0 after lost signal to thread 22223
W20260709 12:11:46.886413 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 266599us
I20260709 12:11:46.895318 22117 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:46.896606 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:46.897578 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.907259 22192 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:46.899106 26906 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.899341 22198 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:46.828375 26916 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:46.909054 26323 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.911861 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.913194 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.914506 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.915218 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.919152 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:46.921092 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:46.922137 22267 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:46.934725 22197 raft_consensus.cc:606] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.940186 22197 raft_consensus.cc:614] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:46.923092 22269 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:46.940251 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.923691 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.934669 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.923827 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:46.924357 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.925559 22268 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:46.937132 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.938390 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.926430 22272 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:11:46.926441 26918 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:11:46.928826 26901 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.933702 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.930347 22114 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:46.931962 22123 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:46.944491 22264 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:46.906891 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:46.900599 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52006.4us
I20260709 12:11:46.945087 22270 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.941500 22191 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
W20260709 12:11:46.945696 22887 debug-util.cc:398] Leaking SignalData structure 0x7b080024cb20 after lost signal to thread 22296
W20260709 12:11:46.946069 22887 debug-util.cc:398] Leaking SignalData structure 0x7b0800379e60 after lost signal to thread 22297
I20260709 12:11:46.947638 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.939841 22263 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.942972 22196 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:46.943549 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.932574 26840 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.934243 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:46.953733 22862 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.945605 22163 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.933943 26718 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.953896 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:46.958251 22887 debug-util.cc:398] Leaking SignalData structure 0x7b080031d840 after lost signal to thread 22890
I20260709 12:11:46.963833 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.964519 22267 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:46.965361 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.965876 22267 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:46.969110 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:46.969787 22268 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 5.
I20260709 12:11:46.970247 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.971148 22264 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:46.971604 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.938755 22190 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:46.935869 26916 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:46.972889 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:46.937486 26902 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.974858 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2358) took 3048 ms. Trace:
I20260709 12:11:46.975303 22193 rpcz_store.cc:276] 0709 12:11:43.926586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.926724 (+   138us) service_pool.cc:224] Handling call
0709 12:11:43.954109 (+ 27385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.750635 (+2796526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.750669 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.753302 (+  2633us) log.cc:844] Serialized 26 byte log entry
0709 12:11:46.842916 (+ 89614us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:46.842957 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.843031 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.974603 (+131572us) raft_consensus.cc:1685] finished
0709 12:11:46.974630 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.974766 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2472934,"raft.queue_time_us":2595340,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":150,"thread_start_us":372178,"threads_started":2,"wal-append.queue_time_us":158280}
I20260709 12:11:46.978016 22269 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:46.979485 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:46.980144 22123 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:46.985611 22270 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:46.988899 26901 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:46.990590 22266 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:11:46.932744 26813 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:46.997076 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:46.991806 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:46.999526 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.000389 22266 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:47.005000 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.005437 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.005661 22114 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:47.005858 26882 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:47.006999 26902 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:47.007428 26921 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.007625 26902 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.007961 26921 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.009953 26902 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:47.010310 26921 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:47.010494 26902 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.010949 26921 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.011155 26902 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.011435 22830 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.011523 26921 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.013219 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.013983 22123 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:47.015056 26848 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:47.015441 26848 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:47.015797 26848 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.006153 22117 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:46.995812 26606 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:47.029016 22263 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:11:47.031405 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.032452 22114 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:47.036129 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.040725 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:47.042289 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.043267 22263 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:47.043749 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:47.047814 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.049506 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.051578 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.056027 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:47.056864 22197 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.057183 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:47.058071 22191 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:47.061003 26915 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.061847 26906 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:47.056092 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.061856 22191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:47.030838 26606 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:47.066924 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:47.065505 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:47.062459 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 72055.3us
I20260709 12:11:47.063778 22191 raft_consensus.cc:606] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:46.997589 26880 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:11:47.065887 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.068053 22265 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:47.071414 22197 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:11:47.069535 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:47.072157 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.073238 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:47.073472 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:47.003228 26901 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.076833 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:47.081351 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.082309 22114 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:47.083757 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.087195 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.088156 22114 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:47.100786 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:47.102660 22197 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:47.066926 26811 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:11:47.105484 26931 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:47.105682 26647 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:47.106173 26931 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:47.106767 26647 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:47.108912 26901 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:47.115968 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 59956.5us
W20260709 12:11:47.119792 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56357.4us
I20260709 12:11:47.120640 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:47.126993 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.129490 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.130214 22272 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:47.131160 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.131913 22267 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:47.132726 26718 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:47.106743 26931 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.133327 26718 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:47.134271 26718 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.137502 26606 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.138717 26840 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:47.141165 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.142294 22263 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:47.149394 26921 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.150820 26931 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.153606 26931 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:47.155601 22861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:47.170084 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.170894 22266 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:47.163539 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:47.172860 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 99783.9us
I20260709 12:11:47.173207 22862 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:47.174078 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.175081 22267 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:11:47.178622 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.178104 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.180680 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.181357 22265 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:47.182200 22270 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:47.176625 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:47.094348 26902 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.187260 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:47.188156 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:47.188218 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:47.189356 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.189917 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.192122 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:47.192324 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:47.189997 22272 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:11:47.193727 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.201081 26880 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:47.201689 26880 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:47.202656 26880 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.204363 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:47.195254 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:47.209195 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:47.217308 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:47.218878 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:47.219532 26931 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:47.220036 26931 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:47.220427 26931 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:47.218914 26895 consensus_meta.cc:287] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.665s	user 0.003s	sys 0.007s
I20260709 12:11:47.221992 26895 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.223191 22120 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:47.108204 26647 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.227814 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:47.220360 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.232877 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:47.250097 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.250895 22268 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:47.140558 26840 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:11:47.255219 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.260588 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:47.269110 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 74958.9us
I20260709 12:11:47.270308 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:47.271667 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:47.273831 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:47.274207 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.274554 22263 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:47.277820 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:47.228606 26902 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:47.280258 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:47.287317 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:47.277067 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.292472 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.294585 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.294486 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.255002 26895 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:47.300559 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.302109 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.192667 26882 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:11:47.307940 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.305341 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:47.309417 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.310109 22267 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:47.309759 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.318048 22272 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:47.321645 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:47.322701 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.323786 22268 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:11:47.288340 26902 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:47.363262 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53621.1us
I20260709 12:11:47.363930 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.364331 22830 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.357496 22163 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.364725 22266 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:11:47.330363 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.365777 22270 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
W20260709 12:11:47.366201 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 44673.6us
I20260709 12:11:47.304193 26920 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:47.304345 26887 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:47.303894 26905 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:47.304795 26813 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.313925 26926 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:47.373382 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:47.319607 26916 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:47.374775 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:47.378597 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.381574 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.308099 26791 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:47.374552 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 179386us
I20260709 12:11:47.371920 26840 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:47.439901 22087 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:47.398433 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.394615 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.395363 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.442016 22120 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:11:47.443794 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.448537 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.367357 26925 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.372416 26920 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:47.371685 26895 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:47.382488 22118 raft_consensus.cc:2410] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:47.383229 26938 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.397564 26902 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.402170 26901 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:47.488467 26901 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:47.489640 26901 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.376811 22265 raft_consensus.cc:2376] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14. Re-sending same reply.
W20260709 12:11:47.400300 26909 consensus_meta.cc:287] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.003s
I20260709 12:11:47.411115 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.396553 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.397115 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.396004 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:47.383256 26906 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:47.444937 26840 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.493431 26840 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.494658 22119 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:47.498242 22297 heartbeater.cc:646] Failed to heartbeat to 127.20.102.254:38171 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.102.254:38171 timed out after 15.000s (SENT)
I20260709 12:11:47.500006 26848 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.382575 26916 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.409919 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.397644 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:47.526477 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 116669us
I20260709 12:11:47.383350 26912 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:47.438459 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.376595 26926 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:47.379810 26665 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:47.474713 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:47.501680 26909 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:47.541833 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 172405us
I20260709 12:11:47.502442 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.378479 26914 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:47.506076 26902 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.473034 26920 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.550302 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.470292 26791 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:47.510354 26906 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:47.480762 26895 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:47.513320 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:47.572602 22271 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:47.514191 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.515650 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:47.574160 22264 raft_consensus.cc:2376] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12. Re-sending same reply.
I20260709 12:11:47.544607 26926 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.582943 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.451571 22087 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:47.528826 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.502566 22266 raft_consensus.cc:2368] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:47.545697 22268 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:47.449036 26940 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.585585 22265 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:47.546020 26665 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:47.586254 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.586341 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.547818 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:47.546456 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:47.508916 26938 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.558975 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:47.557912 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 83179.7us
I20260709 12:11:47.560019 22859 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:47.487336 26941 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:47.562688 22236 connection.cc:256] RPC call timeout handler was delayed by -1.9458388010000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 12:11:47.535086 26916 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.541590 26928 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:47.516345 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:47.517014 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:47.590864 22236 connection.cc:256] RPC call timeout handler was delayed by -1.827938801000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 12:11:47.590932 22861 raft_consensus.cc:606] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.592545 22121 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:47.587867 22123 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:47.593077 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.594969 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.595696 22116 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:11:47.591403 22269 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:47.597020 22117 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:47.572080 26906 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.592440 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.575225 26895 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.575349 26915 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:47.607350 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:47.600440 26946 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.126s	user 0.000s	sys 0.004s
I20260709 12:11:47.597838 26941 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:47.617735 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 58834.9us
I20260709 12:11:47.593334 26665 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.622575 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.583768 26931 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.606415 26915 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.630375 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.610136 26880 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:47.634588 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.635175 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.638221 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.639421 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.640313 26938 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.641453 26921 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.642179 26921 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:47.642802 26921 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.619869 26606 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.645277 26286 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:47.645750 26286 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.636734 26880 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.646077 26286 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.629580 26915 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.650957 26931 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:47.660835 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.652576 26941 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.662787 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:47.627051 26909 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:47.657711 26880 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:47.668293 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 216833us
I20260709 12:11:47.668871 26840 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.673346 26840 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.627430 26791 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.682225 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:47.684824 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45483.3us
I20260709 12:11:47.685662 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.694073 26880 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.709784 26916 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.710631 26880 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.700790 26848 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.703236 26286 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.705353 26901 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.712397 26916 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.713267 26286 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.722606 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:47.729009 26842 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:47.729583 26842 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.729945 26842 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.730326 22861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863b392474d94720808349fe27669b5b"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:11:47.731187 22861 raft_consensus.cc:606] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.731607 22861 raft_consensus.cc:614] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:47.735139 22191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:47.735963 22191 raft_consensus.cc:606] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:47.738258 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.738782 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:47.705924 26895 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.742892 26895 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:47.743680 26916 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:47.703552 26915 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.746814 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:47.748584 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.749173 26811 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:47.749436 26916 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.749594 26811 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:47.750496 26811 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.751852 26811 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.757601 26909 consensus_queue.cc:1059] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:47.758689 26825 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:47.759179 26825 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:47.760339 26825 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.762029 26825 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.769228 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.769918 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:47.771023 26916 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:47.771356 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:47.771577 26916 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.772059 26916 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:47.774737 26915 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.777418 26926 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.779757 26926 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.781733 26916 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.783182 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.783241 26665 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.787690 22119 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:47.789245 22864 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:47.789911 26813 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:47.791392 26909 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:47.792384 26909 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:47.792754 26909 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:47.793370 26665 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.793625 26909 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.794968 26909 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.796583 26811 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.797370 26906 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.797878 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:47.799108 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.728571 26921 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.812574 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:47.840967 26286 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:47.841851 26286 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:47.843885 22859 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:47.844877 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:47.845649 22272 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:47.847174 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 76186.4us
I20260709 12:11:47.850040 26880 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:47.850837 26880 consensus_queue.cc:1243] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:47.851413 22263 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:47.851320 26880 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:47.852738 26880 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:11:47.829751 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.854964 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:47.855216 26880 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:47.856500 26880 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:47.857561 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:47.857676 26880 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.858258 22269 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.859192 26880 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.806222 26811 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:47.832880 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 241305us
I20260709 12:11:47.862958 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.864239 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.865087 26832 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:47.865480 26832 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.865595 26957 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:47.865839 26832 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.866973 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:47.867169 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:47.867636 22263 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.853102 26941 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:11:47.799693 26906 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:47.855659 22266 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.873476 26957 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:47.874066 26957 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:47.874938 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:47.855228 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:11:47.830416 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 227554us
I20260709 12:11:47.876983 26832 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.877674 26951 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:47.877946 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:47.814728 26920 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.878588 22264 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:47.878793 26805 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:47.879220 26805 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:47.880124 22267 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:47.880080 26805 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.874954 26957 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.884881 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:47.885632 22195 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.886379 26920 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:47.887029 26832 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:47.889202 22191 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:47.894291 26926 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:47.895102 26926 consensus_queue.cc:1243] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:47.895609 26263 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:47.896016 26263 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:47.896829 26263 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:47.897367 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:47.898175 26263 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.897394 26805 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.900820 22264 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:11:47.901867 26718 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:47.787739 26916 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:47.911950 22272 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:47.914793 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:47.915838 26916 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:47.916492 26916 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:47.917593 26916 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.918583 22268 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:47.919819 22163 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:47.922333 26718 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:47.922897 26718 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:47.923774 26718 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:47.928520 22122 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:47.918329 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68506.7us
I20260709 12:11:47.935035 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:47.939285 22195 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:47.939782 26941 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:47.940798 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:47.942394 26647 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:47.943881 22266 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:11:47.944674 22269 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
W20260709 12:11:48.003463 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 385684us
I20260709 12:11:48.013892 22263 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:48.008975 26842 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:48.018457 26964 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.009s
I20260709 12:11:48.026089 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.029057 26950 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:48.029639 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:48.029664 26950 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:48.027688 26791 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.030776 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:48.031004 22195 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:48.031672 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.032312 26718 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:48.032930 26718 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:48.033049 26926 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:48.034039 26718 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:48.032956 26951 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:48.035735 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.035949 26951 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:48.036851 26951 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:48.011538 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 144441us
W20260709 12:11:48.021122 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.021886 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 81206.7us
I20260709 12:11:48.041947 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.030524 26950 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.049926 26901 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:48.051659 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.052232 26895 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:48.060424 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:48.060927 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:48.061662 22114 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:48.061748 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.062180 22117 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:48.062886 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:48.063462 22115 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.053809 26813 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:48.054242 26842 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:48.044081 22191 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 12. (term mismatch)
I20260709 12:11:48.041002 22163 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:48.067183 22191 pending_rounds.cc:85] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 11
I20260709 12:11:48.067574 22191 pending_rounds.cc:107] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 10.12
I20260709 12:11:48.067894 22191 raft_consensus.cc:2889] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:48.069172 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:48.070106 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.070498 22266 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:48.071025 22196 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:11:48.012975 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 67459.1us
I20260709 12:11:48.065521 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:48.071162 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:48.072153 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:48.073014 22118 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:48.022603 26941 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:48.075373 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.076467 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.078014 26882 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:48.089253 26882 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:48.089715 26882 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.077922 26938 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.060325 26895 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:48.090993 26895 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:48.092154 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.094684 22115 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:48.078922 26916 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:48.095892 26916 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:48.096932 26916 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:48.099332 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:48.100135 22120 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:48.101527 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.081449 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:48.068068 26931 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.102528 22118 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.104125 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:48.104424 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:48.115355 22117 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.106477 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:48.072531 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.101379 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:48.117241 22123 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.122062 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.127424 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.128820 22190 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:48.130825 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.132705 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.133381 22189 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:48.133950 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.133711 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.135893 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.144430 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:48.145661 22017 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 226) took 16404 ms (client timeout 15000 ms). Trace:
I20260709 12:11:48.073508 26880 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:48.149951 22193 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:11:48.152931 22196 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:11:48.151175 22198 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:48.105923 26941 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:48.153383 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47628.4us
W20260709 12:11:48.163033 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 86616.1us
I20260709 12:11:48.162233 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.174873 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.176353 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.178208 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.181856 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:48.182837 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 99942.1us
I20260709 12:11:48.119544 26940 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:48.181973 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:48.166095 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.169548 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.185480 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.186813 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.187170 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.189635 26825 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.190127 26825 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:48.190515 26825 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.181613 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.192533 22189 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:48.177090 26931 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.153806 26813 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:48.193827 22189 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:11:48.194959 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.195729 22190 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:48.197081 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.200707 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.150354 26938 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.205783 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.199685 26825 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.162971 26789 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.230448 22830 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:48.164103 26957 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:48.213712 22117 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:11:48.219965 22123 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:48.236004 22114 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:48.188282 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.163635 26880 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:48.240083 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.185403 26940 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:48.154326 22017 rpcz_store.cc:269] 0709 12:11:31.741765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.749126 (+  7361us) service_pool.cc:224] Handling call
0709 12:11:48.145563 (+16396437us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:46.842519 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:46.918664 (+ 76145us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:46.918701 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:11:46.918718 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:46.919528 (+   810us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:46.919587 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:46.919611 (+    24us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:46.920256 (+   645us) tablet.cc:701] Row locks acquired
0709 12:11:46.920268 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:11:46.944736 (+ 24468us) write_op.cc:270] Start()
0709 12:11:46.954729 (+  9993us) write_op.cc:276] Timestamp: P: 1783599106920370 usec, L: 0
0709 12:11:46.977638 (+ 22909us) op_driver.cc:348] REPLICATION: starting
0709 12:11:47.046512 (+ 68874us) log.cc:844] Serialized 2872 byte log entry
0709 12:11:47.619968 (+573456us) op_driver.cc:464] REPLICATION: finished
0709 12:11:47.805306 (+185338us) write_op.cc:301] APPLY: starting
0709 12:11:47.805403 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:47.811169 (+  5766us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:47.811275 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:47.820726 (+  9451us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:47.839122 (+ 18396us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:11:47.839169 (+    47us) write_op.cc:312] APPLY: finished
0709 12:11:47.839460 (+   291us) log.cc:844] Serialized 73 byte log entry
0709 12:11:47.839690 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:47.839831 (+   141us) write_op.cc:454] Released schema lock
0709 12:11:47.839889 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:47.840340 (+   451us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:47.840369 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5481,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":183530,"apply.run_cpu_time_us":9952,"apply.run_wall_time_us":35030,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33401,"num_ops":7,"prepare.queue_time_us":140016,"prepare.run_cpu_time_us":48037,"prepare.run_wall_time_us":425227,"raft.queue_time_us":86098,"raft.run_cpu_time_us":4795,"raft.run_wall_time_us":102348,"replication_time_us":617594,"thread_start_us":295201,"threads_started":4,"wal-append.queue_time_us":273120}]]}
I20260709 12:11:48.188174 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.231742 26909 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.203526 26960 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:48.281352 26942 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:48.282979 26647 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:48.283389 26647 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:48.270105 26955 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:48.284408 26955 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:48.284297 26647 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.285557 26647 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.285346 26955 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.249765 26880 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:48.292068 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.293418 22196 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:48.302837 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.265415 26940 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:48.276013 26957 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:48.313236 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.243916 26665 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:11:48.241101 26789 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.316267 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.339318 22191 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:48.342875 22192 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:48.347200 26936 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:48.348069 26936 consensus_queue.cc:1243] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:48.348515 26936 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:48.350219 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.361260 22196 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:48.348804 26936 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:48.356204 26931 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:48.397751 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 270414us
I20260709 12:11:48.398553 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.384907 26956 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:48.381482 26813 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:11:48.402482 26825 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:48.399699 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.420190 22266 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:11:48.422474 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 155459us
I20260709 12:11:48.425498 22268 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:48.427527 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.437080 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:48.437964 26905 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:48.445961 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 257923us
W20260709 12:11:48.446480 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 81753.5us
I20260709 12:11:48.452193 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.453552 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:48.399718 26938 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 12:11:48.449548 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 49905.3us
I20260709 12:11:48.457566 22088 leader_election.cc:400] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:11:48.459735 26973 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:48.460922 26931 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:48.454759 26813 consensus_queue.cc:1243] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:48.465581 26943 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:48.466815 26791 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:48.467887 26791 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:48.468243 26791 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:48.413921 26956 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.469168 26791 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.470856 26791 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.475895 22192 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:48.481469 26925 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:48.485035 26980 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:48.485371 26909 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:48.485514 26980 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:48.486373 26980 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:48.487905 26980 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:48.495590 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43478.8us
I20260709 12:11:48.497201 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.498528 22118 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:48.460956 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.501852 22271 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
W20260709 12:11:48.501295 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49347.7us
W20260709 12:11:48.506717 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.509675 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.511605 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.470980 26956 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:48.515491 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:48.504667 26959 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:11:48.502794 26960 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:48.525592 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 73361.6us
I20260709 12:11:48.526856 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:48.514079 26976 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:48.523582 26813 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:48.531363 26813 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:48.531960 26647 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:48.532231 26813 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:48.526666 26909 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:48.521404 26832 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.534379 26789 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:48.489140 26936 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:48.535219 26921 raft_consensus.cc:993] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:11:48.535774 26921 raft_consensus.cc:1081] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:11:48.535346 22018 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 10 to 11, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 11 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.521092 26984 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.535811 26936 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:48.455067 26950 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:48.538460 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.542961 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.543991 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.544314 26909 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:48.544991 26976 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:48.547431 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 61451.6us
I20260709 12:11:48.546733 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.533666 26813 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.548086 22018 catalog_manager.cc:5697] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 6 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 9 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.551740 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.568064 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.571095 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.572252 22121 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:48.538214 26938 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:48.572992 22830 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.594072 26950 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:48.595070 26905 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:48.595610 26905 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:11:48.596191 26882 consensus_meta.cc:287] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.001s
I20260709 12:11:48.596500 26905 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.572156 26989 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:48.599272 26989 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:48.599390 26931 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:48.572949 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45823.9us
I20260709 12:11:48.600252 26992 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:11:48.603757 26989 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:48.604907 26895 consensus_meta.cc:287] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.513s	user 0.013s	sys 0.000s
I20260709 12:11:48.605408 26895 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:48.538095 26956 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:48.573800 26976 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:48.582667 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 78879.9us
I20260709 12:11:48.573597 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.541666 26985 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:48.570667 26984 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:48.612507 22119 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:48.636113 22118 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:48.551250 26960 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:48.571002 26825 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.621928 26848 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.542042 26832 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:48.628757 22123 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:11:48.633260 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 59764.3us
I20260709 12:11:48.648725 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.596616 26882 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:48.573412 26990 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:48.603049 26931 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.645865 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.607668 26895 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:48.660208 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.660539 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:48.635774 26985 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.635637 26976 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.665125 22263 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:48.638398 26984 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:48.678296 22117 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:48.611585 26880 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.675056 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.644692 26848 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:48.682658 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:48.603183 26938 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.701506 26990 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.705153 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:48.668237 26909 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.680914 26825 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:48.678335 26985 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.681582 26984 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:48.663848 26973 consensus_queue.cc:1059] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 12:11:48.714284 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 253406us
I20260709 12:11:48.667399 26952 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:11:48.720337 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.709645 26990 raft_consensus.cc:2764] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:11:48.725672 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 79900.7us
I20260709 12:11:48.728518 22162 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.729660 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.713446 26718 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.734943 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:48.734812 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.737121 26848 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.739946 26880 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:48.740128 26848 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.753755 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.709378 26941 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.764734 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.737587 26813 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:48.738003 26805 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:48.762324 26880 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:48.802502 22122 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:48.803377 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.804164 26989 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.767351 26998 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:48.804924 26989 raft_consensus.cc:2764] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:11:48.806313 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.768992 26938 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:48.807329 26938 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:48.807787 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.809715 22118 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:48.809857 26980 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:48.813069 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:48.819576 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.781534 26997 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:48.751295 26906 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:48.785871 22114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:11:48.790241 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.824158 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:48.784739 26789 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:48.832993 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 148941us
I20260709 12:11:48.856282 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:48.856950 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.858155 22192 raft_consensus.cc:2410] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:48.859225 22116 raft_consensus.cc:2410] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:48.897254 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.898672 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.772399 26940 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:48.923786 26973 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.923599 26980 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:48.903230 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.877317 26789 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:11:48.939996 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 62725.2us
W20260709 12:11:48.955745 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52658.7us
I20260709 12:11:48.941184 26989 raft_consensus.cc:2764] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:11:48.944346 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.956825 22088 leader_election.cc:400] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9.
I20260709 12:11:48.945344 26882 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:48.945173 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.968828 22266 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:48.946391 22194 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:11:48.901818 26966 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:11:48.929455 22192 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:48.949577 22116 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:48.982285 22116 pending_rounds.cc:85] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 6
I20260709 12:11:48.982600 22116 pending_rounds.cc:107] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:48.982854 22116 raft_consensus.cc:2889] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:48.971014 26973 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.957795 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:11:48.987869 26791 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.000s
I20260709 12:11:48.988792 26980 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:48.989233 26980 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:48.989630 26980 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.989889 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.990406 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:48.991012 26813 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:48.991442 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:48.992367 26813 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:48.992736 26813 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:48.993170 26813 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.994019 26941 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:48.961061 26999 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:48.994376 26997 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:48.956449 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:48.996840 26925 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.947263 22190 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:48.967474 26848 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:11:48.979799 26940 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:48.979393 26789 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:48.980460 22114 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.985402 26952 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:48.999527 22114 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:48.999773 26952 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.005371 22118 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:49.007380 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:49.008126 22122 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:48.831544 26998 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:49.009500 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:48.926036 26938 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:48.987891 26973 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:49.019243 26952 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:49.021569 26718 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:49.023175 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:49.024286 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:49.024920 26931 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.034516 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:49.036101 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:48.876511 26943 raft_consensus.cc:993] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:11:48.896378 26897 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:48.957048 26926 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.026271 26921 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.026563 26813 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.027841 26952 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:49.029381 22263 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:49.032459 22119 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:49.012547 22197 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:49.038785 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:48.896332 26936 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:49.159324 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 113638us
I20260709 12:11:49.180022 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:49.044893 22114 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.163250 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:49.178646 22864 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:49.040496 26897 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:49.188421 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:49.200282 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:49.200418 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:49.201484 22118 raft_consensus.cc:2410] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:49.201654 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:49.205071 22269 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:49.206065 22116 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:49.209964 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:49.152149 26943 raft_consensus.cc:1081] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
W20260709 12:11:49.224912 22236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.018s	sys 0.020s
W20260709 12:11:49.225522 22236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.018s	sys 0.020s
W20260709 12:11:49.226238 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 543638us
W20260709 12:11:49.217398 26920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.011s	sys 0.070s
I20260709 12:11:49.234155 22116 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:11:49.220151 26905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.033s	sys 0.044s
W20260709 12:11:49.241775 26905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.033s	sys 0.045s
I20260709 12:11:49.152626 26926 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.244333 26926 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:49.184003 26805 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:11:49.253345 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:49.254469 22268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.089s
W20260709 12:11:49.254880 22268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.007s	sys 0.089s
I20260709 12:11:49.221259 26997 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.257232 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 2662) took 1182 ms. Trace:
I20260709 12:11:49.257936 22121 rpcz_store.cc:276] 0709 12:11:48.068851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.068965 (+   114us) service_pool.cc:224] Handling call
0709 12:11:48.069207 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.572641 (+503434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.251306 (+678665us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400311ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:49.251564 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156479232}
I20260709 12:11:49.258490 26998 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.257273 22263 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:11:49.260421 26984 consensus_meta.cc:287] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.005s
I20260709 12:11:49.232225 26936 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:11:49.260947 26984 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.261878 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:49.250504 26897 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.263185 26897 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.263288 22864 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.263473 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.266610 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:49.269511 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.269603 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.270887 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.272030 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.273536 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.256438 26999 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:49.274664 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.275916 26940 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.276219 22263 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:11:49.276508 26940 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.277801 26931 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:49.278947 26940 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:49.278579 22263 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:49.281327 22263 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:11:49.244626 26985 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.517s	user 0.004s	sys 0.004s
I20260709 12:11:49.285270 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:49.241494 26920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.011s	sys 0.070s
I20260709 12:11:49.293712 26813 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:49.296530 26984 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:49.301856 22864 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:11:49.304004 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.312754 26842 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:49.313376 26842 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:49.314457 26842 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.316147 26842 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:49.321950 22264 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:49.333534 26985 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.347991 22123 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:49.333213 26960 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:49.349227 26985 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:49.357577 26980 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.359841 26980 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:49.366055 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 75261.9us
I20260709 12:11:49.367502 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:49.372244 22114 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:49.374989 26960 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.382999 26985 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:11:49.406734 26960 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:49.407546 26960 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.378135 27011 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:11:49.409292 27011 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:49.409634 26789 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:49.409512 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.403118 26957 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.418200 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 298264us
W20260709 12:11:49.424600 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 373781us
I20260709 12:11:49.432322 22123 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:49.427897 26980 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:49.454310 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 269218us
I20260709 12:11:49.454885 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:49.461887 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:49.462810 22863 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:49.469558 22120 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:11:49.470239 22120 pending_rounds.cc:85] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 3
I20260709 12:11:49.470551 22120 pending_rounds.cc:107] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:49.470896 22120 raft_consensus.cc:2889] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:49.478037 22271 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:49.478356 22116 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:49.471894 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 291146us
I20260709 12:11:49.479957 22122 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:49.482126 22265 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:49.441543 26938 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.486320 22270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:11:49.487880 22270 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:49.488456 22270 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.445693 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:49.429733 26957 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.484616 26813 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.518390 22270 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.483049 26979 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:11:49.505328 26902 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:49.507961 26263 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:49.544257 22270 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:49.539590 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 145840us
I20260709 12:11:49.485309 26980 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.545585 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:49.553620 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:11:49.553560 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46180.4us
I20260709 12:11:49.523020 26813 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.546314 26960 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:49.598883 22115 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:49.594834 27024 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:49.550542 26263 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.547971 26902 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:49.614084 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 68607.8us
I20260709 12:11:49.627749 27029 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:49.628268 27002 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:49.630208 27000 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:49.602936 27015 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:49.632611 27015 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.635223 27015 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:49.642298 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:49.646328 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.647274 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:49.651249 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 89701.8us
I20260709 12:11:49.606148 27024 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:49.642616 27014 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:49.662820 27011 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:49.666412 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:49.645128 26980 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:49.682618 22863 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:49.688077 27030 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:49.689340 26665 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:49.683053 22863 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:49.690454 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:49.694401 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53174.3us
I20260709 12:11:49.696038 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:49.696686 22866 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:49.697530 27024 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.698369 26898 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:49.698772 27024 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:49.698741 26898 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:49.699781 26898 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:49.703353 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57189.5us
I20260709 12:11:49.691223 22863 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.702663 22088 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:49.665498 27025 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:49.711467 27025 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:49.712682 22194 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:49.712445 27025 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.713905 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:49.715139 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:49.715706 22193 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:11:49.716276 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:49.710464 26263 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:49.712893 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.716570 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:49.716996 26957 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:49.717305 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:49.719537 27017 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:49.735728 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.691484 27014 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.679445 26813 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:49.720412 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:49.659874 26897 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:11:49.721220 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:49.738368 22193 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.722142 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:49.694296 26973 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:49.709101 26902 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:49.707602 26898 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:49.750103 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:49.751092 22191 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:49.755374 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:49.729205 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:49.729393 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:49.729480 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:49.732745 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.733760 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.728917 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:49.758738 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:49.758985 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.735462 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.720157 26718 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:49.742093 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:49.761623 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:49.755569 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:49.734542 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:49.762841 22269 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:11:49.761298 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:49.763792 22860 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:49.764504 22263 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:49.740121 27000 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:11:49.739818 26941 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:49.768649 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:49.774178 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:49.783493 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:49.786378 26883 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.769241 26896 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.753788 26999 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:49.753638 26263 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:11:49.801342 22263 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:49.770488 26941 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.800616 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:49.797494 26883 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:49.859417 26883 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:49.861205 27038 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 12:11:49.775569 26980 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:49.862438 27038 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:49.862910 27038 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:11:49.812009 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.863889 27038 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:49.870697 22265 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:49.841851 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 54698.5us
I20260709 12:11:49.771859 26936 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:49.879259 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:49.880086 22122 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:49.772202 26902 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:11:49.882874 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:49.881242 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:11:49.877291 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 76814.8us
I20260709 12:11:49.893254 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:49.789743 26938 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:49.788504 26811 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:49.803498 26985 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.849545 26941 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.881811 26980 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:49.897878 26811 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.900806 26987 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:49.911028 26914 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:49.916222 27038 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.914793 26936 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:49.966013 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 68581.1us
I20260709 12:11:49.937080 26916 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:49.956559 26811 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.957995 26987 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.990468 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:49.975737 22121 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:49.958422 26914 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:49.982203 26999 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:11:49.985059 22119 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 8. Ops: []
I20260709 12:11:49.985217 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:49.998137 22191 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.998667 22123 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:49.912838 26998 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:11:49.988565 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:49.976300 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:49.996189 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:50.035630 22121 raft_consensus.cc:2393] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:49.986582 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:49.994534 26987 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:50.031028 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.005484 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.989133 26789 consensus_meta.cc:287] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.005s
I20260709 12:11:49.997467 26914 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:50.040745 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52264.2us
I20260709 12:11:49.995482 26980 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:11:50.046736 26938 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.056607 26938 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.057195 26938 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.066531 22191 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:11:50.074586 22193 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:50.076313 22194 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: [9.7-10.8]
I20260709 12:11:50.074555 26938 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.080839 26942 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.097218 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:50.047202 27014 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:50.100713 27036 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:11:50.120733 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 227533us
I20260709 12:11:50.128337 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:50.117059 27005 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:11:50.145464 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:50.123289 26811 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:50.182428 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.189522 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 67019.3us
I20260709 12:11:50.108865 26942 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:50.217267 27023 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.592s	user 0.003s	sys 0.003s
I20260709 12:11:50.220260 26938 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:50.229246 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:50.231999 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:50.205675 26936 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:50.199280 27059 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:50.205153 26980 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.242831 26942 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:50.246716 26914 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.247176 26941 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.248828 26811 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:50.253962 27049 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:50.235023 27014 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:50.234689 26842 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:11:50.255499 26936 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:50.286039 26936 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.256114 22118 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:50.257321 26920 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:50.262475 22859 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:50.266134 27066 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.228730 26999 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:50.259117 26980 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.265517 27002 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:50.297370 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 169121us
I20260709 12:11:50.299829 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:50.300719 26813 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:50.301196 27014 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:50.301626 27014 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:50.293818 26920 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:50.302704 26980 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:50.302488 27014 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.299150 27002 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:50.303862 27014 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.304276 27002 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.303444 26920 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.297470 27015 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:50.307037 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:50.310019 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:50.311153 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:50.315268 27065 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:50.315493 26920 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:50.318704 27066 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:50.325716 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:50.327157 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:50.310127 26980 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:11:50.333707 27022 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.665s	user 0.000s	sys 0.004s
I20260709 12:11:50.349068 27011 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.350534 27011 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.357574 26906 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:50.358302 26906 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:50.358018 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:50.334949 27068 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:50.313645 27015 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.409582 22264 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:11:50.327157 27065 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:50.325965 26813 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:50.314440 27002 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:50.370261 27043 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.338s	user 0.002s	sys 0.000s
I20260709 12:11:50.412067 27015 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:50.419749 26718 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:50.420246 26718 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:50.333814 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:50.421630 26813 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:50.421797 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 88127.5us
I20260709 12:11:50.386740 27011 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:50.373170 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:50.403482 26914 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:50.404534 26987 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.349658 26941 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:50.429658 22121 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:50.430650 22865 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:50.433126 26987 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:50.433346 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:50.434352 26941 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:50.434898 26941 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:50.436028 26941 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:50.441991 27026 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.815s	user 0.002s	sys 0.000s
I20260709 12:11:50.432869 26718 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.445436 26718 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.446326 22861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 713) took 1034 ms. Trace:
I20260709 12:11:50.446797 22861 rpcz_store.cc:276] 0709 12:11:49.411785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.411995 (+   210us) service_pool.cc:224] Handling call
0709 12:11:49.412435 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.412921 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.412967 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.421164 (+  8197us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.550599 (+129435us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:49.550641 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.550735 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.441136 (+890401us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:50.445978 (+  4842us) raft_consensus.cc:1685] finished
0709 12:11:50.446002 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.446257 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4779,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4259,"spinlock_wait_cycles":48243456,"thread_start_us":107919,"threads_started":1,"wal-append.queue_time_us":197066}
I20260709 12:11:50.449362 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:50.450138 22860 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.450533 22270 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 8. Ops: []
I20260709 12:11:50.452585 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:50.457170 26813 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:50.457877 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.359655 26906 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.459367 26813 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.461520 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:50.477274 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:50.480455 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:50.481586 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:50.484176 22859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 705) took 1450 ms. Trace:
I20260709 12:11:50.485040 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:50.486869 22863 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.494525 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:50.484541 22859 rpcz_store.cc:276] 0709 12:11:49.034102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.034265 (+   163us) service_pool.cc:224] Handling call
0709 12:11:50.484028 (+1449763us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540054abd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:11:50.484125 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319161600}
I20260709 12:11:50.497074 22088 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:50.497691 22190 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:50.498725 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:50.499655 22121 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:50.473798 27065 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.507773 22196 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:50.519761 22196 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:50.516379 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46368.6us
I20260709 12:11:50.533248 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:50.534624 26813 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:50.509541 26896 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:11:50.505187 26791 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.542941 26791 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.543447 26791 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.553838 27065 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.477368 26916 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.584190 22121 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:50.575943 22860 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
W20260709 12:11:50.597361 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 361992us
I20260709 12:11:50.613094 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:50.633731 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.634397 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.635165 22863 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:11:50.636685 22863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 759) took 1083 ms. Trace:
I20260709 12:11:50.638024 22863 rpcz_store.cc:276] 0709 12:11:49.553177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.553332 (+   155us) service_pool.cc:224] Handling call
0709 12:11:49.682497 (+129165us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b5400434a20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc5e18 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:50.486529 (+804032us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b58004f1cd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd1e0aa 00007fccedda0447 00007fcceddb8fe7 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c
0709 12:11:50.636626 (+150097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905265408}
W20260709 12:11:50.646469 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 148897us
I20260709 12:11:50.571964 22196 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.649166 22196 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:50.646111 26898 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.564914 26936 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:50.662590 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:50.671399 22123 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:50.632457 22861 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:50.666843 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:50.668572 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:50.672896 22120 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:50.563906 27071 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:50.664394 22114 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:50.676137 22116 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:50.556741 27065 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:50.563284 27068 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:50.636106 27015 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.654112 22237 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:50.582975 26813 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:50.676892 22118 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:50.678629 22122 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:50.654311 26898 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:50.686990 27013 consensus_queue.cc:1175] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cc9b9c8894084021a0c6ddaf659d222e" responder_term: 8 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:50.692430 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:50.695498 22196 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:50.703302 22190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
W20260709 12:11:50.710134 26842 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:11:50.713347 27003 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:50.713819 27003 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:50.641286 26916 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.714757 27003 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.715996 27003 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:50.716881 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.697547 27068 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.720268 27068 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:50.706784 26813 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.726024 26813 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:50.716480 26916 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:50.728536 22118 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 8. Ops: []
I20260709 12:11:50.710176 22190 raft_consensus.cc:606] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:50.736389 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:50.737449 22863 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:11:50.706257 27011 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:50.741130 26898 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:50.742764 26951 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.743314 26951 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.744009 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:50.744903 22193 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:50.683454 27071 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.747079 27071 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:50.684124 26936 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:50.749012 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:50.749678 22196 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.750316 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:50.749624 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57274.9us
I20260709 12:11:50.752512 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:50.753945 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:50.750948 22198 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:11:50.754592 22189 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
W20260709 12:11:50.755534 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.756454 22123 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:50.757117 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:50.757659 22191 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:50.758289 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:50.759318 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:50.749471 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:50.761404 22116 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:50.763530 22193 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:50.767791 22196 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:11:50.768743 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:50.769150 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:50.769840 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:50.769966 22269 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:50.770835 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:50.771018 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:50.771435 22268 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.765964 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:50.773253 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:50.774056 22118 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:50.775091 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:50.776593 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:50.766281 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:11:50.780417 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45252.6us
I20260709 12:11:50.797647 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:50.779857 26813 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.760653 26943 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:50.762066 27011 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:50.778362 27025 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:50.777279 27030 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:50.800446 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:50.772847 27038 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:50.789038 26941 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.809407 27011 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.778741 26936 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.830299 22195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:50.811311 26943 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:50.815819 26791 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:50.816941 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 54148.8us
I20260709 12:11:50.797127 26955 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.852654 22162 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:50.827031 22268 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
W20260709 12:11:50.831763 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 79140.9us
I20260709 12:11:50.831040 22195 raft_consensus.cc:606] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:50.857450 22195 raft_consensus.cc:614] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:50.841995 26942 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.822392 26941 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.862510 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:50.862432 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:50.867355 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.870136 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 69726.1us
I20260709 12:11:50.872810 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:50.873634 22115 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:50.875622 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:50.850108 26951 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:50.853509 26955 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.888406 26955 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.837400 27038 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.868494 26941 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.903631 27038 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:50.900656 26943 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.869122 26942 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:50.896080 27074 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:11:50.899947 26263 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:50.821864 27030 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:50.859378 26920 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:50.872386 26926 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.879423 27025 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:50.881148 26991 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:11:50.958403 26991 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:50.958810 26991 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:50.959661 26991 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.963936 26941 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:50.894824 26936 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.964725 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:50.985574 22264 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.909245 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:50.892999 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:50.939594 27080 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:50.969338 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:50.939730 26263 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:50.943522 22194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:50.907160 26942 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:50.947674 26791 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:50.951332 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:51.005081 22115 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.955410 26902 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.989825 22121 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:11:51.011404 26902 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.011790 26811 raft_consensus.cc:993] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:11:51.012562 26811 raft_consensus.cc:1081] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:11:50.969099 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:50.990883 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:50.977514 22116 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:51.013810 26991 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:50.977852 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:51.014410 26938 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.980046 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:51.014952 26938 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.014614 27038 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.016096 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:51.013835 26902 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:51.016959 22117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:11:50.979319 26936 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.017928 26984 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:51.018218 26936 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.018535 26984 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:51.019464 26984 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.021031 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:50.971050 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:50.998632 22197 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:50.999539 22194 raft_consensus.cc:606] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:50.999898 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 106977us
I20260709 12:11:51.017553 22117 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:50.947472 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:51.022493 22194 raft_consensus.cc:614] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:51.022810 22117 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:50.967736 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:51.023801 22119 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:51.026029 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:51.026867 22118 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:51.007278 22264 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:11:50.966681 27030 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:50.978895 26941 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:51.008036 27025 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:11:51.003360 26813 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.037182 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:50.966585 22272 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:11:50.999116 26263 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:51.038550 22272 pending_rounds.cc:85] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 7
I20260709 12:11:51.039769 22272 pending_rounds.cc:107] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:11:51.039325 26263 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.040076 22272 raft_consensus.cc:2889] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:51.040566 26263 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:51.041051 22118 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:51.041831 26906 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:51.031553 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 84156.7us
I20260709 12:11:51.017468 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:51.043129 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:50.969048 22189 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:51.045424 27017 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:51.045969 27017 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:51.046860 27017 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:51.048230 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:51.049311 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:51.049677 26980 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:51.050192 27068 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:51.051011 26896 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:51.021994 22196 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:51.051465 26896 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.051826 26896 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.027415 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:51.022554 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:51.009724 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:51.053217 22114 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:51.053604 22193 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
I20260709 12:11:51.031553 27002 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:51.032114 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:51.044620 22163 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:51.069633 22194 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:51.028167 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:51.017732 27085 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:51.072613 22268 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:51.072662 22861 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:51.075572 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 43515.3us
I20260709 12:11:51.077965 22115 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:11:51.083806 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:51.084532 22265 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:51.101233 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:51.105453 22861 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:11:51.096930 26998 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.099468 26925 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:51.093497 27071 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:11:51.093822 27030 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:51.131696 22192 raft_consensus.cc:606] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:51.103144 22117 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.126444 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:51.124251 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:51.125430 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:51.098865 27002 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:51.086194 27068 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:11:51.150259 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:51.150995 22270 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.140738 26813 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:51.157403 22117 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:51.159777 22270 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:51.136976 26925 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:51.161051 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:51.135085 27025 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:51.175323 27025 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:51.175762 27025 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.183020 26938 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:51.131668 27030 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:51.139882 27000 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:51.139976 27011 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:51.187173 27002 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:51.190541 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:51.145097 27085 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:11:51.191991 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:51.199957 26813 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:51.201910 26984 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:51.207674 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:51.162093 26925 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:51.218403 22194 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:11:51.174019 26955 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:51.224802 22190 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:51.226892 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:51.255856 22192 raft_consensus.cc:606] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:51.236857 27030 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.244230 27000 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.244464 27011 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:51.327800 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:51.330827 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59161.4us
W20260709 12:11:51.338653 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 67766.7us
W20260709 12:11:51.327314 27074 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:51.270545 27000 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.265209 26984 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:51.332973 27029 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:51.330706 27011 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:51.260237 26941 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:11:51.268285 26980 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:11:51.332973 26985 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.352660 27029 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.364857 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:51.263713 27038 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 12:11:51.384971 22861 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:51.389828 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:51.390669 22192 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.392835 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:51.393622 22115 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:51.400923 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.411568 22115 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:11:51.269429 26936 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.464720 22192 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
W20260709 12:11:51.457896 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53276.1us
W20260709 12:11:51.457990 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 108530us
I20260709 12:11:51.459103 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:51.372877 26813 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:51.381009 27029 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:51.383150 27038 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:51.375787 26955 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:51.372730 27025 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.461365 26980 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:11:51.372726 26896 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:51.522918 26943 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:51.537474 26943 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:51.538542 26943 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:51.541808 27025 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:51.556253 22270 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:51.564126 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 224243us
I20260709 12:11:51.567991 22861 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:51.384806 26984 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.577554 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:51.578429 22121 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:51.580456 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:51.581470 22114 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:51.587968 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:51.594048 22198 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:51.589006 22190 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:51.603927 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:51.523877 27038 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:51.616925 27038 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:51.617612 27038 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.618264 27038 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.619243 22121 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:51.619638 26936 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:51.585100 27017 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:11:51.607884 26980 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:51.631146 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:51.641209 22863 raft_consensus.cc:2368] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:51.637984 22865 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:11:51.620761 27038 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:51.676900 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:51.680241 22115 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.627626 26896 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:51.669808 26941 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.623847 27000 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.625662 27030 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.693476 27000 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:51.709537 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 111743us
W20260709 12:11:51.721223 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 133401us
I20260709 12:11:51.727468 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:51.728564 22114 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:51.731274 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:51.731621 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:51.740943 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:51.742244 22115 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:51.743924 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:51.745498 22268 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.748189 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:51.748878 22272 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.751434 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:51.759996 27093 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.263s	user 0.000s	sys 0.002s
I20260709 12:11:51.769274 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:51.769730 22237 leader_election.cc:400] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:51.770103 22270 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.770138 22237 leader_election.cc:403] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:51.772950 27038 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:51.784323 22189 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:51.840169 22118 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:51.860344 22268 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:11:51.751729 27029 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:51.811298 22269 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:51.785530 27099 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:11:51.707064 26941 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:51.789387 27092 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 12:11:51.828894 22865 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:51.786859 27070 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:51.805454 26938 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:51.810053 26985 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.802379 27030 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:51.824311 27019 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:51.825973 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:51.899356 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 73503.8us
I20260709 12:11:51.900787 26973 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:51.817039 27011 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.849431 22195 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:51.903277 22195 pending_rounds.cc:85] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 8
I20260709 12:11:51.903560 22195 pending_rounds.cc:107] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:51.903784 22195 raft_consensus.cc:2889] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:51.855342 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:51.855419 22266 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:51.856158 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:51.906095 22119 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:51.826999 22272 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:51.857694 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:51.838392 22270 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:51.907002 22198 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.901403 26973 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:51.908087 26973 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:51.845229 26920 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.924651 22198 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
W20260709 12:11:51.925246 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 69969.3us
I20260709 12:11:51.931517 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:51.933462 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:51.870303 27029 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:51.936064 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:51.956391 22119 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:11:51.957671 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 59299.5us
I20260709 12:11:51.916942 27038 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:51.880342 27015 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:11:51.943955 26984 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:51.938707 27025 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:52.038349 27113 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.039074 27113 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:51.955560 27029 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.965555 27030 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:51.929399 26896 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
I20260709 12:11:51.919266 26938 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:52.024153 27106 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:51.936683 26920 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.070035 27106 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:52.070154 27102 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:52.036233 26980 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.071014 27106 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:52.071625 26920 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.071713 26980 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:52.072371 27106 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:52.043507 27090 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:11:51.969445 27107 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:11:52.067984 26938 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:52.068562 27030 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:52.053380 27011 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:52.072962 27104 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:51.919651 26985 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:52.054039 26984 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:52.114459 26984 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.066602 26941 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.076218 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:52.120285 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:52.115509 26985 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:52.111582 27112 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.112062 27104 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.113441 26943 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.127130 27017 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:52.176271 22272 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:52.186547 26980 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:52.197901 27104 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:52.164693 26943 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:52.199904 27030 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.183512 27017 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:52.200662 26943 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:52.232637 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 270336us
I20260709 12:11:52.158011 27112 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.229456 27071 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:52.247192 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:52.254361 27118 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:52.255100 27118 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.257091 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:52.258916 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:52.264518 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:52.265626 27113 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.266319 27106 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:52.266896 27106 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:52.269235 27106 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:52.270699 27118 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:52.271806 27106 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.272372 27106 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.273152 27017 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.274575 27106 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.275983 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:52.277330 27113 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.277954 27112 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.277855 27113 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.280097 27113 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.252257 27071 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:52.285665 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:52.286433 22861 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:52.287557 27071 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:52.298847 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:52.304075 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:52.310781 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:52.311700 22263 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:52.323869 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:52.325001 22115 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:52.323273 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:52.328352 22118 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:52.327240 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:52.332891 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:52.334896 22117 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:52.329303 27029 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.339949 22266 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:52.342057 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:52.342538 27029 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:52.343725 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:52.345193 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:52.344506 22265 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 6.
I20260709 12:11:52.351887 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:52.369839 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:52.372004 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:52.372803 22270 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 8.
I20260709 12:11:52.368924 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:52.346722 27065 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:52.394335 27093 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:52.406272 22270 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:52.406154 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:52.407397 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:52.407608 22865 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:52.380929 27122 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.381372 26985 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.411612 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:52.413671 22117 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:52.414906 27113 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:52.420915 27113 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.421464 27113 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:52.415093 26938 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:11:52.425400 26938 consensus_queue.cc:1243] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:52.403967 27065 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.427780 27065 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:52.403771 26984 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.437557 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:11:52.441016 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.445000 22190 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:52.446888 27013 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:52.447403 27013 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.447768 27013 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.448964 27126 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:52.450001 27085 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:52.450580 27085 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.458868 27085 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:52.459642 27091 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.960s	user 0.002s	sys 0.005s
I20260709 12:11:52.464702 26813 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:52.473654 26813 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.476536 26980 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:52.477197 26980 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.479382 26980 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.480450 26813 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.471594 22117 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:52.472262 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:52.539975 22265 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:52.483924 27097 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.784s	user 0.012s	sys 0.000s
I20260709 12:11:52.557440 22117 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:52.443625 26999 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.563746 26987 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:52.417963 27122 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.571533 27038 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:52.580171 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2433) took 1523 ms. Trace:
I20260709 12:11:52.620288 22193 rpcz_store.cc:276] 0709 12:11:51.057084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.057244 (+   160us) service_pool.cc:224] Handling call
0709 12:11:51.057778 (+   534us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:51.058276 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.058321 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:51.059226 (+   905us) log.cc:844] Serialized 52 byte log entry
0709 12:11:51.327484 (+268258us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:51.327527 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.327606 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.791103 (+463497us) spinlock_profiling.cc:243] Waited 9.53 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:51.800882 (+  9779us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b48000ce358. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf2cebaa1 00007fccf2ce2b37 00007fccf2ce29ca 00007fccf2dda26f 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508 00007fccf2dee488 00007fccf2dee443 00007fccf2ded6ec 00007fccf1d17a96
0709 12:11:52.459325 (+658443us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b24000ddd68. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceab5b9c4 00007fcceab59acb 00007fccead14dc9 00007fccead14a55 00007fccead1409d 00007fcced94610e 00007fcced95d88c 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221
0709 12:11:52.579833 (+120508us) raft_consensus.cc:1685] finished
0709 12:11:52.579856 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.580060 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":968,"raft.run_cpu_time_us":14857,"raft.run_wall_time_us":738774,"spinlock_wait_cycles":144198016,"thread_start_us":198226,"threads_started":1,"wal-append.queue_time_us":402498}
W20260709 12:11:52.589061 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 185658us
I20260709 12:11:52.623348 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:52.604369 22191 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:52.624635 22191 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:52.629614 27135 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:52.630048 27135 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.630342 27135 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:52.594765 27015 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:11:52.637725 27014 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.655392 27128 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:11:52.679625 27122 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.639202 27113 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:52.690723 27133 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.222s	user 0.003s	sys 0.000s
I20260709 12:11:52.682935 27113 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.637231 27038 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.644672 27126 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:11:52.688163 27013 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.672113 27014 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.706770 27013 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.707286 27038 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:52.698290 27129 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.282s	user 0.004s	sys 0.000s
I20260709 12:11:52.703369 27065 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:52.779320 27065 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:52.775156 27129 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:11:52.782125 27135 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:52.788030 27135 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.843775 22115 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:11:52.846868 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 220618us
I20260709 12:11:52.622056 26999 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.859215 26991 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:52.859864 26999 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.843358 26938 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:52.863690 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:52.865965 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:52.870443 27014 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.862553 26938 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.871059 22017 catalog_manager.cc:5697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.878108 22017 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 13, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 13 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.860277 26991 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.898754 27065 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.898967 26938 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:52.900094 26938 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:52.899798 27065 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.903414 27112 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.904476 27112 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.894034 27013 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:52.910661 26938 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.910915 27013 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:52.901621 27085 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:52.907786 22017 catalog_manager.cc:5697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.957021 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:52.960893 27085 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:52.958297 22263 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.971652 22272 pending_rounds.cc:85] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 6
I20260709 12:11:52.972287 22272 pending_rounds.cc:107] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:52.974572 22237 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:52.975828 22270 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:52.979051 27030 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:52.979811 27030 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:52.972713 22272 raft_consensus.cc:2889] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:53.009227 27059 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:53.010433 27059 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.014719 22861 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:53.016443 27112 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.019578 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:53.019719 27125 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.648s	user 0.023s	sys 0.014s
I20260709 12:11:53.020637 22270 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:11:53.023936 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:53.024840 22114 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:53.031689 26914 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:53.032819 22266 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:53.032908 26914 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.036293 22263 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:53.036584 26914 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.042263 27013 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:52.984355 27030 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:52.984661 26991 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.052374 22263 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:53.052714 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:53.054111 27147 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.311s	user 0.003s	sys 0.005s
I20260709 12:11:53.054040 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.059312 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.060720 22265 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:11:53.064847 27085 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.065166 22017 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 9, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 9 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.066414 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:53.068269 22115 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:53.068580 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.075719 22270 raft_consensus.cc:2368] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 10. Current term is 11.
W20260709 12:11:53.077353 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.082753 26914 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.083711 26914 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.085500 27085 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:53.085732 22265 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:53.086391 26914 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.046205 26938 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.094545 22265 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:53.086396 27085 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.097486 27071 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:53.098383 27085 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.090369 27112 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:53.099401 27112 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.098477 27071 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:53.106348 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:53.108242 27071 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:53.114749 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.117982 27122 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:53.118801 27122 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.121502 27065 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.122071 27065 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:53.122700 27065 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.123574 27122 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.125401 27065 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.126765 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:53.129235 22115 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:53.134583 22117 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
W20260709 12:11:53.135820 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49448us
I20260709 12:11:53.129159 22017 catalog_manager.cc:5697] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:53.131150 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:53.132458 27126 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.141180 22119 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.141366 27126 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:53.144428 27126 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:53.140566 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:53.146459 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:53.147667 27107 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:53.139647 22017 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 14, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 14 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:53.150959 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:53.147660 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:53.156701 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.157410 22266 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:53.151029 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:53.151674 22087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.682s (SENT) [suppressed 17 similar messages]
I20260709 12:11:53.159889 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:53.120199 22191 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.163553 22191 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.154024 26914 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:11:53.167520 27054 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:53.168036 27054 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.168421 27054 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.171561 27059 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.152117 27107 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.173403 27107 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:53.177835 22115 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.179711 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:53.180452 22263 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:53.186374 27112 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.188971 22117 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:53.194273 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.187239 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:53.217154 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:53.213124 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:53.220634 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:53.223958 22114 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:53.228487 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:53.228942 27106 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:53.229588 22863 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:11:53.230978 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.234079 27059 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:53.235610 27015 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.234771 22017 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 13, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 13 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:53.240993 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.241825 22193 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:53.234992 27106 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:53.244185 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.244370 27106 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.246758 26647 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:53.248253 27071 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.249064 27071 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.251703 27071 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:53.246810 22117 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:53.255194 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.255936 22272 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:53.257794 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.259965 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.260291 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.261370 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.261554 22119 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:53.262072 22193 raft_consensus.cc:1813] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Handling vote request from an unknown peer ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:53.262701 22193 raft_consensus.cc:2410] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:53.263465 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.265478 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.265777 22264 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:53.266885 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.267836 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:53.268170 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.269215 22193 raft_consensus.cc:2410] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:11:53.270902 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.271349 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.271636 22194 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:11:53.271204 22017 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 11, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 11 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:53.272950 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.273633 22270 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:11:53.274830 22194 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:11:53.274940 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.275288 22194 pending_rounds.cc:85] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 10
I20260709 12:11:53.276127 22194 pending_rounds.cc:107] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:11:53.276438 22194 raft_consensus.cc:2889] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:53.264681 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.277129 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.268676 22118 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:53.235291 27059 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.279556 27107 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.279973 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.281172 22192 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:53.252810 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:53.281930 27059 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.282601 27112 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.280057 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.283216 27112 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.283767 27112 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.285480 22191 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
W20260709 12:11:53.286175 26901 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:11:53.214233 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:53.282528 22197 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:53.291630 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:53.292426 22263 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:11:53.293157 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.293720 22190 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:53.297058 22191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 2434) took 2106 ms (client timeout 1682 ms). Trace:
I20260709 12:11:53.297963 22017 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 10, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 10 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.300005 27054 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:53.300882 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48351.8us
I20260709 12:11:53.300303 22017 catalog_manager.cc:5697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 7, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 7 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:53.301494 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 115935us
W20260709 12:11:53.317289 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 165858us
I20260709 12:11:53.281930 27107 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.340298 22115 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:53.345835 22017 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:53.306017 22191 rpcz_store.cc:269] 0709 12:11:51.190144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.190286 (+   142us) service_pool.cc:224] Handling call
0709 12:11:52.593198 (+1402912us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b54003352a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc5e18 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:53.119160 (+525962us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54003352a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd4006f 00007fcceddb8f60 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2
0709 12:11:53.296914 (+177754us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472071168}
I20260709 12:11:53.361923 22194 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:53.384341 27122 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:53.384964 26999 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:53.385756 26999 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.395498 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.397413 26999 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.397886 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:53.398663 22088 leader_election.cc:400] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 10. Current term is 11.
I20260709 12:11:53.398840 22271 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 7: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:53.399103 22088 leader_election.cc:403] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:53.401026 26938 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 10. Current term is 11.
I20260709 12:11:53.400339 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:53.404188 26938 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:53.404701 26938 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.405172 26938 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.408111 22017 catalog_manager.cc:5697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 10, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 10 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.410559 22017 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 12, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 12 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:53.338932 27059 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 12:11:53.444260 22018 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 237) took 20012 ms (client timeout 15000 ms). Trace:
I20260709 12:11:53.410586 27054 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.464902 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:53.471092 22017 catalog_manager.cc:5697] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:53.479776 27065 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:53.486250 27065 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.488481 27065 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.494442 27065 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:53.496577 27065 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.497189 27065 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:53.467545 27112 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.474462 27085 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:53.511490 22163 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:53.516021 26914 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:53.516570 26914 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:53.542306 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 98315.4us
I20260709 12:11:53.498057 27030 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:53.454319 22018 rpcz_store.cc:269] 0709 12:11:33.426717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.452731 (+ 26014us) service_pool.cc:224] Handling call
0709 12:11:53.438782 (+19986051us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:48.963424 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:48.964065 (+   641us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:48.964101 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:11:48.964121 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:48.964544 (+   423us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:48.964600 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:48.964628 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:11:48.965074 (+   446us) tablet.cc:701] Row locks acquired
0709 12:11:48.965098 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:11:49.173616 (+208518us) write_op.cc:270] Start()
0709 12:11:49.196535 (+ 22919us) write_op.cc:276] Timestamp: P: 1783599109157961 usec, L: 0
0709 12:11:49.197675 (+  1140us) op_driver.cc:348] REPLICATION: starting
0709 12:11:49.275508 (+ 77833us) log.cc:844] Serialized 927 byte log entry
0709 12:11:49.709292 (+433784us) op_driver.cc:464] REPLICATION: finished
0709 12:11:49.757305 (+ 48013us) write_op.cc:301] APPLY: starting
0709 12:11:49.768551 (+ 11246us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:49.857168 (+ 88617us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:49.857290 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:49.858972 (+  1682us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:49.859223 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:11:49.859279 (+    56us) write_op.cc:312] APPLY: finished
0709 12:11:49.859529 (+   250us) log.cc:844] Serialized 33 byte log entry
0709 12:11:49.859752 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:49.859861 (+   109us) write_op.cc:454] Released schema lock
0709 12:11:49.859912 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:49.881328 (+ 21416us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:49.894273 (+ 12945us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11526,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":32285,"apply.run_cpu_time_us":6169,"apply.run_wall_time_us":117447,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12491,"num_ops":2,"prepare.queue_time_us":292924,"prepare.run_cpu_time_us":16446,"prepare.run_wall_time_us":481020,"raft.queue_time_us":121082,"raft.run_cpu_time_us":11635,"raft.run_wall_time_us":32504,"replication_time_us":501438,"thread_start_us":404879,"threads_started":4,"wal-append.queue_time_us":267882,"wal-append.run_cpu_time_us":12314,"wal-append.run_wall_time_us":1322328}]]}
I20260709 12:11:53.554688 22017 catalog_manager.cc:5697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 13, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 13 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:53.527935 26914 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.581463 22269 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:53.523164 27085 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.581630 22017 catalog_manager.cc:5697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 10, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 10 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.592542 22017 catalog_manager.cc:5697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:11:53.593134 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.594110 22017 catalog_manager.cc:5697] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 11, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.595408 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.603437 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.603832 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:53.604565 22191 raft_consensus.cc:2368] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:53.605165 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.605444 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:53.606619 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.607414 22189 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:11:53.607589 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:53.608382 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.609198 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.610623 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.611032 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:53.619376 22192 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:53.628612 27085 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.628866 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.629711 22198 raft_consensus.cc:2368] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11.
I20260709 12:11:53.624521 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:53.634704 26901 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:53.635332 26901 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:53.635622 22191 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:53.637823 26901 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:53.638077 27106 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.638726 27106 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:53.596477 27015 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:53.632913 22017 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index 3 to 8, term changed from 10 to 11, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195), VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New cstate: current_term: 11 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:53.615156 22189 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:53.632426 22197 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:11:53.639353 27106 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.656677 27106 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.659926 22269 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:53.661234 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:53.662288 27106 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.668747 27085 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:53.669440 27085 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.669700 27112 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.671718 27085 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.690735 27030 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:53.713215 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.713289 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:53.710759 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:53.718344 22265 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.722204 22863 raft_consensus.cc:2368] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:53.697639 27071 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:53.725636 27071 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:53.727377 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.713351 27015 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:53.710589 27085 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:53.731666 27015 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:53.731969 27085 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:53.734699 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 269901us
I20260709 12:11:53.740974 22237 leader_election.cc:400] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:53.741815 22237 leader_election.cc:403] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:53.741463 22017 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:53.750015 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:53.812217 22017 catalog_manager.cc:5697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.749871 27030 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:53.826498 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:53.834832 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:53.832707 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:11:53.841435 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 202227us
I20260709 12:11:53.837035 22017 catalog_manager.cc:5697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:53.847844 26896 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:53.841687 26901 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:53.847985 27157 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:53.862352 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:53.862958 22017 catalog_manager.cc:5697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 11, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.870241 26901 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.876084 26901 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.858384 26896 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:53.877612 26896 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:53.867022 22017 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 10 to 11, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 11 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:53.873549 26938 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.886353 26938 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.876628 26901 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:53.873376 27155 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
I20260709 12:11:53.893388 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:53.898831 27105 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:53.884701 26914 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.899539 27105 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.900241 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:53.900696 22195 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:53.901834 27105 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.902350 27127 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.904624 26914 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.887739 27085 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.864845 27157 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:53.935276 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57832.3us
I20260709 12:11:53.936928 22265 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:53.910127 27157 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:53.940748 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77139us
I20260709 12:11:53.942888 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:53.943297 27085 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:53.943697 22264 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.943853 27085 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:53.945173 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.944959 27085 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.942865 22269 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:53.908704 27065 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.950013 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:53.925350 27071 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:53.951798 27065 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.936055 26901 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:53.957792 27157 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:53.959661 26901 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:53.960057 27157 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:53.967046 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:53.984665 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 194923us
I20260709 12:11:53.987301 22264 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:53.994431 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:53.995276 22861 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:11:53.984972 27015 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:54.000466 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:54.011773 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.017376 27065 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:54.018968 22163 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:54.021522 27162 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:54.022056 27162 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:11:54.022516 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55560.9us
I20260709 12:11:54.022962 27162 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:54.024024 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.025564 27054 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.028523 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:54.006318 27015 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.010855 26914 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:53.990347 27059 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:11:54.044376 27105 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:54.053812 27015 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:54.030943 27013 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 12:11:54.090278 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 89270.7us
I20260709 12:11:54.068995 26914 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:54.070909 27105 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.095052 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:54.098704 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:54.078796 27122 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:54.104044 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:54.110086 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:54.111498 22119 raft_consensus.cc:2368] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:54.095108 27107 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:11:54.123997 27065 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.124703 27065 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:54.124990 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:54.124966 27122 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:54.102427 27105 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.129297 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.094014 27085 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:54.134634 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.134904 27085 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:54.136955 27160 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.137248 27085 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:54.144033 26914 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:54.132515 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:54.133627 27065 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:54.134047 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.143500 22087 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.147701 22117 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:54.163528 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.165822 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:54.171865 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.175680 22268 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:54.197621 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 54791.1us
I20260709 12:11:54.200582 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.199304 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:54.201591 22087 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.201761 22197 raft_consensus.cc:2376] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11. Re-sending same reply.
I20260709 12:11:54.203296 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.204978 27059 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:54.206619 27059 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:54.207824 27059 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:54.144416 27085 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:11:54.210191 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.169214 27065 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.217023 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:54.229000 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:54.235030 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:54.235493 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:54.236011 27071 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:54.236498 22272 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:54.237394 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:54.241140 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:54.241923 22266 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:54.246665 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:54.227757 22087 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.253412 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:54.255539 22119 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:54.253283 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:54.263973 22121 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:54.265125 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:54.265502 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:54.266124 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:54.266270 22195 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.266978 22271 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:54.266978 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:54.270069 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:54.273316 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 45686.4us
I20260709 12:11:54.278462 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.276435 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.281744 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:54.283385 27157 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.283598 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:54.277359 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:54.280117 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:54.288753 27178 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:11:54.296733 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.298920 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.300151 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.295725 27015 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:54.306861 27059 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:54.310310 27183 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:54.307562 27180 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:54.311425 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:54.312187 22117 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:54.317440 22191 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:54.329936 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:54.331851 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:54.333635 27173 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:11:54.335271 22118 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:54.336437 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:54.346666 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 110321us
I20260709 12:11:54.349686 22266 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:54.358412 27015 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:54.361753 27122 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:54.363745 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:54.364557 22263 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 9: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:54.375979 22236 leader_election.cc:400] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10.
I20260709 12:11:54.377444 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:54.387863 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:54.393481 27071 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:54.394007 27071 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:54.394382 27071 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:54.410492 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 108523us
I20260709 12:11:54.412068 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.406448 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:54.415881 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.421218 27181 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:54.438135 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:54.459187 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.464129 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:54.471294 22087 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.473222 22119 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:11:54.490556 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.466584 27059 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:54.499496 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:54.477630 27065 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.502031 27030 raft_consensus.cc:2764] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:54.508991 26938 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:54.516891 27059 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:54.611923 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:54.621769 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 130735us
I20260709 12:11:54.627933 22272 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:54.630980 22272 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:54.636343 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:54.662907 27064 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:54.663793 27064 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:54.629043 27030 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.666517 27003 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:54.681318 27003 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:54.683895 27003 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:54.686204 27059 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:54.691334 27064 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:11:54.683790 27186 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.345s	user 0.000s	sys 0.003s
W20260709 12:11:54.699102 27192 log.cc:927] Time spent T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:54.708299 22117 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:54.712010 26914 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:54.712074 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.715858 22162 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.717061 27015 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.717317 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.718438 27107 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.720247 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.720171 22195 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:11:54.752736 22268 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:11:54.755790 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.745296 26914 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:54.765027 27195 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:54.717926 27015 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:54.775643 27071 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:54.782624 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 153760us
I20260709 12:11:54.783571 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:54.722681 27105 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 12:11:54.801640 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:54.806006 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50300.4us
I20260709 12:11:54.806856 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:54.810081 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 338894us
I20260709 12:11:54.812095 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.818079 27204 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.818315 27202 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:11:54.818802 26901 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:54.819419 26901 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:54.820314 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.820938 26999 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:54.821527 26901 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:54.822386 26898 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:11:54.823201 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.823944 26991 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.824388 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.825116 26991 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.808203 27030 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:54.825693 27030 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:54.803086 27105 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:54.826165 27030 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.824733 26901 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.827833 27105 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:54.831020 27015 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:54.831373 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.832134 22195 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:11:54.834095 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:54.834817 22195 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
W20260709 12:11:54.836408 27185 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.515s	user 0.003s	sys 0.000s
I20260709 12:11:54.842672 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:54.844606 27127 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:54.845165 27127 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:54.845527 27127 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.845635 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:54.846658 26943 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:54.847059 26943 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:54.847446 26943 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.857602 26943 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:54.859843 26943 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:54.860802 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:54.861462 22193 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.844415 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:54.866356 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 54345.2us
I20260709 12:11:54.867262 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:54.882521 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 51664.5us
W20260709 12:11:54.889397 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 87851.5us
I20260709 12:11:54.866814 26938 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.890762 27198 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:54.890872 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.903432 22087 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.905336 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.881846 27085 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.910091 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.926541 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:54.906585 26938 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.906939 27071 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:54.931469 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:54.931440 22269 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:54.928220 22087 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.935355 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.936908 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:54.914296 27059 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:54.943019 22193 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:54.943686 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:54.943796 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:54.928681 27181 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.947956 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:11:54.908568 26901 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:11:54.936156 27065 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:54.960407 27105 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:54.964643 22162 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.937732 27157 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.980281 27105 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.973222 27203 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.980695 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:54.934548 27202 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:54.982225 26914 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.958650 26647 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:54.983814 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 93018.4us
I20260709 12:11:54.986114 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:54.988610 22270 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:54.990909 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:54.984493 26647 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:54.947582 27085 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.000818 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:55.040719 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:55.043494 22195 raft_consensus.cc:2368] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:55.051420 22269 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:54.997956 27065 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:55.055881 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:55.058890 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 56788.1us
I20260709 12:11:55.062850 22193 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
W20260709 12:11:55.054239 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44518.2us
I20260709 12:11:55.063809 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:55.072799 22119 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:55.075891 26647 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:55.079448 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:55.093633 22193 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:11:55.066551 27054 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.108893 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:55.078835 27065 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:55.119271 22193 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:55.119417 22119 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:55.161695 27065 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:55.168818 22196 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:55.181180 22236 leader_election.cc:400] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:55.181807 22236 leader_election.cc:403] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:55.112399 27107 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:55.089435 27157 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:11:55.170276 27054 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:55.091218 26991 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:11:55.190527 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:55.191473 27158 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 6. Current term is 7.
I20260709 12:11:55.089160 27030 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:55.199962 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:55.206564 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:55.214185 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:55.203361 27202 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:55.276387 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:11:55.278801 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 88370.3us
I20260709 12:11:55.203786 27204 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:55.285446 27204 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:55.276460 27127 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:55.288126 27127 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:55.288187 27204 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:55.205271 27107 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:55.289036 22860 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:55.298480 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 98058us
I20260709 12:11:55.300710 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:55.305531 27112 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:55.333539 27213 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:11:55.361728 27030 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:55.366852 27112 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:55.371104 27107 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:55.372006 27054 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:55.377381 27112 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:55.412945 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 198854us
I20260709 12:11:55.414600 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:55.346305 26991 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:11:55.420022 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:11:55.432435 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 181983us
W20260709 12:11:55.438416 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 369283us
I20260709 12:11:55.442521 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:55.450325 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:55.451455 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:55.425786 27085 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.469465 27127 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:55.474713 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 223384us
I20260709 12:11:55.435091 27225 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:55.487627 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 184450us
I20260709 12:11:55.437708 27205 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:11:55.534999 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:55.464913 27222 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:11:55.535346 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:55.553293 22189 raft_consensus.cc:2368] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12.
W20260709 12:11:55.551227 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 89426us
I20260709 12:11:55.561511 22190 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:55.561467 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:55.565943 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:55.595912 22268 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:55.599364 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 118984us
W20260709 12:11:55.621156 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 60641.1us
I20260709 12:11:55.712589 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:55.739558 22860 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:55.731328 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 109907us
I20260709 12:11:55.639303 27198 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:55.755353 27198 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:55.765856 27198 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:55.766935 27198 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.781183 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:55.802167 27231 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.264s
W20260709 12:11:55.803469 27240 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:11:55.804111 27228 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:11:55.744295 27059 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:55.808674 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50099.8us
W20260709 12:11:55.815747 27239 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:11:55.840878 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.857486 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:55.863833 22269 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:55.805776 27235 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.867925 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:55.876904 27233 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:55.877600 27233 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:55.879807 27233 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:55.881469 27224 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
I20260709 12:11:55.889787 27222 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:55.890581 27222 consensus_queue.cc:1243] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:55.902768 27112 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:55.832350 27059 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:55.908972 27059 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:55.880358 27233 consensus_queue.cc:1059] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:55.936141 22123 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:55.960482 27203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.013s	sys 0.028s
W20260709 12:11:55.989768 27203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.014s	sys 0.028s
I20260709 12:11:56.007740 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.011804 22236 leader_election.cc:400] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12.
I20260709 12:11:56.012262 22236 leader_election.cc:403] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:56.013164 27234 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:56.014149 27234 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:11:56.019801 27238 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.208s	user 0.000s	sys 0.003s
W20260709 12:11:56.050102 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 175901us
W20260709 12:11:56.056265 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 200460us
I20260709 12:11:55.984103 27225 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:56.059514 22193 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:56.054677 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.063843 22190 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:56.067544 22194 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:56.039656 26999 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:56.075704 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.076128 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:11:56.079605 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 67996.1us
I20260709 12:11:56.079749 27253 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:56.061633 27225 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:56.013604 27202 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12.
I20260709 12:11:56.087864 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.015403 27234 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.072513 27112 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.204676 22192 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:11:56.083212 26999 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:56.246743 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 115518us
I20260709 12:11:56.084924 27253 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:56.140283 27030 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.089355 27065 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 12:11:56.245711 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2490) took 1169 ms. Trace:
I20260709 12:11:56.129419 27235 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 12:11:56.237972 27234 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.264130 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.261628 22195 rpcz_store.cc:276] 0709 12:11:55.069190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.069344 (+   154us) service_pool.cc:224] Handling call
0709 12:11:55.069690 (+   346us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:55.118023 (+ 48333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.118071 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:55.163498 (+ 45427us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b2c00000448. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:11:55.164332 (+   834us) log.cc:844] Serialized 78 byte log entry
0709 12:11:55.472386 (+308054us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:55.472451 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.472560 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.018853 (+546293us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:11:56.238448 (+219595us) raft_consensus.cc:1685] finished
0709 12:11:56.238474 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.238657 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1550,"raft.queue_time_us":19001,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":48854,"spinlock_wait_cycles":27194880,"thread_start_us":307517,"threads_started":1,"wal-append.queue_time_us":470742}
I20260709 12:11:56.270145 27253 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.271867 27253 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:56.275054 27254 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:11:56.275030 22195 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:56.284365 26999 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.305616 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.260911 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.081512 27158 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.178s
I20260709 12:11:56.315197 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.317981 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.321482 22268 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:56.322852 22264 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:56.322365 27170 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.325922 27170 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.327541 27205 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:56.327978 27205 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:56.328306 27170 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.329268 27260 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:56.329936 27260 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.330529 27205 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.332331 27260 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:56.337008 27260 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.338058 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:56.341466 27158 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:56.341928 27260 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:56.342098 27158 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.342474 27260 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:56.345796 27255 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:56.346390 27255 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.347141 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.349040 26896 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:56.343595 27260 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.365294 27263 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:56.366046 27263 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.367429 27030 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:56.368016 27030 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.376704 27030 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:56.362905 27158 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:56.457032 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 133410us
I20260709 12:11:56.463351 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:56.485404 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.498381 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:56.501859 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.312023 27225 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.502254 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.510941 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:56.462998 27030 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:56.507829 27234 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:56.501259 27065 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:56.516620 27202 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:56.526561 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:56.528273 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.517117 27158 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:11:56.533041 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.533517 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.533964 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.534083 27202 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:56.535449 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.507550 27183 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:56.536585 27202 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:56.533215 27158 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.541342 27158 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:56.538264 27183 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.544970 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.543995 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.511919 27106 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.512190 27180 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:56.518808 27263 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:56.567004 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.561879 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.552501 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.507398 27233 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:11:56.569977 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.513667 27235 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:11:56.551743 27197 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:56.561033 27203 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:56.583679 27257 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:56.584281 27257 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.585784 27263 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:56.586421 27257 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.586434 27263 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.588701 27242 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:11:56.590328 27263 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:56.543145 27229 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.564977 27225 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.530498 27030 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.593132 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.595746 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.603543 22237 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.604562 22237 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.606197 27183 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.568516 27180 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.606298 22237 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.607739 27202 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:56.608428 27202 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:56.608831 27180 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.608942 27158 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:56.612933 27258 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 12:11:56.613202 27158 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.613911 27158 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.616357 27158 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:56.561368 27106 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.621655 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.622649 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.627513 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.632179 27030 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:56.634555 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.638768 27106 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.651594 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.653520 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2141) took 1107 ms. Trace:
I20260709 12:11:56.653970 22123 rpcz_store.cc:276] 0709 12:11:55.546602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.546807 (+   205us) service_pool.cc:224] Handling call
0709 12:11:55.547142 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.937483 (+390341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.653237 (+715754us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54002ad5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:56.653427 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884963200}
I20260709 12:11:56.658354 27233 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:56.658880 27233 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.662662 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.665436 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.673233 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.712695 27227 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:56.697851 27180 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:56.713660 27227 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.713994 27180 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.714996 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.699091 27170 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:56.716096 27227 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.716434 27170 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:11:56.717118 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.712819 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.700364 27183 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:56.719297 27183 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.720108 27180 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.700666 27257 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:56.702282 27112 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:56.721287 27183 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.721026 27257 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.721699 27112 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.723670 27257 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.723917 27112 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:56.680723 27255 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:56.704170 27235 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:56.670023 27260 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.725823 27013 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.725608 27235 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.726318 27013 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.727705 27235 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:56.706600 22115 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:56.728668 27013 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.732546 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:56.692977 27233 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:56.733853 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:56.710546 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.704305 27065 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:56.735188 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.735347 27065 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.736629 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.718600 27170 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:56.737613 27065 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:56.700428 27085 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:56.730293 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.773198 22863 raft_consensus.cc:2393] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:56.707181 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.688668 27059 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:56.700491 27205 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.778362 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:56.710188 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 44915us
I20260709 12:11:56.739534 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:56.742102 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:56.743906 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:56.745527 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:56.754186 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.744442 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.791008 22123 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:11:56.794123 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:56.824746 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.834236 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.834972 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.835433 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.836341 22270 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:56.826280 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:56.838478 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.839752 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.840646 22270 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:56.830266 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.841708 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.842917 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.843528 27197 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.845355 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:56.846184 27065 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:56.831429 27253 consensus_meta.cc:287] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.559s	user 0.005s	sys 0.006s
I20260709 12:11:56.848140 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:56.796661 27085 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.856699 27253 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:56.858500 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:56.859171 27253 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.811769 27203 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:11:56.882736 27203 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:56.883154 27203 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:11:56.859891 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 65886us
I20260709 12:11:56.861231 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.836421 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.858563 27085 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:56.811367 27059 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:56.894960 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:56.895788 22191 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:11:56.896600 27059 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:56.903182 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.904440 26901 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.906790 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:11:56.910770 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52383.6us
I20260709 12:11:56.911046 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.912055 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:56.911661 22119 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:56.914454 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.917200 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.911593 22163 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:56.921590 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:56.923426 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:56.923723 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:56.924991 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:56.925295 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:56.929169 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:56.928392 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:56.884173 27203 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:56.936693 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:56.942428 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:56.920488 27059 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.933063 27085 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:11:56.936635 26901 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:56.963425 26901 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.964076 26901 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.931612 27158 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:56.927754 27263 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.934685 27261 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.934796 27197 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:56.958355 27170 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:56.971694 27170 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:56.972380 27170 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:56.953104 27253 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:56.973361 27253 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:56.986711 22263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.032s	sys 0.079s
W20260709 12:11:56.987087 22263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.032s	sys 0.079s
I20260709 12:11:56.976483 27253 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:57.014031 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:57.016616 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:57.026206 27085 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:57.009512 27216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.003s	sys 0.019s
W20260709 12:11:57.029435 27216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.003s	sys 0.019s
I20260709 12:11:56.986454 27229 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.036613 22114 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:57.043637 27168 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:57.013170 27261 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:57.045357 27261 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:57.040673 27253 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.050647 27261 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:57.058195 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:57.035764 26901 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:57.027633 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:57.077464 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49914.6us
I20260709 12:11:57.078567 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:57.084807 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 152208us
I20260709 12:11:57.087677 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:57.089666 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:11:57.090546 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 155241us
I20260709 12:11:57.097283 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:57.083811 27253 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:57.108930 22198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:57.110656 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:57.083112 27235 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:57.117208 22265 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:11:57.119329 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:57.090934 26914 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:57.097164 27264 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:57.104763 27261 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:57.123582 27112 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:57.118152 27127 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.114888 27233 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.138702 22198 raft_consensus.cc:606] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:57.152619 22198 raft_consensus.cc:614] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:57.156525 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:57.157823 22192 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:57.140466 27261 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:57.152163 27127 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:57.152006 27112 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:11:57.191756 27261 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:57.199486 27203 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.193346 27112 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:57.186726 27276 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:11:57.153951 26914 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:57.215006 26901 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:57.215914 26914 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:57.222618 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:57.216281 27278 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:11:57.224133 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:57.224879 22270 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.192857 27127 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:57.273339 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51315.3us
W20260709 12:11:57.274718 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.298550 22198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
W20260709 12:11:57.299105 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 373850us
I20260709 12:11:57.299386 22198 raft_consensus.cc:606] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:57.299978 22198 raft_consensus.cc:614] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:57.278846 27106 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.320132 22270 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:57.303767 27197 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.326517 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:57.331552 27197 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:57.338335 27197 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:57.344250 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:57.383562 27261 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:57.385488 22272 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:57.392135 27170 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:57.394490 27170 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:57.353672 27286 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:57.396073 27286 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:57.397090 27286 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:57.399331 22194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:57.399955 22194 raft_consensus.cc:606] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:57.400279 22194 raft_consensus.cc:614] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:57.319864 27106 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:57.401743 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 77753us
I20260709 12:11:57.413873 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:57.418675 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:11:57.419458 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:57.419973 22859 raft_consensus.cc:2393] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:11:57.425853 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:57.425063 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:57.427599 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:57.430388 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:57.433264 22122 raft_consensus.cc:2410] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:11:57.452695 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:57.434126 26999 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:57.451399 27289 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:11:57.446453 27180 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.476450 27261 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:57.483243 27106 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:57.483407 22116 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:57.461155 26999 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:57.485375 26999 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:57.487337 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53411.4us
I20260709 12:11:57.488204 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:57.431807 27112 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:57.490758 27112 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:57.493352 27059 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.501202 22123 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.502341 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:57.502965 22269 raft_consensus.cc:2368] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13.
I20260709 12:11:57.506990 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:57.515045 22088 leader_election.cc:400] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13.
I20260709 12:11:57.515405 22088 leader_election.cc:403] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:57.519028 27183 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:57.519516 27183 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:57.525650 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:57.526499 22266 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:57.529569 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:57.531064 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:57.535523 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:57.552354 22195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:57.559146 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:57.560020 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:57.560038 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:57.553063 22195 raft_consensus.cc:606] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:57.551570 27085 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.592391 27059 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:57.558255 27180 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:11:57.617046 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 96472.9us
W20260709 12:11:57.620077 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 54584.9us
I20260709 12:11:57.626029 22123 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:57.607010 27235 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:11:57.641950 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:57.630160 27180 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:57.654827 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:57.630702 27233 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13.
I20260709 12:11:57.654843 22198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:11:57.654790 22122 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:11:57.660131 22198 raft_consensus.cc:606] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:57.661518 27300 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:57.642921 27013 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:57.623931 27059 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:57.653229 27183 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:57.669037 27300 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.689980 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:57.650555 27235 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:57.694000 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:11:57.688108 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48336.6us
I20260709 12:11:57.659212 27127 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:57.720327 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:57.695451 27300 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.696545 27013 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:57.724388 27236 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.699378 27170 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:57.743934 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 135703us
I20260709 12:11:57.726523 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:11:57.748759 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:57.774704 27013 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:57.775431 27183 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:57.778450 27301 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:11:57.823454 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 1302) took 1229 ms. Trace:
I20260709 12:11:57.824015 22268 rpcz_store.cc:276] 0709 12:11:56.583702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.587000 (+  3298us) service_pool.cc:224] Handling call
0709 12:11:56.587256 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.628384 (+ 41128us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:56.665311 (+ 36927us) log.cc:844] Serialized 14 byte log entry
0709 12:11:57.096285 (+430974us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:57.096373 (+    88us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:57.096447 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.377912 (+281465us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18004076e0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:11:57.509960 (+132048us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b18004076e0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceaca32a6 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419
0709 12:11:57.813285 (+303325us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b540026b6d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:11:57.813339 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.813468 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6343,"prepare.queue_time_us":54076,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":9524,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":13578,"spinlock_wait_cycles":212771840,"thread_start_us":460767,"threads_started":2,"wal-append.queue_time_us":438134}
I20260709 12:11:57.782873 26999 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:57.831089 27303 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:11:57.835703 27127 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:57.837549 27180 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:57.849853 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:57.850729 22270 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:57.851406 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:57.855465 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:57.802377 27236 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:57.872066 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:57.831118 27170 raft_consensus.cc:993] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
W20260709 12:11:57.880195 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 67199.1us
I20260709 12:11:57.868402 27263 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:57.868075 27261 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:57.893961 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 236824us
I20260709 12:11:57.915693 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:57.919641 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:57.879565 27236 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:57.876695 27085 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:11:57.883991 26901 raft_consensus.cc:1081] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:11:57.946014 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:57.951805 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:57.963104 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:57.966662 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:57.970189 26999 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:57.969897 27236 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:57.988214 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:57.996207 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:57.968452 27112 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.995743 22116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:11:58.002331 22116 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.002820 22116 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:57.996380 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 123218us
W20260709 12:11:58.015637 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 267303us
W20260709 12:11:58.012720 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 83180.4us
I20260709 12:11:58.023149 22123 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:11:58.023530 22116 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.031526 27320 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.034699 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:58.034089 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:58.036672 22271 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:58.044731 22116 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:58.045454 27305 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.048813 27197 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:58.049365 27197 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:58.049067 27305 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:58.050191 27197 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.051154 27305 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:58.048092 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:58.057560 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:58.058248 22193 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:58.058558 22193 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:58.059376 27197 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:58.071547 22271 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:58.072042 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:11:58.073817 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57501.1us
I20260709 12:11:58.076747 22266 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:58.032167 27320 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.077982 22265 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:58.079530 27320 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:58.082619 27059 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:58.085603 27235 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:58.088522 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:58.059398 22193 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.089915 27065 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:58.090093 22193 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:58.090401 27065 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:58.091315 27065 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.092406 27065 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:58.093492 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:58.094208 22197 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:11:58.096144 27300 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.097427 22191 raft_consensus.cc:2368] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13.
I20260709 12:11:58.099738 22118 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:11:58.103976 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:58.105515 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:58.105695 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:58.111094 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:58.111737 22114 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:11:58.113426 27059 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:58.114045 27059 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:58.114976 27059 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.119835 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:58.120555 22114 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:11:58.124814 26914 raft_consensus.cc:993] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:11:58.125288 26914 raft_consensus.cc:1081] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
W20260709 12:11:58.132727 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 72022.7us
I20260709 12:11:58.145979 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:58.146744 22114 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.147862 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:58.148958 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:58.148305 22021 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:58.150089 22021 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:58.153208 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:58.153880 22021 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:58.155591 22021 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 10 to 11, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 11 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:58.163640 22021 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 7 to 8, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 8 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:58.172403 22021 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 7 to 8, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 8 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:58.164636 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57847.8us
I20260709 12:11:58.098556 27300 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:58.167564 22122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:11:58.194692 22193 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:11:58.194928 22122 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.195497 22122 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.198230 22021 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 10 to 11, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 11 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:58.168387 22087 leader_election.cc:400] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13.
I20260709 12:11:58.201327 22087 leader_election.cc:403] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:58.204111 22114 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:58.174064 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 258) took 8579 ms. Trace:
I20260709 12:11:58.120501 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:58.189131 27283 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:58.168366 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:58.200114 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:58.213783 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:58.214584 22264 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:58.216048 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 95609.7us
I20260709 12:11:58.221685 27299 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:58.222658 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:58.223114 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:58.212175 22122 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.221758 27283 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.214564 27205 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13.
I20260709 12:11:58.234289 22264 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:11:58.236502 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:58.241907 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:58.237648 27205 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:58.247947 27063 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:58.248483 27063 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.248893 27063 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.250959 27106 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:58.251585 27106 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:58.252424 27106 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.254441 27320 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:58.254922 27320 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.255298 27320 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.252449 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:58.258589 22191 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:58.258867 22191 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:58.260563 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:58.261531 22122 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:58.234633 27059 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:58.237178 27299 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:58.266413 22191 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.267612 22191 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.274585 27283 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:58.276747 27299 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:58.278261 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:58.283473 22162 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:11:58.289122 27015 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:58.292800 22122 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:58.296917 26999 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:58.305027 22021 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:58.316851 22021 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 7 to 9, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 9 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:11:58.324990 27263 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.325624 27263 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.327817 27263 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:58.327714 27063 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:58.330587 27063 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:58.206036 22017 rpcz_store.cc:276] 0709 12:11:49.594978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.602195 (+  7217us) service_pool.cc:224] Handling call
0709 12:11:58.173984 (+8571789us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:54.197144 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:54.337442 (+140298us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:54.337500 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:11:54.337513 (+    13us) tablet.cc:662] Decoding operations
0709 12:11:54.514961 (+177448us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:54.515074 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:54.515113 (+    39us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:11:54.519698 (+  4585us) tablet.cc:701] Row locks acquired
0709 12:11:54.519757 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:11:54.519967 (+   210us) write_op.cc:270] Start()
0709 12:11:54.520134 (+   167us) write_op.cc:276] Timestamp: P: 1783599114519892 usec, L: 0
0709 12:11:54.520173 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:11:54.532822 (+ 12649us) log.cc:844] Serialized 9554 byte log entry
0709 12:11:54.965896 (+433074us) op_driver.cc:464] REPLICATION: finished
0709 12:11:55.202969 (+237073us) write_op.cc:301] APPLY: starting
0709 12:11:55.203092 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:55.803394 (+600302us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:55.803547 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:56.278766 (+475219us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:56.279311 (+   545us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:11:56.279377 (+    66us) write_op.cc:312] APPLY: finished
0709 12:11:56.280013 (+   636us) log.cc:844] Serialized 212 byte log entry
0709 12:11:56.666881 (+386868us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcceacb80ac 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b
0709 12:11:57.029826 (+362945us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:57.030045 (+   219us) write_op.cc:454] Released schema lock
0709 12:11:57.030139 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:57.030587 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:57.030621 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1927175,"reported_tablets":37,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":233009,"apply.run_cpu_time_us":60129,"apply.run_wall_time_us":1827609,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104495,"num_ops":24,"prepare.queue_time_us":94720,"prepare.run_cpu_time_us":14842,"prepare.run_wall_time_us":481936,"raft.queue_time_us":196967,"raft.run_cpu_time_us":14954,"raft.run_wall_time_us":173827,"replication_time_us":433606,"spinlock_wait_cycles":76329728,"thread_start_us":1141365,"threads_started":5,"wal-append.queue_time_us":883556,"wal-append.run_cpu_time_us":19798,"wal-append.run_wall_time_us":2393151}]]}
I20260709 12:11:58.331992 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:58.333115 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:58.339463 22123 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.333942 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:58.357128 22123 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:11:58.359165 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:58.375664 27063 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:58.376452 27063 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:11:58.378657 22264 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:58.353600 27320 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.386735 27320 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:58.388315 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:58.389109 22193 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.398126 22193 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:11:58.399691 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:11:58.402285 27320 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:58.402848 27320 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:58.381623 27063 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:58.403672 27320 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:58.401765 22191 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:11:58.411851 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:11:58.412420 22264 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.409992 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:58.415331 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:58.416110 22123 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:11:58.382490 27322 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:58.418677 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:58.419322 22123 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.435201 22123 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:11:58.439479 22264 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:11:58.418233 27235 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:58.475034 27235 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:11:58.484025 27235 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:58.515370 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51821.9us
I20260709 12:11:58.516912 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:58.535594 27263 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:58.550311 27263 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.550729 27263 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:58.640051 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 81041.9us
W20260709 12:11:58.640987 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 113157us
W20260709 12:11:58.641367 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 82709.6us
W20260709 12:11:58.643754 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 85156.6us
I20260709 12:11:58.652314 22120 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:58.657505 27065 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:11:58.658156 27065 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:58.660526 27065 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:11:58.642779 27327 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.116s	user 0.004s	sys 0.000s
I20260709 12:11:58.768751 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:58.871166 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:58.874969 22264 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:11:58.878158 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 114789us
W20260709 12:11:58.880719 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 84387.7us
I20260709 12:11:58.892555 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:58.919939 22122 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:58.916630 27298 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:58.935155 22191 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:58.950798 27338 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:58.917304 27170 consensus_queue.cc:1059] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:58.961189 27334 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:58.986083 22264 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:11:58.995114 27063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.121s	sys 0.158s
W20260709 12:11:58.997438 27063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.122s	sys 0.158s
I20260709 12:11:59.000998 22859 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:58.974689 27263 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:59.006806 22269 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:59.011875 22191 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:59.012579 22191 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:59.024097 22191 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:59.025993 22191 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:59.049815 22197 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:59.087523 22114 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:11:59.091431 27170 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:11:59.088447 27263 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:59.088414 27235 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.100809 27235 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:59.103786 27235 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:59.111794 27282 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:59.114599 22193 pending_rounds.cc:85] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 9
I20260709 12:11:59.115010 22193 pending_rounds.cc:107] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:59.115254 22193 raft_consensus.cc:2889] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:59.114599 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 199295us
I20260709 12:11:59.117352 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:59.122720 22196 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:11:59.065831 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 142623us
I20260709 12:11:59.129820 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:59.130651 22114 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.126221 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:11:59.137910 22122 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:59.152263 22114 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:11:59.121047 27335 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:11:59.173867 22116 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:59.182832 27013 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:59.188796 22111 tablet_service.cc:1558] Processing DeleteTablet for tablet f86b841ece254f9bbfd1bd07c08f7004 with delete_type TABLET_DATA_TOMBSTONED (TS ea51e825f0ab4ea2bb6c4d0e29709ca3 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:37726
I20260709 12:11:59.191259 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:59.195097 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:11:59.199211 22088 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:59.200366 27298 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:59.199391 27320 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:11:59.200237 27261 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:59.287843 22118 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:59.294394 22114 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:59.283735 27344 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:59.414846 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 131767us
I20260709 12:11:59.283941 27286 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 12:11:59.418290 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:59.284061 27283 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 12:11:59.286415 27261 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:11:59.426909 27316 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:11:59.445509 27013 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:59.445990 27013 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:11:59.446874 27013 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:59.447925 27013 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.416688 27344 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:59.507997 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65967.4us
W20260709 12:11:59.518697 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 93771.2us
W20260709 12:11:59.520533 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57149.9us
I20260709 12:11:59.493001 27320 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.522037 27358 tablet_replica.cc:333] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
W20260709 12:11:59.548650 27355 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:11:59.527197 27320 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:11:59.551481 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 254028us
W20260709 12:11:59.556237 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 139951us
I20260709 12:11:59.583024 27320 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:59.532377 27261 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:59.592636 27059 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:59.593122 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:59.607264 27358 raft_consensus.cc:2243] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:59.614308 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:59.615435 22116 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:11:59.638592 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:59.648952 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:11:59.644806 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 105757us
I20260709 12:11:59.665298 27368 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:59.673142 27344 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:11:59.707795 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 66182.2us
I20260709 12:11:59.714463 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:11:59.695472 27341 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:11:59.717125 27341 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:59.719599 27341 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:11:59.707444 27368 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.723959 27368 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:59.732656 27298 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.733441 27298 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:11:59.735940 27298 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:11:59.736697 27358 raft_consensus.cc:2272] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:59.741568 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:11:59.753191 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 43708.6us
I20260709 12:11:59.761900 27358 ts_tablet_manager.cc:1916] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:59.765551 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:11:59.766503 27370 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:11:59.773280 27372 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:11:59.800729 27316 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:11:59.829648 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:11:59.830569 22114 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:11:59.805554 27368 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:11:59.845763 22263 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:11:59.848376 27368 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:11:59.859208 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:11:59.864522 22197 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:59.879459 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:11:59.881059 22120 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:59.883785 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:11:59.944416 22087 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:11:59.959043 22120 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:11:59.960624 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:11:59.974813 27205 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:59.981647 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:11:59.981000 27320 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:00.005558 27320 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:00.006533 27320 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:00.014882 27358 ts_tablet_manager.cc:1929] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.7
W20260709 12:12:00.026338 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44888.4us
I20260709 12:12:00.027563 27374 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.767392 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:00.046972 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 75404.1us
I20260709 12:12:00.066730 22197 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
W20260709 12:12:00.125777 22021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 141) took 13715 ms (client timeout 15000 ms). Trace:
I20260709 12:12:00.064407 27358 log.cc:1199] T f86b841ece254f9bbfd1bd07c08f7004 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/wals/f86b841ece254f9bbfd1bd07c08f7004
W20260709 12:12:00.126500 22021 rpcz_store.cc:269] 0709 12:11:46.359027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.359244 (+   217us) service_pool.cc:224] Handling call
0709 12:11:46.377408 (+ 18164us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:00.068233 (+13690825us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:58.760411 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:58.809395 (+ 48984us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:58.810839 (+  1444us) write_op.cc:435] Acquired schema lock
0709 12:11:58.813462 (+  2623us) tablet.cc:662] Decoding operations
0709 12:11:58.852346 (+ 38884us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:58.855540 (+  3194us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:58.856481 (+   941us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:11:58.955071 (+ 98590us) tablet.cc:701] Row locks acquired
0709 12:11:58.955096 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:11:58.955250 (+   154us) write_op.cc:270] Start()
0709 12:11:58.955379 (+   129us) write_op.cc:276] Timestamp: P: 1783599118955201 usec, L: 0
0709 12:11:58.955397 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:11:58.956089 (+   692us) log.cc:844] Serialized 3628 byte log entry
0709 12:11:59.221106 (+265017us) op_driver.cc:464] REPLICATION: finished
0709 12:11:59.232196 (+ 11090us) write_op.cc:301] APPLY: starting
0709 12:11:59.232327 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:59.546645 (+314318us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:59.546756 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:59.672226 (+125470us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:59.740823 (+ 68597us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:11:59.740889 (+    66us) write_op.cc:312] APPLY: finished
0709 12:11:59.741240 (+   351us) log.cc:844] Serialized 89 byte log entry
0709 12:11:59.741446 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:59.741603 (+   157us) write_op.cc:454] Released schema lock
0709 12:11:59.741662 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:59.763229 (+ 21567us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b18002071c0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fccf17f8ef0 00007fccf17f9489 00007fccf17fb71a
0709 12:11:59.763348 (+   119us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:59.763400 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":272741,"reported_tablets":25,"spinlock_wait_cycles":14222720,"child_traces":[["op",{"apply.queue_time_us":10784,"apply.run_cpu_time_us":16831,"apply.run_wall_time_us":509938,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41765,"num_ops":9,"prepare.queue_time_us":219000,"prepare.run_cpu_time_us":17429,"prepare.run_wall_time_us":328020,"raft.queue_time_us":134819,"raft.run_cpu_time_us":15221,"raft.run_wall_time_us":578966,"replication_time_us":265523,"spinlock_wait_cycles":5871744,"thread_start_us":305858,"threads_started":4,"wal-append.queue_time_us":106755}]]}
W20260709 12:12:00.150334 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 81590.5us
I20260709 12:12:00.152257 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:00.161659 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 92422.7us
I20260709 12:12:00.174962 27013 raft_consensus.cc:2764] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:12:00.182528 22006 catalog_manager.cc:5028] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): tablet f86b841ece254f9bbfd1bd07c08f7004 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:12:00.197453 22017 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:00.204819 22017 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:00.211658 22017 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 11, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:00.213761 22017 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 13, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 13 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:00.223268 22120 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:00.221580 22017 catalog_manager.cc:5697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 8, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 8 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:00.225133 22017 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 12, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 12 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:00.226868 22017 catalog_manager.cc:5697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 9 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:00.230754 22017 catalog_manager.cc:5697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:00.236917 22017 catalog_manager.cc:5697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:00.241459 27320 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:12:00.271464 22191 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:12:00.281003 22191 pending_rounds.cc:85] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 7
I20260709 12:12:00.284667 22191 pending_rounds.cc:107] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:12:00.285108 22191 raft_consensus.cc:2889] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:00.297027 22017 catalog_manager.cc:5697] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 12, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 12 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:00.298615 22017 catalog_manager.cc:5697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 10 to 12, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 12 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:00.299616 22017 catalog_manager.cc:5697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:00.309265 22017 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 12, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 12 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:00.310658 22017 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 10, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 10 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:00.311615 27320 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:00.314803 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:00.315424 22860 raft_consensus.cc:606] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:00.311918 22017 catalog_manager.cc:5697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 5 to 7, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 7 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:00.316505 22017 catalog_manager.cc:5697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:00.318094 22017 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:00.320748 22017 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 14, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:00.329596 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:00.330328 22860 raft_consensus.cc:606] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:00.334824 22198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:00.335525 22198 raft_consensus.cc:606] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:00.340360 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:00.341240 22860 raft_consensus.cc:606] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:00.323055 22017 catalog_manager.cc:5697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 11, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 11 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:00.374112 22017 catalog_manager.cc:5697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 12, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 12 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:00.375550 22017 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 10 to 14, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:00.376807 22017 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 12, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 12 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:00.380532 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:00.381675 22860 raft_consensus.cc:606] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:00.396251 27333 raft_consensus.cc:993] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:00.396816 27333 raft_consensus.cc:1081] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:00.398509 22265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:12:00.399050 22265 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:00.399381 22265 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.416805 22265 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.420672 22265 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:00.422129 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:00.421893 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:00.423288 22863 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:00.423625 22863 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:00.424719 22863 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.426635 22863 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.407403 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:00.474900 22191 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.476850 22860 raft_consensus.cc:606] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:00.497547 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:00.499823 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:00.500955 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:00.520975 27336 raft_consensus.cc:993] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:00.521988 27334 raft_consensus.cc:1081] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:00.543143 22863 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:00.544750 22237 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:00.545763 27320 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:00.546375 27320 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:00.548032 27320 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.567545 22123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:00.568514 22123 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:00.569628 22120 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:12:00.569694 22123 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.577373 22189 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:12:00.580019 22191 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:00.583070 27368 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:00.585423 27261 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:12:00.578118 27338 raft_consensus.cc:476] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 12:12:00.631487 27168 raft_consensus.cc:993] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:00.632062 27168 raft_consensus.cc:1081] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:00.670893 22114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:00.671582 22114 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:00.671952 22114 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.675431 22123 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.684760 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:00.685541 22197 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.697247 22114 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.700573 22123 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:00.700712 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:00.701500 22863 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.701853 22863 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:00.702916 22863 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.703990 22863 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.706595 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:00.707286 22193 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.710753 22197 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:00.710911 22863 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:00.712196 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:00.713900 22114 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:00.715762 27205 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:00.716451 27205 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:00.717784 27205 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.738544 27334 raft_consensus.cc:993] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:00.750380 22193 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:00.753548 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:00.755122 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:00.755775 22863 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:00.756100 22863 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:00.756937 22863 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.753726 27334 raft_consensus.cc:1081] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:00.759800 22863 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.759199 27235 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:00.787695 27003 raft_consensus.cc:993] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:00.802392 27333 raft_consensus.cc:1081] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:00.810223 27236 raft_consensus.cc:993] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:00.810844 27236 raft_consensus.cc:1081] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:00.811810 27235 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:00.812760 27235 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.814445 22265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45844
I20260709 12:12:00.815116 22265 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:00.815469 22265 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.810133 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:12:00.818953 22269 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:00.819041 22123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:00.819411 22269 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:00.819706 22123 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:00.820113 22123 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.833053 22123 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.835867 22863 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:00.836730 22265 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:00.842418 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:00.843159 22114 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.851356 22114 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:00.852671 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:00.855700 22269 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.857084 27320 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:00.857617 27320 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:00.858481 27320 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:00.859229 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:00.859937 22263 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.861732 22123 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:00.862707 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:00.863293 22863 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:00.863584 22863 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:00.864274 22863 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.878543 22265 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:00.885560 22269 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:00.886482 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:00.887375 22197 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.887702 22197 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:00.891474 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:00.893174 22114 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:00.892810 22197 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:00.894057 22197 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.899849 22114 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:00.900749 22863 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.903154 22197 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:00.906035 22263 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:00.901115 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:00.909008 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:00.909614 22860 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:00.909896 22860 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:00.909629 27368 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:00.910632 22860 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.911193 27368 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:00.911947 22860 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:00.907342 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:00.922261 27235 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:00.926483 27235 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:00.927493 27235 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.912016 27368 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:00.932554 22863 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:01.006379 22193 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:01.012567 27368 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:01.016597 22860 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:01.140429 22860 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:01.142439 27320 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:01.238968 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 259) took 2295 ms. Trace:
I20260709 12:12:01.263547 22859 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:01.266014 27235 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:01.242512 22017 rpcz_store.cc:276] 0709 12:11:58.943243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.943455 (+   212us) service_pool.cc:224] Handling call
0709 12:12:01.238759 (+2295304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:00.409793 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:00.410395 (+   602us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:00.410429 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:12:00.410450 (+    21us) tablet.cc:662] Decoding operations
0709 12:12:00.412229 (+  1779us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:00.412313 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:00.412346 (+    33us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:12:00.423756 (+ 11410us) tablet.cc:701] Row locks acquired
0709 12:12:00.423774 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:12:00.423951 (+   177us) write_op.cc:270] Start()
0709 12:12:00.424081 (+   130us) write_op.cc:276] Timestamp: P: 1783599120423897 usec, L: 0
0709 12:12:00.424110 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:12:00.436991 (+ 12881us) log.cc:844] Serialized 8716 byte log entry
0709 12:12:00.539263 (+102272us) op_driver.cc:464] REPLICATION: finished
0709 12:12:00.634102 (+ 94839us) write_op.cc:301] APPLY: starting
0709 12:12:00.634190 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:00.774780 (+140590us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:00.774896 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:01.075756 (+300860us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:01.076095 (+   339us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 12:12:01.076146 (+    51us) write_op.cc:312] APPLY: finished
0709 12:12:01.076621 (+   475us) log.cc:844] Serialized 196 byte log entry
0709 12:12:01.085526 (+  8905us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:01.086748 (+  1222us) write_op.cc:454] Released schema lock
0709 12:12:01.086838 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:01.096187 (+  9349us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:01.096226 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34880,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":94546,"apply.run_cpu_time_us":34114,"apply.run_wall_time_us":462050,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96131,"num_ops":22,"prepare.queue_time_us":10634,"prepare.run_cpu_time_us":6126,"prepare.run_wall_time_us":33642,"replication_time_us":114965,"thread_start_us":98661,"threads_started":2}]]}
I20260709 12:12:01.263705 22193 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:01.317427 22193 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:01.322003 27335 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:01.299940 27338 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:12:01.373996 22863 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:01.376191 27205 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:01.389467 22191 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:01.421096 22859 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:01.423228 27368 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:01.403968 27338 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 12:12:01.453171 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53157.3us
I20260709 12:12:01.415884 22019 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 12 to 14, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.461190 22019 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:01.477999 22019 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 9 to 10, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 10 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:12:01.566308 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 118509us
W20260709 12:12:01.606024 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 147962us
I20260709 12:12:01.610021 22114 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:01.610582 22123 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:01.624089 27320 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:01.622895 27368 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 12:12:01.673543 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 54536.4us
I20260709 12:12:01.675645 22859 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:01.683291 22263 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:12:01.716077 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 248512us
I20260709 12:12:01.754568 27403 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
W20260709 12:12:01.759189 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 69251.4us
W20260709 12:12:01.872232 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 126032us
W20260709 12:12:01.890787 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 88877.6us
W20260709 12:12:01.967840 27418 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:01.961105 27405 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.219s
W20260709 12:12:01.986959 27419 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:12:02.048308 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47178.8us
W20260709 12:12:02.061962 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48013.6us
W20260709 12:12:02.089453 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 74566us
I20260709 12:12:02.093712 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:02.128402 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 52836.8us
W20260709 12:12:02.130287 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65417us
I20260709 12:12:02.328152 22017 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 12 to 13, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 13 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:02.329952 22017 catalog_manager.cc:5697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 11, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 11 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:02.331830 22017 catalog_manager.cc:5697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 10 to 13, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 13 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:02.334566 22017 catalog_manager.cc:5697] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 12, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 12 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:02.336269 22017 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 12, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 12 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:02.375519 22859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:02.376648 22859 raft_consensus.cc:606] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:02.381422 22017 catalog_manager.cc:5697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 9 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:02.382930 22017 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 12, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 12 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:02.395547 22859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:02.396687 22859 raft_consensus.cc:606] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:02.405992 22193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:02.406617 22193 raft_consensus.cc:606] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:02.412047 27440 raft_consensus.cc:993] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:02.412566 27440 raft_consensus.cc:1081] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
W20260709 12:12:02.413793 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 136145us
I20260709 12:12:02.416754 22268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45844
I20260709 12:12:02.417387 22268 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.417745 22268 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.418211 22859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:02.418954 22859 raft_consensus.cc:606] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:02.441033 22859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:02.441768 22859 raft_consensus.cc:606] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:02.443709 22111 tablet_service.cc:1558] Processing DeleteTablet for tablet f86b841ece254f9bbfd1bd07c08f7004 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:37726
I20260709 12:12:02.448944 22859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:02.449769 22859 raft_consensus.cc:606] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:02.450199 22859 raft_consensus.cc:614] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:02.451649 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:02.453975 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:02.454908 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:02.482651 22019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 238) took 9226 ms. Trace:
I20260709 12:12:02.442489 22268 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:02.497918 27435 raft_consensus.cc:993] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:02.498728 27431 raft_consensus.cc:1081] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:02.500890 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:12:02.501510 22269 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.501899 22269 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.521802 22269 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:02.526098 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:02.526849 22859 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:02.527194 22859 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:02.527498 22268 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:02.528049 22859 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:02.535054 22859 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.539331 22269 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:02.552384 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:02.553002 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:02.553710 22193 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:02.554020 22193 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:02.552913 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:02.554771 22193 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:02.555558 22122 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.556160 22193 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.559777 22191 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.483147 22019 rpcz_store.cc:276] 0709 12:11:53.256220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.256538 (+   318us) service_pool.cc:224] Handling call
0709 12:12:02.482583 (+9226045us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:01.641211 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:01.641737 (+   526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:01.641767 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:12:01.641783 (+    16us) tablet.cc:662] Decoding operations
0709 12:12:01.642326 (+   543us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:01.642381 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:01.642406 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:01.642708 (+   302us) tablet.cc:701] Row locks acquired
0709 12:12:01.642726 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:12:01.642907 (+   181us) write_op.cc:270] Start()
0709 12:12:01.643005 (+    98us) write_op.cc:276] Timestamp: P: 1783599121642862 usec, L: 0
0709 12:12:01.643024 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:12:01.643620 (+   596us) log.cc:844] Serialized 1311 byte log entry
0709 12:12:01.914574 (+270954us) op_driver.cc:464] REPLICATION: finished
0709 12:12:02.085534 (+170960us) write_op.cc:301] APPLY: starting
0709 12:12:02.085638 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:02.087796 (+  2158us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:02.087896 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:02.249636 (+161740us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:02.249865 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:12:02.249911 (+    46us) write_op.cc:312] APPLY: finished
0709 12:12:02.250153 (+   242us) log.cc:844] Serialized 41 byte log entry
0709 12:12:02.250339 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:02.250445 (+   106us) write_op.cc:454] Released schema lock
0709 12:12:02.250490 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:02.253798 (+  3308us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:02.253827 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11588,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":167086,"apply.run_cpu_time_us":9043,"apply.run_wall_time_us":168232,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16673,"num_ops":3,"prepare.queue_time_us":109158,"prepare.run_cpu_time_us":2733,"prepare.run_wall_time_us":4423,"replication_time_us":221248,"thread_start_us":240259,"threads_started":2}]]}
I20260709 12:12:02.575672 22193 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:02.580837 22191 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:02.582000 22122 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:02.580139 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:02.586985 27412 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:02.587545 27412 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:02.588465 27412 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:02.591951 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:02.593850 22006 catalog_manager.cc:5028] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): tablet f86b841ece254f9bbfd1bd07c08f7004 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:12:02.594995 22859 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:02.615451 27422 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:02.621166 27422 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:02.622192 27422 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:02.660555 27435 raft_consensus.cc:993] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:02.661289 27435 raft_consensus.cc:1081] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:02.663357 27336 raft_consensus.cc:993] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:02.664127 27439 raft_consensus.cc:1081] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:02.666283 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:12:02.667043 22269 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.667514 22269 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.683723 22122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:02.684463 22122 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.684892 22122 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.683588 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 260) took 1381 ms. Trace:
I20260709 12:12:02.693413 22017 rpcz_store.cc:276] 0709 12:12:01.301880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.302024 (+   144us) service_pool.cc:224] Handling call
0709 12:12:02.683485 (+1381461us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:02.494713 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:02.495319 (+   606us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:02.495363 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:12:02.495379 (+    16us) tablet.cc:662] Decoding operations
0709 12:12:02.496309 (+   930us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:02.496391 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:02.496427 (+    36us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:12:02.572348 (+ 75921us) tablet.cc:701] Row locks acquired
0709 12:12:02.573277 (+   929us) write_op.cc:260] PREPARE: finished
0709 12:12:02.578879 (+  5602us) write_op.cc:270] Start()
0709 12:12:02.581548 (+  2669us) write_op.cc:276] Timestamp: P: 1783599122578815 usec, L: 0
0709 12:12:02.582730 (+  1182us) op_driver.cc:348] REPLICATION: starting
0709 12:12:02.593295 (+ 10565us) log.cc:844] Serialized 2881 byte log entry
0709 12:12:02.595947 (+  2652us) op_driver.cc:464] REPLICATION: finished
0709 12:12:02.596647 (+   700us) write_op.cc:301] APPLY: starting
0709 12:12:02.596739 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:02.604484 (+  7745us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:02.604575 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:02.668730 (+ 64155us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:02.669072 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:12:02.669150 (+    78us) write_op.cc:312] APPLY: finished
0709 12:12:02.669548 (+   398us) log.cc:844] Serialized 73 byte log entry
0709 12:12:02.671197 (+  1649us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:02.671383 (+   186us) write_op.cc:454] Released schema lock
0709 12:12:02.671456 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:02.671909 (+   453us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:02.671952 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":91704,"reported_tablets":10,"spinlock_wait_cycles":42112,"child_traces":[["op",{"apply.queue_time_us":450,"apply.run_cpu_time_us":11408,"apply.run_wall_time_us":75219,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29274,"num_ops":7,"prepare.queue_time_us":75705,"prepare.run_cpu_time_us":4896,"prepare.run_wall_time_us":98938,"replication_time_us":13030,"thread_start_us":33829,"threads_started":1}]]}
I20260709 12:12:02.705047 22122 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:02.713454 22269 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:02.717971 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:02.718721 22191 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.719405 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:02.720036 22859 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:02.720333 22859 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:02.721176 22859 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:02.722333 22859 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.725152 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:02.725771 22116 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.747262 22116 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:02.757515 27413 raft_consensus.cc:993] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:02.758198 27413 raft_consensus.cc:1081] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:02.750948 22859 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:02.759250 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:02.751469 22269 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:02.762378 27335 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:02.762787 22191 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:02.763000 27335 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:02.767565 27335 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:02.766724 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:12:02.774415 22269 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.776630 22269 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:02.773146 22021 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:02.779881 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:02.782339 22122 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:02.783403 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:02.784062 22859 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:02.784484 22859 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:02.785591 22859 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:02.790096 22859 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.801558 22859 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:02.787914 27426 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:02.814163 27426 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:02.812518 22021 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:02.815239 27426 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:02.819659 22021 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 14 to 15, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:02.847242 22269 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:02.857121 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:02.857842 22122 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:02.857853 22269 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:02.858994 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:02.859745 22859 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:02.860088 22859 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:02.860941 22859 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:02.862033 22859 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:02.876652 22122 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:02.878248 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:02.885305 22859 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:02.887202 27261 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:02.887900 27261 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:02.888866 27261 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:02.893466 22020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 227) took 14877 ms (client timeout 15000 ms). Trace:
W20260709 12:12:02.894049 22020 rpcz_store.cc:269] 0709 12:11:48.015866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.016067 (+   201us) service_pool.cc:224] Handling call
0709 12:12:02.893207 (+14877140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"reported_tablets":51}
I20260709 12:12:02.909157 22122 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:02.965742 22017 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 14, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:02.967555 22017 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 16, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 16 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:02.969183 22017 catalog_manager.cc:5697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 14, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 14 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:02.976399 22120 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:02.978163 27335 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:12:03.049641 22021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 142) took 2768 ms. Trace:
I20260709 12:12:03.050203 22021 rpcz_store.cc:276] 0709 12:12:00.281667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.281833 (+   166us) service_pool.cc:224] Handling call
0709 12:12:00.310300 (+ 28467us) spinlock_profiling.cc:243] Waited 8.41 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:03.049563 (+2739263us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:02.862893 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:02.899714 (+ 36821us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:02.899753 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:12:02.899772 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:02.900316 (+   544us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:02.900380 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:02.900417 (+    37us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:02.914036 (+ 13619us) tablet.cc:701] Row locks acquired
0709 12:12:02.916870 (+  2834us) write_op.cc:260] PREPARE: finished
0709 12:12:02.934975 (+ 18105us) write_op.cc:270] Start()
0709 12:12:02.937489 (+  2514us) write_op.cc:276] Timestamp: P: 1783599122933347 usec, L: 0
0709 12:12:02.938201 (+   712us) op_driver.cc:348] REPLICATION: starting
0709 12:12:02.938943 (+   742us) log.cc:844] Serialized 1311 byte log entry
0709 12:12:02.941405 (+  2462us) op_driver.cc:464] REPLICATION: finished
0709 12:12:02.941860 (+   455us) write_op.cc:301] APPLY: starting
0709 12:12:02.941950 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:02.944446 (+  2496us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:02.944545 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:02.947889 (+  3344us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:02.948059 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:12:02.948117 (+    58us) write_op.cc:312] APPLY: finished
0709 12:12:02.948358 (+   241us) log.cc:844] Serialized 41 byte log entry
0709 12:12:02.948542 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:02.948653 (+   111us) write_op.cc:454] Released schema lock
0709 12:12:02.948720 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:02.963982 (+ 15262us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:02.964028 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54202,"reported_tablets":16,"spinlock_wait_cycles":19343104,"child_traces":[["op",{"apply.queue_time_us":231,"apply.run_cpu_time_us":5314,"apply.run_wall_time_us":22019,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12546,"num_ops":3,"prepare.queue_time_us":157,"prepare.run_cpu_time_us":3568,"prepare.run_wall_time_us":79691,"replication_time_us":3039}]]}
I20260709 12:12:03.086108 22859 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:03.098625 22193 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:03.096740 27422 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:12:03.103644 27320 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:03.114634 22193 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:03.116578 27422 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:03.097805 22019 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 10 to 11, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 11 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:03.245221 22019 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 11 to 12, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 12 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.328958 22859 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:03.358700 27261 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:12:03.394215 22860 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:12:03.395361 22120 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:03.416129 27423 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:03.426621 27261 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:12:03.443375 22862 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:03.472098 27261 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:03.573963 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:03.592257 27467 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:12:03.640844 22189 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:12:03.643383 22122 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:03.676539 27422 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:03.706687 27424 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:03.913728 22020 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 14, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 14 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:03.979012 22193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:03.979925 22193 raft_consensus.cc:606] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:04.000032 22859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:04.000798 22859 raft_consensus.cc:606] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:04.001204 22859 raft_consensus.cc:614] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:04.021302 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:04.022038 22862 raft_consensus.cc:606] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:04.042671 22019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 239) took 1189 ms. Trace:
I20260709 12:12:04.044570 22017 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 13 to 14, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 14 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.048200 22859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:04.061208 22859 raft_consensus.cc:606] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:04.061641 22859 raft_consensus.cc:614] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:04.065014 22859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:04.059901 22017 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 11 to 12, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 12 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.065711 22859 raft_consensus.cc:606] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:04.071412 22859 raft_consensus.cc:614] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:04.072912 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:04.053901 22019 rpcz_store.cc:276] 0709 12:12:02.852811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.856858 (+  4047us) service_pool.cc:224] Handling call
0709 12:12:04.042555 (+1185697us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:03.543599 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:03.544690 (+  1091us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:03.544842 (+   152us) write_op.cc:435] Acquired schema lock
0709 12:12:03.544891 (+    49us) tablet.cc:662] Decoding operations
0709 12:12:03.545542 (+   651us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:03.545675 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:03.545719 (+    44us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:03.546284 (+   565us) tablet.cc:701] Row locks acquired
0709 12:12:03.546347 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:12:03.546624 (+   277us) write_op.cc:270] Start()
0709 12:12:03.546840 (+   216us) write_op.cc:276] Timestamp: P: 1783599123546539 usec, L: 0
0709 12:12:03.546894 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 12:12:03.548104 (+  1210us) log.cc:844] Serialized 925 byte log entry
0709 12:12:03.721465 (+173361us) op_driver.cc:464] REPLICATION: finished
0709 12:12:03.841362 (+119897us) write_op.cc:301] APPLY: starting
0709 12:12:03.841504 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:03.846216 (+  4712us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:03.846360 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:03.847692 (+  1332us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:03.848017 (+   325us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:12:03.848102 (+    85us) write_op.cc:312] APPLY: finished
0709 12:12:03.848429 (+   327us) log.cc:844] Serialized 33 byte log entry
0709 12:12:03.885893 (+ 37464us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.886316 (+   423us) write_op.cc:454] Released schema lock
0709 12:12:03.912031 (+ 25715us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:03.938127 (+ 26096us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.938160 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32480,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":119561,"apply.run_cpu_time_us":6032,"apply.run_wall_time_us":96451,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12491,"num_ops":2,"prepare.queue_time_us":49851,"prepare.run_cpu_time_us":5069,"prepare.run_wall_time_us":5069,"replication_time_us":174346,"thread_start_us":118442,"threads_started":2}]]}
I20260709 12:12:04.075222 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:04.089860 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:04.081323 22017 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 10 to 11, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 11 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.177541 22020 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 11 to 12, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 12 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:04.308494 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 228) took 1067 ms. Trace:
I20260709 12:12:04.308956 22017 rpcz_store.cc:276] 0709 12:12:03.241576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.252848 (+ 11272us) service_pool.cc:224] Handling call
0709 12:12:04.308419 (+1055571us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:04.158985 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:04.159595 (+   610us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:04.159826 (+   231us) write_op.cc:435] Acquired schema lock
0709 12:12:04.160073 (+   247us) tablet.cc:662] Decoding operations
0709 12:12:04.160919 (+   846us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:04.160990 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:04.161031 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:04.161428 (+   397us) tablet.cc:701] Row locks acquired
0709 12:12:04.161452 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:12:04.161622 (+   170us) write_op.cc:270] Start()
0709 12:12:04.161763 (+   141us) write_op.cc:276] Timestamp: P: 1783599124161564 usec, L: 0
0709 12:12:04.161785 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:04.162543 (+   758us) log.cc:844] Serialized 1311 byte log entry
0709 12:12:04.164648 (+  2105us) op_driver.cc:464] REPLICATION: finished
0709 12:12:04.165183 (+   535us) write_op.cc:301] APPLY: starting
0709 12:12:04.165283 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:04.167382 (+  2099us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:04.167488 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:04.170226 (+  2738us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:04.172348 (+  2122us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:12:04.172415 (+    67us) write_op.cc:312] APPLY: finished
0709 12:12:04.172678 (+   263us) log.cc:844] Serialized 41 byte log entry
0709 12:12:04.173915 (+  1237us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:04.174049 (+   134us) write_op.cc:454] Released schema lock
0709 12:12:04.174099 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:04.174493 (+   394us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:04.174529 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46495,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":317,"apply.run_cpu_time_us":5677,"apply.run_wall_time_us":9266,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12546,"num_ops":3,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":3430,"prepare.run_wall_time_us":3898,"replication_time_us":2718}]]}
I20260709 12:12:04.365970 27420 raft_consensus.cc:993] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:04.366581 27420 raft_consensus.cc:1081] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:04.375758 22265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45844
I20260709 12:12:04.376456 22265 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.376909 22265 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.398826 27439 raft_consensus.cc:993] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:04.399557 27439 raft_consensus.cc:1081] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:04.401746 22263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:12:04.402324 22263 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.402683 22263 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:04.407223 22265 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:04.419747 22263 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:04.427642 22263 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:04.428436 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:04.429363 22193 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:04.438874 22193 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:04.441835 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:04.443022 27428 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:04.443611 27428 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:04.444648 27428 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:04.449119 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:04.450032 22859 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:04.450403 22859 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:04.451574 22859 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:04.454124 22859 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:04.514235 22265 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:04.523303 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:04.524097 22193 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:04.524463 22193 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:04.528496 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:04.529249 22114 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.533555 22193 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:04.535249 22193 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.571924 22114 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:04.614785 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:04.616901 27261 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:04.617648 27261 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:04.614099 22021 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 9 to 10, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 10 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.619036 27261 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:04.587594 22193 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:04.612973 22859 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:04.726179 22021 catalog_manager.cc:5697] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 12 to 13, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 13 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.942086 22859 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:12:04.943984 27261 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:04.945315 22195 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:12:04.949482 27261 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:05.054930 22191 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:12:05.066823 27261 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:05.103821 22114 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:12:05.108000 27261 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:05.341425 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:05.381903 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59895.5us
I20260709 12:12:06.444043 27426 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:06.444984 27426 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:06.448477 27426 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:06.480244 27426 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:06.481163 27426 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:06.484097 27426 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:06.504731 27497 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:06.542553 22052 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc8a0 after lost signal to thread 20894
I20260709 12:12:06.765204 27497 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:06.768070 27497 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:06.768908 27497 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:06.769726 27497 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:06.772712 27497 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:06.779798 27426 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:06.811543 27501 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:06.813009 27502 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.061903 27503 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.064293 27501 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.064957 27426 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.067695 27501 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:07.085167 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080005ee60 after lost signal to thread 22055
I20260709 12:12:07.060319 27497 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.091400 27502 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.094046 27426 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.068828 27501 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.113925 27426 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.115320 27497 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.101820 27503 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.128561 27426 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.138630 27502 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.160063 27502 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.160678 27502 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.161345 27426 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.161881 27426 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.162194 27427 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.162731 27502 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.163297 27502 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.162935 27427 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.163872 27502 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:07.164906 22829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.017s	sys 0.030s
W20260709 12:12:07.165251 22829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.017s	sys 0.030s
I20260709 12:12:07.115841 27501 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.146988 27423 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:07.155874 22163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.405s	user 0.007s	sys 0.012s
I20260709 12:12:07.168884 27428 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.169476 27428 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.170176 27501 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.162328 27426 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.171681 27428 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:07.175374 22163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.424s	user 0.009s	sys 0.013s
I20260709 12:12:07.165583 27427 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.187690 27505 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.189579 27506 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.201855 27506 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.203682 27507 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.190361 27497 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.185173 27503 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.198230 27339 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.180888 27423 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.199311 27428 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.200583 27499 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.201206 27427 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.188328 27505 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.221289 27423 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.221174 27427 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.222083 27420 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.222728 27420 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.223383 27505 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.225589 27500 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.226533 27426 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.226369 27500 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.226989 27493 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.227625 27493 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.228094 27502 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.204407 27507 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.222105 27428 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.205724 27339 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.231091 27507 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.231186 27339 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.219892 27499 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.234071 27499 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.234983 27420 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.237115 27510 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.237651 27510 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.223399 27427 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.240152 27510 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.229283 27508 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.205070 27506 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.231186 27428 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.240754 27510 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.269032 27510 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.243494 27339 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.260247 27505 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.262796 27499 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.263944 27506 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.279973 27428 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.395049 27428 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.277009 27427 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.445472 27520 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.446501 27520 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.449718 27519 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.450773 27519 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.286243 27502 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.458461 27502 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.287576 27493 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.462109 27515 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.462977 27515 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.464857 27504 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.465670 27504 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.455667 27423 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.397163 27426 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.393389 27499 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.263486 27508 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.278553 27339 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.279413 27507 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.539628 27526 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.540684 27526 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.542866 27525 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.282274 27505 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.554736 27339 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.455077 27427 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.555410 27514 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.469008 27511 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.681077 27339 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.681720 27339 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.555927 27499 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.558799 27509 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.469182 27512 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.685029 27514 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.685474 27512 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.688146 27514 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.477978 27510 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.481559 27493 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.689419 27493 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.690757 27505 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.692032 27493 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.485337 27420 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.693308 27420 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.693773 27524 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.694662 27524 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.695904 27420 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.473201 27423 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.696897 27521 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.697747 27521 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.698745 27423 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.477420 27426 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.701138 27426 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.554855 27516 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.684485 27339 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.702250 27339 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.701959 27516 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.702983 27339 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.567889 27502 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.569653 27515 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.483966 27508 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.576233 27428 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.468760 27504 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.583680 27519 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.603744 27517 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.716952 27517 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.706499 27511 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.606686 27520 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.290732 27500 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.685067 27509 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.721390 27500 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.722138 27500 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.287390 27506 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.633370 27518 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.634400 27513 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.647084 27523 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.665244 27528 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.668046 27522 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:07.679386 22235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.014s	sys 0.021s
I20260709 12:12:07.724263 27509 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.693296 27427 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.704661 27516 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.599388 27507 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.688480 27512 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.817481 27339 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.692679 27493 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:07.833366 22235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.014s	sys 0.021s
I20260709 12:12:07.680608 27531 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.704988 27514 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.709163 27521 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.868820 27531 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.858312 27528 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.843552 27428 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.849839 27509 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.708722 27525 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.864658 27530 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.897315 27530 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.900287 27530 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.837241 27518 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.838286 27511 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.901031 27428 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.850234 27522 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.860486 27493 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.839555 27513 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.877406 27524 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.858610 27523 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.861276 27514 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.934460 27513 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.935508 27428 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.928139 27530 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.883301 27509 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.923727 27519 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:07.945618 27493 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.941823 27522 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.926553 27511 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.957968 27511 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:07.961323 27526 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.963068 27506 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.965431 27525 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.720422 27517 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.993237 27507 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:07.994203 27426 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.995312 27428 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:07.995937 27428 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:07.998931 27428 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.004576 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.011710 27489 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:08.012666 27489 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.014671 27500 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.015313 27519 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.017947 27523 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.019829 27518 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.941089 27524 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:07.995142 27426 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.052623 27426 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.974107 27521 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.053368 27521 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.055297 27521 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.056558 27528 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.057550 27524 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.060083 27524 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.967748 27508 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:08.024441 27514 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:07.968721 27511 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.050405 27509 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:07.991043 27510 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:07.968600 27531 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.040441 27530 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.081274 27426 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.084704 27261 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:08.103462 22052 debug-util.cc:398] Leaking SignalData structure 0x7b08002dca60 after lost signal to thread 22147
W20260709 12:12:08.111959 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080032cde0 after lost signal to thread 22222
I20260709 12:12:08.072988 27509 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.104033 27427 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.117074 27509 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.097666 27515 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.118355 27515 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.119825 27509 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.095600 27423 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.116233 27339 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:08.116475 27506 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.127470 27426 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.127449 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.127838 27423 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.127923 27339 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.130954 27423 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.081135 27508 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.131968 27536 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:08.122244 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.132891 27536 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.134313 27505 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.134493 27428 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.135006 27508 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.134886 27505 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.135241 27428 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:08.123782 22052 debug-util.cc:398] Leaking SignalData structure 0x7b0800343d60 after lost signal to thread 22296
I20260709 12:12:08.137068 27505 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.137311 27508 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.137650 27505 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.137815 27499 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.138257 27440 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.138337 27509 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.131997 27422 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.139135 27506 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.109341 27526 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.139443 27509 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.140012 27422 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.140220 27526 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.141657 27506 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.138034 27508 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.142321 27509 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.142551 27422 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.103822 27524 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:08.137672 27477 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.143970 27477 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.144449 27508 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.109843 27514 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.146463 27477 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.138497 27499 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.146958 27514 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.149602 27499 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.143510 27524 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.153353 27524 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.153184 27261 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.156273 27261 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.157081 27440 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.158039 27489 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.158761 27428 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.130167 27426 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.159448 27440 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.117173 27427 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.120472 27515 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.083127 27510 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.090246 27533 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.176662 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.173166 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.180474 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.182659 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.177646 22122 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:12:08.185946 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.109076 27521 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.183557 22263 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:08.186793 22122 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:08.109639 27511 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.121351 27528 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.135329 27536 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.206449 27427 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.203455 27521 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.233650 27521 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.209566 27528 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.196928 27428 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.210548 27510 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.211993 27530 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.192035 27533 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.234694 27428 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.235837 27528 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.236825 27533 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.213138 27511 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.239557 27511 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.217760 27514 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:08.221268 22052 debug-util.cc:398] Leaking SignalData structure 0x7b08003789a0 after lost signal to thread 22890
I20260709 12:12:08.222302 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.240732 22117 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:08.224841 27519 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.244740 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.225790 27339 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.229554 27526 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.237159 27428 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.245512 22118 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:12:08.247066 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.248484 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.252053 27516 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:08.252665 27516 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.261574 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.263221 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.255965 27516 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.138533 27505 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.275621 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.278757 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.276067 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.283516 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.283689 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.284296 22196 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:12:08.287350 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.288077 22264 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:08.290223 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.291114 27519 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.292014 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.292739 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.293299 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.294245 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.294617 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.295313 22861 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:12:08.281467 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.296147 22195 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:08.291782 27519 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.298565 27519 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.299080 27519 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.299556 27519 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.292802 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.280128 27339 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.302961 27339 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.305927 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.281201 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.309748 27339 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.310418 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.311321 27519 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.318437 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.313825 22264 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:08.316563 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.313218 22191 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:08.321436 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.322086 22857 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:08.332917 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.334204 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.335716 27505 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.335876 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.336440 27514 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.336567 22267 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:08.337095 27514 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.337402 22193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:08.337818 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.338059 22193 raft_consensus.cc:606] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:08.334383 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.339162 27514 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.339282 22271 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:12:08.339713 27514 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.340498 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.340929 27530 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.341229 22268 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:08.341547 27530 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.342059 27519 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.342658 27519 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.343724 27530 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.344641 27519 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.340294 27514 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.334321 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.346403 22193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:08.346658 27514 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:08.347038 22193 raft_consensus.cc:606] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:08.347887 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.348312 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:08.350278 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:08.350647 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.351131 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:08.365216 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.369088 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.369222 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.369741 22193 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:12:08.369958 22196 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:12:08.367352 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.371968 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.372658 22196 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:08.373822 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.376619 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.377422 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.377905 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.378796 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.378955 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.379992 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.380805 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.381162 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.382490 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.382769 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.383340 22122 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 4.
I20260709 12:12:08.385039 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.386183 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.390369 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.392288 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.393185 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.393781 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.394948 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.395715 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:08.396693 27500 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:08.397166 27500 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.397562 27500 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:08.400658 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.404963 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.405316 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:08.406390 27512 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.406824 27512 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.407594 27512 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.411183 27500 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.413661 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.415580 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.420131 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.416752 27512 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.421118 22117 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:12:08.423115 27512 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.424156 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.424908 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.425711 22196 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:08.426417 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.426839 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.427513 22271 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:08.428278 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.432235 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.433073 22189 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:08.433207 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.434068 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.434417 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.434724 22191 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:08.435050 22195 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:12:08.434967 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.437179 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.437826 22117 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:08.406808 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:08.439653 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.440387 27435 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.454454 27435 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.454878 27435 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.441264 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.458115 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.459247 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.459834 22263 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:12:08.460716 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.461758 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.448907 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.451164 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.449682 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.464130 22268 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:12:08.464372 22114 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:08.451853 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.450359 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.452473 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.466167 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.444414 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.450794 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.450013 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.442134 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.451500 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.436456 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.465225 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.450026 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.482965 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.481812 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.445161 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.488795 22191 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:08.439031 22830 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:08.478260 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:08.490536 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51607.3us
I20260709 12:12:08.490661 27533 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:08.491228 27533 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.491639 27533 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:08.491566 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.495651 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.495951 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.496747 22197 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:08.498521 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.498845 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.499557 22197 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:08.502465 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.504458 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.504792 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:08.505344 22120 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.506765 27500 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.507638 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.509218 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.511628 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.512269 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.513176 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.514173 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.514972 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.516594 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.516736 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.518162 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.519755 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.521106 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.521787 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.521894 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.523885 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.525308 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.525918 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.526244 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.526615 22189 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:08.526939 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.527652 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.528347 22198 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:08.529456 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.527657 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.530633 22193 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:08.531389 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:08.530802 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:08.533493 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:08.532464 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.533568 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.534304 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.528364 27435 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.536125 22864 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:08.538910 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.539322 27526 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:08.539651 22117 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:08.540053 27526 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.540455 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.540714 27526 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:08.541886 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.540748 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.543682 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.544086 27500 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:08.544585 27500 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.543154 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.545004 27500 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:08.545109 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.490085 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.546419 22196 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:12:08.547179 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.547725 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.548399 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.549238 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.549919 22117 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:12:08.550869 22120 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:08.551466 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.552157 22122 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:08.556418 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.557113 22120 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:08.556675 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.557205 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.558068 22830 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:08.559288 27512 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.559715 27512 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.560148 27512 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.561564 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.537585 27435 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.562232 22198 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:08.563095 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.563694 22191 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:08.562345 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.564628 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.567575 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.568611 27512 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.524307 27533 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.560030 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:08.569974 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.569904 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:08.572402 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.578740 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:08.586071 22114 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:12:08.573109 27435 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:08.591529 27435 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.592025 27435 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.573275 27526 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.595232 27427 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:08.595798 27427 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.571111 27512 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.574275 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.603345 22117 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:08.611552 27533 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:08.612859 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52906us
I20260709 12:12:08.614593 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:08.615931 27522 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:08.616346 27522 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.616743 27522 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.618189 27427 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.618939 27519 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:08.619365 27519 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.619741 27519 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.625690 27526 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.625921 27522 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.628944 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.629630 22117 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:12:08.626752 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:08.627635 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57820.4us
I20260709 12:12:08.627934 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:08.633617 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.633790 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:08.635154 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:08.635615 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.642282 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:08.645145 27533 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:08.645480 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:08.645915 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.645675 27533 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.646554 22118 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:12:08.645685 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.650110 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.650373 22116 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:12:08.650780 22189 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:12:08.651995 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.647918 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.646989 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.656674 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:08.652909 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:08.656270 27439 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:08.659279 27439 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.659356 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:08.659706 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:08.663328 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:08.647995 27526 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:08.668967 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.665087 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.675024 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:08.669247 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.671169 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:08.678956 22116 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.652688 27517 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.656797 27533 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.659727 27439 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.698964 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:08.703038 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.703378 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:08.679824 27526 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.706290 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.680485 27517 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.712836 22163 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:08.701529 27514 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.716677 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.719672 27539 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:08.719745 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.720269 27539 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.720638 27539 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:08.720938 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.715247 27339 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.715497 27526 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:08.730333 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.723536 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:08.714812 27517 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.735688 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.736011 27435 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.738322 27435 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.753197 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.757205 27522 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.718608 27514 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.758255 27514 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.765772 27440 raft_consensus.cc:993] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
W20260709 12:12:08.769608 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46645.3us
I20260709 12:12:08.769764 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:08.776952 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:08.778473 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:08.781790 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.783227 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.784566 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.784883 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.734231 27339 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.766323 27542 raft_consensus.cc:1081] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
W20260709 12:12:08.790493 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 129367us
I20260709 12:12:08.783244 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.787493 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:08.785185 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.799817 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:08.792394 22116 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:08.775460 27440 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.803187 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.804091 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.813808 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:08.782775 27519 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.816115 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.817466 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:08.813482 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:08.818920 22194 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.820847 27518 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:08.821231 27543 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.821478 27518 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:08.821770 27543 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.822301 27543 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.822048 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:08.822522 27518 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.785369 27544 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:08.824782 27530 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:12:08.825145 27544 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:08.825318 27530 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.825428 27500 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.827744 27500 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.827926 22194 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:08.796754 27339 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.785209 27505 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.825654 27544 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.825883 27530 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:08.844544 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:08.836910 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:08.838344 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:08.785027 27516 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:08.842518 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:08.816506 27519 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.844024 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.849321 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.853562 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:08.853871 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:08.856416 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.810276 27440 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.840924 27505 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:08.868907 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 152226us
I20260709 12:12:08.850189 27516 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.861650 27435 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:08.879360 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.879613 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.860585 27522 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.880936 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.863790 27440 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:08.885375 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 97905.2us
I20260709 12:12:08.893224 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.897725 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.898617 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.899163 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:08.893386 22116 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:08.887387 27500 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:08.871712 27505 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.887852 27435 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:08.887213 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:08.908110 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.909516 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.914636 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.916132 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:08.910804 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52331.2us
I20260709 12:12:08.910979 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.916939 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.916134 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:08.920650 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:08.920861 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58605us
I20260709 12:12:08.850643 27514 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.894853 27533 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.874008 27516 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:08.887243 27522 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:08.905386 27546 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:08.922209 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:08.923509 27490 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:12:08.911818 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 87463.8us
I20260709 12:12:08.930200 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.932129 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.927410 27490 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:08.941167 27490 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:08.928651 27512 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:08.945350 27435 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.925417 27522 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.951869 27543 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:08.954522 27514 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:08.961702 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:08.962172 22266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45844
I20260709 12:12:08.962867 22266 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:08.963215 22266 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:08.965193 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:08.965893 22267 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.970970 27517 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.981532 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.982071 22190 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:08.982816 22189 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:08.982933 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.983292 22194 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:08.983482 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.984325 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.985080 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.929644 27546 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:08.986907 27546 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:08.988278 22087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.517s (SENT) [suppressed 6 similar messages]
I20260709 12:12:08.964176 27522 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.993162 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.991255 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:08.997926 27533 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:08.998723 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.000407 27526 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.003252 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.007436 27339 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.008494 22193 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:09.009624 27514 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:09.010942 27505 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.923477 27548 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:09.011301 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:09.013861 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 126705us
I20260709 12:12:09.016757 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:09.017244 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 88192us
W20260709 12:12:09.019556 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 89697.1us
I20260709 12:12:09.026132 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.028914 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.032642 27549 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.033847 27541 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.035132 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.023736 27514 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.036315 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.038964 27544 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.042109 27339 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:09.042733 27517 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:09.047070 27439 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:08.980129 27539 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.050271 22196 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:09.050940 27539 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:09.025085 22266 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.011188 27543 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:09.061259 27544 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:09.064000 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:09.058787 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.065860 27522 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:09.066624 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:08.976271 27516 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.069463 22088 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:09.057591 22267 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:09.063743 27440 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.071518 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.068441 27490 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.074190 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.075846 22266 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:09.076534 22831 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.077428 27526 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:09.074357 27339 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:09.088603 22269 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:09.089686 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.094062 27516 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:09.074162 27530 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.097093 27530 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:09.099139 27533 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:09.102339 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:09.102524 27490 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:09.103647 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:09.103978 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:09.104943 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:09.105160 22193 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:12:09.105535 22858 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:09.106304 22264 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.110343 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:09.111737 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.115592 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.116763 22864 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:09.118462 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.123993 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:09.122660 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:09.135711 22857 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:09.136739 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:09.136674 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.136904 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:09.138674 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.141013 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:09.142570 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.142781 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:09.143893 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:09.146348 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.149679 22831 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.150774 22858 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:09.159111 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.126758 27552 raft_consensus.cc:2764] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:12:09.120101 27539 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:09.119529 27550 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.162503 22864 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:09.157963 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:09.158676 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 258450us
I20260709 12:12:09.131734 27439 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:09.162249 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.167466 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:09.169703 22831 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.171782 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.158386 27505 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:09.130949 27543 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:12:09.173856 22859 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.174446 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.174839 22861 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:09.167037 27511 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:09.197371 27511 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:09.198470 27511 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.165838 27512 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:09.185849 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:09.167784 27500 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:12:09.205155 27500 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.205618 27500 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:09.206656 27500 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.208036 27500 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.186776 22864 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:09.177129 27544 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.212671 27439 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.166862 27517 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:09.159075 27542 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:12:09.223588 27543 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:09.239253 27541 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:09.239979 27543 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:09.240397 27541 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:09.241309 27543 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.242167 27541 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.243906 27541 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.242908 27543 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.249195 22017 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 12 to 13, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 13 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:09.184798 27546 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:09.215883 27440 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:09.258563 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 88922us
I20260709 12:12:09.264945 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:09.266702 27505 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:12:09.250226 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 85010.6us
I20260709 12:12:09.267987 27428 consensus_queue.cc:1059] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:09.269091 27428 consensus_queue.cc:1243] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:09.269671 27544 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:09.270138 27544 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:09.270285 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:09.271030 22270 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:09.271068 27544 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.274999 27548 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:09.275516 27548 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:09.277159 27505 consensus_queue.cc:1059] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:09.278424 27505 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:09.279201 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:09.279408 27505 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:09.279744 27505 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:09.280920 27509 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:09.281344 27509 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:09.282359 27509 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.283773 27509 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:09.285151 27544 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:09.266661 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 91910.5us
I20260709 12:12:09.276504 27548 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.291589 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:09.287811 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:09.293074 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:09.295769 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 120096us
I20260709 12:12:09.296612 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.298517 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.301810 22830 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.301985 27560 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.303319 27533 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.305953 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.299779 27428 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:09.313203 27428 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:09.313612 27428 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.316936 27440 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.317878 27522 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.323376 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.300453 22270 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:12:09.323632 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:09.325641 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.325641 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:09.334542 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:09.369168 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 43589.6us
I20260709 12:12:09.370760 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.280584 27505 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.373967 27505 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:09.375768 22123 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:09.327497 27555 raft_consensus.cc:2764] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:12:09.357026 27550 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:12:09.364912 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 125929us
I20260709 12:12:09.377377 27509 raft_consensus.cc:2764] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:12:09.324312 27563 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:09.366922 27516 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:09.378242 27516 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:09.378683 27516 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:09.380304 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.368867 27548 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.385057 27541 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.386133 27428 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.388209 27428 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:09.390108 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.391033 27539 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:09.392369 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.384017 22122 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.393169 22122 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:09.394160 22122 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.395196 22122 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.382880 27561 raft_consensus.cc:993] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:09.397403 27561 raft_consensus.cc:1081] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:09.409504 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.410081 27541 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:09.410780 27541 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:09.411749 27541 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.422637 27530 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:09.423131 27530 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:09.423235 27561 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.424080 27530 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.425341 27530 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:09.426011 27516 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.428457 27516 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:09.422852 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.430655 22122 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:12:09.434262 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 99799.6us
I20260709 12:12:09.412281 27511 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.441239 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:09.444067 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:09.453095 27548 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.435616 27550 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:12:09.453567 27548 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:09.453598 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.454087 27548 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.456040 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.457120 27549 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:09.457231 22263 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:09.457890 27549 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.456961 27539 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:09.458757 27516 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:09.459120 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.460023 27511 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.459237 27516 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:09.442986 27546 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:12:09.461112 22162 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.461349 27516 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:09.463171 27500 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:09.464871 27511 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.467553 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:09.469512 22263 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:09.469818 27562 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:12:09.470456 27562 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:09.471447 27562 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.477859 27550 consensus_queue.cc:1059] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:09.476855 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.479146 27500 raft_consensus.cc:3055] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:09.479513 27500 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:09.480425 27500 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.481654 27500 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:09.484834 22115 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:09.487221 27561 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.487871 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.488915 27530 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:09.492974 27550 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:09.470250 27548 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.506032 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.511731 27511 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.515221 27548 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:09.517849 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.539544 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.508587 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:09.541246 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.542735 27539 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.547067 27530 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:09.544327 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.548506 27549 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:09.549232 27549 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:09.549381 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.550902 22864 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.552155 22858 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:09.556145 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47647.1us
I20260709 12:12:09.556457 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:09.570109 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.571542 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:09.557673 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.573822 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:09.576411 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:09.556228 27530 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.571342 27547 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:09.587087 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:09.599048 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.594465 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.585683 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:09.625020 22114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:12:09.625044 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.629436 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.630336 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.625732 22114 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.633586 22114 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:09.634656 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.629714 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.638113 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:09.638394 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:09.638919 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:09.639333 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:09.640733 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:09.642308 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:09.643653 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.644812 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.645958 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.647069 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.647387 22162 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.648123 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.633621 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:09.649840 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.650025 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.582280 27427 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:09.580627 27539 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:09.655085 22194 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:09.655144 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.652871 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:09.656539 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:09.598001 27547 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:09.599093 27567 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:12:09.579828 27505 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:12:09.575580 27543 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 12:12:09.659297 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.670858 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.663877 27567 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:09.688172 27567 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:09.664103 27547 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:09.661419 27555 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:09.676465 27561 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:12:09.683254 27565 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:12:09.663051 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:09.686491 27568 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.157s	user 0.002s	sys 0.003s
I20260709 12:12:09.651691 27548 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:09.701020 22196 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:09.699347 27555 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:09.709031 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:09.663956 27563 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:09.745704 22114 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.718756 27565 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:09.725242 27555 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:12:09.751935 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 83648us
I20260709 12:12:09.790759 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:09.729983 27563 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:09.795517 22196 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:09.793784 22114 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:09.805462 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 218450us
W20260709 12:12:09.806488 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 141735us
I20260709 12:12:09.788605 27565 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:09.811375 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.815505 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.815935 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.807665 22087 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.823479 22192 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:09.805073 27563 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.840072 22266 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:09.821285 27522 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:12:09.851591 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.854866 27490 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.856060 27490 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:12:09.859009 22858 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:09.860839 22864 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:09.864838 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.867679 22864 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.870558 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.871409 22114 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.873606 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.845861 27576 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:09.875492 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.891114 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:09.872561 27490 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:09.897461 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 82031.1us
I20260709 12:12:09.898414 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.907790 22114 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:09.913226 27490 consensus_queue.cc:1059] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:09.914963 27490 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:09.916419 27490 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:09.916895 27490 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:09.918134 27490 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.921131 27578 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:12:09.921581 27490 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:09.877030 27552 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 12:12:09.933367 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 125767us
I20260709 12:12:09.893038 27541 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:12:09.944891 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 189238us
I20260709 12:12:09.939505 27583 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:09.939719 27586 raft_consensus.cc:2764] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:12:09.950613 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:09.926541 27576 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:09.949155 27516 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.979225 27516 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:09.959452 27577 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.982227 27577 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:09.982064 27555 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.983292 22263 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:09.983246 27577 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.985534 27587 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:09.985973 27587 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:09.986865 27587 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:09.988130 27555 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:09.989254 27547 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:09.993479 27576 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:12:09.998265 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 350980us
I20260709 12:12:09.999153 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:09.993619 27552 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:09.957564 27578 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:10.003974 27552 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:09.960309 27543 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:09.988426 27587 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.004374 27542 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:10.009006 27578 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:10.016914 27577 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.005235 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.030251 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:10.023898 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 125565us
I20260709 12:12:10.032317 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:10.033049 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 82571.8us
I20260709 12:12:10.035100 27578 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:10.008468 27547 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:10.006253 27517 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:12:10.046437 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.031484 27549 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.044035 27542 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:10.066357 22114 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:10.063810 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.049356 27490 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:12:10.076428 27427 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:10.077004 27427 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:10.081465 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.083709 22117 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:12:10.084087 22117 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:10.084820 22117 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.085731 22117 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:10.061089 27580 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:10.089730 27580 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:10.090569 27580 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:10.091405 22120 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:12:10.091862 27580 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.097429 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:10.104450 22019 catalog_manager.cc:5697] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 12 to 13, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 13 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:10.108093 22019 catalog_manager.cc:5697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 7 to 8, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:10.114351 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:10.028558 27567 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.049075 27590 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.117183 22117 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:12:10.121686 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 61147.4us
I20260709 12:12:10.120707 27428 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:10.062002 27591 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:10.122920 22087 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.077968 27427 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.135972 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.087755 27563 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.138309 22268 raft_consensus.cc:1240] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:12:10.114606 27592 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:10.133163 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:10.132218 27428 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:10.145303 27562 consensus_queue.cc:1059] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:12:10.135085 27543 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:12:10.122026 27511 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:12:10.185431 27440 raft_consensus.cc:3055] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:12:10.067508 27552 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:10.185966 27440 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:10.187136 27552 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.099845 27547 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:12:10.165923 27594 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:10.118463 27519 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:12:10.177003 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43910.3us
I20260709 12:12:10.189038 27589 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:12:10.177757 27576 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.190677 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.173894 27565 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:10.178936 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46967.1us
I20260709 12:12:10.197840 27567 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:10.179836 27428 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:10.184396 27427 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.192060 27543 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:10.201407 27543 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:10.184648 27590 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:10.187207 27440 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.192482 22267 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:10.186003 27511 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:10.191483 27519 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:10.203320 27511 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:10.203462 27519 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:10.204350 27511 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.204509 27519 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.203078 27440 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:10.205862 27511 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.206218 27519 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:10.203047 27563 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:10.180943 27583 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:10.210409 27583 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:10.217361 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.195852 27578 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.196151 22117 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:10.222005 22117 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:10.198038 22116 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:12:10.183252 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:10.237370 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:10.238670 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:10.239899 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:10.240340 27567 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:10.240849 27567 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:10.241039 27509 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:10.241338 27567 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:10.242993 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:10.249382 22263 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:12:10.250492 22117 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.210896 27583 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:10.256433 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.258433 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.259227 27339 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:10.241466 27509 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:10.235214 27592 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.261016 22117 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:10.261422 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 78182.4us
I20260709 12:12:10.253738 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:10.265581 27339 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:10.269806 27339 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:10.240851 27591 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.271127 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.276206 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:10.279618 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.281363 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.289021 22191 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:10.289111 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.272563 27548 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:12:10.292008 27558 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.004s
I20260709 12:12:10.292321 27548 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:10.269397 27505 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:10.292819 27595 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:10.293387 27505 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:10.293304 27548 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:10.294034 27505 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:10.296864 27544 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:10.297493 27544 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:10.298563 27544 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.300747 27490 consensus_queue.cc:1059] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:10.302017 27490 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:10.302591 27587 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:10.303018 27587 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:10.273872 27591 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:10.305212 27591 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.305722 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.307085 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.309094 27590 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:10.309808 27552 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.309898 27590 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:10.259202 27563 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:12:10.308506 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.294086 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.317852 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.261396 27509 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:10.324169 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.270283 27547 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:10.325083 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.323160 27590 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.330544 27428 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.333678 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.334188 22191 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:10.335038 22087 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.340067 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.341667 22117 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:10.272539 27555 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:10.346238 22087 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.311651 27577 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:10.342219 27490 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:10.300743 27581 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:12:10.261749 27562 consensus_queue.cc:1059] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:12:10.364962 22087 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.345314 27552 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:10.321762 27563 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:10.370781 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.369879 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.371167 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.371301 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.372605 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:12:10.362581 27594 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:12:10.374963 22087 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.373611 27339 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.361598 27577 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:10.347569 27590 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:10.378661 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.378978 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.376139 27548 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:10.387312 27543 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.303829 27587 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.384033 27339 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:10.368610 27547 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:10.379302 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.403894 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.384099 27490 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.376233 27580 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:10.384008 27583 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.373795 27563 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:10.414655 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.390511 27565 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:10.420128 27592 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:10.414379 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.378460 27576 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:10.428414 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.456646 27505 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.428711 27595 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.430675 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.428618 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.410140 27530 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:12:10.421108 27587 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:10.423022 27580 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:10.442394 27583 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:10.377900 27541 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:12:10.443238 27578 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:10.421572 27552 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:10.447978 27509 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.450893 22195 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:10.452203 27591 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.452966 27577 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.454408 27567 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.455155 22118 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:10.456480 27543 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:10.425874 27598 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:10.472426 27555 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.459092 27542 raft_consensus.cc:3055] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:10.466987 22267 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:10.464504 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 149) took 1298 ms. Trace:
I20260709 12:12:10.470070 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.470073 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.484123 22191 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:12:10.470829 27594 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.486595 22264 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:10.475225 27580 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:10.494747 27577 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.454411 27428 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:10.512562 22017 rpcz_store.cc:276] 0709 12:12:09.165943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.166121 (+   178us) service_pool.cc:224] Handling call
0709 12:12:09.209254 (+ 43133us) spinlock_profiling.cc:243] Waited 875 us on lock 0x7b5400280690. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9e0b2 00007fccf3c17759 00007fccf3bafa76 00007fccf3b80d58 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc
0709 12:12:10.464405 (+1255151us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:09.490374 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:09.491285 (+   911us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:09.491348 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:12:09.491383 (+    35us) tablet.cc:662] Decoding operations
0709 12:12:09.504707 (+ 13324us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:09.504833 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:09.504871 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:09.505091 (+   220us) tablet.cc:701] Row locks acquired
0709 12:12:09.505109 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:12:09.505280 (+   171us) write_op.cc:270] Start()
0709 12:12:09.505425 (+   145us) write_op.cc:276] Timestamp: P: 1783599129505220 usec, L: 0
0709 12:12:09.505465 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:12:09.506304 (+   839us) log.cc:844] Serialized 539 byte log entry
0709 12:12:09.808681 (+302377us) op_driver.cc:464] REPLICATION: finished
0709 12:12:10.047844 (+239163us) write_op.cc:301] APPLY: starting
0709 12:12:10.051368 (+  3524us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:10.174298 (+122930us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:10.174406 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:10.343529 (+169123us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:10.366878 (+ 23349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:12:10.369723 (+  2845us) write_op.cc:312] APPLY: finished
0709 12:12:10.409903 (+ 40180us) log.cc:844] Serialized 25 byte log entry
0709 12:12:10.425947 (+ 16044us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:10.429262 (+  3315us) write_op.cc:454] Released schema lock
0709 12:12:10.429317 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:10.429734 (+   417us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:10.429763 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":2447744,"child_traces":[["op",{"apply.queue_time_us":214706,"apply.run_cpu_time_us":7403,"apply.run_wall_time_us":383122,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"mutex_wait_us":1468,"num_ops":1,"prepare.queue_time_us":235414,"prepare.run_cpu_time_us":4524,"prepare.run_wall_time_us":39107,"raft.queue_time_us":213421,"raft.run_cpu_time_us":25587,"raft.run_wall_time_us":296872,"replication_time_us":283338,"spinlock_wait_cycles":899456,"thread_start_us":546672,"threads_started":4,"wal-append.queue_time_us":18049}]]}
I20260709 12:12:10.523772 22266 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:10.513499 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:10.514884 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44940.9us
I20260709 12:12:10.514274 27542 raft_consensus.cc:740] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:10.525332 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:10.527006 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:10.531018 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.532653 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.534597 22267 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:10.535481 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.536609 27339 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:10.538215 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:10.551123 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.552414 27339 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:10.554209 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.521826 27578 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.559929 22189 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:10.543861 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.552948 27339 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:10.566056 27339 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.566556 22191 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
W20260709 12:12:10.578787 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.580751 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.535079 27598 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:10.535205 27592 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.607579 22020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 245) took 1023 ms. Trace:
I20260709 12:12:10.608065 22020 rpcz_store.cc:276] 0709 12:12:09.584281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.585832 (+  1551us) service_pool.cc:224] Handling call
0709 12:12:10.607506 (+1021674us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:12:10.610826 27580 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.617281 27505 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:10.622684 27562 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:12:10.623152 27339 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.624518 27591 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:10.625208 27567 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:10.623188 27562 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:10.626909 27562 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.520712 27595 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:10.628296 27562 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:10.633023 22021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 238) took 1059 ms. Trace:
I20260709 12:12:10.633471 22021 rpcz_store.cc:276] 0709 12:12:09.573384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.575293 (+  1909us) service_pool.cc:224] Handling call
0709 12:12:09.583136 (+  7843us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:10.632945 (+1049809us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":11800832}
W20260709 12:12:10.633991 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.592353 27542 consensus_queue.cc:260] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.551266 27552 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.635869 27509 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:10.537387 27543 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:12:10.639370 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.593575 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.552711 27428 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:12:10.646360 27563 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.647541 22263 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 7. Current term is 8. Ops: []
I20260709 12:12:10.553651 27548 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:10.643075 22017 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 14 to 15, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:10.650143 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 64685.3us
I20260709 12:12:10.650987 22192 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:12:10.651142 22017 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 12 to 13, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 13 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:10.663785 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 120768us
I20260709 12:12:10.665230 22266 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:10.666137 22264 raft_consensus.cc:1240] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:12:10.669095 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863b392474d94720808349fe27669b5b"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:10.669736 22192 raft_consensus.cc:606] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.670018 22192 raft_consensus.cc:614] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:10.675670 27580 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:10.677742 27542 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:12:10.691645 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.695474 27563 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:10.697546 27511 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:10.698222 27511 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:10.700467 27511 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:10.710919 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:10.686748 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:10.717008 22192 raft_consensus.cc:606] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:10.718145 22087 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:10.724100 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:10.724953 27580 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:12:10.727140 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:10.728107 22864 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:10.727213 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:10.730593 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:10.731031 22266 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:10.726879 22021 catalog_manager.cc:5697] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 11 to 12, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 12 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:10.725025 27530 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:12:10.733556 22263 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 7. Current term is 8. Ops: []
I20260709 12:12:10.734687 27339 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:10.735458 27608 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:10.736294 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:10.737208 27519 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:10.737560 27519 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:10.737699 22264 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:10.738489 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:10.738442 27519 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.739500 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:10.739969 27519 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:10.741225 27580 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:10.735374 27339 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:10.725507 27539 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:12:10.743232 27339 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:10.743294 27608 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:10.743652 27539 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:10.744009 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:10.742244 27580 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.722504 27577 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:10.745302 27577 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:10.746551 27577 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.748976 27511 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:10.744557 27608 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.749599 27511 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:10.731596 27576 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:12:10.750134 27511 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.750502 27576 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:10.751765 27517 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.725543 27552 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:12:10.752362 27517 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:10.753213 27598 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:10.753616 27598 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:10.754576 27598 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.756080 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:10.756740 22263 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:10.756412 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:10.755932 27598 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:10.757856 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.757906 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:10.757705 22264 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:10.760083 22116 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:12:10.761297 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:10.751780 27576 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:10.762238 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.763064 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:10.763861 22864 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:10.764797 27560 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:10.765224 27560 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.765578 27560 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.733825 27549 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:12:10.744338 27539 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:10.769853 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:10.778776 22266 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:10.779008 22268 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:10.780108 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:10.780243 22269 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:10.780843 22265 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:10.781556 22270 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 8: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:10.781986 22263 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:10.782136 22264 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:10.782723 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:10.784278 27339 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:10.784912 27563 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.799322 27563 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:10.799611 27539 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.800201 27541 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:10.800575 27541 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:10.801206 27539 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:10.801414 27541 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.802841 27541 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:10.804474 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:10.805120 22864 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:10.806564 22237 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:10.807854 27544 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:10.808262 27544 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.808614 27544 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.772300 27517 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:10.798693 22272 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:10.815279 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:10.777748 27549 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:10.831812 22270 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:10.832472 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.833567 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.834508 22192 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:10.834383 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.837759 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.838575 22191 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:10.838456 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.841442 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.843619 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.844559 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.843925 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.846999 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.848263 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.848397 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.850759 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.851740 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.822216 27549 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:10.862386 27549 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:10.814245 27563 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:10.889051 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.889163 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.889313 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:10.891767 22195 raft_consensus.cc:2393] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:10.892108 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:10.895375 22118 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 8: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:10.914589 22270 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:10.916577 27339 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:10.919409 27339 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:10.919255 27587 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:10.919775 27339 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:10.920423 27552 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:10.920809 27552 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:10.923014 22193 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:10.932981 22114 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:10.933084 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:10.946131 22193 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:12:10.924047 27519 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:10.954493 27339 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.968572 27587 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:10.964416 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.949419 27550 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.944350 27559 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.985482 27440 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:10.956559 27563 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.986203 27440 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:10.986014 27550 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:10.994240 27339 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:10.998039 27552 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:10.997038 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:10.989437 27509 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:11.030251 27550 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:11.004714 27576 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:11.012405 27511 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.040443 27576 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:11.000454 22198 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:12:11.006672 22190 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:11.041447 27576 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:11.042188 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45238.1us
I20260709 12:12:11.043530 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:11.043674 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:11.044205 22272 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:11.044341 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:11.001318 27440 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:11.045112 22858 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:11.046272 27428 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:12:10.996883 27563 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.046533 27511 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:11.047034 27428 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:11.008069 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:11.047890 27428 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:11.048206 22270 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:11.024492 22191 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:12:10.990754 27559 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.048945 27428 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:11.050868 27559 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:11.027009 27560 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.006364 22019 catalog_manager.cc:5697] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 8 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 9 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.054107 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:11.055493 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:11.056734 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:11.060277 22190 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:11.060103 22114 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:11.061260 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:11.062260 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:11.002743 27552 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:11.063979 22831 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:11.060082 22019 catalog_manager.cc:5697] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 11 to 12, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 12 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.067993 22189 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:11.060685 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:11.070432 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:11.072337 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:11.073202 22272 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:11.071421 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:11.073740 22864 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:10.959956 27519 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.074646 27339 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:11.042986 27576 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:11.075245 27522 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:11.076159 27554 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:11.078445 27339 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:11.036684 27616 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.116s	user 0.003s	sys 0.000s
I20260709 12:12:11.092140 27543 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:11.083668 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:11.091703 27339 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.048851 27563 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:11.013898 27549 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.090832 27490 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:12:11.062577 27609 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.105327 27490 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:11.105144 27609 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.105852 27490 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:11.106863 27490 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:11.107642 27609 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:11.109879 27560 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:11.110224 27549 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:11.112371 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:11.112603 27519 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:11.096809 27517 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.102464 22114 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:12:11.117313 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:11.118001 22114 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:11.118145 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:11.103572 22196 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:11.091066 27522 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.118815 22118 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.091377 27554 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.131129 27544 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.131889 27554 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.123099 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:11.123201 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:11.141456 22191 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:11.141650 22270 raft_consensus.cc:2368] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13.
I20260709 12:12:11.116329 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:11.114240 27517 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.142556 22198 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:11.142917 22272 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:11.123301 22858 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:11.120247 27522 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:11.103349 27577 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:12:11.130826 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:11.096136 27543 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:11.147933 27339 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.118165 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:11.160384 22163 leader_election.cc:400] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13.
I20260709 12:12:11.160881 22163 leader_election.cc:403] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:11.163688 27339 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:11.165488 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47394.9us
I20260709 12:12:11.169369 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:11.169677 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:11.171340 22272 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.172545 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:11.173589 22864 raft_consensus.cc:2393] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:11.174553 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:11.174593 22264 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:11.167831 22237 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:11.175366 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:11.175439 22858 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:11.179941 27339 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.169848 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:11.185312 22272 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:11.116367 27539 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:11.170245 27490 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:11.159050 27546 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:11.186378 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:11.189293 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:11.159579 27577 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:11.201287 22118 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:11.199555 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:11.200126 27339 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13.
I20260709 12:12:11.179478 27533 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.174692 27428 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:12:11.190733 27511 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:11.190912 27563 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:11.230670 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:11.213275 27546 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.228648 27580 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:12:11.244594 27623 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.245314 27625 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:11.229410 27549 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:11.229866 27544 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:11.236179 27533 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.258412 27549 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:11.259632 27549 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.260262 27533 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:11.260499 27608 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:11.253041 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:11.239295 27563 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.284150 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:11.243139 27546 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:11.198999 27539 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.288019 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:11.286985 22118 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:12:11.282859 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:11.242305 27511 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:11.294924 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:11.297326 22858 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.306654 22858 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:11.298899 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:11.307931 22198 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:12:11.311170 27500 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:11.297408 27428 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:12:11.308848 22237 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:11.311841 27500 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.314133 27500 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:11.320469 27428 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:11.283021 27623 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.321182 27428 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:11.322816 27428 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.305745 27577 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:11.329947 27500 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.288651 27563 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:11.282012 27625 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:11.333566 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:11.287017 27544 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:12:11.337693 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:11.338699 22190 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:12:11.323838 27623 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:11.341521 27500 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:11.343197 27625 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.347653 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:11.346196 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:11.348573 22114 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:11.354144 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:11.355070 22264 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:11.243278 27543 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:11.306772 27591 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:11.359366 22831 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:11.351372 27509 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:11.351519 27573 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:11.345291 27621 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.352854 27580 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:12:11.347486 27567 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:11.410473 22190 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:11.345598 27598 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:12:11.372699 27517 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:11.418993 27622 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:11.442497 27511 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.388283 27609 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.389010 27621 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.431320 27587 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:12:11.449942 27622 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.466086 27627 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.452467 27509 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:11.489235 27580 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:11.495118 27609 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.456684 27562 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:12:11.497473 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 53921.6us
W20260709 12:12:11.500602 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 142164us
I20260709 12:12:11.499486 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:11.501296 22114 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:12:11.501281 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:11.470360 27622 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.520010 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:11.532485 22114 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:11.520736 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:11.534962 22118 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:11.522650 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:11.537510 22198 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:12:11.524350 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:11.545442 27539 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:11.491612 27627 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.550897 27627 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:11.552462 27621 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:11.535666 27550 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.554133 27550 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.554584 27550 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:11.558326 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 51512.6us
I20260709 12:12:11.562016 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:11.562912 22858 raft_consensus.cc:2368] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11.
I20260709 12:12:11.564373 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:11.565646 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:11.566319 22272 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:11.569453 22163 leader_election.cc:400] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11.
I20260709 12:12:11.570006 22163 leader_election.cc:403] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:11.569480 22831 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:11.572459 22117 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:11.573985 22198 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:12:11.575350 27539 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11.
I20260709 12:12:11.575223 27509 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:11.564458 22118 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:12:11.583719 27522 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.591372 22118 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:12:11.600147 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 97300.1us
I20260709 12:12:11.608868 22861 raft_consensus.cc:2368] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14.
I20260709 12:12:11.610261 22118 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:12:11.610997 22264 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:12:11.614264 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:11.616158 22193 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:12:11.518611 27562 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.627555 22272 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:11.565029 27567 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:11.371536 27554 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.638055 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:11.646664 22117 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:12:11.655666 22191 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:11.624737 27627 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.625221 27587 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.680039 22163 leader_election.cc:400] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14.
I20260709 12:12:11.680605 22163 leader_election.cc:403] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:12:11.682096 27339 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:11.495178 27580 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:11.701912 22196 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:11.706522 27339 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14.
I20260709 12:12:11.675563 27627 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.715579 27627 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:11.717897 27552 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.643s	user 0.013s	sys 0.000s
I20260709 12:12:11.648231 27630 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:12:11.720350 27543 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:11.812052 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 174056us
I20260709 12:12:11.688390 27587 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:11.839167 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 189952us
I20260709 12:12:11.840541 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:11.849489 22196 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:11.862107 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:11.862927 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:11.741608 27559 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:11.843629 22195 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:12:11.809018 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 78923us
W20260709 12:12:11.730368 27640 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:11.873047 27339 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:11.873875 27339 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.809600 27541 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.760700 27591 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:11.831717 27576 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:11.878741 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:11.890100 27339 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:11.894814 22264 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:12:11.910115 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:11.911005 22117 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:11.913748 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:11.915517 27339 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:11.915977 27339 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:11.916383 27339 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.864537 27609 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:11.741338 27577 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.155s
I20260709 12:12:11.752949 27490 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.180s
W20260709 12:12:11.931830 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 98210.8us
I20260709 12:12:11.949985 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:11.950894 22264 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:11.951411 27577 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:11.952045 27577 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:11.953334 27591 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:11.954710 27577 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:11.957336 22831 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:11.839514 27543 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.928440 27522 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:11.972965 27339 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:11.997606 27339 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:12.000622 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:12.001083 27651 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:12.005123 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:12.006017 22270 raft_consensus.cc:2393] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 5: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:11.934890 27598 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.866765 27567 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:11.895973 27633 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:12:12.014027 22117 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:11.896620 27541 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.021245 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:11.927752 27576 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.010011 27577 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:12.035070 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77825.9us
I20260709 12:12:12.033900 27339 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.037037 27339 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:12.039652 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 98008.6us
I20260709 12:12:12.019052 27562 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:12.050148 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:12.055483 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:12.056430 22117 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:12.033716 27511 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:12.061967 27339 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.025488 27651 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:12:12.067845 27440 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:12.069648 27440 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.071750 27440 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.017977 27598 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.073957 27598 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:12.075910 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:12.076514 22861 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:12.077929 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.078737 27598 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:12.079111 27598 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.079432 27598 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.081462 27511 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:12.083034 27511 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.096014 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:12.098959 27598 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.112560 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:12.113344 22861 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.112589 27541 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.122892 22861 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:12.124809 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.125922 27490 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:12.126520 27490 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:12.127367 27598 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:12.127485 27490 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.052021 27644 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:12.131436 27576 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.034646 27645 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 12:12:12.057824 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:12.145339 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 87613.8us
I20260709 12:12:12.145720 22264 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:12.147615 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:12.148121 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:12.148278 22117 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:12:12.148674 22114 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:12:12.149855 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.124405 27543 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:12.147724 27626 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:12.151067 22162 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.041030 27577 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.194885 27339 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:12.197523 22861 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:12.201583 27339 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.202051 27339 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:12.202623 22198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.004s
W20260709 12:12:12.209507 22198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.008s	sys 0.004s
W20260709 12:12:12.209734 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 69219.8us
W20260709 12:12:12.143632 27563 consensus_meta.cc:287] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.005s
I20260709 12:12:12.197523 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:12.190539 27440 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:12.192322 27550 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.637s	user 0.014s	sys 0.000s
I20260709 12:12:12.189374 27655 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:12.139922 27644 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.202744 27576 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.153155 27541 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:12.206753 27598 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:12.212422 27563 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.221565 27542 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.216024 27440 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.211024 27626 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:12.222421 27655 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:12.251027 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:12.257362 22861 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.233433 22021 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 14 to 15, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:12.251515 27546 consensus_meta.cc:287] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.953s	user 0.014s	sys 0.000s
W20260709 12:12:12.253091 27627 consensus_meta.cc:287] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.537s	user 0.013s	sys 0.000s
I20260709 12:12:12.247190 27440 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.248737 27655 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:12:12.268122 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 252248us
I20260709 12:12:12.224567 27644 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:12.285583 22861 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:12.251219 27563 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:12.277055 27562 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.293177 22198 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:12.225001 27550 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.282413 27543 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:12.246977 27542 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.255865 27576 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.298933 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:12.299988 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:12.256412 27598 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.267844 27339 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.258016 27541 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.305272 22198 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.248224 27626 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.307061 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:12.307288 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:12.282559 27627 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.305266 22193 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:12.280664 27546 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.315088 22264 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:12:12.317790 22193 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:12:12.326948 27653 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:12:12.328212 27577 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.330102 27542 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.306042 27543 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.336752 27550 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:12.297276 27562 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.342279 27546 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:12.344555 27622 consensus_meta.cc:287] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.803s	user 0.013s	sys 0.000s
I20260709 12:12:12.344935 27576 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.345270 27622 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.346872 27542 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:12.347261 27541 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:12.347590 27542 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.349550 27562 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.350075 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:12.350814 22118 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 4.
I20260709 12:12:12.352418 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:12.353484 22120 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:12.355818 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:12.359170 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:12.358557 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:12.360718 22193 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.356637 22116 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:12:12.353077 22265 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:12.355123 22162 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.364732 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:12.365648 22266 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:12.365986 27576 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:12.366756 27576 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.368472 27567 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:12.369267 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:12.368505 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:12.370141 22859 raft_consensus.cc:2368] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16.
I20260709 12:12:12.371258 27490 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.371827 27490 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.373478 22858 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:12.374066 27577 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.374370 27490 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.375475 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:12.377094 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:12.367938 27622 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.384588 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:12.385015 27339 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.385253 22114 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.385092 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:12.396654 22266 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:12.397948 27339 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:12:12.398633 27339 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.399080 27339 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:12.401625 22116 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:12.392884 22198 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:12.374478 27627 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.414918 22114 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:12:12.422379 22198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "575c887e89834da7b6e222b41a19b692"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:12.424026 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:12.424674 22189 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.426584 27511 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:12.427251 27511 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.383639 27539 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.429080 27539 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.430472 27440 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.431247 27539 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.433421 27655 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.435770 27655 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.441653 22189 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:12.447191 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:12.448169 22116 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.471195 22193 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:12.399464 27664 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:12.480161 22198 raft_consensus.cc:606] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:12.501181 22198 raft_consensus.cc:614] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:12.483399 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:12.502125 22266 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:12.444327 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:12.407905 27562 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:12.495064 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 140037us
I20260709 12:12:12.503866 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:12.504555 22266 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:12:12.504262 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60038.1us
I20260709 12:12:12.505806 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:12.374670 27577 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.496012 27339 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.509099 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:12.509943 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:12.517807 22117 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:12.509346 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:12.509387 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:12.513742 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:12.515581 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:12.521569 22121 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.497301 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:12.522478 22114 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.522485 22830 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:12.432703 27440 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.530752 22197 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:12:12.531008 22117 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:12.527595 22194 raft_consensus.cc:2368] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6.
I20260709 12:12:12.533265 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:12.534219 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:12.472102 27655 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:12.537587 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:12.538329 22197 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:12.538714 22194 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:12.516003 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.535434 27654 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:12.517474 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:12.540604 22193 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:12:12.501014 27664 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.500711 27543 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:12.552021 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:12.541760 22162 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.546324 22114 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:12.551435 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:12.546572 27664 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.548655 22123 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:12.546291 22116 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:12.529543 27576 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.526306 27562 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.739993 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:12.633965 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:12.732080 22017 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 11 to 13, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 13 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:12.556927 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:12.620798 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 78312.8us
I20260709 12:12:12.688431 22115 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:12:12.730090 22019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 240) took 1773 ms. Trace:
I20260709 12:12:12.781234 22019 rpcz_store.cc:276] 0709 12:12:10.957141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.957299 (+   158us) service_pool.cc:224] Handling call
0709 12:12:12.730015 (+1772716us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:11.174486 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:11.252648 (+ 78162us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:11.258000 (+  5352us) write_op.cc:435] Acquired schema lock
0709 12:12:11.258024 (+    24us) tablet.cc:662] Decoding operations
0709 12:12:11.258533 (+   509us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:11.258593 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:11.258623 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:11.258966 (+   343us) tablet.cc:701] Row locks acquired
0709 12:12:11.258980 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:12:11.259144 (+   164us) write_op.cc:270] Start()
0709 12:12:11.259281 (+   137us) write_op.cc:276] Timestamp: P: 1783599131259090 usec, L: 0
0709 12:12:11.259303 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:11.260016 (+   713us) log.cc:844] Serialized 935 byte log entry
0709 12:12:11.738871 (+478855us) op_driver.cc:464] REPLICATION: finished
0709 12:12:12.191360 (+452489us) write_op.cc:301] APPLY: starting
0709 12:12:12.191454 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:12.329211 (+137757us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:12.329345 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:12.331230 (+  1885us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:12.331450 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:12:12.331502 (+    52us) write_op.cc:312] APPLY: finished
0709 12:12:12.331734 (+   232us) log.cc:844] Serialized 33 byte log entry
0709 12:12:12.332107 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:12.332214 (+   107us) write_op.cc:454] Released schema lock
0709 12:12:12.332264 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:12.332681 (+   417us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:12.332713 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":51084,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":364635,"apply.run_cpu_time_us":6708,"apply.run_wall_time_us":141324,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12491,"num_ops":2,"prepare.queue_time_us":14303,"prepare.run_cpu_time_us":3620,"prepare.run_wall_time_us":101259,"replication_time_us":457795,"thread_start_us":178477,"threads_started":1}]]}
I20260709 12:12:12.525195 27560 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:12.529386 27550 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:12.625268 22162 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:12.790148 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 164992us
I20260709 12:12:12.732822 22121 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:12.703905 27577 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.717854 27661 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.531032 27627 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:12.540225 27559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.040s	sys 0.025s
I20260709 12:12:12.804659 22198 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:12.816258 22087 leader_election.cc:400] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6.
I20260709 12:12:12.818413 22087 leader_election.cc:403] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:12.819974 27681 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:12.820181 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.543987 27542 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.825927 22861 raft_consensus.cc:2368] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14.
I20260709 12:12:12.548120 27598 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.815600 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.830003 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:12.702512 27539 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.632655 27630 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.830922 22198 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:12.831414 27539 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.831532 27630 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.708532 27541 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:12.817200 27559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.041s	sys 0.025s
I20260709 12:12:12.839103 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.622291 27511 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.608990 27672 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.648065 27654 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:12.847839 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:12.633301 27543 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.840909 22198 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:12:12.556284 27440 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:12.734961 27554 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:12.634495 27552 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:12.605038 27671 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:12.851410 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:12.826408 27577 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:12:12.848915 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:12.718223 27634 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:12.852329 22115 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:12.824026 27548 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:12.541833 27655 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.823714 27681 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:12.853956 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.809346 27546 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:12:12.839488 27542 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:12.828954 27591 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:12.604182 27660 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.449s
I20260709 12:12:12.863225 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:12.882329 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:12.883281 22198 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:12.830761 27627 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:12.829329 27678 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:12.558771 27644 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.823669 27576 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:12:12.844762 27559 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:12.848091 27651 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.900307 22116 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:12.848899 27598 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:12.890264 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:12.840211 27550 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:12.854620 27440 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:12.893625 27623 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:12.895700 27653 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 12:12:12.902833 27549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.249s	user 0.002s	sys 0.031s
I20260709 12:12:12.894518 27671 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.916899 27598 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.921686 27598 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.923192 22864 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:12.838357 27661 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.847625 27541 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.906064 27678 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:12.929368 22196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:12.930650 22196 raft_consensus.cc:606] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:12.931138 22196 raft_consensus.cc:614] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:12.922797 27549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.285s	user 0.002s	sys 0.031s
I20260709 12:12:12.854873 27543 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.861475 27552 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:12.932648 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 94097.1us
I20260709 12:12:12.898275 27580 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:12:12.895576 27548 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.918833 27440 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.935107 27677 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.936925 27544 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.938539 27627 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.908437 27634 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.963642 27630 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:12.932297 27654 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.941188 27670 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:12.974692 27670 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 18 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:12:12.942708 27684 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:12:12.943240 27681 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.945441 27562 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.931914 27625 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:12:12.932675 27678 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:12.949548 27587 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.950851 27549 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:12:12.951524 27511 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:12.952037 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 12:12:13.037461 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 147286us
I20260709 12:12:13.037839 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:12.935128 27623 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:12.893705 27672 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.953214 27559 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.922636 27671 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:13.050097 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.050961 22117 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:13.052839 27549 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:13.053953 27549 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.906810 27542 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.924038 27539 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.973934 27644 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.969630 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:12.965441 27634 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:12.909582 27591 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:12.982957 27548 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:12.985836 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:12.975072 27655 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:12.920815 27651 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:12.974700 27577 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 5. Current term is 6.
I20260709 12:12:12.961665 27543 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:13.056893 27511 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:13.027920 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:12.988096 27664 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.030434 22269 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.030434 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.031404 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.031517 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:12.976330 27633 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.032229 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.041780 22115 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:12.980482 27677 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.045323 27661 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.045985 27631 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:12:13.057358 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:12.996304 27576 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:13.058689 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.119611 22864 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:13.119925 22196 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:12:12.968680 27544 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.062045 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:13.064821 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.068164 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.081429 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.027456 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.096383 27634 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.091946 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.093533 27608 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.125336 22197 raft_consensus.cc:2393] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 6: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:13.095990 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:13.125990 22120 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:13.028502 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.043355 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.127270 22267 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:13.127202 22114 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:13.128093 27694 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.128639 27694 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.130856 27509 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.085058 27685 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.998622 27550 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.132543 27685 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.134102 22197 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:13.094579 27660 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.113737 27633 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.141137 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:13.141492 27633 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:13.142076 22859 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 13: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:13.142416 27608 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.143127 27511 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.102036 27577 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:13.121057 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:13.131727 27509 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.132896 27559 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.111857 27587 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:13.130957 27694 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:13.167356 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:13.107853 22121 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:12:13.172197 27509 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:13.135710 27697 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:13.174680 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:13.147006 27608 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:13.174331 27697 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.178027 27651 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:13.178510 27697 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.163458 27541 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.165153 27552 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.188969 27671 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.190096 27544 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:13.190673 22192 raft_consensus.cc:2393] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:13.166900 27587 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.135854 27634 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.120880 27623 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.193336 22116 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
W20260709 12:12:13.195119 27643 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.241s	user 0.003s	sys 0.014s
I20260709 12:12:13.126751 27576 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.192852 27587 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.199231 22120 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:13.206974 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2776) took 1706 ms. Trace:
I20260709 12:12:13.213269 27634 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:13.215003 22269 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:13.215276 27440 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.217945 22195 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:13.218026 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 156068us
I20260709 12:12:13.218755 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:13.207417 22190 rpcz_store.cc:276] 0709 12:12:11.490928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.491115 (+   187us) service_pool.cc:224] Handling call
0709 12:12:11.527650 (+ 36535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:11.536141 (+  8491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:11.536173 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:11.557603 (+ 21430us) log.cc:844] Serialized 26 byte log entry
0709 12:12:11.729028 (+171425us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:12:11.729065 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.729134 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:13.109772 (+1380638us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:13.197358 (+ 87586us) raft_consensus.cc:1685] finished
0709 12:12:13.197385 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:13.197580 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8424,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":28203136,"thread_start_us":101069,"threads_started":1,"wal-append.queue_time_us":358152}
I20260709 12:12:13.221902 22270 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:13.250625 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:13.197299 27576 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.066466 27670 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.162941 27577 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.197233 27598 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.254099 22189 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:13.166373 27559 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.253142 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:13.257246 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:13.256913 27634 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:12:13.267366 27691 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:13.268057 27691 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:13.268491 27691 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:13.273350 27629 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:13.274022 27629 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.274586 27577 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.276221 27629 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:13.254009 27587 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:12:13.253839 27591 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:13.278250 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:13.278887 27672 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.280618 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:13.264729 22195 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:12:13.224128 27685 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.155293 27660 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.280977 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:13.290534 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.292186 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:13.254776 27697 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.260445 27541 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:13.332000 22859 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:13.340011 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:13.340422 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.340607 22114 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:13.341511 22237 leader_election.cc:400] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14.
I20260709 12:12:13.341814 22237 leader_election.cc:403] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:13.335851 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:13.342646 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49945.6us
I20260709 12:12:13.343781 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:13.337608 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:13.338836 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46749us
I20260709 12:12:13.338956 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.287755 27577 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:13.349193 22268 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:13.349318 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.345662 22120 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:12:13.346493 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:13.347741 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:13.350322 22197 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:13.347483 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.357828 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:13.294402 27681 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:13.354009 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.358693 22270 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:13.358685 22114 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:12:13.336102 27587 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:13.355980 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.353834 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:13.354017 27633 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14.
I20260709 12:12:13.353662 27685 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.362334 22123 raft_consensus.cc:2368] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18.
I20260709 12:12:13.339934 27541 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:13.366858 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.391691 22194 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:13.374253 27559 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.376435 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:13.397550 27339 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.377188 22087 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:13.363649 27587 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.388484 27660 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:13.366156 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.362041 27688 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:12:13.351357 27576 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:13.415690 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.417279 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.417901 27664 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:13.363082 27681 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:13.348804 27629 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:12:13.468815 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.469728 22121 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:13.394955 22118 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:13.412923 22119 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:13.470629 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.471485 22121 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 13: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:13.399994 27541 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.471550 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.471554 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.473785 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.474804 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.472268 22119 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:13.475553 27707 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:12:13.475950 27677 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.476161 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.477305 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.477901 22119 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:12:13.479056 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.480064 27542 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:13.349400 27672 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:13.393062 22117 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.481052 27672 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.481564 27672 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.414451 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:13.482797 22194 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:13.483705 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:13.484345 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:13.421052 27686 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:13.485369 27339 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.485837 27339 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.389963 27511 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:13.486908 27655 raft_consensus.cc:2764] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:13.487167 27511 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:13.487601 27511 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.487653 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.488229 27655 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:13.418521 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.413486 27587 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:13.491336 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.421716 27440 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:13.421221 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:13.424736 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:13.493274 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.425335 22267 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:13.495039 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.424234 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.430068 27627 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:13.495702 22263 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:13.436460 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:13.437197 27691 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.449101 22270 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:13.504282 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:13.504858 22270 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:13.450587 27598 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.451303 27681 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:13.453331 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.453992 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.455984 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.511617 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.466325 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.468205 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:13.365299 27685 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:13.397323 27490 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.364573 27703 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:13.420576 27688 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:13.435415 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.430743 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:13.543926 22271 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.419960 27552 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:13.497526 22864 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:13.501725 27339 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.362241 27709 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:13.493851 22265 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:13.550644 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.551115 22265 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:12:13.502911 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.505722 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.509311 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.462045 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:13.552683 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 90711us
I20260709 12:12:13.552747 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.553712 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.513029 22269 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:13.511766 22198 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:12:13.555351 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:13.524376 27685 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.518057 22270 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 6.
I20260709 12:12:13.523408 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:13.526229 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:13.526906 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:13.486967 27686 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.545017 27552 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:13.558300 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.559540 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.560333 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.543418 27688 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:13.563668 22268 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:13.566371 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.563661 22831 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:13.569548 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.574016 22267 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:13.562242 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.563714 27591 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:13.572263 27552 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.569977 27609 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:13.569198 27686 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:13.580852 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:13.590862 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:13.573215 27533 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.600090 27533 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.588635 27671 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.601707 22865 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:13.596762 27678 consensus_meta.cc:287] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.560s	user 0.013s	sys 0.000s
I20260709 12:12:13.605581 27533 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.631512 27490 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.609858 27646 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:13.601853 27663 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:12:13.633225 27678 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.635931 27678 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.638691 27533 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.601184 27691 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.645443 27681 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.647292 27685 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.647751 27681 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.644215 27672 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.616714 27541 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.619999 27552 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.649359 27685 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.649716 27672 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.623520 27587 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:13.629643 27713 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:13.633211 27646 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:13.652091 27552 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.652740 27587 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.654808 27511 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.656713 27511 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.657096 27541 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.703233 22118 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:12:13.706068 22119 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:12:13.705824 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 328480us
I20260709 12:12:13.709084 22163 leader_election.cc:400] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16.
I20260709 12:12:13.472319 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.502799 22117 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:13.418502 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.515437 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:13.726595 22197 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:13.730676 22193 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:13.732789 22194 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:13.733775 22122 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:13.571820 22265 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:13.573760 22266 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 14: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:13.618803 27688 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:13.771188 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 58886us
I20260709 12:12:13.773962 27577 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:13.776371 27490 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:13.566936 27709 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.794745 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:13.804436 27641 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:13.651116 27646 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.813000 27552 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:13.814379 27552 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.805658 27641 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.819365 22121 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 14: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:13.804049 22237 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:13.768659 27678 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.835552 22021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 273) took 2170 ms. Trace:
I20260709 12:12:13.838631 22119 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:12:13.838773 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:13.841531 27552 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:13.843214 22117 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:12:13.850883 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 47363us
I20260709 12:12:13.852162 22196 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:12:13.854853 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:13.855260 22865 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:13.855476 22120 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:12:13.865406 27709 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:13.865792 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:13.866739 27688 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.873206 27678 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.876174 27678 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:13.904611 27709 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:13.914093 27709 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:13.917894 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 89146.1us
I20260709 12:12:13.919759 27709 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:13.914662 27490 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:13.921245 27541 consensus_queue.cc:1059] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:12:13.951027 27542 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:13.955417 27541 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:13.955891 27541 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:13.836287 22021 rpcz_store.cc:276] 0709 12:12:11.664941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.665158 (+   217us) service_pool.cc:224] Handling call
0709 12:12:13.835203 (+2170045us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:12.432942 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:12.433616 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:12.433661 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:12:12.433682 (+    21us) tablet.cc:662] Decoding operations
0709 12:12:12.434116 (+   434us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:12.434180 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:12.434217 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:12.434431 (+   214us) tablet.cc:701] Row locks acquired
0709 12:12:12.434451 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:12:12.434631 (+   180us) write_op.cc:270] Start()
0709 12:12:12.434756 (+   125us) write_op.cc:276] Timestamp: P: 1783599132434574 usec, L: 0
0709 12:12:12.434780 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:12:12.435562 (+   782us) log.cc:844] Serialized 539 byte log entry
0709 12:12:12.924149 (+488587us) op_driver.cc:464] REPLICATION: finished
0709 12:12:13.002941 (+ 78792us) write_op.cc:301] APPLY: starting
0709 12:12:13.003041 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:13.004406 (+  1365us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:13.004532 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:13.099626 (+ 95094us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:13.121621 (+ 21995us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:12:13.126661 (+  5040us) write_op.cc:312] APPLY: finished
0709 12:12:13.163445 (+ 36784us) log.cc:844] Serialized 25 byte log entry
0709 12:12:13.174197 (+ 10752us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:13.174307 (+   110us) write_op.cc:454] Released schema lock
0709 12:12:13.174357 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:13.444280 (+269923us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b18002557c0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceaca32a6 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b
0709 12:12:13.446155 (+  1875us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18002557c0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fccf17f8ef0 00007fccf17f9489 00007fccf17fb71a
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":74869,"apply.run_cpu_time_us":8166,"apply.run_wall_time_us":173623,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":150682,"prepare.run_cpu_time_us":3003,"prepare.run_wall_time_us":16130,"replication_time_us":474229,"spinlock_wait_cycles":64096512,"thread_start_us":109683,"threads_started":2}]]}
I20260709 12:12:13.956959 27709 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:13.957194 27541 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.957820 27709 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.958904 27541 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:13.961395 27576 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:13.962345 27576 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:13.964517 22198 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:13.960459 27709 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:13.971115 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 51293us
I20260709 12:12:13.988373 27542 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:14.018373 22117 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:12:14.007656 27685 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.020905 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:14.032975 27539 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.049125 27542 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:14.049436 27539 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:14.052124 27542 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.028995 27678 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:14.053584 27678 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:14.054857 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:14.055637 22122 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:14.057183 27598 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:14.036566 27550 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:12:14.061950 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:14.062812 22114 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:14.063006 27641 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.064385 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:14.065194 22119 raft_consensus.cc:2368] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13.
I20260709 12:12:14.065003 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:14.065876 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:14.066133 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:14.066984 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:14.068197 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:14.024166 27634 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:14.058054 27598 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:14.067132 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:14.048635 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:14.028808 27709 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:14.052352 27539 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.073417 22116 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 14: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:14.083890 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:14.035254 22272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.010s	sys 0.018s
I20260709 12:12:14.068751 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:14.087011 22196 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:14.077337 22190 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:12:14.070652 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57260.5us
I20260709 12:12:14.029439 27707 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:14.099735 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:14.056456 27678 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.077797 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:14.107586 22197 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:14.078593 27685 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:14.071579 27721 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:12:14.070991 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37260 (request call id 1330) took 1189 ms. Trace:
I20260709 12:12:14.071705 27576 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.079413 27709 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.026718 27490 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.095183 27591 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:14.132943 27591 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:14.133934 22114 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:12:14.136128 27591 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:14.094408 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.141353 27709 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.141571 22197 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:14.101061 27694 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:14.142727 27694 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.101871 27629 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:14.089766 27509 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:14.108227 22122 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:14.145116 27629 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.145979 27533 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.147511 27629 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:14.107016 22272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.011s	sys 0.019s
I20260709 12:12:14.119313 22195 rpcz_store.cc:276] 0709 12:12:12.881869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.882065 (+   196us) service_pool.cc:224] Handling call
0709 12:12:14.070535 (+1188470us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54000fcdd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:14.070738 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732321536}
W20260709 12:12:14.100638 22271 consensus_meta.cc:287] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.555s	user 0.017s	sys 0.001s
I20260709 12:12:14.148885 22271 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:14.084846 27598 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.148954 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 2686) took 2148 ms. Trace:
I20260709 12:12:14.150211 27608 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:14.151244 27608 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.150076 22272 rpcz_store.cc:276] 0709 12:12:12.000314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.004438 (+  4124us) service_pool.cc:224] Handling call
0709 12:12:12.009407 (+  4969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:12.012172 (+  2765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:12.012206 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:13.344622 (+1332416us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b180031f720. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceaca32a6 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a
0709 12:12:13.438115 (+ 93493us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b2c000682a8. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:12:13.438863 (+   748us) log.cc:844] Serialized 26 byte log entry
0709 12:12:14.148413 (+709550us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:12:14.148471 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.148585 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:14.148654 (+    69us) raft_consensus.cc:1685] finished
0709 12:12:14.148664 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:14.148860 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14199,"raft.queue_time_us":2763,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":6215,"spinlock_wait_cycles":7180928,"thread_start_us":708869,"threads_started":1,"wal-append.queue_time_us":223585}
I20260709 12:12:14.155925 27608 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:14.157591 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 152) took 1892 ms. Trace:
I20260709 12:12:14.157123 27707 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:14.161695 22123 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:14.162279 22115 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:12:14.070590 27681 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:14.163443 27681 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.165931 27681 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.157996 22017 rpcz_store.cc:276] 0709 12:12:12.264693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.264913 (+   220us) service_pool.cc:224] Handling call
0709 12:12:14.157338 (+1892425us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:12.826445 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:12.933749 (+107304us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:12.935351 (+  1602us) write_op.cc:435] Acquired schema lock
0709 12:12:12.937296 (+  1945us) tablet.cc:662] Decoding operations
0709 12:12:13.026192 (+ 88896us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:13.034075 (+  7883us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:13.038882 (+  4807us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:13.081817 (+ 42935us) tablet.cc:701] Row locks acquired
0709 12:12:13.085837 (+  4020us) write_op.cc:260] PREPARE: finished
0709 12:12:13.098395 (+ 12558us) write_op.cc:270] Start()
0709 12:12:13.112586 (+ 14191us) write_op.cc:276] Timestamp: P: 1783599133095518 usec, L: 0
0709 12:12:13.118283 (+  5697us) op_driver.cc:348] REPLICATION: starting
0709 12:12:13.767026 (+648743us) log.cc:844] Serialized 539 byte log entry
0709 12:12:13.771172 (+  4146us) op_driver.cc:464] REPLICATION: finished
0709 12:12:13.871624 (+100452us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddbde28 00007fccf17f8581 00007fccf17f7d58 00007fccf17fc9f1 00007fccf17fc9a9 00007fccf17fc939 00007fccf17fc901 00007fccf17fbb2d 0000000000388634 0000000000388479
0709 12:12:13.958014 (+ 86390us) write_op.cc:301] APPLY: starting
0709 12:12:13.958174 (+   160us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:13.960446 (+  2272us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:13.960493 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:14.076025 (+115532us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:14.076377 (+   352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:12:14.076442 (+    65us) write_op.cc:312] APPLY: finished
0709 12:12:14.076819 (+   377us) log.cc:844] Serialized 25 byte log entry
0709 12:12:14.077089 (+   270us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:14.077241 (+   152us) write_op.cc:454] Released schema lock
0709 12:12:14.077309 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:14.077880 (+   571us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:14.077921 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":158192,"apply.run_cpu_time_us":6590,"apply.run_wall_time_us":119854,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":182,"prepare.run_cpu_time_us":12076,"prepare.run_wall_time_us":1061751,"replication_time_us":652629,"spinlock_wait_cycles":1446834944,"thread_start_us":21481,"threads_started":1}]]}
I20260709 12:12:14.184432 22020 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 12 to 13, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 13 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.186110 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:14.186929 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:14.187790 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:14.188154 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:14.188253 22267 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:14.188730 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:14.192610 27634 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:14.197901 22267 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:14.213901 22271 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:14.220090 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:14.223276 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 105843us
I20260709 12:12:14.225322 22117 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.226440 22268 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.207881 27634 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.227149 22270 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 14: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:14.244194 22193 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 15. (term mismatch)
I20260709 12:12:14.246059 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:14.240067 22114 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:14.244626 22193 pending_rounds.cc:85] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 14
I20260709 12:12:14.253070 22192 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:12:14.235819 27490 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:14.250553 22193 pending_rounds.cc:107] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 15.15
I20260709 12:12:14.260391 22193 raft_consensus.cc:2889] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:14.239017 22267 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.246368 27694 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:14.279783 22263 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:14.281842 22264 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:12:14.292536 27634 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:14.293148 22267 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:14.297358 27686 consensus_meta.cc:287] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.657s	user 0.003s	sys 0.011s
I20260709 12:12:14.298014 27686 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.299695 22191 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:12:14.263971 27685 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.262571 22020 catalog_manager.cc:5697] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 7 to 8, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 8 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.281950 27709 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.312620 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 213149us
I20260709 12:12:14.305111 27686 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.312022 27634 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.332255 22117 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:14.323612 22020 catalog_manager.cc:5697] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 7 to 8, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 8 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.352454 22269 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:14.357270 22858 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:12:14.364171 22268 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:14.367714 22267 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:12:14.380633 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:14.381491 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:14.385139 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:14.386016 27490 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.386508 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:14.385336 22196 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:14.387042 27490 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:14.388468 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:14.391641 27707 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.392496 27646 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:14.409648 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2408) took 1123 ms. Trace:
I20260709 12:12:14.410161 22191 rpcz_store.cc:276] 0709 12:12:13.286641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.550587 (+263946us) service_pool.cc:224] Handling call
0709 12:12:13.551075 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:14.300250 (+749175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.409289 (+109039us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54001f40d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:14.409566 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1720394496}
I20260709 12:12:14.412844 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:14.415800 27511 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:14.416508 27511 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:14.417979 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.418977 27511 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.420687 27490 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.423075 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:14.425797 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 118057us
I20260709 12:12:14.427489 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:14.428958 27681 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:14.429354 27681 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:14.429733 27681 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:12:14.434449 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 98587.4us
W20260709 12:12:14.437629 27737 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:12:14.353470 27625 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.439751 27625 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:14.441897 27625 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.347141 27685 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:14.442929 27685 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.346390 27709 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:14.450660 27709 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.459546 27739 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:14.460393 27739 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.368429 22267 pending_rounds.cc:85] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 7
I20260709 12:12:14.461773 22267 pending_rounds.cc:107] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:12:14.462682 22120 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:14.443418 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:14.463990 27686 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:14.465463 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 79976us
I20260709 12:12:14.462255 22267 raft_consensus.cc:2889] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:14.465466 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:14.459683 27694 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:14.461838 22163 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:14.355146 27727 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:12:14.488456 22119 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:14.492791 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:14.487525 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.495199 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:14.462726 27739 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:14.515157 22162 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:14.516728 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.497764 27664 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:14.527814 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 137656us
W20260709 12:12:14.529395 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 64160.5us
I20260709 12:12:14.532723 27625 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:14.533654 27709 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:14.535349 27686 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:12:14.535449 27625 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:14.496073 27685 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.540028 27511 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:14.540683 27511 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:14.541028 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.545737 22864 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 12: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:14.513734 27694 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:14.550160 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 62026.6us
W20260709 12:12:14.553712 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 58971.5us
I20260709 12:12:14.545815 27686 raft_consensus.cc:697] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:14.551075 27709 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.563915 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:14.555932 27490 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:14.580854 22162 leader_election.cc:400] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18.
I20260709 12:12:14.581388 22162 leader_election.cc:403] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:14.583108 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:14.584149 22858 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:14.586994 27598 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:14.566147 27688 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:14.601763 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:14.596618 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 54426us
I20260709 12:12:14.607156 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:14.588454 27511 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:14.610605 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46845.9us
W20260709 12:12:14.611759 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50092.7us
W20260709 12:12:14.612022 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 72133.1us
I20260709 12:12:14.611768 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:14.582593 27707 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:14.617024 22267 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:14.605737 27542 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18.
I20260709 12:12:14.585047 27709 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:14.652966 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.660159 22120 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:14.672183 27743 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:12:14.674825 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:14.676366 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:14.677749 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.677301 27686 consensus_queue.cc:237] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.678512 27697 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:14.678925 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47471.8us
I20260709 12:12:14.679473 27681 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.680264 27694 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:14.638765 27664 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:14.639074 27685 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:14.690205 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:14.634774 27490 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.693513 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:14.705152 22162 leader_election.cc:400] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13.
I20260709 12:12:14.707355 22162 leader_election.cc:403] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:12:14.637948 27550 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:12:14.711244 27539 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:14.711736 27539 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.712088 27539 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:14.717444 27697 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.718010 27697 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:14.720747 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:14.726218 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 62324us
I20260709 12:12:14.638567 27688 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.661861 27707 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.700496 27541 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:14.678978 27559 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:12:14.731844 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.736837 27685 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.720505 27697 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.757009 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.758651 27685 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.760035 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:14.760643 27681 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.762378 27634 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:14.746930 27694 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:14.762566 27709 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:14.763125 27694 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.763442 27709 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:14.766060 27688 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.767459 27542 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:14.772186 22191 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:14.773481 27634 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:14.773993 27634 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.743400 27576 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.777376 27576 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.781610 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.735656 27541 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:14.783015 27541 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.763598 27694 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:14.762620 27490 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.786841 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.708938 27678 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:12:14.813915 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.814193 27697 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:14.814908 27697 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.817801 27697 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.824368 22117 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:14.826722 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:14.826818 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 132474us
I20260709 12:12:14.831000 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:14.831756 22120 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
W20260709 12:12:14.831699 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 71769.6us
I20260709 12:12:14.833290 27735 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:12:14.834458 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 171145us
I20260709 12:12:14.835923 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:14.836898 27735 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:14.838567 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:14.839363 27735 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:14.842231 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:14.843020 27735 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:14.843439 27735 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.843784 27735 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:14.764410 27709 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.854735 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.858204 27707 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.860872 27650 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:14.861585 27621 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:14.866930 27609 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:14.883867 22117 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
W20260709 12:12:14.881603 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 184382us
I20260709 12:12:14.890370 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:14.894465 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 144476us
I20260709 12:12:14.897863 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:14.880446 27650 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:12:14.924165 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:14.916968 27760 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.929255 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.930141 27760 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.925832 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.928822 27539 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:14.933223 27573 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
I20260709 12:12:14.934957 27539 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.929252 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:14.914636 27670 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.206s
I20260709 12:12:14.919255 27739 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:14.937459 27625 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:14.938916 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:14.940604 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:14.917405 27688 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:12:14.954057 27761 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:14.950628 27509 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:14.961290 27739 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:14.970256 27761 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:14.956058 27760 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:14.999197 27761 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.000674 27709 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:14.984086 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 61281.3us
I20260709 12:12:15.003464 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:15.005326 22087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.952s (SENT) [suppressed 14 similar messages]
I20260709 12:12:14.987324 27735 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:14.978588 27509 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.981724 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:15.014412 27688 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:15.010716 27509 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:15.019084 27576 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:15.021237 27735 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:15.027909 27511 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:15.025213 27697 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:15.024709 27634 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:15.032745 27697 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.034307 22272 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:15.035727 27697 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:15.038304 27511 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:15.040236 27511 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.038626 27542 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13.
I20260709 12:12:15.045688 27688 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:12:15.026467 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 58395.4us
I20260709 12:12:15.049419 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:15.059194 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53905.1us
I20260709 12:12:15.059428 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:15.028014 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:15.027499 27694 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.062137 27542 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:12:15.025995 27541 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.080120 27681 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:15.096274 27694 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:15.066123 27755 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:12:15.075707 27735 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.107188 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:15.108212 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 80428.2us
I20260709 12:12:15.077041 27539 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:15.104750 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:15.114158 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:15.114719 22830 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:15.083184 27688 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:15.125627 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:15.126307 27688 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.124970 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:15.128494 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:15.134562 22191 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:15.116662 27681 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:15.189042 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:15.190140 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:15.099985 27686 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:12:15.125530 27539 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:15.206530 22263 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:15.150930 27533 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:15.228475 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 74519.5us
I20260709 12:12:15.233809 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:15.229873 27634 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:15.252660 22267 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:15.229836 27533 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:15.212810 27694 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:12:15.251690 27735 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:12:15.291708 22193 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:15.275120 27533 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:15.295897 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:15.310611 27777 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:15.317250 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:15.317975 22196 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:15.319387 27541 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:15.319932 27539 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.328712 27709 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:15.329617 27709 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.332785 27681 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.333918 27646 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:15.334471 27646 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:15.339464 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:15.274786 27685 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:15.341001 27685 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.277989 27686 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:15.342331 27686 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.343380 27685 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:15.344727 27774 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.119s	user 0.000s	sys 0.002s
W20260709 12:12:15.347047 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 59196.4us
I20260709 12:12:15.301090 27688 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:15.304347 27697 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.354849 27709 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:15.367691 27634 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:15.381781 27739 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:12:15.416114 27735 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.438791 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.439024 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.441143 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.442955 22119 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:15.456637 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:15.459560 22196 raft_consensus.cc:2410] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:12:15.422698 27697 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.436810 27686 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:15.468977 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:15.477768 27791 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:15.480093 27646 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:15.489223 27428 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:12:15.502777 22267 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:12:15.464699 27735 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:15.542946 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:15.543545 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:15.543704 22119 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
W20260709 12:12:15.543725 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 194728us
I20260709 12:12:15.468350 27787 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:12:15.547696 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:15.548657 22122 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:15.549996 22123 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:12:15.557360 22272 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:15.558626 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:15.557163 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:15.565339 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:15.570097 22121 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:15.564754 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:15.573177 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 146122us
I20260709 12:12:15.564145 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:15.576109 22123 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:15.582270 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:15.612538 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:15.613300 22119 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:15.613752 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:15.572274 27760 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:15.622113 27760 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.622538 27760 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:15.559768 27792 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:15.618571 27634 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:15.634033 27634 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:15.635198 27634 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.645361 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:15.646647 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:15.648806 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:15.582163 27539 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:15.636596 27634 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:15.653265 22122 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
W20260709 12:12:15.658066 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 83265.2us
I20260709 12:12:15.657634 27576 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:12:15.664419 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.669417 22118 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:12:15.657985 27792 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:15.673434 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 59224.3us
I20260709 12:12:15.678280 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:15.681134 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.682294 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.682431 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.687213 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.688268 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.691476 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:15.692858 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.694401 22270 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:15.683426 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.697062 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:15.697481 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.695025 22270 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:15.689298 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.705152 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.715199 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.680100 27697 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:15.723258 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.719856 22195 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:15.724453 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:15.702328 27791 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:12:15.701411 27609 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:15.720351 22270 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.731390 22270 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:15.732788 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 69308.8us
I20260709 12:12:15.670079 27539 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.696851 27688 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:12:15.785833 22268 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:12:15.789710 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53590.2us
I20260709 12:12:15.760658 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:15.813053 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52520.2us
I20260709 12:12:15.814407 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:15.832814 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.830237 27576 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:15.789774 27791 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:15.927814 27791 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:15.931954 27793 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.407s	user 0.000s	sys 0.003s
I20260709 12:12:15.751912 27542 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:12:15.934485 27576 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:15.935487 27646 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:15.753620 27681 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:12:15.800428 27735 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:15.946204 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:15.946995 22116 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:15.838596 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:15.950423 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 111916us
I20260709 12:12:15.951342 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:15.953102 27735 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:15.953670 27735 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:15.954099 27735 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:15.957008 27428 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:15.957605 27428 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:15.842585 27539 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:15.843080 27790 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:12:15.822010 27688 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:12:15.839854 27709 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:15.964298 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:15.964706 22116 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:12:15.840167 27509 consensus_meta.cc:287] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.006s
I20260709 12:12:15.821640 27697 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:15.965390 22271 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:15.867702 22270 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:12:15.875721 27789 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.398s	user 0.000s	sys 0.010s
I20260709 12:12:15.881681 27794 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:15.897884 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:15.980518 22268 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:12:15.909466 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:15.742848 27609 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:15.915218 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:15.997233 22120 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.754927 27533 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:16.002664 27760 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.004719 27533 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:16.005652 22864 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:15.961426 22123 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:12:15.962894 27428 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:15.849675 27694 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:15.968900 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:15.970532 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.034711 22270 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:16.038501 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:16.039290 22270 raft_consensus.cc:2368] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10.
I20260709 12:12:16.042029 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:16.054576 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:15.980069 27794 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:12:16.064221 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 265274us
I20260709 12:12:16.065584 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:16.066532 22270 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:16.067178 22163 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:15.965397 27509 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:16.073390 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 335214us
I20260709 12:12:16.085891 22162 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:16.131950 22270 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
W20260709 12:12:16.134745 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48972.1us
W20260709 12:12:16.135376 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68341.3us
I20260709 12:12:16.140215 22264 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:12:16.143555 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:16.147706 27686 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:16.144647 27807 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:16.149271 22265 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:16.149602 27807 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.144979 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.154150 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:16.120855 27760 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:16.159586 22162 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:16.158231 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.094520 27542 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:12:16.166023 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:16.168277 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:16.142828 27815 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:16.179049 27794 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:16.149292 27686 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:16.184991 27554 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.135330 27428 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:16.209575 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47420.4us
I20260709 12:12:16.189424 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:16.210788 22194 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.211104 22263 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
W20260709 12:12:16.174969 27634 consensus_meta.cc:287] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.001s
I20260709 12:12:16.162837 27539 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:16.205467 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:16.170564 27688 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:16.222611 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.267995 27428 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:16.283006 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.176296 27792 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:16.291016 22267 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:12:16.190809 27815 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:16.289109 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 78675.1us
I20260709 12:12:16.208328 27542 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:16.209493 27686 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:12:16.310593 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 105255us
I20260709 12:12:16.323195 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:16.312055 22267 pending_rounds.cc:85] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 6
I20260709 12:12:16.312883 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.224141 27554 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:16.323984 22267 pending_rounds.cc:107] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:12:16.326129 22267 raft_consensus.cc:2889] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:16.327574 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.311880 27792 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:16.307435 27688 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:16.334753 27814 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:12:16.340857 27778 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:16.341210 27609 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:16.331907 27678 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:16.345360 27678 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.345969 27554 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:16.315483 27791 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:16.348021 27678 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:16.348088 27791 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:16.349443 27791 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.313941 27815 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:16.324571 27576 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:16.353154 27509 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:16.327881 27787 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:12:16.357270 27807 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:16.358027 27688 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:16.331861 27539 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:16.359462 27539 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:16.359831 27539 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:16.353318 27576 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.365396 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.377992 22194 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:16.381325 22861 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:12:16.384541 22120 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:16.386281 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.388469 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.390807 22268 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:16.364650 27794 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.371213 27792 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:16.383605 27542 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:12:16.382391 27778 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:16.413266 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:16.414934 27819 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:16.418658 27511 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:16.421005 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.421077 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.437613 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:16.445899 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.457196 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.422137 27576 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:16.459422 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.464115 22268 raft_consensus.cc:2410] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:16.475883 27803 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:16.476657 27803 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:16.477813 27803 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.452016 27787 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:16.484589 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:16.487813 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 161738us
I20260709 12:12:16.488575 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:16.413287 27778 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.496353 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:16.502004 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:16.506283 22268 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:16.481913 27787 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:12:16.513762 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 128624us
I20260709 12:12:16.522785 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:16.526508 22122 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:16.499970 27541 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:16.528693 22117 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:16.531909 22263 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:12:16.535526 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.525804 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:16.554562 22120 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:16.555085 22120 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:16.545315 27735 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.004s
I20260709 12:12:16.562486 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.565742 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:16.543726 27678 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:16.556106 22120 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.570680 22120 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:16.553617 27542 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:16.550715 27541 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:16.580744 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:16.559962 27803 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.585139 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.589737 27778 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:16.590837 27816 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.322s	user 0.002s	sys 0.000s
I20260709 12:12:16.591688 27807 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:16.597981 22830 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:16.557781 27828 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:16.630527 27759 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:16.631196 27759 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:16.602128 27686 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.632751 27815 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.634435 22020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 247) took 4240 ms. Trace:
I20260709 12:12:16.634752 27686 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:16.605589 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.639905 22830 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:16.607462 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.642639 27771 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:16.608114 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:16.608143 27542 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:16.643518 22264 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:12:16.643666 27812 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.344s	user 0.007s	sys 0.000s
I20260709 12:12:16.644169 27542 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.644865 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 3370) took 1006 ms. Trace:
I20260709 12:12:16.645345 22272 rpcz_store.cc:276] 0709 12:12:15.638618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.638765 (+   147us) service_pool.cc:224] Handling call
0709 12:12:15.639163 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:15.727676 (+ 88513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:15.727730 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:15.728534 (+   804us) log.cc:844] Serialized 26 byte log entry
0709 12:12:16.083549 (+355015us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:16.083593 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.083668 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:16.642911 (+559243us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:16.644578 (+  1667us) raft_consensus.cc:1685] finished
0709 12:12:16.644600 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.644807 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7925,"raft.queue_time_us":14822,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2288,"spinlock_wait_cycles":24745216,"thread_start_us":374692,"threads_started":2,"wal-append.queue_time_us":422641}
I20260709 12:12:16.609120 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:16.647750 27807 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.648283 27807 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.608700 27541 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.650583 27807 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:16.573381 27576 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:16.566891 27735 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.613708 27509 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:16.653228 27509 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:16.653613 27509 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:16.654296 27735 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:16.654532 27509 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:16.619168 27539 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.559551 27787 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.623587 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:16.626300 27688 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.635169 27815 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:16.606308 27685 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:16.632234 27759 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:16.641721 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3283) took 1077 ms. Trace:
I20260709 12:12:16.693002 22119 rpcz_store.cc:276] 0709 12:12:15.563974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.644641 (+ 80667us) service_pool.cc:224] Handling call
0709 12:12:15.660899 (+ 16258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:15.805585 (+144686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:15.805638 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:15.837868 (+ 32230us) log.cc:844] Serialized 26 byte log entry
0709 12:12:16.058432 (+220564us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:16.058492 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.058587 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:16.590121 (+531534us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:16.641396 (+ 51275us) raft_consensus.cc:1685] finished
0709 12:12:16.641419 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.641655 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1362,"raft.queue_time_us":68265,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":127,"spinlock_wait_cycles":84366592,"thread_start_us":276371,"threads_started":2,"wal-append.queue_time_us":240944}
I20260709 12:12:16.663085 22120 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:12:16.697685 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.685575 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.701442 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:16.700807 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:16.705965 22264 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:16.706852 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.711133 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.706828 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.712863 22271 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:16.714495 22263 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:16.683491 22268 raft_consensus.cc:2376] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13. Re-sending same reply.
I20260709 12:12:16.722393 27509 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.703807 27685 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:16.727615 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:16.723600 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.634878 22020 rpcz_store.cc:276] 0709 12:12:12.393795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.394910 (+  1115us) service_pool.cc:224] Handling call
0709 12:12:16.634345 (+4239435us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:14.785310 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:14.786220 (+   910us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:14.786298 (+    78us) write_op.cc:435] Acquired schema lock
0709 12:12:14.786325 (+    27us) tablet.cc:662] Decoding operations
0709 12:12:14.787110 (+   785us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:14.787253 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:14.787294 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:14.787975 (+   681us) tablet.cc:701] Row locks acquired
0709 12:12:14.788041 (+    66us) write_op.cc:260] PREPARE: finished
0709 12:12:14.788283 (+   242us) write_op.cc:270] Start()
0709 12:12:14.788472 (+   189us) write_op.cc:276] Timestamp: P: 1783599134788182 usec, L: 0
0709 12:12:14.788502 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:12:14.869026 (+ 80524us) log.cc:844] Serialized 1326 byte log entry
0709 12:12:15.134807 (+265781us) op_driver.cc:464] REPLICATION: finished
0709 12:12:15.451003 (+316196us) write_op.cc:301] APPLY: starting
0709 12:12:15.458570 (+  7567us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:15.905942 (+447372us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:15.906078 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:15.917100 (+ 11022us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:15.917391 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:12:15.917457 (+    66us) write_op.cc:312] APPLY: finished
0709 12:12:15.917752 (+   295us) log.cc:844] Serialized 41 byte log entry
0709 12:12:16.006098 (+ 88346us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:16.006226 (+   128us) write_op.cc:454] Released schema lock
0709 12:12:16.006274 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:16.006765 (+   491us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:16.006797 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":195559,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":284378,"apply.run_cpu_time_us":16797,"apply.run_wall_time_us":570748,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16673,"num_ops":3,"prepare.queue_time_us":317393,"prepare.run_cpu_time_us":4646,"prepare.run_wall_time_us":84126,"replication_time_us":317240,"thread_start_us":351167,"threads_started":2}]]}
W20260709 12:12:16.746568 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.719741 27576 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:16.755730 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:16.756218 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:16.764876 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:16.765740 22122 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:12:16.747304 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6553227670001434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 12:12:16.778044 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:16.781953 22263 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:16.787633 22118 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:12:16.797529 22122 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:12:16.798089 22114 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:16.802498 22263 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:16.803066 22263 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:16.812657 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:16.813371 22268 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:16.828787 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:16.829901 22264 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:16.830739 22267 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:12:16.833077 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.755651 27681 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:12:16.724350 27791 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:12:16.853645 22191 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:16.850165 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.854803 22118 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:16.857918 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:16.857919 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.860415 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.862404 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:16.812248 22019 catalog_manager.cc:5697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 9, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 9 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.866011 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:16.866770 22118 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:16.868607 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.830792 22263 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.869910 22263 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.861750 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:16.874629 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.875352 22192 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:16.881174 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.881588 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.881855 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.874485 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.881590 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:16.884090 22193 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.883400 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:16.886111 22019 catalog_manager.cc:5697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 12 to 14, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 14 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.885054 22190 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:12:16.892040 22114 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:12:16.893008 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:16.888702 22019 catalog_manager.cc:5697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 16, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 16 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:16.853368 27832 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.793901 27576 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:16.911095 27831 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 12:12:16.913048 27828 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:16.919996 22193 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:16.923278 22122 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:16.921300 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:16.831334 27792 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:16.919207 27794 consensus_meta.cc:287] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.002s
W20260709 12:12:16.908054 27793 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:12:16.954362 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 198276us
I20260709 12:12:16.984261 22119 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:16.986073 22195 raft_consensus.cc:2410] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:16.991983 22122 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:12:17.010023 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:17.010989 22193 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:16.850236 27685 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:16.967413 27541 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.015060 27688 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:17.020515 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 276931us
I20260709 12:12:16.942099 27511 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:12:17.002207 27794 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.001494 27539 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:17.032505 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:17.041690 22192 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:17.039148 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:17.045109 22198 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:17.045295 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 143267us
I20260709 12:12:17.047894 22268 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:12:17.047771 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:17.051913 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:17.016058 27801 raft_consensus.cc:2764] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:12:17.038010 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:16.938256 27832 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:17.029115 27541 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:17.043109 27685 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.071651 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:17.073761 22193 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:17.127055 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:17.074230 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.074440 27835 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:12:17.075989 27837 log.cc:927] Time spent T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:12:17.077952 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:17.082708 22119 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:17.085798 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:17.014415 22019 catalog_manager.cc:5697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 11, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:17.073803 27833 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 12:12:17.122942 22191 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:12:17.130712 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:17.044934 27794 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:17.132704 22163 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:17.148528 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:17.141786 22019 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:17.160928 27846 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:12:17.161749 27846 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:17.162472 27791 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.088369 27739 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:12:17.184556 22116 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:12:17.185865 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:17.199657 22118 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:17.220201 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:12:17.245151 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 73253.6us
I20260709 12:12:17.163268 27791 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:17.218708 22118 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:17.261224 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:17.250792 27809 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.315936 27809 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:17.318044 27809 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:17.322260 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:17.325205 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.329067 27533 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.251781 27739 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:17.275480 27852 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:17.281240 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:17.330155 27739 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:12:17.330977 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49844us
I20260709 12:12:17.331158 27852 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:17.283689 27848 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:12:17.284171 27851 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:17.163053 27846 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:17.334858 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:17.285772 27850 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:17.289888 27576 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:17.291951 22194 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:17.291986 27794 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:17.366880 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:17.367944 22162 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:17.357673 27760 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:17.369885 27681 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:17.371498 27681 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:17.371678 27847 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:17.372087 27847 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:17.378770 27787 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:12:17.295086 27803 consensus_meta.cc:287] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.668s	user 0.003s	sys 0.006s
I20260709 12:12:17.295774 27832 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:17.040059 27778 consensus_queue.cc:1175] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cc9b9c8894084021a0c6ddaf659d222e" responder_term: 15 status { last_received { term: 13 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: [14.9-14.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:17.254547 27792 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:17.387676 27541 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:17.389323 22119 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:12:17.394212 27847 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:17.395646 27847 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:17.398365 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:17.405619 22196 raft_consensus.cc:2410] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:17.331220 27739 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:17.407276 27739 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:17.410563 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:17.315153 27791 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:17.336714 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:17.362634 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 198158us
I20260709 12:12:17.358263 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:17.425447 22272 raft_consensus.cc:2410] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:12:17.425979 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:17.358847 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:17.426471 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:17.342990 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:17.426553 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:17.426749 22265 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:17.427469 22268 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:17.428934 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:17.430770 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 66524.7us
I20260709 12:12:17.360445 22263 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:17.332751 27813 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.357358 27678 consensus_queue.cc:1059] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:12:17.366806 27794 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:17.295007 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.448834 22263 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:17.452096 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:17.415757 22266 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
W20260709 12:12:17.413763 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 77113.8us
I20260709 12:12:17.454107 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:17.439600 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 106864us
I20260709 12:12:17.455404 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:17.442101 22272 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:17.447657 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:17.372040 27681 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:17.461398 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:17.447624 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:17.458109 22123 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:12:17.456511 22864 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:17.339082 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:17.430965 27807 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:17.467363 22194 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:17.472191 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:17.472935 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:17.473337 22189 raft_consensus.cc:2410] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:12:17.475512 27807 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:17.476050 27807 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:17.477764 27509 consensus_meta.cc:287] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.001s
I20260709 12:12:17.482553 27681 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:17.437844 27803 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:17.447116 27576 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:17.470899 22122 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
W20260709 12:12:17.527877 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.461248 27760 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:17.544052 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 78040.6us
I20260709 12:12:17.511786 27828 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:17.536989 27816 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:17.474988 27856 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:12:17.519666 27846 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:12:17.474469 27794 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:17.538950 27541 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:17.566944 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 112944us
I20260709 12:12:17.572355 22087 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:17.574553 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 119245us
I20260709 12:12:17.575960 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:17.493048 27801 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:12:17.555734 27828 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.450462 27813 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:17.515986 27803 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:17.593178 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 129661us
I20260709 12:12:17.549878 27760 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:17.581840 27828 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:17.600185 27857 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
I20260709 12:12:17.682087 22119 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:17.683833 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.577345 27541 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:17.678275 22831 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:17.615008 27841 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:12:17.614494 27859 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:12:17.694114 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 121849us
W20260709 12:12:17.720464 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.730566 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 130910us
I20260709 12:12:17.740531 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:17.719805 27678 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.762396 27874 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:17.764070 27874 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:17.766299 27803 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:17.764501 27874 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:17.784730 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:17.786571 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:17.847976 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 272113us
I20260709 12:12:17.746490 27771 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:17.781872 27874 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:17.899250 22265 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:17.921277 22265 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:17.927009 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:17.961534 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 90245.2us
I20260709 12:12:17.962635 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:17.971671 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 231274us
I20260709 12:12:17.972586 22087 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:17.917531 27685 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.932176 22265 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:17.988657 22265 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:17.957805 27787 consensus_meta.cc:287] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.002s
W20260709 12:12:18.028620 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 355301us
W20260709 12:12:18.033356 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60838.9us
I20260709 12:12:17.970810 27813 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:18.032367 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:18.047358 22197 raft_consensus.cc:2410] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:12:18.045332 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 81441.1us
I20260709 12:12:18.061558 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:18.066591 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.067409 22864 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:18.013715 27853 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:18.062727 27883 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:18.066622 22088 connection.cc:256] RPC call timeout handler was delayed by -1.2540757110000413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 12:12:18.028790 27685 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:18.114372 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.058223 27760 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:18.128250 22088 connection.cc:256] RPC call timeout handler was delayed by -1.2288757110000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 12:12:18.129882 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:18.107628 27862 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 12:12:18.118155 27739 consensus_meta.cc:287] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.710s	user 0.013s	sys 0.000s
W20260709 12:12:18.118192 27807 consensus_meta.cc:287] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.642s	user 0.013s	sys 0.000s
I20260709 12:12:18.135659 27883 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:18.148753 22271 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:12:18.153331 22271 pending_rounds.cc:85] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 6
I20260709 12:12:18.153689 22271 pending_rounds.cc:107] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:12:18.153980 22271 raft_consensus.cc:2889] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:18.118113 27888 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:18.131999 27735 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:18.138909 22088 connection.cc:256] RPC call timeout handler was delayed by -1.1293307020000611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 12:12:18.157321 22088 connection.cc:256] RPC call timeout handler was delayed by -1.1055828750002092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
I20260709 12:12:18.123616 27853 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.139341 27876 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:18.167184 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:18.155427 27678 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:18.174472 27879 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:18.175227 27853 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:18.175740 27685 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:18.177611 27794 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:18.179704 27859 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.180397 27859 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:18.181084 27801 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:18.182296 27801 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:18.182926 27801 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:18.183310 27801 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:18.183859 27576 raft_consensus.cc:3055] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:18.184515 27576 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:18.187172 27847 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.790s	user 0.008s	sys 0.005s
I20260709 12:12:18.156912 27807 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.185735 27576 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.189675 27807 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:18.190593 27576 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:12:18.192924 27868 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.173s	user 0.001s	sys 0.001s
W20260709 12:12:18.195019 27895 log.cc:927] Time spent T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:12:18.197084 27877 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:18.157567 27760 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:18.188651 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 2825) took 1358 ms. Trace:
I20260709 12:12:18.198154 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 3406) took 1040 ms. Trace:
I20260709 12:12:18.201496 22197 rpcz_store.cc:276] 0709 12:12:16.830287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.833308 (+  3021us) service_pool.cc:224] Handling call
0709 12:12:18.188319 (+1355011us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002e72d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:18.188558 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2727010560}
W20260709 12:12:18.206543 22267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.039s
W20260709 12:12:18.210390 22267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.001s	sys 0.039s
I20260709 12:12:18.209601 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3308) took 1342 ms. Trace:
I20260709 12:12:18.210407 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.213631 22265 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:18.221261 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:18.223528 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 189443us
I20260709 12:12:18.205238 27892 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:18.224867 22268 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:18.142309 27875 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:12:18.211194 22115 rpcz_store.cc:276] 0709 12:12:16.856738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.129770 (+273032us) service_pool.cc:224] Handling call
0709 12:12:17.159005 (+ 29235us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:17.168552 (+  9547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:17.168581 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:17.192205 (+ 23624us) log.cc:844] Serialized 52 byte log entry
0709 12:12:17.515930 (+323725us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:17.515966 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.516033 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.198502 (+682469us) raft_consensus.cc:1685] finished
0709 12:12:18.198522 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.198666 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9257,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":11355,"thread_start_us":262753,"threads_started":1,"wal-append.queue_time_us":571683}
I20260709 12:12:18.234210 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.234889 22266 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
W20260709 12:12:18.236940 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.225937 27678 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:18.239550 27886 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:12:18.242211 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.206199 22264 rpcz_store.cc:276] 0709 12:12:17.158301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.158449 (+   148us) service_pool.cc:224] Handling call
0709 12:12:17.158826 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:17.159204 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:12:17.190564 (+ 31360us) log.cc:844] Serialized 14 byte log entry
0709 12:12:17.560648 (+370084us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:17.561082 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.561238 (+   156us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:17.561272 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.561341 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.197781 (+636440us) raft_consensus.cc:1685] finished
0709 12:12:18.197911 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.198061 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4333,"prepare.queue_time_us":60321,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2170,"raft.queue_time_us":23661,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":30798,"spinlock_wait_cycles":5376,"thread_start_us":368857,"threads_started":1,"wal-append.queue_time_us":550174}
I20260709 12:12:18.245321 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.241159 27509 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:18.247119 27509 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.249630 27509 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:18.247119 27678 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:18.253578 27877 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:18.254097 27877 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.256193 27877 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:18.242024 27896 log.cc:927] Time spent T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:12:18.231113 27876 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.265410 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:18.231009 27794 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:18.269217 22088 leader_election.cc:336] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.557s (SENT)
I20260709 12:12:18.269760 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:18.270594 22088 leader_election.cc:336] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.590s (SENT)
I20260709 12:12:18.184257 27801 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.270864 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.274428 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.215691 27760 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.256599 27814 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:12:18.260886 27509 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:18.289069 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43925.7us
I20260709 12:12:18.271570 27875 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:18.264622 27883 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:18.274111 27831 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:18.283592 27828 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 12:12:18.296169 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.282639 27807 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:18.308001 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.275105 27880 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:18.234849 27892 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.309723 27801 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:18.293730 27877 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:18.279918 27794 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.275545 27876 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.303064 27831 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.330235 27831 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.329458 27815 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:18.295082 27875 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.302085 27509 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.352286 27735 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:18.353235 27883 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.355803 27892 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:18.338656 27815 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:18.361872 27815 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.366451 27794 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:18.309252 27828 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.368415 27760 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:18.379346 27831 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.385675 27509 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:18.387719 27875 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:18.369136 27828 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:18.371035 27876 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:18.343978 27830 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.743s	user 0.007s	sys 0.003s
W20260709 12:12:18.394248 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 116592us
W20260709 12:12:18.394956 22088 leader_election.cc:336] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.606s (SENT)
I20260709 12:12:18.395349 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.409745 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:18.410667 22116 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
W20260709 12:12:18.421295 22088 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.634s (SENT)
W20260709 12:12:18.424937 22088 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.734s (SENT)
I20260709 12:12:18.425659 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.409139 27876 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:12:18.431690 27871 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.829s	user 0.006s	sys 0.008s
I20260709 12:12:18.429374 27875 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.432981 27831 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:18.434768 22088 leader_election.cc:336] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.832s (SENT)
I20260709 12:12:18.439730 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:18.404696 27828 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:12:18.439564 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:18.447458 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.448496 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.450194 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:18.444934 27875 raft_consensus.cc:2764] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:18.455550 27533 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:18.455811 27859 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.456125 27533 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.471732 22272 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:18.472198 22272 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:18.473367 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:18.474184 22197 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:18.475512 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:18.479099 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:18.482097 22088 leader_election.cc:336] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.630s (SENT)
I20260709 12:12:18.482666 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:18.484259 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.486601 27875 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:18.487285 27875 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.487932 22830 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:18.489128 27759 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:18.489547 27759 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.489758 27875 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:18.490794 22088 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.651s (SENT)
I20260709 12:12:18.491299 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:18.493548 27908 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:12:18.495527 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:18.496345 22196 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:18.496973 27875 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.498967 27858 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:18.499455 27858 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:18.500314 27858 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.500696 27831 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:18.501535 27858 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:18.501363 27831 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.503953 27831 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:18.504855 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:18.505227 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:18.506871 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:18.507470 27874 consensus_meta.cc:287] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.000s
I20260709 12:12:18.508064 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:18.507886 27874 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.510033 27874 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:18.494870 22088 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.679s (SENT)
I20260709 12:12:18.511214 27859 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:18.524737 27902 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.529366 27902 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.529786 27902 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.531880 27902 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:18.512863 22196 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:18.514933 22192 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:18.517206 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.517576 22194 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:12:18.518038 27815 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:18.551853 27910 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:12:18.520013 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:18.553251 27865 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:18.520743 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:18.553804 27865 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.523173 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:18.556612 27865 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:18.481595 22272 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.524299 22123 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:12:18.532599 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.558441 22263 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:12:18.533274 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:18.533587 27877 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.533905 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:18.559437 22265 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:18.559757 22270 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.534551 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:18.535712 27533 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:18.538136 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 3409) took 1144 ms. Trace:
I20260709 12:12:18.561028 22271 rpcz_store.cc:276] 0709 12:12:17.393509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.404946 (+ 11437us) service_pool.cc:224] Handling call
0709 12:12:17.405273 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.159102 (+753829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.537905 (+378803us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54002279d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:18.538054 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708627200}
I20260709 12:12:18.539285 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.562215 22267 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:18.540027 27541 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:18.511251 22195 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:18.524892 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:18.524909 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 228805us
I20260709 12:12:18.563736 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.564896 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.565603 22163 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:18.560554 22266 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:18.565891 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.567778 22122 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:18.546361 22269 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:12:18.528504 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.489961 27759 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:18.548934 22191 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:18.570564 22272 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:12:18.572592 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77759.6us
I20260709 12:12:18.576076 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:18.577795 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 60693us
I20260709 12:12:18.580818 27879 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.581369 27688 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.579792 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.585124 22162 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.585816 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.525631 27883 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:18.606459 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.598237 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:18.598114 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:18.573482 27801 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:18.573949 27902 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:12:18.577005 27865 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:12:18.625193 22088 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.793s (SENT)
I20260709 12:12:18.638144 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.611497 27541 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:18.667229 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.645007 22116 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:18.588027 27688 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:18.647578 27814 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:18.572201 27877 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.649574 27794 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:18.610508 27834 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:18.607604 27859 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:12:18.637287 27509 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:18.662786 22265 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:18.689862 22122 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:18.665305 22266 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:18.666669 22270 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:18.639575 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:18.692174 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 52679.1us
I20260709 12:12:18.604926 27890 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:12:18.698261 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.598014 27739 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:18.676602 27814 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:12:18.672405 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.692467 27686 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:12:18.708191 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.705899 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.684788 27824 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.588450 27803 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:18.677103 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 171719us
I20260709 12:12:18.682294 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.683377 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.654870 27759 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.668948 27688 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.695039 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.727246 27688 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:18.727464 22267 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:18.728258 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:18.695804 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.696213 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:18.696573 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:18.695879 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.667584 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.699579 22270 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:18.700872 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.608383 27778 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.692539 27865 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:12:18.752900 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 56782.8us
I20260709 12:12:18.752909 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.753012 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.753821 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:18.707108 27877 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:18.756623 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:18.709925 27831 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:18.721208 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.762602 22265 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:12:18.726413 27541 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:18.728497 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.695736 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.768275 22271 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:18.704734 27509 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:18.713985 27828 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.773144 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.710886 27814 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:18.737877 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:18.739727 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 114605us
I20260709 12:12:18.777734 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.740631 22116 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:18.757481 22266 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:18.756729 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:18.758876 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.753208 27771 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:18.760811 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.761983 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.758162 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:18.763818 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.738368 27859 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:18.769675 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.754432 27874 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:18.765796 27794 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:18.793113 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.794243 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.794987 22267 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:18.795856 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.796411 22267 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:12:18.785230 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:18.785526 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.773705 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.761416 27847 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:18.781001 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.789714 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.798338 22271 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:18.803653 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:18.810883 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:18.786712 27759 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:18.811847 22116 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:18.812744 22270 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:18.814877 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:18.815075 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.815860 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:18.818281 22269 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:18.820818 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:18.825192 27898 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:18.826344 27898 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:18.826730 27898 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:18.827169 27824 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:18.827672 27898 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.829702 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.835196 27898 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:18.836006 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.836881 27760 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:18.837080 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.837604 27760 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:18.779848 27828 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.839186 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.840502 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:18.841758 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.842139 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:18.842365 22858 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:18.843178 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:18.831202 27875 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.831784 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:18.832428 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:18.833705 27902 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:18.856838 27760 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:18.857357 27760 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.857780 27760 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:18.857996 27877 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:18.858397 27877 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.858732 27877 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:18.784180 27883 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:18.840046 27876 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.840046 27828 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:18.759701 27778 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.783335 27771 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:18.876070 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.807199 27879 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:18.807044 27853 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:18.895237 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:18.896878 22861 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:18.891417 27771 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:18.908448 27902 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:18.909526 27902 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.914347 27509 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.919248 27739 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:18.919706 27739 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:18.921032 27853 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:18.921389 27876 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.921977 27853 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:18.876237 27874 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.937192 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:18.937855 22117 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:18.941618 22272 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:12:18.944159 22272 pending_rounds.cc:85] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 4
I20260709 12:12:18.944519 22272 pending_rounds.cc:107] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:12:18.944864 22272 raft_consensus.cc:2889] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:18.945814 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 3422) took 1432 ms. Trace:
I20260709 12:12:19.009706 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:19.010408 22861 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.946288 22272 rpcz_store.cc:276] 0709 12:12:17.513739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.518731 (+  4992us) service_pool.cc:224] Handling call
0709 12:12:17.519180 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.471544 (+952364us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400298c20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc41c0 00007fcceddc5231 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c
0709 12:12:18.945487 (+473943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.945749 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869155200}
I20260709 12:12:19.028594 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:19.029527 22858 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:19.036427 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.950428 27794 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:18.947960 27688 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:19.057956 27688 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:18.949168 27856 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:12:18.920603 27739 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:19.065673 27739 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:19.089651 27794 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:19.093276 27803 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:19.094050 27803 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:18.942581 27874 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:19.108163 27874 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:19.074560 27778 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:19.115056 27771 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:19.126849 22117 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:19.128615 22861 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:19.146575 22830 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:19.146735 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 116179us
I20260709 12:12:19.096740 27803 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:19.116290 27688 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:19.146242 27858 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.644s	user 0.006s	sys 0.006s
W20260709 12:12:19.198259 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:19.165318 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 350798us
I20260709 12:12:19.206437 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:19.207096 22265 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:19.197422 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:19.213539 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:19.214102 22264 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:19.218437 22266 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
W20260709 12:12:19.221035 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 377897us
I20260709 12:12:19.193186 27625 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:19.165237 27847 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:19.222290 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:19.222388 22163 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:19.232316 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:19.234670 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:19.235898 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:19.236677 22272 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:19.223104 27811 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:19.195570 27760 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:19.231220 27834 consensus_meta.cc:287] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.003s
I20260709 12:12:19.203855 27688 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:19.247656 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:19.212888 27828 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 12:12:19.250105 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.252959 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:19.255293 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:19.255528 22263 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:19.256697 27925 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:19.257268 27925 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.257691 27925 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:19.234706 27874 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:19.234428 27625 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:12:19.270426 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:19.264300 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49810.2us
I20260709 12:12:19.274456 27847 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:19.243486 27879 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:19.238085 27926 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:19.242281 27811 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:19.317061 27811 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:19.321692 27771 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:19.325306 27688 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:19.249186 27883 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.329257 27883 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:19.332129 27883 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:19.243798 27858 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:19.300396 27875 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:19.332909 27858 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:19.333123 27875 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:19.335381 27858 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:19.335989 27875 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:19.250604 27834 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:19.345773 27814 consensus_meta.cc:287] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 12:12:19.346509 27814 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:19.371497 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 118626us
I20260709 12:12:19.372627 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:19.374116 27858 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:19.406333 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 175746us
I20260709 12:12:19.385818 27803 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:19.414435 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:19.416409 22123 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:19.422194 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:19.425753 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:19.429343 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:19.430152 22119 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:12:19.429451 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:19.431232 27874 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:19.413563 27625 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:19.439152 27828 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:19.439725 27828 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:19.455822 27828 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:19.456020 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:19.456712 22195 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:19.463336 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:19.464519 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:19.466813 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.467366 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:19.468072 22117 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:19.436913 27928 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:12:19.473317 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:19.428423 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:19.474560 22264 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
W20260709 12:12:19.467379 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:19.476374 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49433.7us
W20260709 12:12:19.477909 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 256694us
I20260709 12:12:19.477497 22163 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:19.482676 22858 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:19.483559 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:19.485572 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:19.488169 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:19.491758 27926 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:19.473148 27681 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:19.495383 27811 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:19.496706 22861 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:19.497617 27877 consensus_meta.cc:287] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.001s
I20260709 12:12:19.498101 27874 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:19.498718 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:19.470855 27815 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.882s	user 0.009s	sys 0.004s
I20260709 12:12:19.499758 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:19.501030 22120 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:19.514848 22263 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:19.501173 22195 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:19.503526 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:19.517757 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:19.526244 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 97951.9us
I20260709 12:12:19.527155 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:19.433091 27807 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:19.419903 27541 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:12:19.527827 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:19.545946 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:19.541167 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53571.4us
I20260709 12:12:19.549687 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:19.549911 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:19.551189 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:19.554198 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:12:19.560132 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.492709 27681 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:19.562882 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47086.5us
I20260709 12:12:19.507513 27850 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:19.564738 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:19.488190 27814 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:19.514019 27858 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.530169 27875 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:19.530323 27859 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:19.602504 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:19.563592 27883 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:19.607746 22193 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:19.529508 27893 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:12:19.498142 27877 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:19.537032 27926 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 12:12:19.561895 27801 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:12:19.582852 27898 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:19.498732 27874 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:19.585647 27815 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:19.566116 27688 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:19.634943 22120 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:19.574406 27681 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.607077 27850 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:19.637157 27688 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.625521 27883 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:19.605834 27859 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:19.642575 22266 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:12:19.632468 27739 consensus_meta.cc:287] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.566s	user 0.003s	sys 0.011s
I20260709 12:12:19.657159 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:19.657822 22192 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:19.657711 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:19.658529 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:19.659662 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:19.660400 22196 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:19.661211 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:19.665452 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:19.666363 22121 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:19.666611 22195 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:19.667327 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:19.669088 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:19.669225 22270 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:19.634490 27898 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:19.674713 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:19.674997 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:19.676563 22196 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:19.643956 27688 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.676723 22269 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:19.677754 22196 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:19.677067 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:19.677402 22195 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:19.680054 22198 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:19.644554 27859 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:19.692662 22192 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:19.693807 22196 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:19.676255 27898 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:19.701725 27933 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:12:19.703696 27934 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:12:19.705813 22268 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 8. Current term is 9. Ops: []
W20260709 12:12:19.747306 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 191838us
W20260709 12:12:19.808214 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 240691us
W20260709 12:12:19.764022 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 197120us
I20260709 12:12:20.009127 22195 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:12:19.842176 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 2753) took 1139 ms. Trace:
I20260709 12:12:20.051538 22268 rpcz_store.cc:276] 0709 12:12:18.702259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.799751 (+ 97492us) service_pool.cc:224] Handling call
0709 12:12:19.705598 (+905847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.706259 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.841859 (+135600us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b5400055d50. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:19.842075 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936571648}
I20260709 12:12:20.052103 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:19.854995 27760 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:20.061779 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:19.863842 27928 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:19.734457 27883 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:19.685438 27850 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.077481 22865 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:20.078047 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.023577 22017 catalog_manager.cc:5697] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 9 to 11, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 11 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:20.011276 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.054126 22864 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:20.066373 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.730104 27811 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:20.074630 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:20.018548 22193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2443) took 1519 ms (client timeout 1993 ms). Trace:
I20260709 12:12:20.063337 27902 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:20.067462 27541 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:12:20.085609 27946 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:20.082965 22193 rpcz_store.cc:269] 0709 12:12:18.498692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.507812 (+  9120us) service_pool.cc:224] Handling call
0709 12:12:19.856756 (+1348944us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002369d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:20.018466 (+161710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338594688}
I20260709 12:12:20.021713 27875 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:12:20.161842 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 75047.5us
W20260709 12:12:20.166083 22118 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.007s	sys 0.038s
W20260709 12:12:20.166509 22118 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.007s	sys 0.038s
I20260709 12:12:20.181471 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:20.086179 27902 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.149767 27875 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:20.080577 27928 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.168418 27874 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:20.193778 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:20.196853 27875 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.180737 27760 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:20.198046 27760 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.198513 27875 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:20.200971 27831 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:20.208182 22087 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:20.210377 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:20.214115 27928 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.223106 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:20.236639 22087 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:20.243422 27688 consensus_meta.cc:287] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
I20260709 12:12:20.214772 27928 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.248368 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:20.259747 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 66085.5us
W20260709 12:12:20.257704 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 206437us
I20260709 12:12:20.265595 22115 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:20.266466 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 215316us
I20260709 12:12:20.235811 27945 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.270464 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.271219 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.250914 27926 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:20.268472 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:20.252373 27801 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:20.259553 27856 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:20.282016 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:20.259377 27874 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.264897 27791 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.294281 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:20.296842 22114 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 12: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:20.298069 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:20.250568 27947 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:12:20.269938 27814 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:20.287863 27941 log.cc:927] Time spent T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:12:20.257953 27688 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.291496 27958 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:20.322645 27958 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.326026 27834 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.326951 27834 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:20.327929 27879 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.979s	user 0.009s	sys 0.000s
I20260709 12:12:20.311134 27791 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.329589 27760 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:20.328496 27879 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:20.351016 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 87275.1us
W20260709 12:12:20.353786 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72909.3us
I20260709 12:12:20.355142 22118 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:20.283201 27815 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 12:12:20.334964 27859 consensus_meta.cc:287] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.000s
W20260709 12:12:20.340567 27942 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 12:12:20.280268 27847 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:12:20.365859 22191 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:20.340708 27925 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.078s	user 0.021s	sys 0.000s
I20260709 12:12:20.367262 22123 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:20.336320 27959 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:20.308557 27874 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.349442 27926 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:20.279691 27945 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.340292 27801 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:12:20.418032 22117 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:20.396268 27879 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:20.396597 27947 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:20.400166 27950 log.cc:927] Time spent T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:12:20.379906 27859 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.400722 27834 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.397840 27956 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:20.415609 27952 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:12:20.425539 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 91096.2us
I20260709 12:12:20.400898 27959 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:20.433535 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:20.388087 27925 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.451572 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.452986 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:20.422848 27936 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.424791 27879 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:20.448971 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 95524.4us
I20260709 12:12:20.423609 27958 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:20.425303 27509 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.457267 22193 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:20.462317 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:20.463126 27883 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.436421 27902 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:20.451870 27972 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.454695 27541 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.454833 27969 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:20.486991 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:20.523777 27978 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.524377 27978 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.459157 27936 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.528010 27902 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.528231 27974 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:20.528537 27902 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.529162 27936 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:20.529770 27974 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:20.530882 27974 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:20.531332 27978 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.530728 27902 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.532334 27974 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.533895 27974 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:20.534024 27877 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:20.539161 27791 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:20.541014 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 3459) took 1344 ms. Trace:
I20260709 12:12:20.501829 22122 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:20.541463 22270 rpcz_store.cc:276] 0709 12:12:19.196985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.197169 (+   184us) service_pool.cc:224] Handling call
0709 12:12:19.197437 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.669757 (+472320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.540738 (+870981us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54003b2ed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:20.540948 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084252416}
I20260709 12:12:20.542655 27688 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:20.543896 27874 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:20.539165 27681 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.885s	user 0.007s	sys 0.003s
W20260709 12:12:20.510195 27961 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:12:20.548074 27681 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.517999 27945 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.518406 27972 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:20.550052 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 278808us
I20260709 12:12:20.472760 27509 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.476950 27760 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.553280 27760 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.555251 27509 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.555966 27760 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:20.558557 27962 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:12:20.552287 27972 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:20.521515 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58484.3us
I20260709 12:12:20.487917 27926 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:20.509472 27957 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:12:20.545254 27879 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.568720 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:20.569698 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.571741 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:20.572743 22122 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:20.574756 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:20.569079 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.465888 27967 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:20.578575 27959 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.479530 27958 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:20.581933 27760 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.582552 27958 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.582724 27760 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.583235 27958 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.485627 27965 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 12:12:20.585398 27760 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.581923 27859 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.586057 27979 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:20.586850 27979 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.587383 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.591365 27828 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:20.591889 27828 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:20.592648 27853 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.593104 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 3342) took 1130 ms. Trace:
I20260709 12:12:20.593536 22120 rpcz_store.cc:276] 0709 12:12:19.462374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.463074 (+   700us) service_pool.cc:224] Handling call
0709 12:12:20.592898 (+1129824us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b5400311fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:20.593015 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85115264}
I20260709 12:12:20.593618 27853 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.595126 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:20.596377 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:20.563892 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53304.6us
I20260709 12:12:20.603042 27853 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.607808 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 3338) took 1171 ms. Trace:
I20260709 12:12:20.608242 22123 rpcz_store.cc:276] 0709 12:12:19.456741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.464259 (+  7518us) service_pool.cc:224] Handling call
0709 12:12:20.607624 (+1143365us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b540012a2d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:20.607734 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074149248}
I20260709 12:12:20.563750 27541 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.568480 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:20.433705 27947 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.609166 22122 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:12:20.561949 27681 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:20.622190 27940 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.913s	user 0.012s	sys 0.023s
W20260709 12:12:20.647172 27968 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 12:12:20.618296 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2398) took 1064 ms. Trace:
I20260709 12:12:20.621933 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3337) took 1189 ms. Trace:
I20260709 12:12:20.649782 22119 rpcz_store.cc:276] 0709 12:12:19.435760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.448931 (+ 13171us) service_pool.cc:224] Handling call
0709 12:12:19.449334 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:19.582816 (+133482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.582858 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:19.599928 (+ 17070us) log.cc:844] Serialized 26 byte log entry
0709 12:12:19.836805 (+236877us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:12:19.836852 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.226069 (+389217us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400327b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:20.226121 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:20.621547 (+395426us) raft_consensus.cc:1685] finished
0709 12:12:20.621575 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.621850 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13397,"raft.queue_time_us":40612,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"spinlock_wait_cycles":275139840,"thread_start_us":163463,"threads_started":1,"wal-append.queue_time_us":448740}
I20260709 12:12:20.487308 27803 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:20.648936 22117 rpcz_store.cc:276] 0709 12:12:19.553829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.572877 (+ 19048us) service_pool.cc:224] Handling call
0709 12:12:19.602004 (+ 29127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.418611 (+816607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.617956 (+199345us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54002ad5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:20.618201 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1876139392}
I20260709 12:12:20.658209 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:20.661460 27509 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.671558 27856 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.671852 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:20.672158 27856 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.674470 27965 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:20.675427 27965 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:20.675791 27965 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:20.676183 27965 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:20.676952 27902 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:20.677465 27902 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:20.671604 27509 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.490743 27831 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.679881 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:20.679673 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:20.682209 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:20.682869 22266 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:20.681121 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:20.684285 22237 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:20.686364 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:20.530942 27925 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:20.682438 22271 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:12:20.689260 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:20.697929 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.698544 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:20.699204 22116 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:20.696931 22266 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:20.690267 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:20.691715 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.678433 27902 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.686869 27978 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:20.693274 27541 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.693656 27945 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:20.747735 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:20.694423 27831 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.662019 27803 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:20.701304 22195 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:20.702194 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:20.698807 22198 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:12:20.746723 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:20.710939 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 112580us
I20260709 12:12:20.762102 22191 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:20.730633 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:20.731199 22858 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:20.767030 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:20.768018 22119 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:20.769125 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.772673 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:20.773705 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:20.776572 22865 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:20.736112 22088 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:20.741202 22265 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:20.663354 27972 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 12:12:20.752825 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.781385 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:20.751942 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:20.482406 27971 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.266s
I20260709 12:12:20.785583 22118 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:12:20.462432 27956 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.791859 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:20.739113 27978 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:20.799324 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:20.799717 27978 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:20.801005 27978 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:20.802119 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:20.804153 27956 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.805876 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:20.808034 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 72013.3us
I20260709 12:12:20.809352 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.793309 22264 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:20.798447 27975 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:20.806447 22115 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:20.592662 27828 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.667428 27969 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 12:12:20.780727 27834 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.779734 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:20.778308 27967 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:20.792618 27760 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:20.817272 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:20.489761 27883 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.789989 27874 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.815726 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:20.826073 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:20.833184 22271 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:20.831301 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:20.826706 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:20.828195 22116 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:20.793531 27945 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:20.780405 27856 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.844642 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:20.845110 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:20.810979 27541 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:20.846066 22194 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.000s	sys 0.028s
I20260709 12:12:20.818908 27902 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:20.846850 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:20.881913 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 196826us
I20260709 12:12:20.814169 27979 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:20.891534 22830 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:20.893784 22114 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:20.875727 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:20.822532 27967 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.831664 27760 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:20.960953 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:20.961691 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:20.976150 22269 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:20.969712 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 94086.8us
W20260709 12:12:20.971944 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 140716us
I20260709 12:12:20.813166 27972 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:12:20.888404 27969 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.893111 27856 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:20.883756 27739 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:20.932184 27801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.100s	sys 0.171s
W20260709 12:12:20.975490 27898 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.241s	user 0.011s	sys 0.003s
I20260709 12:12:20.832010 27834 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.045351 22119 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:20.846571 27688 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.129s
I20260709 12:12:20.870030 27874 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:20.986040 27760 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:20.986614 27960 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:21.057762 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.966953 27509 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:21.046912 22271 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:21.033815 27856 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:20.975365 27967 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:21.062870 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 55422.6us
I20260709 12:12:20.882529 27541 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:21.063651 27926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.011s	sys 0.010s
I20260709 12:12:21.067575 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:21.042330 27975 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:21.055213 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 369751us
I20260709 12:12:21.056988 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:21.066174 27946 consensus_meta.cc:287] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.900s	user 0.008s	sys 0.004s
I20260709 12:12:21.062675 27958 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:21.113132 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56265.1us
I20260709 12:12:21.117555 27956 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:21.151190 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:21.119969 22237 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:21.120812 27924 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.303s
I20260709 12:12:21.156503 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:21.081190 27960 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:21.121631 27966 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:21.122045 27921 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.293s
I20260709 12:12:21.123859 27994 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:21.127192 27984 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:21.079357 27807 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:21.102140 27926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.011s	sys 0.013s
I20260709 12:12:21.198653 22121 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:21.152572 27958 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:21.201239 27958 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:21.203182 27847 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:21.203646 27958 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:21.156373 27947 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:21.151700 27956 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:21.205864 27831 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:20.987730 27803 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.129405 27946 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:21.206792 27883 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.206823 27803 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:21.155565 27791 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:21.208262 27791 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:21.209306 27791 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.127799 27975 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.133711 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:21.134415 27541 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.031934 27951 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:12:21.157896 22189 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:21.059530 27898 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.159730 22237 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:21.219640 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 65154.5us
W20260709 12:12:21.219841 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 61646.3us
I20260709 12:12:21.215409 27875 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:21.222129 27875 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.223596 27924 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:21.224550 27898 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.225277 22120 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:21.225927 27946 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:21.225574 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 65919.6us
I20260709 12:12:21.227803 27975 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:21.228421 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.218983 27994 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.231761 27984 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.220504 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:21.234082 27984 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:21.207733 27960 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:21.162330 22269 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:21.163839 22267 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:12:21.171868 27877 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:21.113227 27969 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:21.155905 27801 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:12:21.183035 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:21.183771 27981 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:21.187603 27874 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.194758 27807 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:21.205511 27956 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:21.130831 27982 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:12:21.236915 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:21.165601 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:21.236845 22017 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 12 to 14, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 14 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.248836 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:21.218562 27965 consensus_meta.cc:287] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.542s	user 0.000s	sys 0.013s
I20260709 12:12:21.250008 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:21.258226 22189 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
W20260709 12:12:21.251892 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.252560 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:21.250649 27969 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.267237 27981 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:21.268285 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.252947 27922 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:12:21.247663 27966 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:21.271574 27966 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.251060 27541 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:21.273048 27541 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.273195 27807 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:21.273422 27541 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:21.276489 27965 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.279218 27853 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.279004 27760 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:21.280525 22117 raft_consensus.cc:2393] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:21.283155 22264 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:12:21.283721 22264 pending_rounds.cc:85] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 11
I20260709 12:12:21.284024 22264 pending_rounds.cc:107] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:12:21.284299 22264 raft_consensus.cc:2889] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:21.252741 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:21.285120 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:21.285951 22270 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:21.286238 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:21.287000 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:21.287286 27969 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.287914 27877 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:21.288868 27981 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:21.289414 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:21.290094 22116 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:21.290436 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:21.256528 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:21.288615 27815 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:21.296283 27981 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:21.279084 27965 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:21.297309 27831 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:21.298002 27850 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.299952 27965 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:21.302444 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:21.314947 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:21.322109 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:21.322463 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:21.324615 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.351962 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:21.319284 27965 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:21.325457 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:21.331637 22196 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:21.345132 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:21.312318 27922 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:21.328238 22193 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:21.323951 27969 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:21.331113 22192 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:21.365415 22190 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:21.367273 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:21.374284 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:21.359026 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:21.375165 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:21.376319 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:21.377882 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:21.377978 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:21.378837 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:21.379146 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:21.379367 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:21.379642 22117 raft_consensus.cc:2393] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:21.382459 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:21.382400 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:21.321586 27688 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:12:21.363195 27874 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.328989 27831 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:21.362634 27807 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.342677 27994 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.378078 27928 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:21.385502 27975 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:21.388427 27898 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:21.429384 27760 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:21.388008 27958 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:21.325112 27967 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.406872 27831 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.387633 27969 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.400391 27541 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.437808 27975 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:21.457656 27975 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:21.450210 27965 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:21.461956 27967 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.464046 27831 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.465881 27834 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.471557 27879 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:21.472201 22191 raft_consensus.cc:2368] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14.
I20260709 12:12:21.407207 27874 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:21.474838 27874 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:21.475405 27977 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:21.475872 27977 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:21.476823 27977 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:21.478206 27977 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:21.480573 27975 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.498624 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:21.484741 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:21.487382 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:21.476503 27541 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.441083 27958 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.481284 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:21.497476 22017 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 16 to 18, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 18 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.515910 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:21.513804 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:21.545737 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.590669 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:21.592970 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:21.593642 22264 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:21.601049 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:21.603559 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:21.520233 27966 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:21.652158 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:21.566331 27967 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:21.654875 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64615.3us
I20260709 12:12:21.686813 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:21.667500 27993 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:12:21.708815 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:21.713323 28013 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 12:12:21.715067 27803 consensus_meta.cc:287] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.010s
W20260709 12:12:21.717705 28012 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.258s	user 0.001s	sys 0.003s
I20260709 12:12:21.720242 22270 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:21.720341 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:21.721477 22272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:59754
I20260709 12:12:21.721840 22266 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:21.722218 22272 raft_consensus.cc:606] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:12:21.722554 22272 raft_consensus.cc:614] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:21.730957 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:21.751333 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.776134 22272 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:21.777133 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 12:12:21.792613 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.782692 27969 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.667665 27967 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:21.797621 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:21.798560 27967 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:21.800284 27902 consensus_meta.cc:287] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.904s	user 0.013s	sys 0.002s
I20260709 12:12:21.800938 22271 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:21.804085 27875 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.812605 22264 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
W20260709 12:12:21.846248 28010 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 12:12:21.891964 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.913219 27975 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.913980 27958 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:21.913689 27824 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:21.902117 27875 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:21.915017 27824 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:21.915597 27875 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:21.917189 27824 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:21.917619 27875 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:21.923343 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:21.954618 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1440) took 1435 ms. Trace:
I20260709 12:12:21.955232 22197 rpcz_store.cc:276] 0709 12:12:20.505217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.506830 (+  1613us) service_pool.cc:224] Handling call
0709 12:12:20.507206 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.687578 (+180372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.687647 (+    69us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:20.687717 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:20.687771 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.940371 (+1252600us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54002373d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:21.940421 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.940576 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414180096}
I20260709 12:12:21.954171 27831 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:21.959175 27858 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:21.959628 27858 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:21.960572 27858 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.963677 27858 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:21.971544 27971 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:21.972318 27971 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.975391 27902 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:21.976341 27971 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:21.976171 27902 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:21.979028 27902 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:22.032359 28003 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:22.032496 27815 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:22.041214 27815 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.044117 27815 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:22.020576 27980 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:22.021107 27971 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:22.049893 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 254929us
I20260709 12:12:22.061712 22237 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:22.062119 22861 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:22.049376 27831 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:22.069182 22265 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:22.055891 27951 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:12:22.047046 28003 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.067960 27858 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:22.076514 27828 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:22.053603 27971 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.080809 27977 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:12:22.055051 27980 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.095882 27875 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:12:22.100822 27977 consensus_queue.cc:1243] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:22.125669 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:22.125978 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:22.130007 27856 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.131347 27856 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:22.095988 22087 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:22.140450 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:22.128119 27980 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:22.141618 22265 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:22.144308 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:22.138716 27807 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:22.165979 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:22.167515 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:22.169719 27877 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:22.169968 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:22.142390 27875 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:22.172729 22266 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:22.173074 22265 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:12:22.174566 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.175056 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.176399 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:22.178170 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:22.179970 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:22.178197 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:22.185106 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:22.187949 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:22.188750 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:22.190824 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:22.190946 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:22.161018 27977 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.199007 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:22.176119 27972 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:22.196125 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:22.204504 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:22.176954 27875 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:22.205627 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.209081 27974 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:22.177286 27947 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.196741 27999 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:22.226740 27879 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:22.228154 27874 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:22.228705 27958 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:22.200441 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:22.221005 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 278560us
I20260709 12:12:22.232590 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:22.259999 22265 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:22.260383 22017 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 14 to 16, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 16 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.219460 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:22.214139 27883 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:22.262820 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:22.262333 22017 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 14 to 16, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 16 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.263867 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:22.248335 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.178658 27807 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.218924 27875 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:22.264052 22017 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 11 to 13, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 13 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.264226 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:22.288168 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.269809 27967 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:22.299144 27971 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:22.300024 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:22.304873 27969 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:22.305727 27972 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:22.305495 22017 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:22.306330 27972 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.235829 27975 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.309604 27975 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.310320 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:22.311367 27972 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:22.214903 27977 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.313637 27977 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:22.314136 27977 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.314563 27977 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.237025 27974 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.321303 27974 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:22.269640 22019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 274) took 7429 ms. Trace:
I20260709 12:12:22.327368 22270 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:12:22.329460 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 62107.4us
I20260709 12:12:22.316524 27977 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:22.350632 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:22.351624 22269 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 8.
I20260709 12:12:22.353513 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:22.324440 22019 rpcz_store.cc:276] 0709 12:12:14.840061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.840375 (+   314us) service_pool.cc:224] Handling call
0709 12:12:15.015339 (+174964us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:22.269575 (+7254236us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:17.456974 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:17.606623 (+149649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:17.608903 (+  2280us) write_op.cc:435] Acquired schema lock
0709 12:12:17.612097 (+  3194us) tablet.cc:662] Decoding operations
0709 12:12:17.770450 (+158353us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:17.770513 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:17.770539 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:12:17.771092 (+   553us) tablet.cc:701] Row locks acquired
0709 12:12:17.771111 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:12:17.771282 (+   171us) write_op.cc:270] Start()
0709 12:12:17.777022 (+  5740us) write_op.cc:276] Timestamp: P: 1783599137771235 usec, L: 0
0709 12:12:17.777066 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:12:17.924239 (+147173us) log.cc:844] Serialized 2104 byte log entry
0709 12:12:18.523948 (+599709us) op_driver.cc:464] REPLICATION: finished
0709 12:12:18.724238 (+200290us) write_op.cc:301] APPLY: starting
0709 12:12:18.748901 (+ 24663us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:18.828252 (+ 79351us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:18.828349 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:18.856524 (+ 28175us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:18.875881 (+ 19357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:12:18.890730 (+ 14849us) write_op.cc:312] APPLY: finished
0709 12:12:18.917493 (+ 26763us) log.cc:844] Serialized 57 byte log entry
0709 12:12:18.917794 (+   301us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:18.917961 (+   167us) write_op.cc:454] Released schema lock
0709 12:12:18.918043 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:18.918633 (+   590us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:18.918682 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75879,"reported_tablets":14,"spinlock_wait_cycles":75767168,"child_traces":[["op",{"apply.queue_time_us":171606,"apply.run_cpu_time_us":9886,"apply.run_wall_time_us":196553,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25037,"num_ops":5,"prepare.queue_time_us":193114,"prepare.run_cpu_time_us":48214,"prepare.run_wall_time_us":857377,"raft.queue_time_us":119127,"raft.run_cpu_time_us":23410,"raft.run_wall_time_us":213131,"replication_time_us":746670,"thread_start_us":482250,"threads_started":4,"wal-append.queue_time_us":413822,"wal-append.run_cpu_time_us":37348,"wal-append.run_wall_time_us":1674857}]]}
I20260709 12:12:22.371670 22269 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:22.372259 22265 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:12:22.376950 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:22.258278 27947 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.359340 27883 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.383313 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 3505) took 1065 ms. Trace:
I20260709 12:12:22.387101 22271 rpcz_store.cc:276] 0709 12:12:21.313832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.322179 (+  8347us) service_pool.cc:224] Handling call
0709 12:12:22.378609 (+1056430us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b540029d6d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:22.378755 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097986944}
I20260709 12:12:22.391904 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1264) took 1550 ms. Trace:
I20260709 12:12:22.316681 27875 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.374786 27971 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.392344 22116 rpcz_store.cc:276] 0709 12:12:20.841921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.843560 (+  1639us) service_pool.cc:224] Handling call
0709 12:12:21.289899 (+446339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:21.290527 (+   628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.391671 (+1101144us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b5400084650. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:22.391839 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1025686912}
I20260709 12:12:22.394387 22269 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:12:22.406502 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 146913us
I20260709 12:12:22.424147 27977 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:22.425197 27977 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.427736 27977 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:22.386783 27999 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.431762 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:22.437204 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 173371us
I20260709 12:12:22.438259 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 3498) took 1321 ms. Trace:
I20260709 12:12:22.438246 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:22.440755 22163 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.518s (SENT) [suppressed 28 similar messages]
I20260709 12:12:22.438742 22263 rpcz_store.cc:276] 0709 12:12:21.117047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.121985 (+  4938us) service_pool.cc:224] Handling call
0709 12:12:21.122366 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:21.246430 (+124064us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:21.368557 (+122127us) log.cc:844] Serialized 14 byte log entry
0709 12:12:21.610475 (+241918us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:21.610524 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:21.610566 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.415766 (+805200us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b18002990e0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceaca32a6 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419
0709 12:12:22.416636 (+   870us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400055d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:22.416686 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.438202 (+ 21516us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32601,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":30,"raft.queue_time_us":84,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":42808,"spinlock_wait_cycles":266942592,"thread_start_us":363268,"threads_started":2,"wal-append.queue_time_us":556479}
I20260709 12:12:22.461146 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:22.461758 22087 leader_election.cc:400] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14.
I20260709 12:12:22.469810 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:22.471781 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:22.475282 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.476795 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.478446 22189 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:12:22.485149 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.485325 22116 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:22.489893 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:22.492944 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:22.493469 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.432822 27879 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:22.503499 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.496153 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:22.495483 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:22.508643 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:22.509429 22191 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:22.434830 28031 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.451294 27977 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:22.513409 22189 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:22.518028 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.518368 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.521468 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.518656 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:22.522692 22190 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:22.524999 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:22.519058 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:22.463428 27966 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:22.469421 27958 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:22.408373 27971 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.474723 27883 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.526042 22117 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:12:22.501104 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:22.508980 27859 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.451342 27855 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:12:22.436563 27999 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.493705 27541 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:22.532759 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.552047 27541 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.554242 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.557134 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:22.558729 27958 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:22.559649 27859 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:22.561257 28028 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:12:22.561801 28003 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:22.574433 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:22.575165 27807 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:22.575491 27902 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:22.577461 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:22.496271 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:22.502734 27856 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:22.511365 27831 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:22.578617 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 82408us
I20260709 12:12:22.585460 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.589226 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:22.591176 22088 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:22.595510 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.595743 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.598418 22190 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:22.599629 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:22.600310 22264 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:22.587371 27807 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:22.601830 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:22.525267 28031 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.537580 27966 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.619846 22195 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:22.611049 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:22.587390 27902 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:22.621930 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:22.595683 27883 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:22.599968 27958 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:22.594491 27831 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.668030 22193 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:22.671168 22191 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
W20260709 12:12:22.672657 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 231915us
I20260709 12:12:22.613345 27807 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.640269 27803 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.655786 28032 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:22.671505 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56046.6us
I20260709 12:12:22.651736 28030 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:12:22.673386 28019 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:22.664134 27883 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:22.684934 27794 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:22.689951 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:22.678102 27807 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:22.683336 27875 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:22.637616 27879 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.677219 27947 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:22.691315 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 94874us
I20260709 12:12:22.685878 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:22.685268 27974 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.674949 27965 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:12:22.705024 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:22.695398 28030 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.711800 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:22.709239 27946 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:22.699198 27925 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:22.724726 27925 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.725157 27925 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:22.725241 27883 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.693734 27803 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.728350 27803 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.710549 27974 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.733559 27947 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.734143 27947 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.736219 28030 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:22.737234 28036 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:12:22.738003 27902 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:22.738303 27917 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:22.738931 27743 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:22.739372 27743 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:22.740948 27875 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.741531 27875 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.742563 28040 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:22.743155 28040 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.745229 27999 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:22.697497 27794 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.731542 27803 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:22.747294 28038 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:12:22.763175 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51442.2us
W20260709 12:12:22.762681 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 204227us
I20260709 12:12:22.769737 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.770798 22195 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:22.771112 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:22.767999 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:22.764945 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 69143.2us
W20260709 12:12:22.774437 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 62592us
I20260709 12:12:22.778887 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:22.769876 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:22.790640 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:22.794483 22236 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:22.797389 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:22.799602 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:22.807773 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:22.797501 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:22.810344 22272 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:22.798735 22270 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:12:22.811884 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:22.786868 27946 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:22.777098 27965 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.790784 28032 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:22.808233 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:22.789705 27685 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:22.790285 27999 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.824937 22195 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:22.804911 27874 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:22.825666 27999 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.796759 28034 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:22.823524 27856 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.740348 27743 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.826572 27874 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:22.796792 27971 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:22.816493 27803 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:22.821246 27946 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.915302 22197 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:22.814153 27964 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:12:22.930038 22195 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:12:22.842566 27828 consensus_meta.cc:287] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.752s	user 0.013s	sys 0.000s
I20260709 12:12:22.835827 27743 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:22.927641 28014 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:12:22.914996 27972 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.918311 27946 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:12:22.956921 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 147473us
I20260709 12:12:22.843515 27902 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:22.835948 27685 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:22.921700 27803 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.902802 27971 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:22.949163 28030 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:22.836236 27925 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.835161 27856 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.927125 28031 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:22.969271 27803 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:22.912596 27958 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:22.837162 27874 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 12:12:22.828758 27999 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:22.964812 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 152620us
I20260709 12:12:22.927891 27947 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:22.932641 27974 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:22.830546 28049 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 12:12:22.949198 27831 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:22.833292 28034 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.842058 28032 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:22.902165 27966 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.047906 28034 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.048867 27974 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:23.049490 27974 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.051692 27974 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.055182 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.061021 27807 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.068486 27999 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:23.068753 27807 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.069496 27807 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:22.959357 27853 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:22.969473 28043 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:12:23.069953 27803 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.070201 27853 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.957140 27923 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:23.071219 27923 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.056483 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.072528 27803 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:22.969206 27685 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.074556 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:22.915956 28040 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.018517 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:22.969416 27902 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.005596 28047 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:22.972317 27971 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:22.963197 27972 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.032212 27958 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:23.032933 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.033016 27794 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.037986 27925 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.044904 28032 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:23.069204 27999 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:22.963907 27875 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:22.841487 27965 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.075626 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:23.076700 22269 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 12:12:23.092171 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 73710.9us
I20260709 12:12:23.104861 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:23.104990 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.058890 27946 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.073540 27923 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.117621 22117 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:12:23.086011 28047 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.157820 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.159680 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.160072 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.114542 27874 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:23.103483 27947 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:23.171314 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:23.125140 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.125928 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.126720 22119 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:23.172653 22121 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:23.096446 27893 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:23.175613 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:23.130510 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 120938us
I20260709 12:12:23.131305 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.132915 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.120182 27999 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.160429 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:23.180173 22116 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:23.161221 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.161286 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.169847 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.061925 27956 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.128376 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:23.173712 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 361881us
I20260709 12:12:23.127518 27892 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:23.198968 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:23.201185 22116 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:23.202113 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.202859 22123 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:23.096993 27807 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.205662 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:23.169219 27925 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.207224 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.209035 22163 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:23.201185 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:23.141601 28031 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.163225 28047 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.127913 27533 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:12:23.213047 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.120185 27965 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.219051 28031 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.215044 27688 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:23.230479 28035 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:23.231109 28035 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.231518 28035 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:23.235487 27856 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.236158 27856 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:23.236670 27856 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.206279 27874 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:23.207388 28030 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:23.275691 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.280131 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.285550 27964 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:23.286103 27964 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:23.287992 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:23.288829 22117 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:12:23.290525 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 81580.7us
I20260709 12:12:23.238615 27874 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.212709 27925 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.199347 27893 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.213347 27892 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.300745 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.302398 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.306792 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.302661 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:23.307987 22194 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.302673 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:23.303318 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 203987us
I20260709 12:12:23.287593 27965 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.328143 22864 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:23.329454 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.332928 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.313340 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.315826 27856 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.321188 27946 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.302023 27974 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:23.311587 27977 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:12:23.336287 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.337087 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.349212 22264 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:23.287074 27964 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.351070 27964 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:23.352865 27855 consensus_queue.cc:1175] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7d3f536360b444b1886777f4776be22c" responder_term: 14 status { last_received { term: 13 index: 10 } last_committed_idx: 9 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:23.303524 27972 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.355593 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.338443 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.334986 22197 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:23.302399 28057 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:23.294229 27803 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:23.339315 22269 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:23.340267 22198 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:23.273049 28030 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.339263 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:23.349005 22860 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:23.366627 22265 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:23.369622 27807 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:23.371007 28044 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.534s	user 0.002s	sys 0.002s
W20260709 12:12:23.387689 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 72955.4us
I20260709 12:12:23.342504 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:23.402648 22266 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.422345 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:23.375396 27794 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.430565 22194 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:23.396595 27856 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:23.395357 27541 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.340189 28063 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:12:23.339888 27965 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.359155 27974 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:23.468150 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 165564us
I20260709 12:12:23.477706 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.405730 27803 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.434779 28049 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:23.438179 27856 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:23.437390 28031 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.439325 27902 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.445314 27688 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:23.503149 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.441179 27794 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.477823 27977 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.399598 28057 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.511833 27893 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.528815 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.551887 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.515424 22266 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:23.516019 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.557226 22263 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:12:23.558508 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.559868 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:23.516425 27902 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:23.523145 27946 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.525696 28035 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.560721 22263 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:23.562790 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.586896 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.590245 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.591097 22194 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:23.533943 28051 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.522s	user 0.002s	sys 0.000s
I20260709 12:12:23.574324 22087 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:23.502029 27856 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:23.594806 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.595315 27974 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:23.597487 28073 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:12:23.597703 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.605139 22267 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:23.529102 27892 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.608623 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.610028 27965 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.610347 27794 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.529202 28029 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:23.612164 28029 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.614240 28029 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:23.615412 27685 consensus_meta.cc:287] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.530s	user 0.001s	sys 0.017s
I20260709 12:12:23.615229 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.589635 27946 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.616127 27685 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.514909 27688 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:23.617048 27688 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.617955 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.619745 27803 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.620568 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.621495 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.620636 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.504036 28058 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 12:12:23.623587 28058 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:23.623971 28058 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:23.625188 28057 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.624961 28058 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.625379 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.626224 28058 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:23.627453 22115 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:23.618053 27946 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.622166 22268 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:23.587697 22270 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:23.635689 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.582610 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.630012 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:23.639571 22266 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:23.643494 27971 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.645351 22267 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:23.645539 28030 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:23.674481 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44570us
I20260709 12:12:23.646507 27853 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.652755 27975 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.653163 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.679167 22196 raft_consensus.cc:2410] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:12:23.653879 22197 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:23.654213 28047 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.579728 27977 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.655303 28053 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.508801 28049 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.587693 27902 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.651710 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.694031 22194 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:23.659053 28060 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:23.660524 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 86303us
I20260709 12:12:23.674136 27879 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:23.681818 22192 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:23.685612 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:23.633530 28052 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
W20260709 12:12:23.665702 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 219508us
I20260709 12:12:23.663738 27803 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:23.687183 28057 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:23.713914 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.691926 27947 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:12:23.704022 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 153408us
I20260709 12:12:23.704883 22122 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:23.712673 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.699816 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:23.729234 22189 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:23.698312 27946 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:23.701376 27965 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:23.695633 28053 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.741961 27828 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:23.742614 27828 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:23.746313 27925 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.744591 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2425) took 1249 ms. Trace:
I20260709 12:12:23.750388 22115 rpcz_store.cc:276] 0709 12:12:22.494827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.495274 (+   447us) service_pool.cc:224] Handling call
0709 12:12:23.744396 (+1249122us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002544d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:23.744526 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2574249344}
I20260709 12:12:23.751755 27856 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.751942 27828 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.754329 27856 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.754987 27828 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:23.728467 28032 consensus_meta.cc:287] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.614s	user 0.017s	sys 0.009s
I20260709 12:12:23.766108 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.767472 22189 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:12:23.770427 27902 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.770200 27947 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:23.765717 27807 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:23.764992 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:23.732898 27879 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:12:23.724750 28057 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:23.703464 28030 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 12:12:23.782389 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 49725.4us
I20260709 12:12:23.699963 28060 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.796397 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:23.772557 27947 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:23.790339 27688 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.773355 27807 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:23.802583 27807 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.773548 28049 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.803964 28053 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.799808 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.804427 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.804817 22263 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:23.806576 27688 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:23.808118 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.811393 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:23.812208 22189 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:23.816896 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.733301 27803 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.789677 28057 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:23.823196 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.823724 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.826409 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:23.824107 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.817870 22267 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:23.834759 22268 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:23.774041 27975 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:23.813868 22087 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:23.789649 27969 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:23.820638 28086 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:12:23.836591 27807 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:23.844063 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.799548 28058 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:23.764760 27946 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.833841 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:23.844751 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.821033 27892 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:23.846441 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:23.827679 27958 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:23.789909 27879 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:12:23.829360 27977 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.774901 28032 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.852540 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:12:23.853197 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.827507 27859 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.838049 27824 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:23.857856 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:23.864193 27946 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.845103 27969 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.850811 27831 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:23.851090 27892 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:23.851511 27958 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:23.891369 27892 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:23.892213 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:23.892010 27958 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.864518 27685 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.892899 22268 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.858017 28035 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.870951 28057 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.893463 27958 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.843513 27975 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:23.845074 27807 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.895056 28057 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.882059 22267 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:23.901288 22264 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:23.901590 27807 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.882239 28058 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:23.896356 27969 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.911931 27803 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:23.912599 28088 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 12:12:23.908447 28090 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:12:23.915421 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:23.850914 28045 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:12:23.919229 28047 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.927829 27856 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:23.935091 28058 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.935777 28032 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:23.936059 27892 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:23.937426 28085 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.204s	user 0.003s	sys 0.000s
I20260709 12:12:23.937644 27947 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:23.938666 28060 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:23.929268 27975 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:23.984288 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 284273us
W20260709 12:12:23.985850 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 108863us
I20260709 12:12:23.986966 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:23.988221 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.990520 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.991255 22236 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:23.995684 22237 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:23.996624 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:12:24.002422 22193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2480) took 1448 ms (client timeout 1591 ms). Trace:
W20260709 12:12:24.003144 22193 rpcz_store.cc:269] 0709 12:12:22.554202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.578727 (+ 24525us) service_pool.cc:224] Handling call
0709 12:12:24.001815 (+1423088us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b54000fb4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:24.002072 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164788480}
I20260709 12:12:24.022523 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:24.024156 22119 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:24.026548 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1449) took 1181 ms. Trace:
I20260709 12:12:24.027801 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:24.029222 22119 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:24.027390 22191 rpcz_store.cc:276] 0709 12:12:22.845204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.845372 (+   168us) service_pool.cc:224] Handling call
0709 12:12:24.009070 (+1163698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:24.009587 (+   517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:24.009632 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:24.009722 (+    90us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:24.009799 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.009896 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:24.026076 (+ 16180us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000fb4d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:24.026284 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2516414208}
I20260709 12:12:24.031173 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:23.988473 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:24.040403 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52275.7us
I20260709 12:12:24.042053 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:24.042773 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:24.043928 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:24.046726 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:24.056173 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:24.057919 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:24.059176 22122 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:24.056277 22021 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 14 to 15, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 15 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:24.067963 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 151815us
W20260709 12:12:24.073167 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 157368us
I20260709 12:12:24.078759 22163 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:23.933601 27856 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:24.084170 27831 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:24.084739 27831 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.085376 27801 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:24.048638 22268 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:24.049875 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:24.083755 27856 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.040710 22115 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:24.094946 22122 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:24.085260 27815 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:24.113713 22196 raft_consensus.cc:2368] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14.
I20260709 12:12:24.114611 27947 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:24.121870 27975 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:24.122351 28032 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:24.123723 28032 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:24.124055 28032 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:24.085289 27831 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.128244 27650 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:24.132557 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77118.6us
I20260709 12:12:24.135006 27794 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:24.135623 27794 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.135730 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:24.136142 27794 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:24.137243 27902 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:24.138387 27803 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:24.139237 27858 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:24.138754 22021 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 9 to 10, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 10 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:24.139189 27803 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:24.139900 27858 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:24.093313 27801 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:24.145959 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.148651 27974 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:24.156709 27902 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:24.163766 22264 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:24.161835 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 153) took 9781 ms. Trace:
I20260709 12:12:24.164324 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:24.163347 27902 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:24.164870 22196 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:24.165874 22195 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:24.144105 27858 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.151041 27856 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:24.151262 27947 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:24.149114 27966 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:24.170502 27966 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.171003 27966 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.164413 22017 rpcz_store.cc:276] 0709 12:12:14.380494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.380885 (+   391us) service_pool.cc:224] Handling call
0709 12:12:24.161550 (+9780665us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:22.689920 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:22.730629 (+ 40709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:22.730667 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:12:22.730685 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:22.731609 (+   924us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:22.731686 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:22.731727 (+    41us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:12:22.732297 (+   570us) tablet.cc:701] Row locks acquired
0709 12:12:22.732314 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:12:22.732455 (+   141us) write_op.cc:270] Start()
0709 12:12:22.732575 (+   120us) write_op.cc:276] Timestamp: P: 1783599142732411 usec, L: 0
0709 12:12:22.732599 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:12:22.737488 (+  4889us) log.cc:844] Serialized 2856 byte log entry
0709 12:12:23.286910 (+549422us) op_driver.cc:464] REPLICATION: finished
0709 12:12:23.502278 (+215368us) write_op.cc:301] APPLY: starting
0709 12:12:23.510206 (+  7928us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:23.653378 (+143172us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:23.653464 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:23.770365 (+116901us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:23.770600 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:12:23.770644 (+    44us) write_op.cc:312] APPLY: finished
0709 12:12:23.770936 (+   292us) log.cc:844] Serialized 73 byte log entry
0709 12:12:23.771099 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:23.771234 (+   135us) write_op.cc:454] Released schema lock
0709 12:12:23.771276 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:23.772702 (+  1426us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:23.772741 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2469870,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":192182,"apply.run_cpu_time_us":12376,"apply.run_wall_time_us":289627,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33401,"num_ops":7,"prepare.queue_time_us":354109,"prepare.run_cpu_time_us":74028,"prepare.run_wall_time_us":231672,"raft.queue_time_us":249320,"raft.run_cpu_time_us":32153,"raft.run_wall_time_us":152296,"replication_time_us":554123,"thread_start_us":707279,"threads_started":4,"wal-append.queue_time_us":235320}]]}
I20260709 12:12:24.174798 27892 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:24.152424 28032 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.181447 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:24.182484 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48056.2us
I20260709 12:12:24.185151 28040 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:24.185691 28040 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:24.186131 28040 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.187773 27803 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:24.186091 28032 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:24.194597 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59380.6us
I20260709 12:12:24.195303 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:24.207015 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:24.208634 27541 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:24.222877 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:24.226615 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:24.227417 22123 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:24.217046 27801 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:24.154049 22021 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 10 to 11, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:24.248842 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:24.254232 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:24.265678 22119 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:24.289508 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:24.298365 22021 catalog_manager.cc:5697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 8 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 9 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:24.311877 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:24.316016 27923 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:24.316968 27923 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.318360 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:24.330559 28053 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:24.350363 22191 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:12:24.313283 27809 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.101s
I20260709 12:12:24.365077 22021 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 13 to 14, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 14 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:24.369408 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:24.437847 28047 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.515267 27923 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:24.518081 27807 consensus_meta.cc:287] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.616s	user 0.016s	sys 0.009s
W20260709 12:12:24.518986 27828 consensus_meta.cc:287] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.763s	user 0.018s	sys 0.007s
W20260709 12:12:24.519800 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 241258us
W20260709 12:12:24.523041 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 158689us
W20260709 12:12:24.524398 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 254291us
I20260709 12:12:24.533581 27855 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
W20260709 12:12:24.529552 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 160380us
W20260709 12:12:24.541047 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 200028us
W20260709 12:12:24.556090 28097 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:12:24.549420 22021 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:24.545686 27923 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:24.553470 27650 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.579675 28068 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:24.563244 27923 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:24.581002 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:24.591619 28040 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:24.595181 28068 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:24.605491 27650 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:24.538607 27807 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:24.613893 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50417.4us
I20260709 12:12:24.550511 28047 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.634716 22197 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:24.640537 22857 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:12:24.641067 22857 pending_rounds.cc:85] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Aborting all ops after (but not including) 10
I20260709 12:12:24.641356 22857 pending_rounds.cc:107] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:12:24.641669 22857 raft_consensus.cc:2889] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:24.655222 27947 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:24.655831 27947 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:24.656244 27947 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:24.630316 27794 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.635174 27975 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:24.669135 27794 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:24.629426 27966 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.630136 27801 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:24.683151 27923 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:24.685675 27856 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.007s
W20260709 12:12:24.685925 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 131421us
I20260709 12:12:24.683189 28068 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:24.695495 28068 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:24.648449 27902 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:12:24.697088 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:24.698948 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:24.704082 28040 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:24.704900 28040 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:24.704985 27807 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:24.660012 28053 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:24.720705 28053 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.723264 28053 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:24.691201 27975 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.705724 28040 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:24.729902 27856 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:24.738288 27856 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.738507 28047 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:24.749827 22272 raft_consensus.cc:2368] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14.
W20260709 12:12:24.715767 27858 consensus_meta.cc:287] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.008s
I20260709 12:12:24.762208 27959 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:12:24.778352 27959 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:24.778851 27959 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:24.801558 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:24.764019 27858 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:24.798127 27856 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:24.817216 28047 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:24.821800 27831 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.008s
I20260709 12:12:24.795423 27959 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:24.815523 27902 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:24.840456 22831 leader_election.cc:400] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14.
I20260709 12:12:24.851282 22831 leader_election.cc:403] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.848445 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:24.855588 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 89569.2us
I20260709 12:12:24.854349 27807 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:24.832381 27966 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:24.860277 27807 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.865175 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:24.865942 22272 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.861229 28053 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:24.870772 27856 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:24.871147 28053 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.871425 27856 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.873485 27856 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:24.881960 22266 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:24.882565 27807 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:24.886251 28053 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:24.887645 27650 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:24.890210 27801 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:24.866344 28047 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:24.894023 28047 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.894928 22272 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:24.905650 27854 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:24.905663 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 84556.7us
I20260709 12:12:24.866330 27975 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:24.900736 28032 consensus_meta.cc:287] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.711s	user 0.016s	sys 0.000s
W20260709 12:12:24.914463 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 213967us
I20260709 12:12:24.908533 27959 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.917582 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:24.918613 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:24.920935 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:24.836104 27831 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.930526 22197 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:24.914613 27856 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:24.870164 27902 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.925804 28047 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:24.969067 28053 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:24.971707 28053 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.972393 27902 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:24.972059 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 105780us
I20260709 12:12:24.957041 27801 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.958199 27975 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:24.986737 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:24.994321 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:24.990904 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:25.016885 22266 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:24.989528 27858 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:24.998631 27856 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:24.990751 27947 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.028211 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:25.022317 28040 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:25.015065 27801 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.048722 22264 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:25.049739 22194 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:25.051179 28107 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:12:25.051344 28053 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.052415 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:25.053153 22267 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:25.057988 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.058712 22265 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:25.061093 27801 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:25.061389 27831 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:25.061874 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 95984.4us
I20260709 12:12:25.063052 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:25.064029 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.064718 27975 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:12:25.065174 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.065368 22269 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:25.066079 22264 raft_consensus.cc:2393] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:12:25.069048 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 74919us
I20260709 12:12:25.070735 22162 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:25.071728 27831 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:25.072821 28063 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:25.072980 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:25.045313 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:25.078670 28104 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:25.079453 28104 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:25.081248 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 79283.8us
I20260709 12:12:25.082194 28104 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.082266 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:25.038245 27902 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:25.083563 27902 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:25.084148 27902 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:25.086524 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 57636.1us
I20260709 12:12:25.091373 27854 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14.
W20260709 12:12:25.093933 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 48728.3us
I20260709 12:12:25.095799 22267 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:25.096498 27858 raft_consensus.cc:2764] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:12:25.084281 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:25.104494 22860 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:25.110214 22268 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:25.118947 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:25.132128 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.126735 27801 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.133893 27801 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.135062 22237 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:25.137036 28040 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:25.137449 27947 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.137737 28040 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:25.138975 28040 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.143246 22163 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:25.145033 27831 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:25.150149 27831 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:12:25.150401 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 66259.1us
I20260709 12:12:25.151422 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:25.151340 27831 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.152361 27947 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:25.152999 27947 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:25.153422 27947 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:25.153784 22268 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:12:25.156080 27801 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:25.158496 27856 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:25.161456 22163 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:25.128129 27975 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:25.163440 27975 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.163851 27975 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:25.163919 28063 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:25.162977 27966 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:25.165076 28108 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:25.165313 27815 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:25.166003 27815 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:25.166085 28108 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:25.167037 27815 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.175894 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.172900 22163 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:25.185950 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.127668 28104 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:25.188956 27533 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:25.189597 27533 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.190074 27533 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:25.197139 28063 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:12:25.198244 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 99945.8us
I20260709 12:12:25.199656 27541 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:25.203632 27815 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:25.211864 28063 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:25.172972 27966 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:25.213109 28063 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.213126 27966 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:25.216815 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.217214 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.217868 22116 raft_consensus.cc:2410] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:12:25.218972 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:25.220804 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:25.221179 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.221853 22118 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:25.167606 28108 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:25.223884 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:25.224489 27923 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:12:25.230059 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 95085.2us
W20260709 12:12:25.228617 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46572.5us
I20260709 12:12:25.233451 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.245078 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:25.245832 22272 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:25.247339 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:25.248616 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.234040 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.249301 22118 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:25.260895 22857 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:25.272010 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:25.273046 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:25.273216 22272 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:25.272751 28106 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:25.275209 22270 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:25.283017 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:25.301306 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:25.318564 22860 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:25.331240 22263 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:25.335778 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:25.336321 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 112609us
I20260709 12:12:25.336683 22264 raft_consensus.cc:2368] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14.
I20260709 12:12:25.288826 28106 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.348003 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:25.364624 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.365667 22267 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:25.351951 28032 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:25.370132 28032 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.293227 28053 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:25.382118 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:25.382650 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.384205 27831 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:25.386907 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:25.388000 27831 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:25.392890 28120 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 12:12:25.394966 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.396083 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.390492 27947 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.402137 22264 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:25.379861 28047 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.407647 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.421639 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.423941 28053 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.426082 28104 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:25.426851 28053 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.431731 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.433393 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.432577 22118 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 9.
I20260709 12:12:25.434231 22271 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:12:25.434489 28032 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.435132 28032 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:25.435400 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.436059 22116 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:25.382439 27975 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.369282 28106 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.447353 27975 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.449040 28106 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.381897 27902 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.451040 28106 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:25.452018 27902 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:25.452373 27533 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:25.452894 22268 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:25.453812 22864 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:25.418525 28047 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.455080 27533 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:25.456710 28047 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.459882 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.463308 22123 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:25.463553 27966 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.460301 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.464931 22119 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
W20260709 12:12:25.470772 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50875.2us
I20260709 12:12:25.475780 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:25.477029 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.436379 28032 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:25.486158 22263 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:25.490097 22264 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:25.490515 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.490612 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:25.493402 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.482776 28032 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:25.500613 28053 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:25.507427 22266 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:25.512467 22119 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:25.499356 28047 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:25.550310 28047 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.537185 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:25.542827 27966 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.562470 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:25.563475 28104 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:25.565439 28104 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:25.566643 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:25.552754 28047 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.577076 28047 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:25.572201 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:25.573824 28032 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.622231 28032 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:25.575546 27947 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.630486 28053 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:25.631621 28104 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:25.632175 27947 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.632498 27902 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:25.633020 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 60928.5us
I20260709 12:12:25.649618 22264 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
W20260709 12:12:25.654968 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 263994us
I20260709 12:12:25.664747 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:25.672183 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:25.680547 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.681392 27966 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:25.684912 27966 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:25.676604 27947 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.670358 27902 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.687402 27947 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.687777 27902 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:25.685451 27966 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:25.690768 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 181378us
W20260709 12:12:25.692787 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 294800us
I20260709 12:12:25.699009 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:25.699730 22197 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:25.701607 22088 leader_election.cc:400] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14.
I20260709 12:12:25.701973 22088 leader_election.cc:403] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:12:25.702961 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:25.704280 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:25.705051 28047 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14.
I20260709 12:12:25.705825 28047 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:25.706182 28047 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:25.706542 28047 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:25.708248 28032 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:25.710768 28032 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:25.711182 28032 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:25.689757 27831 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:25.714263 27831 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.716449 27831 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.693470 27947 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:25.722652 22197 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:25.721269 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:25.724126 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 59551.8us
I20260709 12:12:25.725804 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:25.726399 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:25.727355 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:25.727718 28132 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:25.728314 28132 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:25.729305 28132 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.733506 28104 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:25.723469 27794 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:12:25.734756 28053 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:25.735158 28053 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:25.735476 27794 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:25.735957 27794 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:25.736063 28053 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:25.736620 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:25.736845 27794 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:25.737533 28128 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:25.738546 27794 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:25.743278 27951 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:25.743871 27951 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:25.743888 22087 leader_election.cc:400] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14.
I20260709 12:12:25.748263 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:25.748721 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:25.749634 22119 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:25.750854 22118 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:25.752027 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:25.752943 22115 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:25.753450 28106 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:25.753868 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:25.754005 28106 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:25.754463 22122 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:25.755056 28106 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.741704 28053 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:25.771998 27856 raft_consensus.cc:2764] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:25.774610 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:25.791431 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 58120.4us
I20260709 12:12:25.777621 22122 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:25.816720 22116 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:25.816943 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:25.765015 27951 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:25.819339 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.820029 22123 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
W20260709 12:12:25.820803 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.822448 27975 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.823199 27975 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.825664 27975 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.826893 22269 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:25.827708 27966 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:25.833016 27966 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:25.837203 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 60732us
I20260709 12:12:25.838198 22197 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:25.842077 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:25.846583 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.846450 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.847985 22118 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:25.851508 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:25.852242 22264 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:25.847261 22116 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:25.861873 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:25.868103 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:25.866685 22021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 241) took 11029 ms. Trace:
I20260709 12:12:25.867447 28047 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.873569 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:25.874054 28109 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:25.874539 28109 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:25.874799 28047 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:25.874977 28109 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:25.874647 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:25.874737 22117 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:25.883982 28124 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:25.884734 28124 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:25.885722 28124 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:25.887569 28032 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:25.875054 27856 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:25.889039 27856 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:25.889428 27856 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:25.890595 22122 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:25.897830 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:25.869450 22021 rpcz_store.cc:276] 0709 12:12:14.833393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.834248 (+   855us) service_pool.cc:224] Handling call
0709 12:12:15.065436 (+231188us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:25.862941 (+10797505us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:25.079187 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:25.080055 (+   868us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:25.080121 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:12:25.080144 (+    23us) tablet.cc:662] Decoding operations
0709 12:12:25.107074 (+ 26930us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:25.107193 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:25.107245 (+    52us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:12:25.107974 (+   729us) tablet.cc:701] Row locks acquired
0709 12:12:25.108031 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:12:25.108249 (+   218us) write_op.cc:270] Start()
0709 12:12:25.108425 (+   176us) write_op.cc:276] Timestamp: P: 1783599145108146 usec, L: 0
0709 12:12:25.108467 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:12:25.109346 (+   879us) log.cc:844] Serialized 2486 byte log entry
0709 12:12:25.484014 (+374668us) op_driver.cc:464] REPLICATION: finished
0709 12:12:25.682923 (+198909us) write_op.cc:301] APPLY: starting
0709 12:12:25.683104 (+   181us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:25.688760 (+  5656us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:25.699573 (+ 10813us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:25.731040 (+ 31467us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:25.731336 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:12:25.731393 (+    57us) write_op.cc:312] APPLY: finished
0709 12:12:25.772002 (+ 40609us) log.cc:844] Serialized 65 byte log entry
0709 12:12:25.772255 (+   253us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:25.772389 (+   134us) write_op.cc:454] Released schema lock
0709 12:12:25.772455 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:25.862987 (+ 90532us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:25.865009 (+  2022us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20113,"reported_tablets":11,"spinlock_wait_cycles":77096192,"child_traces":[["op",{"apply.queue_time_us":186022,"apply.run_cpu_time_us":13955,"apply.run_wall_time_us":133717,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29219,"num_ops":6,"prepare.queue_time_us":163653,"prepare.run_cpu_time_us":73992,"prepare.run_wall_time_us":213625,"raft.queue_time_us":181058,"raft.run_cpu_time_us":7617,"raft.run_wall_time_us":12684,"replication_time_us":375362,"thread_start_us":486948,"threads_started":4,"wal-append.queue_time_us":190722}]]}
I20260709 12:12:25.912405 27855 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:25.900410 27902 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:25.964902 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:25.965986 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 149131us
I20260709 12:12:25.963990 27854 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:12:25.969970 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 72173.7us
I20260709 12:12:25.952371 22020 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 14 to 15, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:25.972898 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:25.975225 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:25.973064 22020 catalog_manager.cc:5697] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 8 to 9, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 9 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:25.971724 27902 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:25.973786 27854 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:12:25.989696 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.989950 27854 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:25.984251 22020 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.991794 27854 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.992905 27902 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:25.993681 27902 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:25.992744 22020 catalog_manager.cc:5697] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:26.001533 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:12:26.009286 28135 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:12:26.010763 27902 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.017814 28109 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.003998 22020 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 14 to 15, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 15 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:26.033433 22858 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:26.038757 28144 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:26.039332 28144 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.039705 28144 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.042443 28032 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:26.043613 22020 catalog_manager.cc:5697] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 9 to 10, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 10 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:26.045030 27902 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:26.020499 28109 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:26.062271 22195 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:26.070227 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.052273 22020 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 8 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 9 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:26.075901 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.077463 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:26.080673 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.087126 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.087800 22020 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 15 to 16, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 16 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:26.089757 22020 catalog_manager.cc:5697] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 12 to 14, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 14 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:26.095472 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:26.106881 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 131730us
I20260709 12:12:26.099063 22264 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:26.047981 27856 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.108887 22268 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:26.110162 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.076879 27902 raft_consensus.cc:2764] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:26.109141 22191 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.113396 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.109954 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:26.095350 28124 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:26.101451 28141 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:12:26.102662 28132 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.121323 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:26.122730 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:26.124444 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:26.125980 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:26.126098 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:26.129335 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:26.117471 28109 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:26.131702 22264 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:26.129969 28124 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:26.137707 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.137730 28124 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:26.138718 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.139312 22197 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:26.136174 28146 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:26.143589 28146 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:26.143850 27856 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:26.144182 28146 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.130857 27947 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:26.130568 28032 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:26.144726 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:26.145177 28032 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:26.145680 28032 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:26.146474 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:26.147315 22121 raft_consensus.cc:2368] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:12:26.149438 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:26.150440 27856 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:26.151036 27856 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.130731 28053 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:26.153107 28053 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:26.153165 27856 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:26.153643 28053 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.154920 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:26.157280 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:26.158071 22264 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:26.159830 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:26.160528 22269 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:26.166750 22263 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:26.132077 28109 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:26.170111 28109 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.136161 28132 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:26.174806 28132 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:26.178404 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:26.179447 22267 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:26.145756 22122 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 14: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:26.183686 22191 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:26.181802 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:26.186205 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:26.191707 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:26.192308 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:26.192663 22272 raft_consensus.cc:2368] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:12:26.193030 22268 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:26.202067 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:26.205145 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:26.201478 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:26.211627 22264 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:26.211804 22263 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:26.219514 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.221360 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:26.223615 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:26.224486 22860 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 14: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:26.232477 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.242449 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.249965 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.252866 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:26.251852 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.269083 22163 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:26.261621 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:26.273691 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 87570.3us
I20260709 12:12:26.277184 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:26.275007 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:26.282135 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.273171 22198 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:26.284435 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.286887 28149 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:26.287423 28149 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.287806 28149 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.295899 28032 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.309293 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.246040 27856 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:12:26.299649 27966 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:26.239552 28140 consensus_queue.cc:1059] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:12:26.202976 28144 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.305840 27541 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:26.308044 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.279899 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.300210 28109 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.313012 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:26.325490 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:26.322567 22122 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:12:26.326375 22122 pending_rounds.cc:85] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 11
I20260709 12:12:26.326673 22122 pending_rounds.cc:107] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:12:26.326965 22122 raft_consensus.cc:2889] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:26.342651 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.351148 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.352834 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.354591 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.355042 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.355321 28144 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:26.360893 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.363656 27975 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:26.364081 27975 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.364415 27975 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.304458 28053 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.373728 28053 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:26.314002 27947 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:26.375655 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 96384.4us
I20260709 12:12:26.304613 28146 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.322860 28104 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:26.343541 28047 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:26.370139 27966 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:26.349479 27856 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:26.399317 28032 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:26.406471 27947 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.408378 27856 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.409457 27966 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.385092 28047 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:26.411511 28047 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.412472 28130 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:26.412900 28130 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:26.394425 28104 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.414930 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.417848 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.418519 27815 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:26.418720 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.421104 28130 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.422529 28130 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:26.436064 28104 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:26.431260 22858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:26.437804 22858 raft_consensus.cc:606] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:26.439152 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.443410 28146 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:26.445421 28156 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:26.446012 28156 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:26.447187 28156 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.450160 27541 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:26.429612 28109 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:26.453446 22264 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:26.454344 28124 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:26.454782 28124 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:26.455040 22265 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:26.455627 28124 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.469502 22236 leader_election.cc:400] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
W20260709 12:12:26.469806 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.470027 22236 leader_election.cc:403] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:26.478478 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.480370 22198 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
W20260709 12:12:26.481518 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 166888us
I20260709 12:12:26.485416 22269 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:26.489180 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:26.496084 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.483737 28124 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:26.482880 28109 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.484373 28156 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.501461 22858 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:26.506641 27794 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.506791 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:45120
W20260709 12:12:26.508633 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.522819 22860 raft_consensus.cc:606] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:12:26.523375 22860 raft_consensus.cc:614] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:26.499789 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.518185 27541 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:26.498651 28125 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:26.531672 22198 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:26.532414 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.532078 22265 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:12:26.540922 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.550628 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.498407 27951 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 12:12:26.552878 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 227493us
I20260709 12:12:26.558851 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:26.561597 22190 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:26.566799 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.573630 27815 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:26.574968 28131 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:12:26.575603 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.577661 28047 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.580169 28047 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:26.590133 22088 leader_election.cc:400] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:12:26.590826 22088 leader_election.cc:403] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:12:26.527148 28145 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:12:26.551892 27855 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:26.602540 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.607618 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:26.608790 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72559.5us
W20260709 12:12:26.612634 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.605427 28047 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:26.625198 28047 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.625423 22197 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:26.625635 28047 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:26.627543 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.629189 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.630291 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.631717 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.633013 22860 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:26.633184 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.633301 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.633792 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.634358 22193 raft_consensus.cc:2368] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:12:26.635036 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.635205 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.636258 27794 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:26.637122 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.646180 22191 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:26.640705 22190 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:26.649302 22196 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:26.649375 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.654847 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.655685 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:26.656812 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 61998.1us
I20260709 12:12:26.659253 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.660669 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.663686 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.632063 27975 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.665905 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.666381 27975 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:26.668759 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.668828 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:26.670907 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:26.671295 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:26.671516 22122 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.610641 28159 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:12:26.678472 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:26.678853 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:26.681087 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:26.681480 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:26.610106 28149 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.637133 27855 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:26.690424 28149 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:26.692845 27855 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:26.693121 22195 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:26.694952 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.695784 22195 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:26.697104 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:26.698424 22270 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:26.697405 22268 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:26.701975 28125 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:26.702602 28125 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:26.697190 22267 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:26.705456 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 47486.4us
I20260709 12:12:26.712144 22117 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.712467 22858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:26.712981 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.713147 22858 raft_consensus.cc:606] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:26.717115 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:26.718776 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:26.719630 22198 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:26.720959 27815 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:26.722044 22123 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:26.722813 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:26.725056 28109 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:12:26.727139 22114 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:26.728461 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:26.729851 27964 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:26.730500 22119 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:26.733561 22115 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:12:26.734016 22115 pending_rounds.cc:85] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 7
I20260709 12:12:26.720993 22270 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:26.734292 22115 pending_rounds.cc:107] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:12:26.734737 22115 raft_consensus.cc:2889] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:26.729902 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:26.736516 22264 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.736573 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:26.737620 22266 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:26.739387 22121 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:26.748450 22122 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
W20260709 12:12:26.753717 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 46103.5us
I20260709 12:12:26.754649 22117 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:26.759150 22858 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:26.759387 28065 raft_consensus.cc:993] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:26.760025 28065 raft_consensus.cc:1081] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:26.755767 22264 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:26.760946 22116 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:26.754230 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:26.763621 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:26.769130 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:26.771679 22122 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:26.770800 22121 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:26.777801 22117 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.782851 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:26.791038 22189 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:26.798380 27815 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:26.801882 22263 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:26.801600 28140 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:26.803306 22263 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:26.804184 22196 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:26.779146 28145 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:26.806636 22265 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:26.810549 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:26.818001 22087 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:26.774276 27975 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:26.828320 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:26.821831 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:26.826860 28159 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:26.838011 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:26.839732 28068 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.810264 28168 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:12:26.838938 22020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 248) took 7939 ms. Trace:
I20260709 12:12:26.847883 27947 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:26.848483 27947 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:26.849061 27947 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:26.851593 22117 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:26.857210 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:26.863337 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51076.7us
I20260709 12:12:26.867871 28124 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:26.869335 27794 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:26.869761 27794 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:26.811654 28145 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:12:26.859104 28146 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:26.872079 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:26.870539 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 60528.5us
I20260709 12:12:26.846825 22020 rpcz_store.cc:276] 0709 12:12:18.899293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.899475 (+   182us) service_pool.cc:224] Handling call
0709 12:12:26.838843 (+7939368us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:26.406058 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:26.406659 (+   601us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:26.406702 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:12:26.406720 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:26.418882 (+ 12162us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:26.418968 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:26.418994 (+    26us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:12:26.419681 (+   687us) tablet.cc:701] Row locks acquired
0709 12:12:26.419700 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:12:26.419859 (+   159us) write_op.cc:270] Start()
0709 12:12:26.419975 (+   116us) write_op.cc:276] Timestamp: P: 1783599146419809 usec, L: 0
0709 12:12:26.419998 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:12:26.420647 (+   649us) log.cc:844] Serialized 3664 byte log entry
0709 12:12:26.542437 (+121790us) op_driver.cc:464] REPLICATION: finished
0709 12:12:26.646245 (+103808us) write_op.cc:301] APPLY: starting
0709 12:12:26.653144 (+  6899us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:26.697812 (+ 44668us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:26.697919 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:26.786438 (+ 88519us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:26.786699 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:12:26.786763 (+    64us) write_op.cc:312] APPLY: finished
0709 12:12:26.787380 (+   617us) log.cc:844] Serialized 89 byte log entry
0709 12:12:26.789339 (+  1959us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:26.789473 (+   134us) write_op.cc:454] Released schema lock
0709 12:12:26.789523 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:26.790090 (+   567us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:26.790120 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":993542,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":65502,"apply.run_cpu_time_us":15082,"apply.run_wall_time_us":172582,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41765,"num_ops":9,"prepare.queue_time_us":188185,"prepare.run_cpu_time_us":3919,"prepare.run_wall_time_us":36255,"replication_time_us":122255,"thread_start_us":146127,"threads_started":2}]]}
I20260709 12:12:26.858883 28109 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:26.893635 28106 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:26.894097 28106 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:12:26.894891 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 85736.5us
I20260709 12:12:26.895104 28106 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.895875 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:26.877592 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:26.857443 28047 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.885973 27831 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:26.889889 27794 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:26.870854 27975 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:26.897270 22236 leader_election.cc:400] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:12:26.926465 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:26.926647 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 49182.3us
I20260709 12:12:26.927876 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:26.927794 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:26.938683 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:26.906142 22017 catalog_manager.cc:5697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 9, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 9 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.952519 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:26.954972 27541 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:26.896737 28106 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.955415 22017 catalog_manager.cc:5697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 12 to 13, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 13 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.897575 28160 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:26.924180 28146 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.899976 28159 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.967717 27794 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:26.968015 22017 catalog_manager.cc:5697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.980307 22017 catalog_manager.cc:5697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 14, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 14 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.949736 27856 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:26.905249 27831 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:26.978283 27541 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.982388 22017 catalog_manager.cc:5697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 16 to 17, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.926164 28104 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:26.964305 28040 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:12:26.951444 27902 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:26.897480 28162 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.091s
I20260709 12:12:26.926630 28156 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
W20260709 12:12:27.000320 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 72715.7us
I20260709 12:12:26.961606 28161 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:12:26.961409 28131 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:12:26.992730 27975 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:27.005825 22017 catalog_manager.cc:5697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 9 to 10, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 10 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.980001 28132 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:12:27.011040 28109 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:27.033870 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:26.952960 28168 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:12:27.043208 22017 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.060338 22017 catalog_manager.cc:5697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 12, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 12 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
W20260709 12:12:27.053962 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 115371us
I20260709 12:12:27.005457 28124 consensus_queue.cc:1059] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:12:27.069620 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:27.081436 28178 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:12:27.084235 28047 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:27.085320 28173 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:12:27.086113 28109 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:27.040722 27831 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.087178 28109 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:27.088455 28124 raft_consensus.cc:3055] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:27.088842 28124 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:27.089649 28124 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.091861 28125 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.071149 28159 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:27.094553 27923 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:27.094941 27923 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:27.095350 28068 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.095755 27923 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.099467 28182 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:27.102938 27541 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:27.103408 27541 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:12:27.106753 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 73206.8us
I20260709 12:12:27.108418 22087 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:27.073266 22017 catalog_manager.cc:5697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 16, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 16 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.104146 27541 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.081159 28180 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.110895 22017 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.119930 27541 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:27.112874 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 160432us
I20260709 12:12:27.114454 27975 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:27.141332 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 71851us
I20260709 12:12:27.143684 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.129385 28104 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.146590 28104 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.148905 27975 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.151420 27975 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:27.154469 27947 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.135769 28159 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:12:27.158433 28159 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.159026 28125 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:27.158916 28159 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.161038 28159 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:27.161559 27923 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:27.121896 28180 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:27.164974 28180 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:27.139667 28130 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:12:27.125458 22017 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 14 to 15, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:27.172487 22017 catalog_manager.cc:5697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 12, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 12 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:27.177920 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.179422 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:27.181576 22017 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:27.190793 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47171.2us
I20260709 12:12:27.191730 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.193842 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.197978 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:27.202440 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.148684 28104 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:27.206784 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.207826 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:27.208081 22190 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:27.206972 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:27.208631 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:27.209496 22114 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:27.198292 27794 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 12:12:27.181250 27947 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:27.214920 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:27.271092 22860 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:12:27.202917 27902 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:27.273422 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 78435.9us
I20260709 12:12:27.275617 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.208164 28182 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:27.207306 22117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
W20260709 12:12:27.285085 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 96470.2us
I20260709 12:12:27.287101 22117 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:12:27.284693 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 108930us
I20260709 12:12:27.287660 22117 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:27.287825 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:27.293813 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:27.295728 28190 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:27.298897 28185 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.299511 28185 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.303416 22117 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:27.272218 28047 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:27.308395 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.285521 28180 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:27.303640 28160 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:27.358345 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:27.360567 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:27.362044 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:27.362867 22263 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:27.364423 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:27.366278 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:27.367005 22263 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:27.356467 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:27.284514 27856 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:12:27.375383 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.376294 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.376994 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.377220 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:27.377508 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.378504 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.379340 22117 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:27.379487 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:27.382068 22265 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:27.378571 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.382838 22197 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:12:27.380196 22189 raft_consensus.cc:2376] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12. Re-sending same reply.
I20260709 12:12:27.338789 28190 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:27.389763 22087 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:27.393354 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.393553 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:27.394508 22860 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:27.395035 22860 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:27.394539 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:27.393882 22265 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:27.398010 22196 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:27.399125 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:27.400454 27975 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.401330 27975 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:27.353210 28182 raft_consensus.cc:2764] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:12:27.351193 28160 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.408241 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:27.410751 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:27.411479 22263 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:27.415706 22123 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:12:27.419492 22265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:59754
I20260709 12:12:27.421072 22265 raft_consensus.cc:606] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.389608 28104 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:27.347692 28180 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.424750 22123 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:12:27.429593 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.421995 22265 raft_consensus.cc:614] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:27.347450 28047 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.431370 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:27.432148 22197 raft_consensus.cc:2376] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17. Re-sending same reply.
I20260709 12:12:27.433172 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:27.433913 28047 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:27.433933 22191 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:27.430250 22193 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:27.395943 22860 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:27.438665 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 115859us
I20260709 12:12:27.439078 22272 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:12:27.439766 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:27.440162 22162 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:27.441049 27541 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:27.441480 27541 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.441831 27541 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:27.448012 22191 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:27.448945 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.449519 28187 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:27.535547 28187 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:27.536731 28187 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:27.451045 28193 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:12:27.453675 22189 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:12:27.548022 22121 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:27.551349 22117 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:27.441046 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.437898 28104 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:27.558327 28104 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.416702 28160 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.462754 28180 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:27.463191 28063 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:27.561668 28063 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:27.562057 28063 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:27.562850 28063 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.564020 28063 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:27.448947 28174 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:12:27.465395 28192 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:12:27.469148 22198 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:27.471012 22119 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:27.472062 22115 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:27.421994 28188 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:12:27.474666 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:27.479826 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 85362.3us
I20260709 12:12:27.622284 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:27.479993 27541 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.491606 27831 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:27.628293 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.493444 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.494701 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.496434 22087 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:27.630255 22196 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:12:27.501906 28195 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.056s	user 0.004s	sys 0.000s
I20260709 12:12:27.522396 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.532920 28190 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:27.603119 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:27.622117 22195 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
W20260709 12:12:27.624970 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 111377us
I20260709 12:12:27.628402 22121 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:27.493269 28185 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:27.638923 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 144292us
I20260709 12:12:27.630551 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:27.631887 27856 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:27.642053 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:27.642688 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 146336us
I20260709 12:12:27.637511 22191 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:12:27.640321 27541 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:27.647547 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.647657 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:27.622457 27947 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.645651 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:27.656100 22264 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:27.636538 28106 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:27.664464 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.652689 28185 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:27.653254 28188 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:27.653920 28047 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:27.753448 22264 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:27.655066 27975 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:27.655364 27856 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:12:27.741582 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 77209.8us
I20260709 12:12:27.761842 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:27.754550 22271 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:27.764721 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 109275us
I20260709 12:12:27.655462 27947 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:27.765600 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 113377us
W20260709 12:12:27.799299 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 118604us
I20260709 12:12:27.757439 28190 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:12:27.802021 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 154429us
W20260709 12:12:27.801462 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 166288us
I20260709 12:12:27.759271 27975 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.685552 28106 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.807819 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:27.809659 28188 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:27.811357 27975 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:27.841885 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 80177.7us
I20260709 12:12:27.842979 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:27.858668 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:27.859472 22122 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:27.836884 28047 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:27.863632 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.871050 28223 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:27.873183 28047 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.871608 28023 raft_consensus.cc:993] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:27.845057 28146 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:27.850056 28215 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:27.839191 28204 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.241s
W20260709 12:12:27.945489 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 142853us
W20260709 12:12:27.932101 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 82876us
I20260709 12:12:27.866515 28226 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:27.953532 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 89992us
I20260709 12:12:27.954483 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:27.847100 28128 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:12:27.925669 28023 raft_consensus.cc:1081] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:27.965543 22122 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
W20260709 12:12:27.998754 28216 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:12:28.002333 28214 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:28.002884 28214 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:28.003741 28214 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.931722 28188 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:27.856101 27856 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:27.957701 28226 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.017377 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:28.048835 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 403231us
W20260709 12:12:28.064013 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46527.3us
I20260709 12:12:28.075811 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:28.076416 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 268718us
I20260709 12:12:28.077256 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:28.079824 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 110185us
I20260709 12:12:28.016150 28146 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:28.077234 28226 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.111173 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:28.124595 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.125775 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.126283 22263 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:12:28.134490 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57383.9us
I20260709 12:12:28.077659 28215 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:28.157696 22115 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:12:28.154331 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.093423 28214 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:28.197517 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 66980.9us
I20260709 12:12:28.199050 28239 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.199731 28239 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.204936 28215 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:28.206075 28215 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.077598 28190 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:12:28.129001 28187 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:28.219774 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.222803 22272 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 13: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:28.168347 28128 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.190680 28106 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.253398 28243 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:28.256508 28200 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:12:28.280995 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 145617us
I20260709 12:12:28.283074 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:28.319330 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.233646 28187 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.262992 28243 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:28.338230 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 179669us
I20260709 12:12:28.239094 28128 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.342857 22858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:28.343612 22858 raft_consensus.cc:606] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:28.345518 22189 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:12:28.312834 28146 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:28.331745 28124 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:28.331820 27947 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:28.360198 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 77234us
I20260709 12:12:28.327817 28190 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.362427 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:28.367416 28187 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:28.369215 27947 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:28.369987 27947 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:28.370381 27947 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:28.370784 27947 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:12:28.370966 28233 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:12:28.373339 28243 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:28.374567 27975 consensus_meta.cc:287] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.002s
I20260709 12:12:28.375044 27975 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.376796 28244 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:28.377621 28244 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:28.377805 28248 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:28.378808 28244 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.381000 28239 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.383162 28251 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:28.383561 28251 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:28.384541 28251 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.389276 28128 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:28.390450 28225 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:12:28.368623 28187 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:28.393335 28187 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.395588 28187 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:28.372443 28220 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:28.396344 28220 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.399091 28220 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:28.400211 28224 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.474s	user 0.001s	sys 0.000s
I20260709 12:12:28.400569 27975 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.404222 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:28.320533 28204 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:12:28.411617 22858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:28.412318 22858 raft_consensus.cc:606] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Received request to transfer leadership to TS 7d3f536360b444b1886777f4776be22c
I20260709 12:12:28.412827 22115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:28.425827 22115 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.426483 22115 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.345240 28047 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:12:28.414299 27975 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:28.437318 28234 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:28.457639 27975 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:28.458520 28160 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.897s	user 0.010s	sys 0.003s
I20260709 12:12:28.458674 27975 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.438232 28242 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.438009 27947 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.461005 28242 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.462886 27947 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.463394 28242 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:28.447582 28255 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:28.467321 28187 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:28.467912 28187 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:12:28.450368 28252 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 12:12:28.476347 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 130762us
I20260709 12:12:28.451542 28253 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.453151 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:28.454227 28229 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.415083 28190 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.473440 22118 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:28.475194 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:28.477780 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:28.481426 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.459461 28160 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.480664 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:28.491668 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:28.495375 27902 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:12:28.497629 28249 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:12:28.497903 27831 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.866s	user 0.008s	sys 0.005s
I20260709 12:12:28.499449 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:28.502010 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:28.501698 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:28.505817 22118 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:28.498858 22192 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:28.507826 22123 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:12:28.493044 28063 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.929s	user 0.015s	sys 0.000s
I20260709 12:12:28.484486 28253 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.512400 22268 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 10: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:28.515621 22114 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:12:28.515805 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.510479 28190 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.556411 22270 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:28.566061 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:28.573191 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:28.483968 28146 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.487833 28229 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.594334 28259 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:28.596896 28205 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.597597 28205 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.599730 22115 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.606976 28229 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.504082 28187 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.608763 28187 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.614343 28253 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.615212 28261 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.615903 28261 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.618747 28261 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:28.622483 28190 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.623107 28190 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.624789 28247 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.625499 28247 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.629746 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:28.631474 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:12:28.633081 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 408855us
I20260709 12:12:28.644181 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.600337 28205 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:28.614239 28160 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.608392 28226 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.662098 22121 raft_consensus.cc:2368] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14.
I20260709 12:12:28.663192 28226 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.647361 28190 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.664762 28040 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.664927 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:28.665720 22270 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.665482 28040 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.586495 28215 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:12:28.680647 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3460) took 1476 ms. Trace:
I20260709 12:12:28.681784 22116 rpcz_store.cc:276] 0709 12:12:27.204099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.204250 (+   151us) service_pool.cc:224] Handling call
0709 12:12:27.204581 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:27.204936 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.204963 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:27.205529 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:12:28.509837 (+1304308us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b18003b3f80. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:12:28.567475 (+ 57638us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:28.585092 (+ 17617us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.675327 (+ 90235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.675423 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.680273 (+  4850us) raft_consensus.cc:1685] finished
0709 12:12:28.680384 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.680543 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5589,"prepare.queue_time_us":17385,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":90616,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8646,"spinlock_wait_cycles":7106944,"thread_start_us":57416,"threads_started":1,"wal-append.queue_time_us":1358883}
I20260709 12:12:28.695868 22270 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
W20260709 12:12:28.718465 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.719630 28261 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:28.720885 28220 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.720764 28180 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.715886 28182 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:28.719326 28191 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.722883 28040 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.725914 28226 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:28.760006 22270 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:28.726794 28149 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.730922 28215 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:28.766819 28251 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:28.768793 28180 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.754159 28229 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.774976 28226 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.781448 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:28.782191 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:28.786150 28263 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:28.756947 28220 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.750857 28261 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.803047 28180 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.803531 28259 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.803716 28229 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.804140 28259 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.804853 28261 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:28.806360 28229 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.807467 28259 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.799062 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.781126 28149 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.811443 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.812609 22271 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:28.815133 22263 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:28.817139 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.790642 28240 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.818243 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.819057 22269 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:28.815227 28226 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.823872 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:28.825613 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:28.826529 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 2854) took 1471 ms. Trace:
I20260709 12:12:28.826974 22264 rpcz_store.cc:276] 0709 12:12:27.355609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.380413 (+ 24804us) service_pool.cc:224] Handling call
0709 12:12:28.826312 (+1445899us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54002274d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:28.826445 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554514816}
W20260709 12:12:28.828382 22192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 2937) took 1401 ms (client timeout 1533 ms). Trace:
W20260709 12:12:28.828848 22192 rpcz_store.cc:269] 0709 12:12:27.426662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.426817 (+   155us) service_pool.cc:224] Handling call
0709 12:12:28.828209 (+1401392us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b54003b51d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:28.828313 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2216221568}
W20260709 12:12:28.830286 22087 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.533s (SENT)
I20260709 12:12:28.830828 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:28.833393 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:28.836071 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:28.836376 27856 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.836961 22123 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:28.837196 27856 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.838927 28244 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.813890 28261 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:28.809394 28160 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:28.836457 28220 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.902542 27856 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.757930 28182 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.907219 28182 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:28.908883 28160 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.796948 28215 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.910734 22237 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:28.911602 28160 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.912199 28261 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.911602 28215 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.914842 28261 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:28.917021 28240 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.917969 28182 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:28.919658 28240 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.920630 28181 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:28.921339 28181 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.922185 28149 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.813969 28264 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:28.923620 28264 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.924947 28181 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.926087 28264 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:28.929564 28215 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.930083 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:28.930143 28215 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:28.932786 28215 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:28.933645 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:28.936065 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.936928 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:28.945585 22088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.969s (SENT) [suppressed 20 similar messages]
I20260709 12:12:28.959770 22860 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:28.969563 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:28.954469 28240 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.759271 28191 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:28.986569 22860 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
W20260709 12:12:28.989482 22860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 902) took 1594 ms (client timeout 1918 ms). Trace:
W20260709 12:12:28.990042 22860 rpcz_store.cc:269] 0709 12:12:27.393174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.393329 (+   155us) service_pool.cc:224] Handling call
0709 12:12:28.841090 (+1447761us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b58006f7ad0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd1e0aa 00007fccedda0447 00007fcceddb8fe7 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c
0709 12:12:28.987185 (+146095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119133056}
I20260709 12:12:28.977015 28234 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:28.997748 28234 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.000180 28234 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:28.996044 28264 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.008186 28264 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.010769 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3465) took 1606 ms. Trace:
I20260709 12:12:29.011220 22114 rpcz_store.cc:276] 0709 12:12:27.403930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.451892 (+ 47962us) service_pool.cc:224] Handling call
0709 12:12:27.452260 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:28.554622 (+1102362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.010482 (+455860us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002ae4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:29.010701 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2444958080}
I20260709 12:12:29.029419 22121 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:28.988921 28240 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.031333 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.047435 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.048599 22270 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:29.034004 28215 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.010830 28264 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:29.065910 28243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.014s	sys 0.027s
W20260709 12:12:29.073670 28243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.015s	sys 0.027s
W20260709 12:12:29.083784 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 138242us
I20260709 12:12:29.084378 22831 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:29.086850 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:29.088757 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:29.094365 28109 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.020s	sys 0.027s
W20260709 12:12:29.095559 28109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.020s	sys 0.027s
I20260709 12:12:29.054280 28215 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.081136 28243 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.089705 28202 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:29.111049 22270 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:29.103003 28160 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:29.114337 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.106243 27975 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.109494 28202 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.117473 28202 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.112457 27809 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:12:29.134315 28191 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:29.134315 28274 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
I20260709 12:12:29.136824 28240 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:29.137679 28258 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.565s	user 0.005s	sys 0.000s
I20260709 12:12:29.106665 28243 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.125629 27975 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.140219 28243 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.141463 27975 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:29.144793 28273 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:12:29.124058 28160 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.123564 28239 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.150936 28239 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.153519 28239 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.154031 28239 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:29.154593 28239 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.160466 27650 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.161206 27650 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.148449 28160 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.166574 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:29.172873 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:29.174269 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:29.175758 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.176642 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.176739 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.173674 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:29.173601 22265 raft_consensus.cc:2376] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15. Re-sending same reply.
I20260709 12:12:29.177384 22271 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:29.179632 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.180838 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.180281 22267 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:29.186511 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.187170 22272 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:12:29.179448 28240 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:29.193656 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:29.187564 28160 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:29.198426 28226 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:29.198993 28226 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.199441 28226 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.188488 28068 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.205170 28068 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.207741 28068 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.214613 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:29.217947 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2543) took 1836 ms. Trace:
W20260709 12:12:29.222909 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 438249us
I20260709 12:12:29.234524 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.193159 28239 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:29.235472 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:29.223291 28234 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:12:29.246549 28247 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.224391 28160 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:29.247747 28160 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.196274 27975 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:12:29.259101 28240 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:29.259651 28191 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.260392 28191 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.262135 28202 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.263263 22858 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:29.222985 28244 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:29.264030 28244 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:29.264549 28191 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:29.215760 28264 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.265636 28264 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.266671 28226 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.267866 28264 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:29.278882 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.279338 28229 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:29.279968 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:29.281941 28128 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:29.276074 28132 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:29.285698 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:29.318967 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:29.287596 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.288841 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.289572 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:29.255839 28248 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.333859 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.291975 28040 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:29.292299 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:29.293543 22115 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:29.264552 28244 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.294081 28156 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:29.347769 28156 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.349717 27951 raft_consensus.cc:993] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:29.350026 28156 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:29.294576 28167 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.350821 28167 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.350344 27951 raft_consensus.cc:1081] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:29.295038 28247 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.297749 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.298656 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.299016 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.299741 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.293630 28140 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:29.291917 28262 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.304617 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.306361 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.310256 27650 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.320004 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:29.276885 28184 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.336705 28132 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.374154 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.374766 22272 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:12:29.341007 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.342206 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.342871 27975 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:29.356465 22192 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:29.382368 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.361003 22198 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:29.343953 28248 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.356730 22197 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:29.384274 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:29.385234 22269 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.355592 22196 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:29.358798 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.307871 28215 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.362668 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.388882 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.361444 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.365480 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.365859 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.365952 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.366492 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.366765 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.387990 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.367065 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.369194 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:29.370321 22270 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.392966 22117 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:29.398098 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.218354 22194 rpcz_store.cc:276] 0709 12:12:27.381434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.382089 (+   655us) service_pool.cc:224] Handling call
0709 12:12:27.382517 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:27.415341 (+ 32824us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:27.450955 (+ 35614us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.637874 (+1186919us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b18003735a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a 00007fcceddcca2a
0709 12:12:28.642549 (+  4675us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b18003735a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:12:28.750898 (+108349us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:28.758307 (+  7409us) log.cc:844] Serialized 26 byte log entry
0709 12:12:28.758460 (+   153us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:28.759630 (+  1170us) log.cc:844] Serialized 14 byte log entry
0709 12:12:29.215095 (+455465us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b18003735a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceac4fc0a 00007fccf438f219 00007fcceacd7a40 00007fcceacd24e4 00007fcceacd2455 00007fcceddba060 00007fcceddcc716 00007fccedddd287 00007fccedddd208
0709 12:12:29.217631 (+  2536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.217703 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:29.217743 (+    40us) raft_consensus.cc:1685] finished
0709 12:12:29.217757 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.217889 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4326,"prepare.queue_time_us":31657,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":485394,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":38358,"spinlock_wait_cycles":106954496,"thread_start_us":91883,"threads_started":1,"wal-append.queue_time_us":1321816}
I20260709 12:12:29.404335 22830 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:29.407332 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.408030 22194 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:29.408136 22115 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:29.410072 22119 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:29.410915 22122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:29.410903 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.411661 22122 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:29.411824 22117 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:29.412101 22122 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.352938 28227 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:29.352833 28226 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.425709 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:29.355938 28217 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.412523 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:29.353158 28167 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.448158 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.452278 27809 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:29.383311 28234 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.381084 27975 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.453640 22861 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:29.479504 22861 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:29.454749 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.484622 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.353957 28040 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.462841 22163 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:29.462895 28248 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:29.364969 28259 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:12:29.465176 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 52744.3us
I20260709 12:12:29.495713 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:29.429163 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:29.365604 28132 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:29.351650 28128 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.421028 27856 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.447625 28227 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.353098 28247 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.491639 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:29.357072 28140 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.357409 28262 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.499650 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:29.361929 28184 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.493604 22861 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.504935 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:29.520946 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 91930.7us
I20260709 12:12:29.520736 22861 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.476044 28205 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:29.506791 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.481766 27975 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.526360 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:29.527061 22195 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:29.501420 28259 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.512193 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.506769 22122 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.510424 22270 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:29.520483 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:29.526815 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:29.502332 28218 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:29.502513 28183 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.536432 28140 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:29.537544 28202 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.539702 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.540891 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:29.541378 22194 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:29.513293 27856 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.545421 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:29.547129 27856 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:29.547648 28184 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.477069 28217 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.548880 22197 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:29.549842 28217 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.550420 28183 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.552124 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:29.513422 28227 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.554039 28247 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.554589 28204 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:29.555641 28204 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:29.555987 28204 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:29.557469 28262 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.557765 28109 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.558454 22190 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:29.558369 28109 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.517881 28226 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.559758 28226 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.561856 28226 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.562007 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.562429 28226 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.562866 28226 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.563077 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.564704 28040 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:29.483603 28234 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.567106 28234 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.567201 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.530746 28191 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:29.525866 27794 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:29.531694 22193 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:29.533373 22272 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:12:29.562935 28128 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.571218 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:29.573910 22197 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:29.514124 28248 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:29.577528 28264 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:29.577706 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.576911 22194 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:29.582021 22122 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:29.584937 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.560577 27892 raft_consensus.cc:993] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: : Instructing follower 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:12:29.602321 22116 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:29.560554 28109 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:29.526870 28205 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.611878 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:29.579108 28226 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.569887 28218 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.619273 28040 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:29.570180 28259 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:29.621485 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.623100 22190 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:29.574894 28183 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.635844 22861 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:29.637848 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:29.640187 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:29.613904 28205 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.593334 28234 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:12:29.621048 28181 raft_consensus.cc:1081] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Signalling peer 7d3f536360b444b1886777f4776be22c to start an election
I20260709 12:12:29.594228 28244 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.645853 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:29.630187 28218 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:29.647059 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.646494 28199 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:29.640022 27650 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:29.649957 22190 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:29.630062 28160 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.596153 28204 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:29.655257 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.659713 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.651892 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.665635 22189 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:12:29.679112 22269 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
W20260709 12:12:29.650761 28213 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:12:29.665686 22114 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:29.666869 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.682634 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:29.705484 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.669258 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:29.686298 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.665351 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.707387 22267 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:29.692543 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:29.744481 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.668408 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.758018 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.667300 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.759815 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:29.762156 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 69757.5us
I20260709 12:12:29.760783 22267 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:12:29.659612 27892 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:29.672724 28204 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:29.801471 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.803404 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:29.804317 22191 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:12:29.799362 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:29.660751 28160 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.859476 28160 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.862388 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.863078 22118 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:29.865871 28244 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:29.866642 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:29.870240 28202 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:29.769485 28215 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:29.873248 28215 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:29.874238 28215 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.743729 28109 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:29.876286 28109 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:29.877912 28287 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 12:12:29.878405 28109 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:29.878691 22197 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:29.879617 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:29.880409 22118 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:29.882145 28264 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.882628 28264 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:29.886337 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:29.895362 22195 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:29.896425 22196 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:29.672676 28248 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.909211 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:29.910650 22194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
 from {username='slave'} at 127.0.0.1:37260
I20260709 12:12:29.911279 22194 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:29.911589 22194 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:29.925768 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.931238 22088 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:29.933653 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:29.936926 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 137614us
I20260709 12:12:29.938220 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:29.939182 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:29.940994 28217 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:29.941444 28217 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.941648 28236 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:29.941932 28217 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:29.943418 28234 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:29.947381 28160 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:29.947962 28160 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:29.805662 28185 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.949187 28264 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.949986 28185 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:29.951382 28264 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:29.952180 28185 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:29.952517 27533 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:29.940533 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:29.955080 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.955763 22267 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:29.932511 22194 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:29.963912 22195 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:29.974778 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:29.976400 22120 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:29.980326 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:29.959100 27809 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:29.942123 28236 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:29.995882 22195 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:29.968031 28247 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:29.966933 28140 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:29.982156 27809 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:30.007944 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:30.013418 22263 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:30.014292 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.015043 22195 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:30.014308 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:30.018421 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:29.996554 28236 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.935501 28248 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.050355 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:30.058214 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.006911 28247 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.035254 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:30.066632 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:30.067562 22116 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:30.073474 22195 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:30.084003 28248 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:30.060002 28227 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.091642 28227 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:30.093295 28183 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:30.093767 28183 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:30.094748 28183 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:30.097610 28289 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:12:30.110849 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:30.111594 22857 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:30.113145 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.111923 22857 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:29.962373 28160 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:30.114599 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:30.119360 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:30.120937 22266 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:12:30.121505 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46484.7us
I20260709 12:12:30.118384 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.023993 28191 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:30.115025 22857 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:30.024189 28264 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:30.130522 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52050.3us
I20260709 12:12:30.122949 22120 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:30.133675 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:30.134546 22194 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:30.138631 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:30.139314 22268 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:30.104287 28204 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:30.114740 28239 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:30.104800 28247 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:30.136672 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:30.146193 27533 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:30.137728 27809 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:30.165328 27809 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:30.147744 28204 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:30.169157 28204 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:30.124397 28191 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:30.174896 28191 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:30.132261 28264 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.177171 28264 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.185688 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.186457 22192 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:30.186324 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.188123 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.188359 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:30.189191 22191 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:30.191556 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.193250 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.194764 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:30.195436 22197 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.202682 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.204161 27541 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:30.208030 28217 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.127040 28234 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 12:12:30.210152 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51851us
I20260709 12:12:30.211349 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.222747 22195 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:30.189083 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:30.218535 22191 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:30.223735 22193 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.225256 22116 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
I20260709 12:12:30.220651 22197 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:30.223245 22194 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:30.232030 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:12:30.235080 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57876.4us
I20260709 12:12:30.147476 28239 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.235878 28239 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:30.131390 28065 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
W20260709 12:12:30.244146 28259 consensus_meta.cc:287] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.005s
I20260709 12:12:30.143443 28248 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:30.246173 28040 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:30.248232 28130 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:30.249774 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:30.261023 22194 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:30.235272 27975 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.000s
W20260709 12:12:30.266040 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.274266 22266 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:30.258803 22162 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:30.294993 22268 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:30.298175 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:30.299499 28184 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:30.277681 28259 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.306003 27975 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:30.310345 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51664.8us
I20260709 12:12:30.317245 22194 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:30.318711 22123 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:30.319815 22862 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:30.327836 28264 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.330224 28185 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:30.330595 28264 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:30.276925 28248 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.333655 28248 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:30.338740 28217 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:30.346606 28191 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.350744 28234 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:30.351473 28234 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.354105 28234 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:30.358247 22269 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:30.363467 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:30.364639 22266 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:30.378980 22193 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
W20260709 12:12:30.383855 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65989.7us
I20260709 12:12:30.320402 27975 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:30.404700 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:30.398070 27831 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:30.403129 28205 consensus_meta.cc:287] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.000s
I20260709 12:12:30.389375 28185 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:30.426537 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:30.429379 22858 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:30.415587 28229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.033s
I20260709 12:12:30.452011 27831 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.470063 28247 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.459631 28262 raft_consensus.cc:2764] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:30.474581 28236 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:30.475565 28218 consensus_meta.cc:287] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.815s	user 0.008s	sys 0.004s
I20260709 12:12:30.460297 27541 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:12:30.448489 28259 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:30.457952 28191 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:30.447080 28130 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:30.507479 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:30.478549 28229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.012s	sys 0.033s
I20260709 12:12:30.524217 22189 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:30.452754 28205 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:30.538427 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 338721us
I20260709 12:12:30.541313 22272 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:30.475975 28185 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.542109 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:30.553169 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:30.553995 22115 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 18
W20260709 12:12:30.557082 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.514247 28218 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:30.560415 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 425021us
I20260709 12:12:30.545877 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:30.567118 22115 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:30.567759 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:30.568684 22116 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:30.569204 22196 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:30.552708 28184 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:12:30.564890 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 354050us
I20260709 12:12:30.558883 27975 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:30.563604 28217 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:12:30.620270 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 165058us
I20260709 12:12:30.621423 22162 leader_election.cc:400] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14.
I20260709 12:12:30.621726 22162 leader_election.cc:403] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:30.577033 28215 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:30.629391 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.630663 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.631567 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.631906 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.632238 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:30.586426 28109 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.631628 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:30.648038 22266 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:30.648373 22121 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:30.625003 22116 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:30.635313 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.621876 27831 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:30.632709 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.652266 22122 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:30.648272 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:30.658331 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.659826 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:30.661566 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.660488 22122 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:30.649422 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.610231 28217 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:30.665859 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.667378 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.667721 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.668651 27831 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.669207 27831 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:30.669618 22832 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.001s	sys 0.050s
I20260709 12:12:30.669919 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.622074 27856 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:30.670907 22193 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
W20260709 12:12:30.674299 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 89952.5us
I20260709 12:12:30.679446 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.619029 28160 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:30.671804 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.672202 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.673424 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:30.685287 22194 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:30.686005 22197 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:30.673357 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:30.674173 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:30.669998 22832 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.001s	sys 0.051s
I20260709 12:12:30.675616 22162 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:30.680189 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:30.680990 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:30.671741 22857 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.648213 27815 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14.
I20260709 12:12:30.697307 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:30.698400 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:30.647188 27975 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:30.701529 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:30.703171 22195 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.704056 22121 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:12:30.708515 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 76396.4us
I20260709 12:12:30.709767 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:30.701328 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 117701us
I20260709 12:12:30.716952 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:30.718645 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:30.670737 28240 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:30.728056 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 52546.5us
I20260709 12:12:30.729816 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:30.729228 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:30.736971 22271 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:12:30.656104 28109 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.654865 28215 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.700261 27856 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:30.742493 28109 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:30.742573 28215 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:30.744699 28218 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:30.748163 28204 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.004s
I20260709 12:12:30.748250 28320 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:30.706331 28247 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:30.755291 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:30.756043 22268 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:12:30.742211 27856 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.753515 27831 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:30.762066 22122 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:30.763067 22195 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:30.764906 22162 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:30.767071 22268 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:30.797395 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:30.772733 22163 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:30.801568 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:30.805624 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:30.817574 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:30.759439 28205 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:30.748595 28204 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:30.769860 27815 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:30.718971 28160 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:30.836138 27794 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:30.841890 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.836257 28262 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:30.866062 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 147611us
I20260709 12:12:30.864576 22271 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:30.877635 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:30.869258 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 152432us
I20260709 12:12:30.803623 28247 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:30.882012 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:30.808975 27831 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:12:30.891136 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 73676.9us
I20260709 12:12:30.808660 28218 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:30.895577 22162 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:30.906443 22263 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:30.733489 28184 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:30.872628 28303 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
W20260709 12:12:30.883786 28304 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.302s	user 0.002s	sys 0.000s
W20260709 12:12:30.911671 28312 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:12:30.749449 28217 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:30.894188 28325 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:12:30.921378 28307 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
W20260709 12:12:30.910269 28317 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:12:30.928036 22857 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
W20260709 12:12:30.928113 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 46252us
I20260709 12:12:30.939013 22162 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:30.892560 28322 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:30.907033 28109 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:30.920583 28239 consensus_meta.cc:287] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.000s
I20260709 12:12:30.894476 28321 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:30.930576 28314 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:30.951850 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:30.841104 27975 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:30.949929 28306 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:12:30.943588 28247 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:30.949925 28316 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:31.008821 22861 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:31.011406 22861 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:30.950186 27831 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:30.960084 22162 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:31.015362 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 63581.1us
I20260709 12:12:31.017048 22861 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.020257 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:31.020542 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:31.021447 22265 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 11: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:31.028172 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:30.984400 28322 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:30.987260 28109 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:30.962001 28218 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:31.000954 28319 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:30.977290 28215 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:12:31.034878 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:31.040599 22271 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
W20260709 12:12:31.040763 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 80784.5us
I20260709 12:12:31.042311 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:31.014633 28334 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:31.092213 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 2972) took 1026 ms. Trace:
W20260709 12:12:31.048729 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 171090us
I20260709 12:12:30.976580 28239 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.022526 28140 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:30.987100 28321 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.029824 28320 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:31.012488 28247 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:30.992000 28314 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:31.065156 28326 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:12:31.064939 27831 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.071682 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 2900) took 1157 ms. Trace:
I20260709 12:12:31.072435 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 2905) took 1103 ms. Trace:
I20260709 12:12:31.078867 28204 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:31.090481 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:31.090875 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68485.8us
I20260709 12:12:31.092758 22196 rpcz_store.cc:276] 0709 12:12:30.066267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.112823 (+ 46556us) service_pool.cc:224] Handling call
0709 12:12:31.091887 (+979064us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54002e6dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:31.092120 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046696832}
I20260709 12:12:31.103142 22118 raft_consensus.cc:2368] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16.
I20260709 12:12:31.014137 28316 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.046974 28333 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:31.098331 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55582.8us
I20260709 12:12:31.099977 22267 rpcz_store.cc:276] 0709 12:12:29.968623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.969059 (+   436us) service_pool.cc:224] Handling call
0709 12:12:29.969492 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:29.969888 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.969914 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:29.978869 (+  8955us) log.cc:844] Serialized 26 byte log entry
0709 12:12:30.490283 (+511414us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:30.490363 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.490449 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:31.072151 (+581702us) raft_consensus.cc:1685] finished
0709 12:12:31.072173 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.072368 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1651,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":25614,"thread_start_us":429955,"threads_started":1,"wal-append.queue_time_us":948430}
I20260709 12:12:31.099434 22270 rpcz_store.cc:276] 0709 12:12:29.905132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.910068 (+  4936us) service_pool.cc:224] Handling call
0709 12:12:29.962692 (+ 52624us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:29.972722 (+ 10030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.972761 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:29.983740 (+ 10979us) log.cc:844] Serialized 52 byte log entry
0709 12:12:30.496152 (+512412us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:30.496195 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.496272 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:31.062254 (+565982us) raft_consensus.cc:1685] finished
0709 12:12:31.062276 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.062437 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4063,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":24796,"thread_start_us":475968,"threads_started":1,"wal-append.queue_time_us":654689}
I20260709 12:12:31.105018 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.114580 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 3694) took 1066 ms. Trace:
I20260709 12:12:31.115020 22269 rpcz_store.cc:276] 0709 12:12:30.048491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.060523 (+ 12032us) service_pool.cc:224] Handling call
0709 12:12:30.061258 (+   735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.358961 (+297703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.114341 (+755380us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400056254. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:31.114504 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682283776}
I20260709 12:12:31.120280 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:31.121364 22122 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 11: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:31.121956 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:31.123040 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:31.103703 27794 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.125850 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.128510 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.099797 28215 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:12:31.107141 28140 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:31.131171 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:31.142395 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.126617 28185 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:31.133060 28247 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.130110 28341 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:31.109171 28338 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:31.162137 28316 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:31.163856 28239 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:31.132987 28334 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:31.173925 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.177188 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:31.178983 28248 consensus_meta.cc:287] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.845s	user 0.014s	sys 0.002s
I20260709 12:12:31.129835 28339 raft_consensus.cc:2764] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:12:31.179662 28319 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:31.214450 28248 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.243914 28160 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.189682 28204 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:31.172017 28229 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:31.114336 28322 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.155079 28329 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:31.154232 28340 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:31.206041 28140 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:31.319303 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 205200us
W20260709 12:12:31.323827 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 146741us
I20260709 12:12:31.320318 28227 raft_consensus.cc:2764] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:12:31.330587 28248 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:31.331041 28204 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.182386 28185 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:31.334558 28345 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.175s	user 0.000s	sys 0.007s
I20260709 12:12:31.337545 28321 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.338889 28314 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:31.450685 28323 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.450956 28160 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:31.468552 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 286119us
I20260709 12:12:31.444058 28109 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.458674 22087 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.464377 28316 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:31.490293 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.507519 28316 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.487301 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:31.493952 28185 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.494098 28227 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:31.464818 28215 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:12:31.508926 28227 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:31.471731 28318 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:12:31.509877 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:31.494519 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.494765 28340 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:31.497252 28337 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:31.498500 27975 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:31.505970 28160 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:31.518392 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 66718.9us
I20260709 12:12:31.456873 27856 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:31.512920 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:31.513365 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:31.571657 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58868.1us
I20260709 12:12:31.473752 28248 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:31.510722 28318 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:31.504505 28236 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:31.570892 28332 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:31.554464 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:31.484376 28204 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.553382 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:31.509104 28325 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:31.490267 28202 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.575536 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.576336 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:31.581779 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.584437 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.586189 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:31.569218 28109 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:31.490507 28323 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.578119 28329 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:31.596292 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 2979) took 1409 ms. Trace:
I20260709 12:12:31.596149 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:31.597959 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.577895 28318 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:31.600831 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:31.596809 22189 rpcz_store.cc:276] 0709 12:12:30.187333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.202364 (+ 15031us) service_pool.cc:224] Handling call
0709 12:12:31.596118 (+1393754us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54003b65d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:31.596235 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737453952}
I20260709 12:12:31.586035 28347 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:31.509936 28227 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.583518 28325 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:31.602093 28191 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.551478 28337 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.579612 28248 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.593981 28332 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.589093 28202 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.621860 28329 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.622028 28332 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.622195 28316 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.622464 28329 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.582094 27856 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.603008 28321 raft_consensus.cc:2764] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:31.600726 28348 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:31.617825 28337 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.620000 28248 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:31.625301 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.625627 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.613413 28325 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:31.641386 22858 raft_consensus.cc:2393] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:31.622496 28202 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:31.624598 28329 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.599131 28204 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:31.657511 28204 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.646834 28318 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.598891 28109 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.673471 28318 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:31.674988 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.675349 28109 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.621910 28160 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.651453 27856 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:31.655148 28323 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:31.634462 28348 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:31.678403 28348 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:31.680574 22123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2475) took 2317 ms (client timeout 2108 ms). Trace:
W20260709 12:12:31.681511 22123 rpcz_store.cc:269] 0709 12:12:29.363189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.366256 (+  3067us) service_pool.cc:224] Handling call
0709 12:12:31.680199 (+2313943us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b5400129dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:31.680410 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111305984}
I20260709 12:12:31.645996 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.567379 28319 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.680567 22119 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:31.689833 28204 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.694097 28247 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:31.694736 28247 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:31.659766 22862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 915) took 1549 ms. Trace:
I20260709 12:12:31.705258 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:31.713302 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.701665 22862 rpcz_store.cc:276] 0709 12:12:30.110770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.110953 (+   183us) service_pool.cc:224] Handling call
0709 12:12:31.659344 (+1548391us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b540059e7d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:31.659669 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140066048}
W20260709 12:12:31.727602 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 62294us
I20260709 12:12:31.737123 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.737970 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.736325 28223 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:31.742738 28223 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.745398 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.746496 22860 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:31.748260 28204 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:31.749002 28204 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.753620 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.732659 28181 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:31.758287 28181 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.761029 28204 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:31.761703 28309 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:31.763413 28309 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.766319 28309 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:31.768574 28223 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:31.695858 28247 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.770840 28247 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:31.777717 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.779420 28329 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:31.780297 28329 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:31.762617 22862 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:31.781476 28329 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.784813 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.802058 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:31.811077 28348 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.813392 28348 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:31.817173 28348 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:31.817684 28348 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.697379 28240 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:31.819450 28240 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:31.819737 28348 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:31.820248 28240 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.821182 28181 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:31.783993 28104 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:31.846758 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 55525.9us
W20260709 12:12:31.849933 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 274512us
I20260709 12:12:31.851251 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.856523 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.857668 28328 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:31.858542 28328 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:31.860320 22087 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.861294 28328 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:31.864056 28328 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:31.868017 28183 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:31.868840 22087 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.869903 28328 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.871376 22087 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.872305 28328 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:31.873948 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:31.874998 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 168820us
I20260709 12:12:31.884219 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:31.892735 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:31.896565 22193 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:31.852680 28181 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.910316 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:31.910573 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:31.885576 28104 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:31.942924 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 340031us
W20260709 12:12:31.942924 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49031.7us
I20260709 12:12:31.944399 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:31.947988 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:31.831115 28325 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.908634 28350 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.948276 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:31.952239 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 68108.9us
I20260709 12:12:31.961367 22123 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 20: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:31.907375 28264 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:31.848302 28160 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 12:12:31.909732 28227 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:31.938158 27815 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.966791 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:31.969970 27815 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.963142 28109 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:12:31.962476 28202 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.973285 28202 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.947183 28226 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:31.975606 28202 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:31.975664 28226 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.962632 28323 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:12:31.960160 28320 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:31.951647 28348 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:31.958238 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:31.968266 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.969962 22264 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:31.980280 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.989063 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:31.992422 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:31.991747 28348 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:31.993667 28348 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:31.994109 28348 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:31.966298 28350 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:31.996824 28350 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:31.990952 28202 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:12:31.998059 28202 consensus_queue.cc:1243] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:31.972568 27815 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:32.006886 28340 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:32.009514 28315 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.323s	user 0.006s	sys 0.000s
I20260709 12:12:32.010311 28325 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:32.012060 28104 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:31.981199 28264 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:32.020763 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:31.981398 28215 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:32.025974 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:32.030489 22271 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:32.025971 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:31.943471 28181 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:32.037671 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.038319 22193 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:32.039800 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.040472 22195 raft_consensus.cc:2368] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 15. Current term is 16.
I20260709 12:12:32.040800 22123 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:32.041112 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:32.039125 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:32.046415 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:32.050681 22114 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:32.053918 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.026823 28264 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:32.020414 28323 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:32.058637 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.065997 22264 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:32.069378 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:32.077428 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:32.070206 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.079010 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.070662 22198 pending_rounds.cc:85] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 7
I20260709 12:12:32.080060 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:32.080296 22198 pending_rounds.cc:107] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:12:32.080734 22198 raft_consensus.cc:2889] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:32.071732 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.073024 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:32.074146 22194 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:32.082477 22263 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.083074 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:32.083179 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.084360 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.084427 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.075192 22193 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:32.086656 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:32.087141 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:32.079737 22192 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:32.074952 28128 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.051730 28348 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:32.089622 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.055878 28319 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:32.090306 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:32.055505 28318 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.095497 22192 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.091447 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:32.098620 22270 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:32.092078 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.100103 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.096942 28128 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:32.103717 28128 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:32.105427 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:32.106256 22264 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:32.107121 22189 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:32.108083 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.108804 22265 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:32.109758 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:32.111806 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.112455 22236 leader_election.cc:400] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 15. Current term is 16.
I20260709 12:12:32.112897 22236 leader_election.cc:403] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:32.113125 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:32.115666 22117 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:32.113576 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.126626 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:32.080011 28262 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:32.143371 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.146453 22263 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:32.148149 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.224913 22114 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:32.088335 28244 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:32.226881 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.088881 28185 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:32.240103 28109 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 15. Current term is 16.
I20260709 12:12:32.241732 22117 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
W20260709 12:12:32.229758 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:32.289886 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.235421 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.236269 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:32.292510 22264 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
W20260709 12:12:32.316495 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 127327us
I20260709 12:12:32.317670 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:32.324275 22192 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:32.097505 28319 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:32.120471 28333 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.095618 28318 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:32.139338 28264 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:32.364266 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:32.364830 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.349382 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.435705 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.467896 22192 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
W20260709 12:12:32.364163 28247 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.593s	user 0.007s	sys 0.003s
I20260709 12:12:32.456303 22831 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:32.475927 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.489643 27951 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:32.490470 27951 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.262488 28181 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:32.358736 28348 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:32.491019 27951 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:32.365067 28319 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:32.366624 28366 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.365s	user 0.003s	sys 0.000s
W20260709 12:12:32.495160 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 177589us
I20260709 12:12:32.499276 22194 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:32.503788 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.506129 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:32.523193 22087 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:32.532023 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:32.575562 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52544.5us
W20260709 12:12:32.576617 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68616us
I20260709 12:12:32.449368 28264 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:32.348160 22115 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:32.607843 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:32.608398 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.613395 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:32.613932 22264 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:32.237285 28262 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:32.616508 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:32.617067 22196 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:32.618486 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.615075 28264 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:32.633386 28349 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.063s	user 0.004s	sys 0.013s
I20260709 12:12:32.633513 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 3685) took 2604 ms. Trace:
I20260709 12:12:32.632464 22861 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:32.634096 22272 rpcz_store.cc:276] 0709 12:12:30.028605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.033357 (+  4752us) service_pool.cc:224] Handling call
0709 12:12:30.077269 (+ 43912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.550842 (+473573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.633168 (+2082326us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400160dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:32.633402 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066533248}
I20260709 12:12:32.642598 28215 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:32.643193 28215 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:32.645138 22123 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:12:32.645452 22861 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
W20260709 12:12:32.646224 22861 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 895) took 2414 ms (client timeout 1928 ms). Trace:
W20260709 12:12:32.646633 22861 rpcz_store.cc:269] 0709 12:12:30.231535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.231680 (+   145us) service_pool.cc:224] Handling call
0709 12:12:31.008653 (+776973us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b54006705a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc5e18 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:31.679709 (+671056us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b180030ee20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddfd646 00007fccedd3758e 00007fcceddb8f9e 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c
0709 12:12:32.632160 (+952451us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b58005237d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd1e0aa 00007fccedda0447 00007fcceddb8fe7 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c
0709 12:12:32.646095 (+ 13935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1603894400}
I20260709 12:12:32.654018 28318 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:32.301817 28104 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:32.654878 28104 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:32.656980 28104 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:32.657895 28347 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:32.658669 28262 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:32.658780 28347 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:32.660077 28215 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:32.662130 28367 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.655s	user 0.005s	sys 0.012s
I20260709 12:12:32.662436 28215 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:32.662655 28347 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:32.658818 28264 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:32.665268 28264 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:32.683805 28226 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:32.685356 22118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 3494) took 2047 ms (client timeout 1649 ms). Trace:
W20260709 12:12:32.685968 22118 rpcz_store.cc:269] 0709 12:12:30.638086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.648900 (+ 10814us) service_pool.cc:224] Handling call
0709 12:12:32.685052 (+2036152us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400215f54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:32.685237 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948821760}
I20260709 12:12:32.688905 28244 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:32.689220 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3505) took 1568 ms. Trace:
I20260709 12:12:32.689564 22119 rpcz_store.cc:276] 0709 12:12:31.121177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.121866 (+   689us) service_pool.cc:224] Handling call
0709 12:12:31.680358 (+558492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.688836 (+  8478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.689034 (+1000198us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b5400129dd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:32.689166 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283647744}
I20260709 12:12:32.615350 28356 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.690059 28340 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:32.690914 28340 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:32.690831 28356 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:32.692947 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 76853.9us
I20260709 12:12:32.693717 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:32.613065 28204 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.695597 28204 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:32.697054 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.697624 28204 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:32.699829 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:32.507253 28348 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:32.701752 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.704897 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.712214 22192 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 12: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:32.467373 28333 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:32.724640 28368 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.730s	user 0.010s	sys 0.008s
W20260709 12:12:32.725775 28365 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.719s	user 0.003s	sys 0.013s
W20260709 12:12:32.714430 28065 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:12:32.625473 28109 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:32.728399 28109 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:32.729080 28370 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.735s	user 0.013s	sys 0.008s
I20260709 12:12:32.729395 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.730192 22123 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:32.730499 28109 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:32.710265 28202 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:32.731335 22123 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:12:32.731469 28202 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:32.733417 28240 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:32.734851 28217 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.606920 28247 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.739774 28247 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:32.713549 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.742244 22119 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:32.729110 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.743992 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:32.716244 28229 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:32.716658 28234 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:32.713615 27975 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:12:32.744670 22121 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:32.748026 22189 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
W20260709 12:12:32.750844 22163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.025s	sys 0.087s
W20260709 12:12:32.753284 22163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.025s	sys 0.087s
I20260709 12:12:32.753456 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:32.754026 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 667893us
I20260709 12:12:32.702023 28329 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:32.757460 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:32.758257 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:32.750500 28229 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:32.765890 28229 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:32.766213 28247 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:32.768180 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.769109 28234 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:32.769852 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:32.770110 28234 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:32.770741 28247 raft_consensus.cc:2764] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:12:32.772200 28247 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:32.768885 28346 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:32.775015 22272 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:12:32.775209 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:32.776142 22263 raft_consensus.cc:2410] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:12:32.776185 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.777873 22192 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:32.778734 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.777216 22264 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:32.784654 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:32.785861 22263 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:32.788146 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:32.789106 22271 raft_consensus.cc:2410] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
W20260709 12:12:32.789659 22862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.009s	sys 0.011s
W20260709 12:12:32.790128 22862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.009s	sys 0.012s
I20260709 12:12:32.733510 28202 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:32.797650 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:32.796140 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:32.748880 28340 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:32.800863 22263 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:12:32.803285 22197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.014s	sys 0.010s
I20260709 12:12:32.804380 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:32.807809 22197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.014s	sys 0.011s
I20260709 12:12:32.808501 22267 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:32.810412 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:32.811566 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.789295 28346 consensus_queue.cc:1243] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:12:32.815558 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:32.823449 22267 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:32.825580 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:32.801538 28259 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:32.834355 28373 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:12:32.819892 28247 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.819588 28109 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:32.848230 28348 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:32.821599 28227 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.849253 28227 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:32.845090 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:32.852416 28348 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:32.853228 28348 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:32.854532 28348 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:32.852449 28109 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:32.857369 28109 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:32.851569 28227 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:32.868302 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:32.828850 28329 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.879941 28329 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:32.840939 28356 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:32.858562 28331 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 12:12:32.884729 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.888852 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:32.899914 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:32.827904 28320 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:12:32.833998 28259 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:32.929090 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:32.912389 22198 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.007s	sys 0.014s
W20260709 12:12:32.930867 22198 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.007s	sys 0.014s
I20260709 12:12:32.886430 28331 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:32.883950 28340 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:32.882345 28329 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:32.887140 28323 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:32.934828 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:32.980221 22264 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:32.881152 28346 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:32.901803 28264 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:32.940213 27951 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:32.943650 22114 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:32.901854 28204 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:32.943360 28229 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:32.910588 28347 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:12:32.887110 28350 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:12:32.952589 22190 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:12:32.937471 28331 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:32.880681 28262 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.985265 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:32.934434 28259 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.878611 28247 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:32.885947 28319 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:32.982194 28130 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.006s	sys 0.027s
I20260709 12:12:32.936607 28376 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:33.050127 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64984us
W20260709 12:12:33.051129 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 473885us
I20260709 12:12:33.010227 28040 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.097105 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.033951 28264 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.986400 28323 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:33.057049 28130 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.007s	sys 0.032s
I20260709 12:12:33.000080 28346 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.049373 28376 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.124487 22831 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:12:33.131577 22237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.013s
I20260709 12:12:33.131662 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:33.132139 22237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.000s	sys 0.013s
I20260709 12:12:33.132354 22264 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
W20260709 12:12:33.132975 22195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.002s	sys 0.011s
I20260709 12:12:33.039366 28204 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:12:33.036115 28262 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.098667 28374 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:33.173139 28239 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.177866 28374 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.178433 28374 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:33.179163 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 490855us
I20260709 12:12:33.179800 28262 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.134313 28282 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:33.182507 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.183077 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.181982 28282 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:33.183764 28282 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:33.184571 22119 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:12:33.186854 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:33.187630 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 487830us
W20260709 12:12:33.098155 28205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.176s	user 0.031s	sys 0.054s
W20260709 12:12:33.188512 28205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.266s	user 0.031s	sys 0.057s
W20260709 12:12:33.133363 22195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.002s	sys 0.012s
I20260709 12:12:33.122368 27892 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:33.130986 28331 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.191511 28331 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:33.192757 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2586) took 1061 ms. Trace:
I20260709 12:12:33.167948 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:33.193459 22189 rpcz_store.cc:276] 0709 12:12:32.131254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.696756 (+565502us) service_pool.cc:224] Handling call
0709 12:12:33.192454 (+495698us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b54002373d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:33.192652 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115730688}
I20260709 12:12:33.178424 28239 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.123421 28333 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.181182 22117 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:33.195642 22119 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:33.196080 22189 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:12:33.163632 22191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.013s
I20260709 12:12:33.187700 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:33.198676 22191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.000s	sys 0.014s
I20260709 12:12:33.133299 28376 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:33.176354 22190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37260 (request call id 1586) took 1287 ms (client timeout 1557 ms). Trace:
I20260709 12:12:33.103467 28040 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.096073 28217 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.203543 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:33.170217 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:33.216235 22861 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
W20260709 12:12:33.200263 22190 rpcz_store.cc:269] 0709 12:12:31.888641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.893263 (+  4622us) service_pool.cc:224] Handling call
0709 12:12:33.176092 (+1282829us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000fcdd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:33.176265 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328887040}
I20260709 12:12:33.201391 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.208163 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2583) took 1115 ms. Trace:
I20260709 12:12:33.218614 22189 rpcz_store.cc:276] 0709 12:12:32.092856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.195228 (+1102372us) service_pool.cc:224] Handling call
0709 12:12:33.195644 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.196652 (+  1008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.208071 (+ 11419us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:33.220052 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 316334us
I20260709 12:12:33.221801 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:33.228749 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:33.230369 22829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.004s	sys 0.017s
W20260709 12:12:33.230746 22829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.005s	sys 0.017s
I20260709 12:12:33.214150 28218 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:33.236967 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:33.240161 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:33.249070 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:33.249890 22863 raft_consensus.cc:2410] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:12:33.232764 28181 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:33.255837 22864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:33.256624 22864 raft_consensus.cc:606] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.216394 28217 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.235142 28329 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:33.243522 28234 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.281420 27951 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.248473 27794 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.292618 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1591) took 1015 ms. Trace:
I20260709 12:12:33.293526 22190 rpcz_store.cc:276] 0709 12:12:32.277637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.257449 (+979812us) service_pool.cc:224] Handling call
0709 12:12:33.292127 (+ 34678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.292302 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.292330 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.292371 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:33.292399 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.292455 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.292551 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:33.295281 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1589) took 1018 ms. Trace:
I20260709 12:12:33.295995 22189 rpcz_store.cc:276] 0709 12:12:32.276951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.228116 (+951165us) service_pool.cc:224] Handling call
0709 12:12:33.246560 (+ 18444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.246807 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.291361 (+ 44554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.294113 (+  2752us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:33.294252 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.294439 (+   187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.295056 (+   617us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:33.263616 28181 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.251343 28379 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.251690 28236 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:33.247702 28381 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:33.316551 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 94888.6us
I20260709 12:12:33.317977 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:33.294879 28229 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.328647 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:33.342093 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:33.346658 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2504) took 1149 ms. Trace:
I20260709 12:12:33.313347 28181 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.258301 28218 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.347239 22114 rpcz_store.cc:276] 0709 12:12:32.197201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.226498 (+ 29297us) service_pool.cc:224] Handling call
0709 12:12:33.346440 (+1119942us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54002ac6d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:33.346586 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633073024}
I20260709 12:12:33.343778 28347 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:33.331192 28379 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.354823 28379 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.291735 28329 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.357265 28323 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:33.341483 28381 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.358501 28329 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.360368 28381 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:33.361435 28385 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:12:33.363344 28184 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:33.363608 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2996) took 1291 ms. Trace:
I20260709 12:12:33.327936 28374 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.352510 28347 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:33.373301 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.326694 28319 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:33.347227 28377 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:12:33.326983 28394 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:33.294234 28234 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.378791 22197 rpcz_store.cc:276] 0709 12:12:32.072281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.091484 (+ 19203us) service_pool.cc:224] Handling call
0709 12:12:32.091819 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.808419 (+716600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.808601 (+   182us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.820971 (+ 12370us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.228098 (+407127us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:33.248602 (+ 20504us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.248946 (+   344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.249053 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.363337 (+114284us) raft_consensus.cc:1685] finished
0709 12:12:33.363362 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.363527 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24194,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":58,"raft.queue_time_us":19733,"spinlock_wait_cycles":300636288,"thread_start_us":1041626,"threads_started":2,"wal-append.queue_time_us":446219}
I20260709 12:12:33.385020 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.303565 27794 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.346515 28205 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:33.377776 28380 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:12:33.388757 22197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
W20260709 12:12:33.389146 28383 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:12:33.390842 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2577) took 1352 ms. Trace:
I20260709 12:12:33.391454 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2505) took 1157 ms. Trace:
I20260709 12:12:33.393097 28234 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.393091 28239 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.394214 22862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 923) took 1283 ms. Trace:
I20260709 12:12:33.394448 28217 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.395035 28346 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.398623 28259 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.380344 28229 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:33.341938 28247 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.333565 28236 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.455076 28239 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:33.455758 28239 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.457875 27794 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.458220 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2998) took 1382 ms. Trace:
I20260709 12:12:33.414858 28282 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.444839 28323 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:33.437358 22196 rpcz_store.cc:276] 0709 12:12:32.038205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.040871 (+  2666us) service_pool.cc:224] Handling call
0709 12:12:33.390641 (+1349770us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b5400109fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:33.390784 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053157248}
I20260709 12:12:33.462280 28259 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.465039 28264 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:33.457923 28239 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.414175 28140 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:33.453896 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3000) took 1377 ms. Trace:
I20260709 12:12:33.436326 22115 rpcz_store.cc:276] 0709 12:12:32.234505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.235093 (+   588us) service_pool.cc:224] Handling call
0709 12:12:33.391299 (+1156206us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b540012b1d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:33.391402 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129981824}
I20260709 12:12:33.381070 28184 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:33.416939 28382 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:33.417660 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:33.378571 28348 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:12:33.444584 22862 rpcz_store.cc:276] 0709 12:12:32.110635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.110793 (+   158us) service_pool.cc:224] Handling call
0709 12:12:32.117695 (+  6902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.125606 (+  7911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.125650 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.126204 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:12:32.790556 (+664352us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:32.790611 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.790737 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.393976 (+603239us) raft_consensus.cc:1685] finished
0709 12:12:33.393998 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.394133 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17523,"raft.queue_time_us":20066,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":85356,"thread_start_us":663997,"threads_started":1,"wal-append.queue_time_us":889449}
I20260709 12:12:33.452788 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:33.413867 28109 consensus_meta.cc:287] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.000s
I20260709 12:12:33.458710 22193 rpcz_store.cc:276] 0709 12:12:32.075434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.111967 (+ 36533us) service_pool.cc:224] Handling call
0709 12:12:32.112309 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:32.142376 (+ 30067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.142416 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:32.230521 (+ 88105us) log.cc:844] Serialized 52 byte log entry
0709 12:12:32.820413 (+589892us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:32.820456 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.820521 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.457986 (+637465us) raft_consensus.cc:1685] finished
0709 12:12:33.458010 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.458158 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29581,"raft.queue_time_us":117592,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":11370,"thread_start_us":459252,"threads_started":1,"wal-append.queue_time_us":674129}
I20260709 12:12:33.460520 28282 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.486805 28229 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:33.488020 22193 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:12:33.487852 28229 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.488478 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 2999) took 1412 ms. Trace:
I20260709 12:12:33.489023 22194 rpcz_store.cc:276] 0709 12:12:32.075695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.084191 (+  8496us) service_pool.cc:224] Handling call
0709 12:12:33.488266 (+1404075us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400142dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:33.488405 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949567616}
I20260709 12:12:33.490794 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2593) took 1058 ms. Trace:
I20260709 12:12:33.491498 22197 raft_consensus.cc:606] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.491927 22197 raft_consensus.cc:614] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:33.441867 28205 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:33.491204 22190 rpcz_store.cc:276] 0709 12:12:32.433013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.323617 (+890604us) service_pool.cc:224] Handling call
0709 12:12:33.345408 (+ 21791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.366630 (+ 21222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.366676 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.381501 (+ 14825us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.470106 (+ 88605us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:33.488996 (+ 18890us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.489261 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.490344 (+  1083us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b54001bf8d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:33.490387 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.490433 (+    46us) raft_consensus.cc:1685] finished
0709 12:12:33.490528 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.490739 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12598,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":2151,"spinlock_wait_cycles":47686912,"thread_start_us":67532,"threads_started":1,"wal-append.queue_time_us":63701}
W20260709 12:12:33.468977 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 126964us
I20260709 12:12:33.467375 22192 rpcz_store.cc:276] 0709 12:12:32.075945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.842542 (+766597us) service_pool.cc:224] Handling call
0709 12:12:32.842936 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.843126 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:33.226344 (+383218us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.453412 (+227068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.453473 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:33.453523 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.453613 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.453809 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2987,"prepare.queue_time_us":370134,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":78,"raft.queue_time_us":4513,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":102,"thread_start_us":559743,"threads_started":2}
W20260709 12:12:33.442714 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57939.3us
I20260709 12:12:33.500674 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:33.421720 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.502121 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:33.466806 28140 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:33.507150 28140 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.508380 28140 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:33.475181 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:33.502774 28205 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:33.410529 28347 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:33.409050 28374 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.388810 28393 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:33.485466 28181 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.468811 22272 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:12:33.518683 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 177771us
I20260709 12:12:33.522020 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2991) took 1452 ms. Trace:
I20260709 12:12:33.522488 22191 rpcz_store.cc:276] 0709 12:12:32.069783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.070054 (+   271us) service_pool.cc:224] Handling call
0709 12:12:32.070399 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:32.615477 (+545078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.615508 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:32.637895 (+ 22387us) log.cc:844] Serialized 52 byte log entry
0709 12:12:33.206025 (+568130us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:33.286804 (+ 80779us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.519767 (+232963us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.521719 (+  1952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.521796 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.521837 (+    41us) raft_consensus.cc:1685] finished
0709 12:12:33.521848 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.521967 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200710,"prepare.queue_time_us":7647,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":69572,"raft.run_cpu_time_us":5321,"raft.run_wall_time_us":95534,"spinlock_wait_cycles":51072,"thread_start_us":1293971,"threads_started":4,"wal-append.queue_time_us":598826}
I20260709 12:12:33.498335 28109 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.541771 28393 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.491398 28382 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.511618 28264 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:33.514297 28226 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:33.564303 28181 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.564795 28319 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:33.593338 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:33.565750 28376 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.569257 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.596479 28140 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:33.596961 22162 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.598318 22863 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:12:33.598430 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.600490 22858 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:33.591544 28411 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:12:33.571434 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.573167 22272 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:33.605592 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:33.603493 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:33.576048 28347 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:33.576733 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:33.585973 28403 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:33.579136 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.580340 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:33.580994 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:33.613607 22119 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:33.614094 22268 raft_consensus.cc:2393] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 17: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:33.514595 28394 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:33.582332 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.584090 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:33.584435 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.585450 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.589380 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:33.617544 28347 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.622742 28347 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:33.627413 28236 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.593509 22862 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:33.543787 28184 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.593956 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:33.631004 22861 raft_consensus.cc:2393] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 17: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:33.618968 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.590368 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:33.577837 22263 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:33.632804 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:33.633565 22263 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:33.569657 28205 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.607813 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:33.609212 22831 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:33.606470 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:33.598241 28356 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:33.623171 27794 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:33.606102 28405 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:33.624085 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:33.623742 28403 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.622754 28382 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:33.623108 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:33.675289 22191 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.625094 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.611192 28234 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 12:12:33.625768 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:33.684728 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:33.592518 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 90477.4us
I20260709 12:12:33.685900 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.619916 22120 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:33.603863 22265 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:33.645547 22272 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.647508 22860 raft_consensus.cc:606] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.650913 22266 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:33.619791 28404 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:12:33.595605 28226 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.654409 28376 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.656117 28109 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.663146 28393 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.664728 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2594) took 1210 ms. Trace:
I20260709 12:12:33.704025 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:33.703356 22189 rpcz_store.cc:276] 0709 12:12:32.454043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.411588 (+957545us) service_pool.cc:224] Handling call
0709 12:12:33.412027 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.442835 (+ 30808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.442875 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.449470 (+  6595us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.589670 (+140200us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:33.608099 (+ 18429us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.641882 (+ 33783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.642005 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.664461 (+ 22456us) raft_consensus.cc:1685] finished
0709 12:12:33.664481 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.664648 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63786,"prepare.queue_time_us":17812,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":40,"raft.queue_time_us":64983,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":27009,"thread_start_us":129499,"threads_started":1,"wal-append.queue_time_us":170140}
I20260709 12:12:33.665310 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:33.668193 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:33.673599 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:33.679364 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60476.6us
I20260709 12:12:33.708164 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:33.691429 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 101115us
I20260709 12:12:33.692015 22263 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:33.709695 22272 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:33.602015 28319 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.684382 28184 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:33.693768 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:33.696425 28384 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.377s	user 0.004s	sys 0.000s
W20260709 12:12:33.688262 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45031us
I20260709 12:12:33.713903 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:33.728147 22263 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:12:33.714617 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:33.720249 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:33.723881 27533 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:33.730232 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.697240 28382 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:33.724288 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.690078 28213 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:33.747056 28213 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:33.747562 28213 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:33.697503 28374 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:33.733160 28068 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:33.725013 22191 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:33.749500 28068 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:33.750483 28068 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.734149 28217 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:33.734702 28330 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:33.753692 28330 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:33.754592 28205 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:33.754684 28330 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.737099 28400 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:33.757073 28400 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.738819 28226 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.760195 28400 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.760442 28403 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.733471 28404 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:33.765376 28319 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:33.731673 28393 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:33.765527 28404 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.766696 28331 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:12:33.741752 28140 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:33.672905 27794 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.666994 28130 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:12:33.733418 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.770644 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.730232 22162 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:33.772557 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 48358.9us
I20260709 12:12:33.776312 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:33.775173 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45020.4us
W20260709 12:12:33.777349 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 44028.8us
I20260709 12:12:33.783985 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.784636 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.785007 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:33.785403 22122 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 17: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:33.785753 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.785423 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:33.786509 22119 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:33.786602 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.785748 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:33.787425 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:33.785808 22268 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:33.788192 22263 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.789156 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.786016 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.794061 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.794167 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.796236 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:33.793977 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:33.801014 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.801255 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:33.803638 22190 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:33.804895 22120 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:33.805976 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:33.806286 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.807337 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:33.808894 22192 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:33.811765 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.812083 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.812358 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:33.811175 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.812909 22194 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:33.812407 22197 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:33.813390 22196 raft_consensus.cc:2410] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:12:33.779043 28346 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:33.773773 28393 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:33.818962 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:33.819288 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.816131 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:33.819777 22263 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:33.818040 22191 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:12:33.836279 28346 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.836796 28346 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:33.837698 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:33.809053 28130 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:33.816124 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3001) took 1739 ms. Trace:
I20260709 12:12:33.817533 28109 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:33.817411 28382 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:33.805127 28335 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:33.854442 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:33.823552 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:33.774931 28181 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:33.778151 28319 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:33.841279 28264 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:12:33.797380 28140 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:12:33.828966 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.829735 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.831264 22194 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:33.831321 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.833171 27794 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.809329 28205 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:33.851027 28227 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:33.882037 28227 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.867640 27951 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:33.886307 28040 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.857288 28335 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.887400 28335 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:33.861351 28181 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:33.891700 28181 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.844883 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:33.893167 22193 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:33.873018 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.842767 22198 rpcz_store.cc:276] 0709 12:12:32.076594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.983614 (+907020us) service_pool.cc:224] Handling call
0709 12:12:32.984083 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.988713 (+  4630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.988794 (+    81us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.989626 (+   832us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.628971 (+639345us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b1800476440. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:12:33.772177 (+143206us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:33.772215 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.772278 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.800174 (+ 27896us) raft_consensus.cc:1685] finished
0709 12:12:33.800192 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.816065 (+ 15873us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29322,"raft.queue_time_us":8987,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":3853,"spinlock_wait_cycles":29411200,"thread_start_us":143034,"threads_started":1,"wal-append.queue_time_us":789811}
I20260709 12:12:33.894690 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.851768 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:33.815420 28404 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.857977 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:33.826349 28393 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.857285 28130 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:33.827682 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.828859 28394 raft_consensus.cc:2764] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:33.881843 28213 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:33.891098 28184 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:33.814617 28376 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:33.855861 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:33.868194 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:33.907924 22271 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:33.909708 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 51830us
I20260709 12:12:33.910043 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:33.882083 28395 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.564s	user 0.004s	sys 0.000s
I20260709 12:12:33.866106 28388 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:33.936527 28388 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.937032 28388 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.937678 28376 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:33.938648 28376 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.942358 28213 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:33.943061 28184 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.945504 28184 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:33.946928 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 2997) took 1874 ms. Trace:
I20260709 12:12:33.914573 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:33.915830 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 88253.3us
I20260709 12:12:33.859771 28329 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:12:33.923274 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:33.925201 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57116.8us
I20260709 12:12:33.950627 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.920995 28281 raft_consensus.cc:993] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:33.900476 28104 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:33.924569 28205 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:33.928493 28247 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:33.930398 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 3739) took 1002 ms. Trace:
I20260709 12:12:33.947325 22195 rpcz_store.cc:276] 0709 12:12:32.072614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.111018 (+ 38404us) service_pool.cc:224] Handling call
0709 12:12:32.111355 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.346347 (+234992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.346386 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.346801 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.189273 (+842472us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:33.189313 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.624391 (+435078us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:33.946609 (+322218us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54001f3bd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:33.946662 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.946706 (+    44us) raft_consensus.cc:1685] finished
0709 12:12:33.946719 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.946858 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75986,"raft.queue_time_us":76709,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":383143552,"thread_start_us":791348,"threads_started":1,"wal-append.queue_time_us":860307}
I20260709 12:12:33.951000 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:33.952994 27541 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:33.953603 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.884593 28227 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.908900 28393 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:33.964741 22266 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 17: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:33.964907 22267 rpcz_store.cc:276] 0709 12:12:32.928202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.930417 (+  2215us) service_pool.cc:224] Handling call
0709 12:12:32.944629 (+ 14212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.945002 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.945041 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.945867 (+   826us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.230168 (+284301us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:33.230206 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.230289 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.881343 (+651054us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:33.930143 (+ 48800us) raft_consensus.cc:1685] finished
0709 12:12:33.930161 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.930340 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12129536,"thread_start_us":283815,"threads_started":1,"wal-append.queue_time_us":372044}
W20260709 12:12:33.970136 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46936.3us
W20260709 12:12:33.968719 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 54261us
I20260709 12:12:33.976434 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:33.921473 28404 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:33.899547 28334 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:33.980593 22116 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:33.982810 27541 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:33.924710 28130 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:33.983233 27541 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:33.985989 27541 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:33.986342 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:33.988193 22162 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:33.954432 28247 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.967219 28281 raft_consensus.cc:1081] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:33.982659 28401 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:33.994729 28128 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:33.978883 28355 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:33.993247 27541 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:33.993038 28264 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:33.977062 28184 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:33.954523 28394 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:12:33.982659 28205 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:33.988287 28140 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.018390 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:34.011818 28213 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:12:33.983776 28262 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:12:34.000059 28247 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:34.021867 28335 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.002789 28401 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.996500 28130 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.024425 28218 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:33.962440 28104 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.026196 28227 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:34.029064 27892 raft_consensus.cc:993] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
W20260709 12:12:34.031682 28418 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:34.035017 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:34.037140 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:33.985137 28334 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.042613 27541 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:34.042294 28205 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.108110 27533 raft_consensus.cc:1081] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:34.041651 22162 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:34.104912 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:34.107318 22196 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:34.050422 28381 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:34.055670 28227 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:34.121939 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 80384.5us
I20260709 12:12:34.126720 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:34.127697 27541 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:34.121858 28040 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:34.123071 28381 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:34.136384 28262 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:34.135800 28388 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:34.213251 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 232617us
W20260709 12:12:34.212941 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 223298us
I20260709 12:12:34.229444 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.232191 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:34.233825 22263 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:34.235077 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:34.147495 28346 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:34.237521 22263 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:34.239391 22862 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:34.239665 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.240588 27533 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:34.244256 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:34.214951 28404 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.256255 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:34.262193 22189 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:34.228366 28341 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 12:12:34.227212 28239 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:12:34.251165 28403 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:34.255194 28130 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.290490 22267 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:34.283627 28128 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:34.306027 28104 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.261569 28404 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:34.300680 28422 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:12:34.290477 28334 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.297566 28130 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.293834 28335 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.055363 28401 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.315157 28181 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:34.329154 28140 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:34.329551 28423 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:12:34.329954 28388 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.335824 28404 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.284233 28227 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.346917 28401 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.343109 28393 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.336130 28247 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.279663 28381 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:34.353008 28393 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:34.354104 28227 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.354728 28247 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:34.395515 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 141683us
W20260709 12:12:34.396813 22088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.508s (SENT) [suppressed 6 similar messages]
I20260709 12:12:34.409859 22198 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:34.311939 28040 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:34.438202 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:34.442080 22269 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:34.447788 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.449348 22270 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:34.452016 22123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:34.455353 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.460655 28247 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:34.462270 28247 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.463735 22118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:34.464570 22118 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.465123 22118 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:34.465693 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:34.475040 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:34.450609 22861 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:34.486030 28401 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:34.487455 28401 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.483126 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:34.500576 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 104035us
I20260709 12:12:34.504354 22123 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.506543 22123 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:34.520239 22268 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:34.520663 28130 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.522850 22268 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:34.523594 28438 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:34.525509 22269 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:34.527941 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.529110 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:34.538343 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.539994 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.538568 22272 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:34.543412 28438 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.572880 28335 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:34.577250 28217 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.578234 28217 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.581331 28217 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.581375 28439 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:12:34.585820 22270 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:34.587910 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.589025 22270 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:34.590404 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.595047 28331 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:34.607040 28331 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:34.610836 28331 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.612680 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.614267 22264 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:34.616676 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.619258 22123 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:34.620803 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.565474 28401 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.556731 28438 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.638806 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:34.639838 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:34.638008 22121 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:34.648814 28215 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.652102 28130 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:34.567471 28247 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.635438 22118 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:34.633358 22123 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:34.662892 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.663832 22270 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:34.660454 28130 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.666556 28130 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:34.669992 22120 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:12:34.671941 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:34.673933 28259 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:34.674439 28259 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:34.682353 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:34.664599 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.687793 22114 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:34.689175 28215 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:34.696980 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.697582 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:34.698127 28215 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.719511 22272 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:34.723289 22267 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:34.728210 28381 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:34.735208 28394 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.735704 28181 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:34.698460 22264 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:34.700199 22116 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 20: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:34.675997 28259 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:34.730154 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 1941) took 1312 ms. Trace:
I20260709 12:12:34.744989 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:34.746467 22122 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:34.747076 28184 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.751808 22267 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:12:34.763059 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.762815 28184 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.780442 22266 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:34.783215 28184 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.785401 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:34.787410 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:34.787626 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:34.788285 22857 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:34.788666 22857 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:34.789806 22857 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:34.736120 28394 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.791129 22857 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:34.743495 22265 rpcz_store.cc:276] 0709 12:12:33.417653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.417773 (+   120us) service_pool.cc:224] Handling call
0709 12:12:33.418070 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.689438 (+271368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.729619 (+1040181us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54002288d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:34.729942 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424932224}
I20260709 12:12:34.765303 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:34.793677 22120 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:34.790621 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:34.794854 22860 raft_consensus.cc:606] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:34.777614 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:34.779958 22864 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:34.787923 22865 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:34.776826 22114 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:34.803936 22267 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:34.802345 28346 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:34.809271 22118 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:34.793561 28259 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:34.809563 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52832.9us
I20260709 12:12:34.818854 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:34.822425 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:34.825142 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:34.825183 22266 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:34.827620 28394 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:34.830282 22020 catalog_manager.cc:5697] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 8 to 9, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 9 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:34.832688 22857 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:34.835367 28215 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:34.838197 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:34.840396 22120 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:34.846815 22860 raft_consensus.cc:606] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:34.852838 22118 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:34.847365 22860 raft_consensus.cc:614] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:34.854111 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:34.860881 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:34.842871 28394 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.864789 28394 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.882954 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 275) took 10137 ms. Trace:
I20260709 12:12:34.888249 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:34.873684 28215 consensus_queue.cc:1243] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:34.889242 22116 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 19: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:34.889454 28437 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:34.889890 28437 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:34.891187 28437 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.893206 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:34.893934 22116 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:34.894731 28331 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:34.895449 28215 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:34.896659 28401 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:34.880074 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:34.900933 28401 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:34.906607 28184 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.914093 28184 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.909888 28264 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.915158 28264 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.911113 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:34.922415 28264 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:34.922540 28401 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.924152 28401 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:34.925177 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:34.927012 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:34.929124 28347 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:34.929572 28347 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:34.929944 28347 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:34.898793 22020 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 13 to 15, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:34.902089 28437 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:34.936682 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:34.916553 28184 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.928665 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:34.953152 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:34.952172 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:12:34.964924 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:34.965337 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 144914us
I20260709 12:12:34.933032 28215 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:34.967437 28215 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:34.970221 28215 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:34.972685 22865 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:34.973250 22865 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:34.974246 22865 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:34.975697 22865 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:34.977985 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:34.883427 22017 rpcz_store.cc:276] 0709 12:12:24.745462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.745724 (+   262us) service_pool.cc:224] Handling call
0709 12:12:34.882695 (+10136971us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:28.082047 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:28.082768 (+   721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:28.082821 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:12:28.082847 (+    26us) tablet.cc:662] Decoding operations
0709 12:12:28.084428 (+  1581us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:28.084509 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:28.084550 (+    41us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:12:28.258709 (+174159us) tablet.cc:701] Row locks acquired
0709 12:12:28.258725 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:12:28.258876 (+   151us) write_op.cc:270] Start()
0709 12:12:28.259000 (+   124us) write_op.cc:276] Timestamp: P: 1783599148258827 usec, L: 0
0709 12:12:28.259018 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:12:28.259716 (+   698us) log.cc:844] Serialized 5222 byte log entry
0709 12:12:29.027704 (+767988us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:29.241166 (+213462us) op_driver.cc:464] REPLICATION: finished
0709 12:12:29.651173 (+410007us) write_op.cc:301] APPLY: starting
0709 12:12:29.656817 (+  5644us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:30.195934 (+539117us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:30.195968 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:31.068284 (+872316us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:31.068572 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:12:31.068628 (+    56us) write_op.cc:312] APPLY: finished
0709 12:12:31.069132 (+   504us) log.cc:844] Serialized 121 byte log entry
0709 12:12:31.069396 (+   264us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:31.069588 (+   192us) write_op.cc:454] Released schema lock
0709 12:12:31.069645 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:31.070108 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:31.070135 (+    27us) write_op.cc:454] Released schema lock
0709 12:12:31.623695 (+553560us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b18003991c0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd5522 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
Metrics: {"mutex_wait_us":2553,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":396150,"apply.run_cpu_time_us":27204,"apply.run_wall_time_us":1423824,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58493,"num_ops":13,"prepare.queue_time_us":666251,"prepare.run_cpu_time_us":60983,"prepare.run_wall_time_us":407008,"raft.queue_time_us":101801,"raft.run_cpu_time_us":25765,"raft.run_wall_time_us":225700,"replication_time_us":981857,"spinlock_wait_cycles":30600320,"thread_start_us":726661,"threads_started":4,"wal-append.queue_time_us":802135,"wal-append.run_cpu_time_us":16992,"wal-append.run_wall_time_us":2735656}]]}
I20260709 12:12:34.985155 22865 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:34.988731 28382 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:34.989292 28382 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:34.989681 28382 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:34.990334 28184 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:34.991160 28184 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:34.993137 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:34.995210 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:34.993474 28407 consensus_queue.cc:1059] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:34.996167 22020 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:34.995884 22860 raft_consensus.cc:606] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:34.999941 22860 raft_consensus.cc:614] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:34.998452 28394 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:35.011508 22007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 76963.4us
I20260709 12:12:34.998720 28264 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:35.015789 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.016307 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:35.017066 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:35.018821 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:35.013737 28264 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:35.019585 22196 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:35.023308 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:35.025909 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:35.021340 28068 consensus_queue.cc:1059] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:12:35.028082 28068 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:35.028890 28068 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:35.024055 28264 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:35.026065 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.032090 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:35.034721 28281 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:35.036093 28023 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:35.036545 28023 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:35.037509 28023 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:35.039753 28184 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:35.048971 28331 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:35.049479 28331 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:35.049773 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:35.050616 28331 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:35.052448 28331 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:35.053045 28040 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:35.065344 28040 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.065918 28040 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:35.054714 22007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f1b154b48c54be6b421b01ed436bf21 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 164596fc2efa450581a5b68cad62271f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:35.070200 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:35.071152 28381 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:12:35.073056 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:35.057279 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45877.5us
I20260709 12:12:35.076005 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:35.058393 22020 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:35.082324 22020 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 14 to 15, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:35.059331 28068 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:35.063374 28130 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:35.056809 22269 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:35.074640 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:35.113426 22272 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:35.052917 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:35.110461 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 181980us
I20260709 12:12:35.039788 28023 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:35.126889 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:35.116130 28215 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:35.139662 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:35.143078 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:35.149834 22192 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:35.150871 22196 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:12:35.154589 28205 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:35.154858 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:35.138747 28130 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:35.163801 22020 catalog_manager.cc:5697] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 13 to 15, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:35.189731 22120 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:35.190205 22120 pending_rounds.cc:85] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 12
I20260709 12:12:35.190414 22120 pending_rounds.cc:107] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:35.190730 22120 raft_consensus.cc:2889] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:35.160146 28215 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:35.194428 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 68945.1us
I20260709 12:12:35.205982 27794 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:12:35.207670 28382 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:35.190687 28403 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:12:35.209715 28403 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:35.210108 28403 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:35.224107 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.227761 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:35.233965 28382 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:35.235046 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:35.235347 28040 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:35.236861 28330 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:35.228945 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:35.244079 22189 raft_consensus.cc:2368] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 20. Current term is 21.
I20260709 12:12:35.256126 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:35.269217 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:35.270295 22197 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:35.274699 28068 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:35.276569 22196 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:35.288043 22269 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:35.256072 28259 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:35.211185 28403 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:35.310096 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:35.254420 22020 catalog_manager.cc:5697] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 13 to 15, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:35.312676 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:35.331841 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:35.345837 22020 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:35.351531 22191 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:35.327425 28382 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:35.355502 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:35.359366 28405 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:12:35.361956 28227 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.899s	user 0.018s	sys 0.002s
I20260709 12:12:35.362895 28227 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:35.363034 22123 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:12:35.363615 22123 pending_rounds.cc:85] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 9
I20260709 12:12:35.363886 22123 pending_rounds.cc:107] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:12:35.364121 22123 raft_consensus.cc:2889] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:35.364959 28333 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:35.366004 28333 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:35.366451 28333 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:35.367681 28333 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:35.372303 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 89793.5us
I20260709 12:12:35.373597 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:35.375317 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:35.376098 28403 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.343258 28040 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:35.382177 22192 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
W20260709 12:12:35.384912 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 84981.9us
I20260709 12:12:35.387791 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:35.388298 22020 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:35.389814 22189 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260709 12:12:35.390105 22020 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 14 to 15, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:35.391613 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:35.392551 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:35.393525 22195 raft_consensus.cc:2410] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:12:35.394831 22195 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:35.396526 22196 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:35.398084 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:35.336426 27794 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:35.403644 22195 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:35.329563 28281 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:12:35.387889 22830 leader_election.cc:400] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 20. Current term is 21.
I20260709 12:12:35.391924 22020 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 13 to 15, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:35.408571 28437 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:35.410820 22198 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:35.404024 28205 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:35.414671 22830 leader_election.cc:403] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:12:35.428753 22114 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:12:35.445145 22114 pending_rounds.cc:85] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 7
I20260709 12:12:35.445797 22114 pending_rounds.cc:107] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:12:35.446133 22114 raft_consensus.cc:2889] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:35.429876 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:35.401338 28394 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:35.363626 28227 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:35.454375 22191 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:12:35.434234 28401 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.013s
W20260709 12:12:35.460112 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:35.465071 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:35.465611 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.468746 28215 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:35.469220 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.443113 28407 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:35.479979 22189 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:35.481103 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 105898us
I20260709 12:12:35.481894 28450 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:35.482170 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 94455.1us
I20260709 12:12:35.489992 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:35.495509 22196 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:35.487761 28264 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:35.453729 28394 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:35.504549 28264 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:35.505622 22267 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:35.509205 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 174546us
I20260709 12:12:35.509646 22197 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:35.514683 22190 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:12:35.514777 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:35.473867 28040 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:35.522894 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:35.524112 22118 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:35.526816 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:35.501794 28394 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:35.489065 27794 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:35.501438 28330 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
W20260709 12:12:35.553809 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 203342us
I20260709 12:12:35.549041 22118 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:35.562029 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:35.562917 22121 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:35.572085 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:35.572963 22123 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.522852 28407 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:35.569659 28184 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:35.596354 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 326040us
I20260709 12:12:35.572428 28259 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:35.557909 28040 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:35.610893 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57213.3us
I20260709 12:12:35.575832 28264 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 12:12:35.615228 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.625438 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:35.599218 28184 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:35.664248 22123 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:12:35.665462 28259 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:35.668783 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:35.677069 22115 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
W20260709 12:12:35.681604 28451 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:12:35.683080 28465 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:35.667928 28227 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:35.746918 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 146486us
W20260709 12:12:35.748896 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 123525us
I20260709 12:12:35.760367 28181 raft_consensus.cc:993] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:35.761103 28181 raft_consensus.cc:1081] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
W20260709 12:12:35.764891 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.770349 22263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:12:35.784291 22263 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:35.784814 22263 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.797003 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:35.802554 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 136310us
W20260709 12:12:35.832574 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:35.816269 28347 consensus_meta.cc:287] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.886s	user 0.012s	sys 0.006s
W20260709 12:12:35.838217 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 97568.4us
I20260709 12:12:35.829715 28264 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:35.845327 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:12:35.839294 28068 consensus_meta.cc:287] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.004s
I20260709 12:12:35.840386 28382 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:35.873649 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:35.846885 28264 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:35.843758 28401 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
W20260709 12:12:35.885213 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.852984 28040 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:35.888942 28477 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:12:35.891181 28454 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:35.891825 28468 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:12:35.873370 28333 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:35.887387 28471 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:35.877503 28264 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.842557 28347 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:35.863173 28382 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:35.875296 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:35.875834 28381 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.853637 28215 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 12:12:35.921170 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 128341us
I20260709 12:12:35.946672 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:35.914822 28454 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:35.862783 28455 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.221s
W20260709 12:12:35.940744 28403 consensus_meta.cc:287] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.564s	user 0.018s	sys 0.000s
I20260709 12:12:35.922920 28184 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:35.968869 22264 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:35.970883 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 130303us
I20260709 12:12:35.939394 28205 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.979000 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:35.918099 28437 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 12:12:35.984848 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:35.994771 28481 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 12:12:35.999934 22196 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.000s
I20260709 12:12:36.014961 22196 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:36.004585 28068 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.020488 28068 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.023715 28068 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:36.004925 28464 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.024868 28464 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.028168 28464 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.005327 28456 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.028949 28456 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.029366 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.030038 22266 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:36.031195 28456 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.031522 22831 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:36.006489 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.033089 28184 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:35.994801 28476 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.969415 28454 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.033819 28476 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.036142 28476 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.037878 22162 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.039427 28476 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:36.018867 22121 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:35.986775 28205 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:36.049325 28478 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:12:36.050779 28205 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:36.054986 28347 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:36.056102 28466 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 12:12:36.056785 28461 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.231s	user 0.000s	sys 0.002s
I20260709 12:12:36.064185 22264 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:35.964959 28381 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:36.065299 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 207163us
I20260709 12:12:36.062618 22162 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.070572 28205 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:36.013082 28259 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.014034 28403 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:36.072381 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 96936.7us
I20260709 12:12:36.074630 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:36.071725 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 104867us
W20260709 12:12:36.078542 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.073089 28464 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:36.083029 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.075592 28403 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.085765 28403 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.085843 28470 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:36.087378 28394 consensus_meta.cc:287] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.002s
I20260709 12:12:36.087908 28394 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.089215 22269 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:36.090435 28394 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:36.091368 28474 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:36.091877 28474 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:36.093010 28474 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.094646 28474 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:36.097395 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.102615 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:36.102803 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.111178 28475 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:36.115031 28407 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.080386 28476 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:36.083452 28437 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:36.072196 28259 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.085184 28464 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.107913 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:36.123607 28486 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.124565 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:36.128206 28381 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.129588 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.140143 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.130038 28259 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:36.118911 28437 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:36.131732 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.140530 22267 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:36.142895 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.142903 22196 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:36.119282 28394 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:36.139642 28464 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:36.144366 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:36.147686 22263 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.153538 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.142038 28215 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:36.158094 28495 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.158751 28495 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.160949 28457 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.163332 28264 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.163697 28454 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.154323 22118 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:12:36.152038 28486 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.167985 28486 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:36.174413 28382 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.175000 28407 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:36.175624 28382 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.176317 28405 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:36.147106 28476 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:36.176736 28405 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:36.176980 28476 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.177410 28476 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:36.177583 28487 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:36.178113 28487 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.178524 28487 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:36.182646 28450 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.664s	user 0.010s	sys 0.001s
I20260709 12:12:36.183082 28450 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 20. Current term is 21.
I20260709 12:12:36.185545 27794 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:36.177876 28405 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.188926 28493 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:12:36.189486 28259 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:36.190135 28493 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:36.190550 28493 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:36.192507 28437 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.193140 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:36.193470 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:36.194206 22863 raft_consensus.cc:2393] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:36.194121 28437 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:36.197263 22268 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:36.204196 22865 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:12:36.206969 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.191707 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:36.208038 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.213984 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.239437 22272 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
W20260709 12:12:36.239626 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48026.3us
I20260709 12:12:36.240929 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:36.228247 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.209997 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 52480.9us
I20260709 12:12:36.244132 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.245031 22271 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:36.249989 28264 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:36.147452 28403 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.252517 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:36.252734 28403 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:36.254886 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 130489us
I20260709 12:12:36.255414 28330 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:36.255910 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:36.212917 28184 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:36.258659 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:36.255925 28330 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.262897 28330 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.188963 28405 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:36.215503 28497 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.144s	user 0.002s	sys 0.000s
I20260709 12:12:36.280691 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:36.270859 22122 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:36.247695 28407 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:12:36.265797 28181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.003s	sys 0.026s
I20260709 12:12:36.211524 28215 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:36.247557 28486 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:36.290544 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.274617 28455 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:36.275568 28496 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:36.295497 28355 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:36.191793 28493 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:36.303020 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44471.3us
W20260709 12:12:36.288725 28181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.003s	sys 0.027s
I20260709 12:12:36.307086 22268 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:36.317766 28467 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:36.318277 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:36.319839 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.293208 28458 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:36.294021 28495 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.285120 28040 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:12:36.313656 28474 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:36.331383 28479 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:36.331641 28476 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.316309 28355 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.383296 28355 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:36.319134 28456 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:12:36.335187 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:36.385663 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50619.7us
I20260709 12:12:36.386787 28456 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:36.387576 28456 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:36.335836 28215 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.388381 28456 consensus_queue.cc:1243] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:36.338868 22263 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:36.340117 28454 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.387863 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:36.394183 28452 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:36.394667 28452 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:36.395531 28452 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.401913 28493 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.311421 28486 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.347188 28140 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:36.328512 28333 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:12:36.348680 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.353843 28227 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:36.357216 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:36.404066 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.407397 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.433590 22193 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:36.377045 28458 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.342187 28184 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:36.411928 28330 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.431041 28407 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:36.360167 28464 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.434298 22271 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:36.441397 22863 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:36.424141 28456 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:36.432061 28227 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:36.445410 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 153384us
I20260709 12:12:36.445500 22863 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:12:36.446831 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 59472us
I20260709 12:12:36.457571 22863 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.457940 28264 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:36.458870 28264 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:36.459297 28264 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:36.460021 28331 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:36.460471 28331 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:36.458349 28454 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:36.461225 28454 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.461508 28331 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.463258 28331 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.463541 28454 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.465214 28486 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:36.467057 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:36.467552 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 118957us
I20260709 12:12:36.468030 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:36.467708 28401 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:36.468860 28401 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.468876 28333 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:36.469972 22163 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:36.471210 28506 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:36.470028 28333 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:36.471630 28394 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:36.472095 28333 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.472528 28184 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:36.472942 28205 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:36.475431 28205 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:36.475802 28205 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:36.472175 28140 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:12:36.476608 28347 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:36.477094 28347 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:36.477545 28140 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:36.478075 28140 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:36.477977 28347 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.479534 28347 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.479480 28140 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.482263 28330 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:36.482142 28227 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.483393 28227 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.471697 28506 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.447268 28495 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:36.485119 28506 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.438721 28452 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.489804 28205 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.486723 28333 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.491171 28205 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:36.473004 28184 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.434602 28496 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:36.492722 28184 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.492900 28401 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.493117 28496 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.493602 28333 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.495764 28496 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:36.473330 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 85538.6us
I20260709 12:12:36.497972 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:36.499342 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:36.504896 28471 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:36.448868 28456 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:36.506705 28456 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.507848 28456 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:36.509306 28458 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.509961 28407 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:36.512715 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.513247 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.514153 28140 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:36.515532 22863 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.472287 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.520534 28506 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.521699 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:36.522418 22263 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.523334 28506 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:36.524302 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.524979 28495 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:36.526893 28476 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.529181 28464 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.531332 22863 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:36.533754 28259 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:36.564097 28401 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.538838 28264 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.567024 28264 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:36.568310 28347 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.569516 28347 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.579485 28184 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.555248 28495 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:36.562752 28394 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:36.562927 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 90706.3us
I20260709 12:12:36.563413 22263 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:36.580842 28347 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:36.549052 28487 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.554430 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:12:36.589418 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 308636us
I20260709 12:12:36.617758 22162 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:36.437696 28467 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:12:36.590227 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 141590us
W20260709 12:12:36.589686 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 71147.6us
W20260709 12:12:36.590415 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 141655us
W20260709 12:12:36.592564 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.619831 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65610.3us
I20260709 12:12:36.615209 28394 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:36.624887 28394 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.627542 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:36.620958 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.621585 28507 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:36.628115 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:36.630740 22271 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:36.634613 28184 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.635991 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.636924 22269 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:36.642299 28259 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:36.645880 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.646520 22118 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:36.648823 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:36.649690 28330 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:36.650082 28330 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:36.650432 28330 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.651213 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:36.651834 22863 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:36.652920 28068 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.654012 28068 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.656422 28068 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.653381 28506 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:36.658113 28506 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:36.659228 28506 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.630172 28507 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.660523 28330 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.661345 28507 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:36.664824 28330 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.665293 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:36.666448 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:36.666999 22268 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.652601 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.669684 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:36.671811 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:36.672422 22198 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:36.673808 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:36.674669 22269 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.685743 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:36.686165 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.686414 22118 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.688478 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.690315 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.691742 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:36.692229 22263 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:36.694056 22118 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:12:36.693930 28509 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:36.695534 28509 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.697713 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.697968 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:36.698630 22265 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:36.698788 22264 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.700043 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.700800 22121 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:12:36.702996 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:36.707698 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:36.712152 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.631574 28452 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:36.718155 22198 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:36.727576 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.727912 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.728580 22118 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:36.737315 22263 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:36.740437 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:36.746708 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.742175 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.748939 22121 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:36.729965 22830 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:36.715518 22237 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:36.740724 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:36.752292 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.753038 22264 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:36.751214 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.754598 22863 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:36.757855 22266 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:36.761412 22269 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:36.762861 22087 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:36.764094 22271 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:36.765892 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.768440 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.768558 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.738538 22268 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:36.768453 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:36.769330 22114 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:36.739336 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.745909 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:36.773481 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.773818 22263 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:36.774573 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 44704.5us
I20260709 12:12:36.714618 28509 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:36.775995 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:36.776611 22118 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.771327 28264 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:36.777235 28264 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:36.777910 28485 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:36.778133 28264 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.781870 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:36.784197 22270 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
W20260709 12:12:36.787775 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.752094 28454 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.800127 22163 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:36.801716 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.795446 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:36.796718 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:36.797715 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.803828 22269 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:12:36.799612 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68208.3us
W20260709 12:12:36.798179 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.753407 28496 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:36.805981 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.804471 28485 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:36.812104 28331 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.812672 28331 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.812871 28485 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.813567 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.814311 22196 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:36.814816 28331 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.808291 28470 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:36.808135 28476 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:36.811349 28496 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.817649 22117 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:36.812052 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:36.767050 28452 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:36.811978 22193 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:36.804531 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.824431 22267 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:12:36.819758 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.822168 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.820694 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:36.827123 22264 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:36.827514 22271 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.819977 22120 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:36.828836 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.791474 28464 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:36.832928 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:36.833578 22196 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.821715 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:36.829123 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:36.835287 22115 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.826704 22272 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:36.829877 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.836453 22265 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:36.830312 22267 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:36.830313 22263 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
W20260709 12:12:36.831295 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.831947 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:36.819468 28184 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.839967 22118 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:36.842268 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:36.842864 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:36.845062 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:36.837821 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:36.844288 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.842176 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:36.849143 22266 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:36.851409 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.808229 28511 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.855268 22264 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:12:36.850414 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:12:36.861977 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50891.1us
I20260709 12:12:36.846877 28464 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.872428 22271 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:36.846740 28470 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:36.846347 28476 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:36.852810 28205 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:36.876362 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.876380 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.881256 22121 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:36.883194 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.820289 28454 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.892532 22196 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:36.872303 28355 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:36.871456 28496 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:36.878026 28464 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:36.859247 28184 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.902179 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.905943 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:36.951623 22196 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:36.908252 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:36.914324 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.956254 22197 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:36.915488 28470 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:36.958964 28516 log.cc:927] Time spent T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:36.917445 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.918926 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:36.917479 28355 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:36.960081 22194 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
W20260709 12:12:36.929867 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.960743 27951 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.960073 22192 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:36.961604 27951 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.968271 22114 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:36.972905 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:36.975262 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:36.963343 28355 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.976815 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:36.932090 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 98239.2us
I20260709 12:12:36.988583 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:36.941803 28394 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:36.942498 28482 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.942989 28512 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:36.943457 28452 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.841713 28467 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:36.951742 22122 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.990943 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:36.997566 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 114469us
I20260709 12:12:36.863039 28511 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.005594 28476 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:36.953460 28493 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:37.024309 27951 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:37.059664 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47893.5us
I20260709 12:12:37.033701 28184 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:37.034085 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:37.034597 28487 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:37.075282 28386 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.010869 28181 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:37.076090 28386 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:37.042888 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 52075.8us
I20260709 12:12:37.077447 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:37.079890 28386 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:37.048933 28140 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:37.013857 28512 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.081301 28512 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:37.081233 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:37.082031 22267 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:37.039150 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:37.069528 22189 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
W20260709 12:12:37.070267 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 50431.1us
I20260709 12:12:36.913236 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:37.073875 22190 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
W20260709 12:12:37.074407 22088 leader_election.cc:336] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.508s (SENT)
I20260709 12:12:37.076788 28181 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:37.051750 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:37.089641 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:37.093412 22197 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:37.112319 22114 raft_consensus.cc:2368] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13.
I20260709 12:12:37.093317 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:37.092957 22115 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:37.092064 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:37.094982 22194 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:37.124075 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:37.130322 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:37.122949 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:37.132532 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.134680 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:37.135548 22189 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.137473 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:37.140115 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:37.141012 22271 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
W20260709 12:12:37.087783 28456 consensus_meta.cc:287] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.004s
W20260709 12:12:37.147253 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 78558.1us
I20260709 12:12:37.147364 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:37.147891 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:37.150972 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:37.151636 22267 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.065917 28394 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:37.154003 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:37.159230 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:37.159889 22115 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:37.148813 22194 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:37.157336 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:37.162935 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:37.083150 28493 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:37.131340 28486 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:37.171111 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:37.173700 22270 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:37.120563 28454 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:37.166330 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:37.163463 22194 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:37.168999 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:37.166471 22123 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 17: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:37.171063 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:37.172711 22265 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:37.166378 28259 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:37.190132 22190 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:37.209726 22193 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:37.212994 22193 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260709 12:12:37.210352 22122 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:37.213582 22120 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:37.193681 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:37.208745 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 295652us
I20260709 12:12:37.152549 28471 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:37.217453 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:37.219691 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.151829 28465 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:37.228247 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:37.179318 22189 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:37.225807 22267 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:37.249269 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:37.299157 28511 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:37.301616 22263 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 12:12:37.318851 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 244463us
I20260709 12:12:37.204401 28407 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:37.303661 22120 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:37.131505 28205 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 12:12:37.193450 28518 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 12:12:37.306047 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.308851 22192 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
W20260709 12:12:37.297137 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 70270.6us
I20260709 12:12:37.234908 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:37.314565 22114 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:37.167517 28264 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:37.195088 28514 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:12:37.180639 28486 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.228406 28471 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.323202 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:37.352558 22268 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:37.332471 22196 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:37.243119 28184 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:37.334786 22115 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:37.341116 22193 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:37.345444 22198 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 16. Ops: []
I20260709 12:12:37.342175 22123 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:37.348969 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:37.323026 28331 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:12:37.421152 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 72271us
I20260709 12:12:37.348184 28407 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.355392 28471 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:37.391405 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.369997 28507 consensus_meta.cc:287] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.708s	user 0.008s	sys 0.006s
I20260709 12:12:37.437644 28507 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.440008 28507 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:37.440984 22195 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:37.401654 28465 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:37.443257 28465 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:37.444281 28465 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.446024 28465 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:37.455353 28205 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:37.392277 28517 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:12:37.508553 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.357766 28184 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:37.354365 28486 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.362926 28264 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:37.434589 22831 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:37.423950 28511 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:37.469297 28140 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.432869 28331 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.409780 28493 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:37.337795 28181 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:37.487462 28465 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:37.490135 28464 consensus_meta.cc:287] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 12:12:37.494997 28407 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:37.183697 28394 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:37.501914 22121 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.023s	sys 0.023s
W20260709 12:12:37.529507 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 95034.7us
W20260709 12:12:37.527899 22116 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.028s	sys 0.018s
W20260709 12:12:37.587949 22116 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.028s	sys 0.018s
I20260709 12:12:37.538861 22122 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:37.525228 28184 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:37.555209 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:37.584167 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.538041 28023 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:37.590765 22121 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.024s	sys 0.023s
I20260709 12:12:37.575544 28465 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.540442 28205 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.545064 28140 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.647799 22123 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:37.615134 28023 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.645752 28281 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:12:37.585649 28464 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:37.670100 28482 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.656s	user 0.003s	sys 0.009s
I20260709 12:12:37.670758 28482 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:37.675732 22269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.015s	sys 0.030s
W20260709 12:12:37.677107 22269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.015s	sys 0.030s
I20260709 12:12:37.665546 28023 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:37.678750 28467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.010s	sys 0.011s
W20260709 12:12:37.713590 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.702629 28467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.011s	sys 0.012s
W20260709 12:12:37.738798 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 316015us
I20260709 12:12:37.724978 28205 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:37.742199 22119 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.009s	sys 0.017s
W20260709 12:12:37.743537 22119 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.009s	sys 0.017s
W20260709 12:12:37.745978 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 426185us
W20260709 12:12:37.747087 22194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.009s	sys 0.019s
W20260709 12:12:37.747499 22194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.009s	sys 0.019s
W20260709 12:12:37.750829 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.767100 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:37.767946 22123 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:37.770500 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:37.772004 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:37.772969 22123 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:37.766827 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:37.775306 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:37.744942 28347 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:37.780388 22123 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:37.782107 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:37.712620 28264 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.802141 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:37.781013 28496 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:37.850919 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:37.862898 28527 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 12:12:37.869354 28526 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:12:37.873315 28205 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.873922 28331 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:37.880326 28464 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:37.882246 28512 consensus_meta.cc:287] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.800s	user 0.008s	sys 0.005s
I20260709 12:12:37.837409 28465 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:37.885653 28140 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:37.886627 28496 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.868463 28533 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:37.876271 28184 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:37.790055 28347 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:37.916335 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 274822us
I20260709 12:12:37.930467 22860 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:37.931509 22192 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.908228 28496 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:37.933949 22117 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:37.934419 22117 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:37.946715 22198 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:37.902863 28205 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.956034 22162 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:37.907120 28512 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.962057 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:37.949452 22117 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.971310 22117 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.915242 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:37.981841 22193 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:37.933846 28227 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:37.982465 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 67320.3us
I20260709 12:12:37.969782 22190 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:37.930567 28452 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:37.984529 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60341.5us
I20260709 12:12:37.990348 22831 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:37.943828 28476 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:37.999174 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 217132us
I20260709 12:12:37.999264 22865 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:37.998751 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2635) took 1168 ms. Trace:
I20260709 12:12:37.944144 28467 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:38.004478 22192 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:37.915325 28533 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:37.960955 28509 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.003167 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:37.969591 28405 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.983443 28511 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:37.998091 28452 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.005441 22197 rpcz_store.cc:276] 0709 12:12:36.830325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.174775 (+344450us) service_pool.cc:224] Handling call
0709 12:12:37.175078 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:37.175299 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:37.664324 (+489025us) log.cc:844] Serialized 14 byte log entry
0709 12:12:37.998073 (+333749us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:37.998291 (+   218us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:37.998368 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.998477 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.998672 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38427,"prepare.queue_time_us":623066,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":41171,"thread_start_us":767942,"threads_started":2}
I20260709 12:12:38.016386 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:38.001520 28450 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:38.035470 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3574) took 1271 ms. Trace:
I20260709 12:12:38.049064 28184 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:38.051069 28347 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:38.051465 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 276243us
I20260709 12:12:38.056733 28533 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:38.013586 28215 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.057416 28215 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.058626 28227 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.059162 28227 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:38.059679 28215 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.060330 28215 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:37.997221 28333 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:12:38.034710 28355 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:38.061530 28355 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.061966 28355 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:38.035900 28452 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:38.007253 28476 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.065035 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:38.066829 28476 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.068605 28512 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.030224 28509 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.071142 28509 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.035538 28465 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
W20260709 12:12:38.072196 28471 consensus_meta.cc:287] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.001s
I20260709 12:12:38.072888 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2628) took 1212 ms. Trace:
W20260709 12:12:38.060385 28486 consensus_meta.cc:287] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.001s
I20260709 12:12:38.074348 28486 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.078204 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:38.079986 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:38.013995 28467 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:38.036027 28511 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.029508 28482 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 12:12:38.094506 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 399214us
I20260709 12:12:38.073518 22191 rpcz_store.cc:276] 0709 12:12:36.823200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.823311 (+   111us) service_pool.cc:224] Handling call
0709 12:12:38.035170 (+1211859us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540011a154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:38.035351 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410040064}
W20260709 12:12:38.096040 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.097151 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:38.046114 22119 rpcz_store.cc:276] 0709 12:12:36.751297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.778547 (+ 27250us) service_pool.cc:224] Handling call
0709 12:12:36.778897 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:36.828557 (+ 49660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.828586 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:36.841964 (+ 13378us) log.cc:844] Serialized 26 byte log entry
0709 12:12:37.095025 (+253061us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:37.744235 (+649210us) log.cc:844] Serialized 14 byte log entry
0709 12:12:37.756725 (+ 12490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.974066 (+217341us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b18003c5f20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceaca32a6 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419
0709 12:12:37.997304 (+ 23238us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b18003c5f20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:12:38.022705 (+ 25401us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b5400214b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:38.022766 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:38.022828 (+    62us) raft_consensus.cc:1685] finished
0709 12:12:38.022846 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:38.023026 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14403,"prepare.queue_time_us":638500,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1018,"raft.queue_time_us":7655,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":26931,"spinlock_wait_cycles":112187264,"thread_start_us":814149,"threads_started":2,"wal-append.queue_time_us":741528}
W20260709 12:12:38.102082 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:38.103838 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.035358 28470 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.103015 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:38.110146 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.111565 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:38.083927 28023 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:38.117942 22193 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:38.119481 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:38.124202 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.034933 28405 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.094031 28511 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:38.109885 28465 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.127120 28486 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:38.127022 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:38.101200 28450 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:38.130812 22865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:38.138204 22119 raft_consensus.cc:2410] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:12:38.072678 28471 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.138523 28450 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:38.113461 28205 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:38.138155 22865 raft_consensus.cc:606] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:38.141090 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:38.145488 22117 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:38.146639 22264 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
W20260709 12:12:38.131171 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51291.8us
I20260709 12:12:38.094086 28464 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:12:38.116942 28552 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:38.148748 22192 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:12:38.119705 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2544) took 1220 ms. Trace:
I20260709 12:12:38.149044 22116 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:38.151219 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:38.150413 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:38.154410 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.158631 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.161249 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:38.161907 28559 consensus_queue.cc:1059] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:12:38.168668 28535 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:12:38.155200 28227 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:38.169832 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3049) took 1305 ms. Trace:
I20260709 12:12:38.170133 28227 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:38.171344 28227 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:38.161356 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:38.171880 28227 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:38.173750 28540 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:12:38.175047 28538 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:12:38.177217 28493 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:38.161938 22263 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:38.170217 22194 rpcz_store.cc:276] 0709 12:12:36.864074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.202110 (+338036us) service_pool.cc:224] Handling call
0709 12:12:37.202511 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:37.203244 (+   733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:37.203281 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:37.203856 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 12:12:37.747992 (+544136us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:37.748035 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.748112 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:38.169644 (+421532us) raft_consensus.cc:1685] finished
0709 12:12:38.169665 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:38.169781 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"thread_start_us":543666,"threads_started":1,"wal-append.queue_time_us":710831}
I20260709 12:12:38.182842 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 2977) took 1023 ms. Trace:
I20260709 12:12:38.183277 22269 rpcz_store.cc:276] 0709 12:12:37.159757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.159891 (+   134us) service_pool.cc:224] Handling call
0709 12:12:37.164691 (+  4800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:37.680603 (+515912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:37.680648 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:37.727134 (+ 46486us) log.cc:844] Serialized 26 byte log entry
0709 12:12:38.013776 (+286642us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:38.013815 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.013879 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:38.182614 (+168735us) raft_consensus.cc:1685] finished
0709 12:12:38.182637 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:38.182776 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125465,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":793730,"threads_started":2,"wal-append.queue_time_us":423220}
I20260709 12:12:38.186475 28405 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.159648 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.189527 28023 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.190179 28552 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:38.191551 28471 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.191397 28552 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.199604 28467 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:38.200529 28550 raft_consensus.cc:2764] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:38.200615 28394 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:38.202046 28205 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:38.202207 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.202525 28205 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.202903 28205 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:38.203127 28547 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:38.203637 28547 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:38.201711 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:38.204452 28547 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.205300 22264 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:38.145087 28465 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.208196 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.209013 28550 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:38.209535 28550 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:38.209861 28465 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:38.210510 28550 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.118913 28470 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.213558 28533 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:12:38.145280 28215 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:38.219089 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:38.221030 22197 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:38.222774 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
W20260709 12:12:38.225574 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 75311.2us
I20260709 12:12:38.242197 22269 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:38.225982 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:38.235109 28560 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:38.242354 22860 raft_consensus.cc:606] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:38.246701 28536 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:38.237457 28533 consensus_queue.cc:1243] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:12:38.247320 28536 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.242652 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:38.243314 22267 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:38.243857 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:38.258260 22117 raft_consensus.cc:2368] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19.
I20260709 12:12:38.245031 28394 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:38.281214 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:38.158309 22121 rpcz_store.cc:276] 0709 12:12:36.899039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.899874 (+   835us) service_pool.cc:224] Handling call
0709 12:12:36.900284 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.925572 (+ 25288us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:37.623466 (+697894us) log.cc:844] Serialized 14 byte log entry
0709 12:12:38.058251 (+434785us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b1800047e60. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:12:38.119258 (+ 61007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:38.119332 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:38.119397 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.119492 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:38.119631 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11845,"prepare.queue_time_us":750538,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3567,"raft.queue_time_us":104100,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":34532608,"thread_start_us":1151845,"threads_started":3,"wal-append.queue_time_us":378341}
I20260709 12:12:38.285241 22267 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
W20260709 12:12:38.286900 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 67884.9us
W20260709 12:12:38.287195 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 247648us
I20260709 12:12:38.299871 22264 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:38.304713 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:38.306591 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:38.307366 22197 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:38.311910 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:38.286592 28554 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:12:38.244131 28512 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.322173 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:38.277761 28486 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:38.284211 28507 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.326231 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:38.331272 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:38.284468 28560 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:38.333683 22117 raft_consensus.cc:2410] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:12:38.305721 28533 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:38.336318 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:38.339099 22861 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:38.305497 28536 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:38.342367 22264 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:38.252799 28181 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 12:12:38.349002 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:38.351037 22197 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:38.299221 28544 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:12:38.277822 28355 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:38.326148 28486 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:38.351648 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863b392474d94720808349fe27669b5b"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:38.365281 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.348039 22831 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.360982 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:38.374194 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.361481 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:38.376269 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:38.377004 22122 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:38.377406 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:38.378209 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:38.378865 22117 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:12:38.378945 22114 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:38.380045 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:38.380681 22190 raft_consensus.cc:2376] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13. Re-sending same reply.
I20260709 12:12:38.381049 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:38.381733 28536 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:38.364061 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:38.382285 28536 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.382782 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.378213 22118 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:38.376271 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:38.382828 28536 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:38.366266 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:38.384760 22123 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:38.308485 28555 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:38.387442 22267 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:38.387202 28555 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.387691 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:38.388633 22198 raft_consensus.cc:2368] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:12:38.300038 28556 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:38.394028 28543 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:38.394954 28470 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.395617 28470 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:38.396189 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:38.371773 22860 raft_consensus.cc:606] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:38.342020 28512 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:38.397312 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:38.397595 28482 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:38.398099 22264 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:38.398231 28482 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:38.399936 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:38.400012 22191 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:38.402689 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:38.404145 22122 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:38.406226 22197 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:38.412853 22263 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:38.414222 22860 raft_consensus.cc:2410] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 19 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 12:12:38.414883 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:38.415789 22196 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:38.415922 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:38.416844 22269 raft_consensus.cc:2410] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:12:38.423105 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:38.443493 22117 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
W20260709 12:12:38.444720 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 141273us
I20260709 12:12:38.446789 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:38.318892 28227 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.454241 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:38.340494 28507 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.399091 28512 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:38.495534 22268 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.498380 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:38.470472 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:38.500782 22117 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
W20260709 12:12:38.504889 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.506330 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:38.511226 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64561.1us
I20260709 12:12:38.392338 28533 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:12:38.513108 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:38.339895 28215 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.438421 28543 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:38.515818 22162 leader_election.cc:400] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19.
I20260709 12:12:38.559686 22162 leader_election.cc:403] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:38.518301 22192 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:38.454475 28464 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.448868 28547 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:38.525681 28565 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.525858 28556 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:38.528100 28559 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:38.530539 28496 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.003s
I20260709 12:12:38.533182 22861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:38.535302 28555 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.539366 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:38.601050 22196 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:38.542263 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.542510 28511 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.544595 28507 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.522162 28184 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:12:38.510807 28561 consensus_queue.cc:1059] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:12:38.551187 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:38.521293 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:38.414691 28529 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:38.561767 28464 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:38.572646 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 60069.9us
W20260709 12:12:38.611028 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:38.613682 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 92708.8us
W20260709 12:12:38.567462 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55822.1us
I20260709 12:12:38.576947 22268 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:38.582698 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:38.579144 28470 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19.
I20260709 12:12:38.558483 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:38.600199 22861 raft_consensus.cc:606] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:38.448285 28394 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.518453 28333 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:12:38.579811 28560 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:38.633387 22117 raft_consensus.cc:2410] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 19 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 12:12:38.399212 28482 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:38.635319 22272 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:38.636096 22122 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:38.414045 28452 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.638116 22122 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:38.639732 22163 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:38.634048 22196 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:38.644218 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:38.646045 28281 raft_consensus.cc:993] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:38.612635 28529 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.649292 28556 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:38.650905 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:38.639320 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:38.579236 28486 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.657146 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:38.631506 28507 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:12:38.663753 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 276127us
I20260709 12:12:38.664841 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:38.607470 28496 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:38.604475 28559 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:38.658592 28140 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:38.662982 28570 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:38.595878 28565 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:38.664034 28529 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:38.637794 28555 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:12:38.675575 28544 raft_consensus.cc:1081] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
W20260709 12:12:38.695536 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56305.5us
I20260709 12:12:38.710131 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:38.693970 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:38.700927 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 43835.8us
I20260709 12:12:38.713353 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:38.711221 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:38.715340 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.659837 28509 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.033s
W20260709 12:12:38.714058 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48304.4us
I20260709 12:12:38.715909 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:38.671543 28476 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:12:38.687659 28558 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:38.724619 22236 leader_election.cc:400] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:12:38.729985 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.696744 28570 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.732247 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:38.707567 28507 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:38.753904 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.716578 28486 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:38.724202 28568 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:38.727064 28184 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:38.757778 28333 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:38.777462 28565 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:38.691908 28205 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:38.730408 28556 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:38.736333 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:38.726481 28470 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:38.652941 28543 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:38.757112 28533 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:38.730798 28547 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:38.919324 28512 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.915714 28570 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:38.892218 22861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
W20260709 12:12:38.914341 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 179243us
W20260709 12:12:38.778158 28566 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.233s	user 0.003s	sys 0.000s
I20260709 12:12:38.937371 28470 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.731726 28550 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:38.882117 28467 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:38.888444 28536 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.504s	user 0.014s	sys 0.000s
I20260709 12:12:38.768564 28355 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.914908 28507 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.882097 28559 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:38.890933 28564 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.331s	user 0.001s	sys 0.010s
I20260709 12:12:38.922116 28333 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:38.904551 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 244626us
I20260709 12:12:38.893626 28452 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:38.890439 28511 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:38.986955 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 250686us
I20260709 12:12:38.937021 28140 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.025466 28140 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.027932 28140 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:38.933420 28184 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:38.989776 22861 raft_consensus.cc:606] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:39.032898 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:39.033710 22114 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:39.035033 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:38.999578 28470 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:38.996942 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 279550us
W20260709 12:12:39.000264 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 268074us
I20260709 12:12:38.737108 28558 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.017110 28333 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:39.014387 28476 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:12:39.013491 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:39.018817 28496 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:38.889580 28562 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.237s	user 0.000s	sys 0.006s
I20260709 12:12:39.038772 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:39.060797 22268 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:39.061527 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:39.008257 28507 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:39.005834 28550 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:39.062477 22119 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:39.054327 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:39.060639 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 70036us
I20260709 12:12:38.992683 28512 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.046386 28465 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:12:39.059388 28563 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.255s	user 0.003s	sys 0.003s
W20260709 12:12:39.059176 28569 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.323s	user 0.000s	sys 0.011s
I20260709 12:12:39.038018 28580 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:39.066236 28576 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:12:39.106490 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 71567.2us
I20260709 12:12:39.107733 22268 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:39.109015 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:39.109234 22831 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:39.091806 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 45108.1us
I20260709 12:12:39.109828 22114 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 14: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:39.005348 28467 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.006009 28536 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.101850 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:39.064886 28511 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:39.120716 22196 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:39.122193 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:39.135926 22119 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:39.136399 22119 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:39.137048 22120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:39.137666 22120 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:39.138017 22120 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:39.138250 22270 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:39.139252 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:39.086045 28465 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.144135 22265 raft_consensus.cc:2368] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:12:39.093510 28589 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:39.103796 28140 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:39.263614 22195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1fb787db87147b3be49bef974365af1"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:39.165390 22861 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 17: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:39.160113 22198 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:39.163892 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:39.172158 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:39.162253 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:39.244858 22189 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:39.265064 22863 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:39.265669 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:39.264356 22195 raft_consensus.cc:606] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:39.266623 22195 raft_consensus.cc:614] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:39.267287 22270 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:12:39.267315 22189 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:39.270946 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:39.264194 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:39.142223 28580 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.237481 22193 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:39.128952 28533 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:39.212492 22119 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.275681 22119 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:39.205626 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:39.203284 22857 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:39.203866 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:39.195822 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:39.162794 28465 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:39.142870 27951 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:39.237142 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:39.236166 22190 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:12:39.216693 28540 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.101s	user 0.003s	sys 0.002s
I20260709 12:12:39.197489 22263 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:39.239023 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:39.116791 28496 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.111s
I20260709 12:12:39.145323 28511 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.288540 22270 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:12:39.294878 22265 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:39.204449 28205 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:39.286340 22120 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.346050 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:39.347108 22196 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:39.306440 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:39.348129 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:39.348706 22865 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:39.348487 22117 raft_consensus.cc:2376] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13. Re-sending same reply.
I20260709 12:12:39.146384 28184 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.264168 28140 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:39.279466 28452 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.363929 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:39.299139 27951 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.291405 28487 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:39.374311 22120 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:39.375262 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:39.332998 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:39.160844 28552 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.121s
I20260709 12:12:39.284111 22272 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:39.378405 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:39.375211 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:39.356137 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:39.356818 22114 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:39.358217 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1655) took 1117 ms. Trace:
I20260709 12:12:39.381883 22194 rpcz_store.cc:276] 0709 12:12:38.226603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.227117 (+   514us) service_pool.cc:224] Handling call
0709 12:12:38.227476 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:38.239481 (+ 12005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:38.239517 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:38.243780 (+  4263us) log.cc:844] Serialized 26 byte log entry
0709 12:12:38.505241 (+261461us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:38.505286 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.505356 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.341920 (+836564us) raft_consensus.cc:1685] finished
0709 12:12:39.341950 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.342151 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12932,"raft.queue_time_us":12224,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":35066,"thread_start_us":261093,"threads_started":1,"wal-append.queue_time_us":335575}
I20260709 12:12:39.268827 28589 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.365310 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:39.371531 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:39.321542 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:39.401660 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:39.402303 22117 raft_consensus.cc:2376] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15. Re-sending same reply.
I20260709 12:12:39.403106 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:39.403407 22196 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:39.404449 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:39.405015 22123 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:39.405827 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:39.383715 28590 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:39.368112 28140 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:39.403684 22117 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:12:39.425443 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:39.425755 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:39.426071 22864 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:39.426410 22123 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:39.426364 22864 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:39.430073 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:39.399446 28205 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:39.432605 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:39.397320 28487 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:39.407442 28552 consensus_queue.cc:1243] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:12:39.282490 28550 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.442432 22088 leader_election.cc:400] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:12:39.292964 28580 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.442319 22123 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:39.400166 28589 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.380395 28452 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.450332 22117 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:39.431411 28583 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.421s	user 0.002s	sys 0.000s
I20260709 12:12:39.427886 28493 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:12:39.441166 28587 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:12:39.467281 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:39.447263 28509 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:39.454945 22865 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:39.485396 22196 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:39.447295 28512 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:39.495163 22123 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:39.495159 22190 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:39.415858 28560 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:12:39.493767 28496 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
W20260709 12:12:39.511479 28595 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:39.513660 27951 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:39.538332 28452 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:39.516475 28570 consensus_meta.cc:287] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.000s
W20260709 12:12:39.520134 28592 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 12:12:39.477064 28493 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:39.542587 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:39.544714 22272 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:39.539216 28487 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:39.525020 28586 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 12:12:39.496500 28509 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.540944 22864 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.566715 22864 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:39.441682 28533 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.427206 28590 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.587450 22117 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:39.508186 28536 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:39.582994 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:39.595180 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:39.540221 28467 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:39.588810 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 183668us
I20260709 12:12:39.572425 28509 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.575537 28551 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:39.570567 28496 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:39.574267 28205 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.614326 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:39.634582 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:39.636080 22198 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:39.591557 28552 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:39.554960 28570 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.600188 28560 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:39.607780 28452 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:39.673233 28452 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:39.658330 22235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.025s	sys 0.045s
W20260709 12:12:39.674397 22235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.026s	sys 0.045s
I20260709 12:12:39.663765 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:39.663796 22088 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:39.675949 22117 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:39.616092 28551 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.669603 28596 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 12:12:39.659255 28536 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:39.641928 28507 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.004s
I20260709 12:12:39.677387 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:39.620193 28496 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:39.659247 28347 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:39.689618 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.691831 22120 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:39.689875 28507 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:39.694569 22163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.026s	sys 0.055s
W20260709 12:12:39.695077 22163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.026s	sys 0.055s
W20260709 12:12:39.695745 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 682305us
I20260709 12:12:39.696594 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:39.697636 28507 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:39.698227 22189 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 20: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:39.701737 22196 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:39.682255 28551 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.660346 28511 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:39.640832 28205 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.682303 28565 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:39.612299 28493 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.737527 22117 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:12:39.706583 28347 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.747979 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:39.754706 22198 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:39.764734 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 3858) took 1342 ms. Trace:
I20260709 12:12:39.753959 22194 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:39.753283 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:39.772830 22193 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:39.779781 22198 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:39.770396 22263 rpcz_store.cc:276] 0709 12:12:38.422666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.422844 (+   178us) service_pool.cc:224] Handling call
0709 12:12:39.764426 (+1341582us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54000ea454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:39.764620 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776289152}
I20260709 12:12:39.780632 22119 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:12:39.782662 22119 pending_rounds.cc:85] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 13
I20260709 12:12:39.782974 22119 pending_rounds.cc:107] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:12:39.783283 22119 raft_consensus.cc:2889] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:39.788733 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:39.788369 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:39.791257 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:39.798182 22198 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:39.757498 28604 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:12:39.798485 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:39.737986 28184 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:39.703063 28536 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.794991 28565 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:39.757833 28580 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:39.753600 28590 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:39.764438 28465 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.755614 28394 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:39.746111 28205 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:39.763428 28464 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:39.832075 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:39.833094 28585 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:39.833379 28470 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.761s	user 0.012s	sys 0.000s
I20260709 12:12:39.834545 28621 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:39.835062 28227 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:39.835714 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:39.837057 28347 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:39.837710 28542 raft_consensus.cc:993] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:39.846755 28536 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:39.740540 28452 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.849776 22122 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.850289 28570 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:39.853128 22194 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:39.853545 22864 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:39.818632 28023 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:39.799983 28555 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:39.749962 28610 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 12:12:39.830749 28584 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:39.867295 22271 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:39.868520 22116 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:39.857719 28493 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:39.872478 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:39.878320 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 195878us
I20260709 12:12:39.856402 28184 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:39.779399 28496 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.893810 22088 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:39.864980 28511 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:39.867615 28565 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 12:12:39.889766 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.901129 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 74819.1us
W20260709 12:12:39.939533 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 191636us
I20260709 12:12:39.862900 28394 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.886945 22193 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
W20260709 12:12:39.942242 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 49571.4us
W20260709 12:12:39.890736 28333 consensus_meta.cc:287] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.822s	user 0.012s	sys 0.000s
I20260709 12:12:39.920661 28227 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:39.942920 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:39.883118 28464 raft_consensus.cc:1081] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:39.870334 28470 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.948838 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:39.945426 28227 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:39.950168 28629 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.953312 28623 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.954362 28589 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:39.955868 28140 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.002s
I20260709 12:12:39.940927 28511 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.958236 28394 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:39.892867 28023 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.872118 28585 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.963312 28507 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:39.978560 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:39.956333 28509 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.972683 28632 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:12:39.972834 28227 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.013363 28227 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.013432 28509 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.018333 28511 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:39.985740 28140 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.023429 28140 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.024160 22195 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:39.982023 28594 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:39.982424 28627 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
W20260709 12:12:39.984122 28529 consensus_meta.cc:287] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.270s	user 0.009s	sys 0.005s
I20260709 12:12:39.965767 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:40.026181 22193 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:39.986239 22197 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:39.952579 28558 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:39.968384 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:39.986474 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:39.871925 28621 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:39.946242 28333 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.978252 28629 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:39.965951 28555 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:39.978186 28623 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.002054 28589 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:40.002663 28023 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.004340 28470 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:39.976037 28565 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:40.004172 28551 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.009258 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.051357 22268 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:12:40.012192 28632 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:40.025048 28467 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.049726 22193 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:40.053649 22831 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:40.055562 28636 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:40.059082 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:40.032989 28594 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:40.033360 28558 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:40.037498 28565 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:40.052695 28465 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:40.031162 28529 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.088431 28565 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.089099 28333 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.063252 28023 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:40.093237 28585 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.087996 28452 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:40.122430 28565 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.124225 22269 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:40.096060 22115 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:40.125190 28529 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:40.057761 28632 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.119242 28023 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:40.126396 28023 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:40.127838 28632 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.060493 28467 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.085791 28558 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.130124 28467 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.125702 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1561) took 1017 ms. Trace:
I20260709 12:12:40.098371 28629 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.109881 28555 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:40.110810 28551 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:40.112103 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:40.134380 22861 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.115175 28623 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:40.056440 28636 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.136885 28555 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.140182 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:40.122509 28452 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.142275 28636 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:40.142755 28593 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.886s	user 0.000s	sys 0.002s
I20260709 12:12:40.143489 28452 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:40.131476 28594 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.144696 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:40.131754 22114 rpcz_store.cc:276] 0709 12:12:39.108297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.171954 (+ 63657us) service_pool.cc:224] Handling call
0709 12:12:39.247883 (+ 75929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.398002 (+150119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.125433 (+727431us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b54002acbd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:40.125642 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229247232}
I20260709 12:12:40.132536 28584 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:40.160878 22861 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:12:40.163133 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:40.164532 28567 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 1.514s	user 0.003s	sys 0.008s
I20260709 12:12:40.165655 28023 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.167289 28542 raft_consensus.cc:993] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:40.171672 28458 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 12:12:40.180418 28542 raft_consensus.cc:1081] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
W20260709 12:12:40.182163 22269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 3861) took 1663 ms (client timeout 2133 ms). Trace:
W20260709 12:12:40.182750 22269 rpcz_store.cc:269] 0709 12:12:38.518980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.523213 (+  4233us) service_pool.cc:224] Handling call
0709 12:12:40.181989 (+1658776us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54002c3654. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:40.182109 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3482097920}
I20260709 12:12:40.184732 28558 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.188926 28023 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.189458 28621 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.190357 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:40.195209 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:40.193081 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:40.196640 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:40.172199 28570 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:40.182086 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:40.200816 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:40.210855 28570 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:40.231500 28570 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.235057 22865 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 12:12:40.235376 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:40.239701 28573 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.319s	user 0.004s	sys 0.000s
I20260709 12:12:40.241343 22860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56950 (request call id 930) took 1725 ms. Trace:
I20260709 12:12:40.241770 22860 rpcz_store.cc:276] 0709 12:12:38.516402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.516525 (+   123us) service_pool.cc:224] Handling call
0709 12:12:38.516882 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:38.525400 (+  8518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:38.525454 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:38.525960 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:12:38.637222 (+111262us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:38.637283 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.637381 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:40.239042 (+1601661us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:40.240934 (+  1892us) raft_consensus.cc:1685] finished
0709 12:12:40.240958 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.241242 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10462,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":18855296,"thread_start_us":110793,"threads_started":1,"wal-append.queue_time_us":185548}
I20260709 12:12:40.244033 28642 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.244735 28642 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.249986 28559 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:40.250595 28559 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:40.256358 28642 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.251740 28559 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.258992 28559 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.263877 28537 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.264477 28537 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.268339 28537 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.271370 28463 raft_consensus.cc:993] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:40.272105 28355 raft_consensus.cc:1081] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:39.617447 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:40.309144 28599 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.701s	user 0.004s	sys 0.000s
I20260709 12:12:40.312361 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3614) took 1282 ms. Trace:
I20260709 12:12:40.312793 22118 rpcz_store.cc:276] 0709 12:12:39.030165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.032567 (+  2402us) service_pool.cc:224] Handling call
0709 12:12:39.067892 (+ 35325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.145228 (+ 77336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:39.145263 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:39.201016 (+ 55753us) log.cc:844] Serialized 26 byte log entry
0709 12:12:39.417536 (+216520us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:39.417584 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.417663 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:40.308535 (+890872us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:40.312037 (+  3502us) raft_consensus.cc:1685] finished
0709 12:12:40.312061 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.312297 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163541,"raft.queue_time_us":129014,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":34188,"spinlock_wait_cycles":22951296,"thread_start_us":123425,"threads_started":1,"wal-append.queue_time_us":249981}
I20260709 12:12:40.315590 28559 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.316175 28559 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.318781 28559 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.341238 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:40.341290 22194 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:12:40.343706 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:40.343967 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:40.344700 22192 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:40.340651 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:40.347538 22195 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.349498 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:40.348807 28588 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.351269 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:40.351732 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:40.352387 22192 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:40.357477 22191 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:40.351023 28570 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:12:40.351876 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:40.346985 28215 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.365016 22087 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:40.358237 28642 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:40.350942 28588 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.347123 28347 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:40.376904 22861 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:40.377039 28347 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.379360 28347 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:40.379649 22269 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:40.379824 28588 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:40.385201 22122 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.385764 28450 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:40.386344 28450 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.389209 28588 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.372197 28264 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:40.389804 28588 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.390043 28264 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.391887 28588 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:40.367082 28565 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:40.363260 28205 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:40.393136 28565 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:40.393193 28205 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.394309 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2654) took 1258 ms. Trace:
I20260709 12:12:40.394981 22195 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:12:40.395533 28205 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:40.359892 28550 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:40.372279 28529 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:40.373282 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.396788 28496 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:40.374066 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:40.397069 28529 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.397867 22265 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:40.399387 28529 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:40.401134 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:40.402163 28570 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:40.402662 28570 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.381749 28215 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.396211 28550 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.403587 28642 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:40.403066 28570 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:40.404908 28215 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.405030 28550 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:40.367702 28624 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:12:40.406837 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.394316 28565 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.382330 28023 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:40.409757 28023 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.410202 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2569) took 1131 ms. Trace:
I20260709 12:12:40.410650 22123 rpcz_store.cc:276] 0709 12:12:39.278526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.454385 (+175859us) service_pool.cc:224] Handling call
0709 12:12:39.454762 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.495819 (+ 41057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.409938 (+914119us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b5400254ed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:40.410138 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92241280}
I20260709 12:12:40.412024 28023 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.412185 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:40.412948 22115 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:40.392469 28264 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:40.414587 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:40.415318 22114 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:40.415483 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:40.416973 28482 raft_consensus.cc:2764] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:40.418051 28558 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:40.418778 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:40.420433 28556 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:40.420845 28556 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.421160 28556 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.421695 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:40.422688 22115 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:40.423609 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:40.424681 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:40.418607 28558 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.394755 22197 rpcz_store.cc:276] 0709 12:12:39.135629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.136063 (+   434us) service_pool.cc:224] Handling call
0709 12:12:39.136385 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:40.027559 (+891174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.394022 (+366463us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400236ed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:40.394233 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953919872}
I20260709 12:12:40.348187 28559 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:40.430816 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.429163 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:40.434571 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.434765 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 2985) took 1298 ms. Trace:
I20260709 12:12:40.436221 22271 rpcz_store.cc:276] 0709 12:12:39.136094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.136227 (+   133us) service_pool.cc:224] Handling call
0709 12:12:40.434560 (+1298333us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54000f00d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:40.434703 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355688832}
I20260709 12:12:40.441390 22116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:40.442065 22116 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:40.442466 22116 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:40.437682 22122 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:40.445256 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1555) took 1852 ms. Trace:
I20260709 12:12:40.408843 28642 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:40.445914 22122 rpcz_store.cc:276] 0709 12:12:38.594025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.594321 (+   296us) service_pool.cc:224] Handling call
0709 12:12:38.606646 (+ 12325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.849362 (+1242716us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b54005003a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd4006f 00007fcceddb8f60 00007fcceddba7de 00007fcceddc4b49 00007fcceddc5416 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62
0709 12:12:40.384964 (+535602us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b58006620d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd1e0aa 00007fccedda0447 00007fcceddb8fe7 00007fcceddba7de 00007fcceddc4b49 00007fcceddc5416 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4
0709 12:12:40.444976 (+ 60012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.445206 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230901376}
I20260709 12:12:40.388706 28450 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:40.450688 28561 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:12:40.452039 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:40.438031 28264 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.451119 28215 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:40.451097 28642 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:40.490103 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:40.490574 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 555087us
I20260709 12:12:40.491091 22270 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:40.448941 28559 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.497786 22865 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:40.495741 28588 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:40.465155 28281 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:12:40.504204 28623 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:40.491974 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:40.484014 28215 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.505228 22265 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:40.553215 22122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:40.554641 22122 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:40.555081 22122 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:40.556677 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.557535 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.558316 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:40.558732 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.554893 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:40.559427 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:40.559857 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.560058 22268 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:40.489722 28450 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.562980 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.571909 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.563879 22270 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:40.573047 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.573640 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.577458 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.578604 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.579008 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.578871 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.580159 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:40.580423 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:40.583424 22268 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:40.585489 22267 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:40.485424 28264 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.589037 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.589464 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.590348 22268 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:12:40.590976 22271 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:40.591650 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:40.593034 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:40.594365 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.564960 28215 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:40.595532 22265 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:40.596306 22263 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:40.549042 28606 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:40.496567 28205 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 12:12:40.594437 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.602262 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:40.601771 22122 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.604640 22831 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:40.505976 28555 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
W20260709 12:12:40.605542 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 113628us
I20260709 12:12:40.606138 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:40.616060 22114 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.507838 28625 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 12:12:40.507890 28347 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:12:40.597147 28584 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.603315 28572 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:40.605927 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.609882 22267 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:40.612274 22263 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:40.613037 22020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 242) took 13133 ms (client timeout 15000 ms). Trace:
I20260709 12:12:40.504627 28642 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.631084 22263 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:40.617838 22830 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:40.620828 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.608017 22271 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:40.619889 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:40.637853 22122 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:40.609385 28281 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:40.618774 28450 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:40.659361 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:40.655892 28458 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:40.637951 28572 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:12:40.663991 28658 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:40.628659 28584 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.667102 28450 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:40.664052 28572 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.702889 28331 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.707451 28331 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:40.707717 28450 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.665596 28347 consensus_queue.cc:1243] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:12:40.624002 22020 rpcz_store.cc:269] 0709 12:12:27.472125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.472616 (+   491us) service_pool.cc:224] Handling call
0709 12:12:40.605846 (+13133230us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:36.050071 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:36.050916 (+   845us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:36.050985 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:12:36.051005 (+    20us) tablet.cc:662] Decoding operations
0709 12:12:36.052238 (+  1233us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:36.052347 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:36.052381 (+    34us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:12:36.134063 (+ 81682us) tablet.cc:701] Row locks acquired
0709 12:12:36.134129 (+    66us) write_op.cc:260] PREPARE: finished
0709 12:12:36.134340 (+   211us) write_op.cc:270] Start()
0709 12:12:36.134548 (+   208us) write_op.cc:276] Timestamp: P: 1783599156134265 usec, L: 0
0709 12:12:36.134600 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 12:12:36.196114 (+ 61514us) log.cc:844] Serialized 4430 byte log entry
0709 12:12:36.867950 (+671836us) op_driver.cc:464] REPLICATION: finished
0709 12:12:37.673125 (+805175us) write_op.cc:301] APPLY: starting
0709 12:12:37.681904 (+  8779us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:38.056460 (+374556us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:38.056634 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:38.188278 (+131644us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:38.188714 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:12:38.244345 (+ 55631us) write_op.cc:312] APPLY: finished
0709 12:12:38.339040 (+ 94695us) log.cc:844] Serialized 105 byte log entry
0709 12:12:38.385454 (+ 46414us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:38.385638 (+   184us) write_op.cc:454] Released schema lock
0709 12:12:38.385729 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:38.386245 (+   516us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:38.386276 (+    31us) write_op.cc:454] Released schema lock
0709 12:12:38.777581 (+391305us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
Metrics: {"mutex_wait_us":91672,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":776109,"apply.run_cpu_time_us":35959,"apply.run_wall_time_us":713155,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":140884,"prepare.run_cpu_time_us":30903,"prepare.run_wall_time_us":278301,"raft.queue_time_us":280059,"raft.run_cpu_time_us":34237,"raft.run_wall_time_us":614118,"replication_time_us":699179,"spinlock_wait_cycles":46163200,"thread_start_us":797083,"threads_started":5,"wal-append.queue_time_us":338133,"wal-append.run_cpu_time_us":54308,"wal-append.run_wall_time_us":2875974}]]}
I20260709 12:12:40.686677 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:40.611922 28606 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.703064 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:40.726197 22192 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:12:40.726420 22119 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:40.675170 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:40.675791 28642 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.739135 28584 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:40.731006 28657 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:12:40.745790 28627 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:40.746001 28572 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.761773 28627 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.705020 28533 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.814203 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:40.816460 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 196636us
I20260709 12:12:40.817780 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:40.822060 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:40.825687 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 118322us
I20260709 12:12:40.844107 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:40.844906 22121 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.843195 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:40.862483 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:40.832423 28347 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.864964 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:40.838649 28614 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.859984 28536 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:40.866601 28603 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.855361 28613 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:40.870890 28625 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:40.981189 28264 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:40.981962 28512 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:40.874264 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:40.983323 28537 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:40.985041 28555 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.968483 28509 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.989677 28536 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:40.871819 28559 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:40.995365 28613 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:41.011994 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.025293 28551 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:41.025491 28496 consensus_meta.cc:287] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.628s	user 0.014s	sys 0.000s
W20260709 12:12:41.026753 22116 consensus_meta.cc:287] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.569s	user 0.019s	sys 0.003s
W20260709 12:12:41.024080 28570 consensus_meta.cc:287] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.619s	user 0.015s	sys 0.000s
I20260709 12:12:41.024070 28330 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:41.010999 28512 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.380505 28551 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:41.012998 28625 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:41.407341 28625 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:41.408155 28551 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:41.069001 28556 consensus_meta.cc:287] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.647s	user 0.006s	sys 0.014s
I20260709 12:12:41.037469 28627 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:41.034327 28331 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:41.032871 28591 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:12:41.094043 28662 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.430s	user 0.005s	sys 0.000s
W20260709 12:12:41.418001 28661 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.440s	user 0.003s	sys 0.000s
I20260709 12:12:41.108991 28550 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:41.419193 28550 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:41.420166 28550 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:41.421209 28550 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:41.380657 28613 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:41.123106 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 258218us
I20260709 12:12:41.425271 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:41.130913 22121 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:41.426642 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:41.136345 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2030) took 1258 ms. Trace:
I20260709 12:12:41.191327 22122 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:41.202558 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:41.205500 22194 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:41.205615 22195 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:41.427350 22272 rpcz_store.cc:276] 0709 12:12:39.878127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.878311 (+   184us) service_pool.cc:224] Handling call
0709 12:12:39.878805 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:40.500688 (+621883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.500738 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:40.552325 (+ 51587us) log.cc:844] Serialized 26 byte log entry
0709 12:12:40.859685 (+307360us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:40.859725 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.859808 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:41.136058 (+276250us) raft_consensus.cc:1685] finished
0709 12:12:41.136079 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.136258 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":473339,"raft.queue_time_us":488393,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":399219,"threads_started":2,"wal-append.queue_time_us":493824}
I20260709 12:12:41.206390 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:41.238785 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.379770 28509 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:41.429023 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 222709us
I20260709 12:12:41.429126 22191 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:41.429673 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:41.429868 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:41.242849 22019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 154) took 15929 ms (client timeout 15000 ms). Trace:
W20260709 12:12:41.430436 22019 rpcz_store.cc:269] 0709 12:12:25.185896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.186166 (+   270us) service_pool.cc:224] Handling call
0709 12:12:25.300665 (+114499us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:41.114223 (+15813558us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112290,"reported_tablets":13,"spinlock_wait_cycles":242306432}
I20260709 12:12:41.431073 28509 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:41.257717 28671 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:12:41.283545 28660 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.619s	user 0.004s	sys 0.000s
I20260709 12:12:41.288648 28558 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:41.289856 28642 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:41.291574 28678 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:41.301517 28606 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:41.313016 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:41.317473 28565 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.327078 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:41.431967 28603 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:41.329207 22860 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:41.327064 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:41.340415 28680 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:12:41.351377 22193 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:12:41.358232 28664 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
I20260709 12:12:41.441148 28509 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:41.366048 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 493144us
I20260709 12:12:41.372728 28584 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:41.367012 28561 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:41.382047 22116 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:41.473819 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.404136 28559 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:41.474668 22115 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:41.369145 28552 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:41.405144 28570 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:41.406168 28512 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:41.479966 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:41.480222 22196 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:41.480300 22864 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:41.480840 22191 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 13: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:41.082546 28215 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:41.481518 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.367795 28623 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:41.482678 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.453099 28603 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:41.099766 22114 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:41.368027 28537 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:41.212255 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.490455 22191 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:41.432227 22858 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:41.433565 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:41.430399 22117 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:41.448995 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:41.492148 22118 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:41.450206 22861 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:41.492923 22861 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:41.328073 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:41.450255 22119 raft_consensus.cc:2410] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:41.493176 22114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "863b392474d94720808349fe27669b5b"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:41.454991 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:41.441388 28331 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:41.473107 28551 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:41.358543 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.498624 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.375979 28555 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:41.469391 22088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.533s (SENT) [suppressed 17 similar messages]
I20260709 12:12:41.478600 28281 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:12:41.469973 28496 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:41.502202 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1569) took 1058 ms. Trace:
I20260709 12:12:41.502663 28496 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:41.502609 22115 rpcz_store.cc:276] 0709 12:12:40.444256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.444884 (+   628us) service_pool.cc:224] Handling call
0709 12:12:40.445254 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.475162 (+1029908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.501952 (+ 26790us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002c1ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:41.502137 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2367032192}
I20260709 12:12:41.476227 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.476681 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.477697 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:41.505463 22198 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:41.408998 28556 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:41.496676 28685 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:41.506944 28675 log.cc:927] Time spent T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
I20260709 12:12:41.506635 28685 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:41.507867 28556 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:41.464622 28509 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.496302 28631 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:41.509954 28509 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.498257 22861 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:41.510638 22861 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:41.479451 28394 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:12:41.513252 28394 consensus_queue.cc:1243] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:41.513929 28685 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:41.460508 28642 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:41.494906 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 61437.9us
I20260709 12:12:41.458905 22193 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:41.518838 22193 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:41.519835 22193 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:41.521883 28555 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:41.515333 28551 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:41.523075 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.524396 28551 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:41.478529 28624 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:12:41.524902 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 949) took 2267 ms. Trace:
I20260709 12:12:41.525341 22858 rpcz_store.cc:276] 0709 12:12:39.257365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.257525 (+   160us) service_pool.cc:224] Handling call
0709 12:12:39.298292 (+ 40767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.432080 (+2133788us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400840e20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc41c0 00007fcceddc5231 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c
0709 12:12:41.491212 (+ 59132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.524628 (+ 33416us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400840b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:41.524820 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4733016064}
W20260709 12:12:41.526273 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.494486 22116 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:41.528355 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:38186 (request call id 1568) took 1087 ms. Trace:
I20260709 12:12:41.515542 22123 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:41.488226 22120 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 14: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:41.456722 28565 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:41.490796 28603 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:41.487208 28623 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:41.491564 28561 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:41.484365 28552 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:41.486378 28584 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:41.539781 28536 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:41.451568 28678 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:41.547976 22121 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:41.528674 22116 rpcz_store.cc:276] 0709 12:12:40.441159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.441270 (+   111us) service_pool.cc:224] Handling call
0709 12:12:41.528252 (+1086982us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:41.554040 22861 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:12:41.484588 28559 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:41.592535 28678 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:41.536273 28627 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:41.593374 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:41.593665 28627 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:41.594837 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:41.595312 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 3619) took 1182 ms. Trace:
I20260709 12:12:41.595691 22117 raft_consensus.cc:2410] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:41.595933 28627 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:41.596180 28565 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:41.588047 22017 catalog_manager.cc:5697] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:41.597306 22017 catalog_manager.cc:5697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:41.599038 22120 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:41.598780 22017 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 15 to 16, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 16 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.580982 28551 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:41.600208 28551 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:41.595716 22123 rpcz_store.cc:276] 0709 12:12:40.412914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.423366 (+ 10452us) service_pool.cc:224] Handling call
0709 12:12:41.595074 (+1171708us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540012b1d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:41.595220 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2494004992}
I20260709 12:12:41.601920 28613 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:41.602967 28551 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:41.604172 28613 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:41.579465 22114 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:41.608137 22114 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:41.556231 22193 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:41.580300 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:41.544337 28623 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:41.547742 28584 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:41.538411 28537 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:41.605324 22116 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:12:41.611824 22116 pending_rounds.cc:85] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 9
I20260709 12:12:41.612135 22116 pending_rounds.cc:107] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:12:41.612444 22116 raft_consensus.cc:2889] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:41.605619 22123 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9. Ops: []
W20260709 12:12:41.606382 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.611020 22017 catalog_manager.cc:5697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 11 to 12, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 12 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:41.614425 22017 catalog_manager.cc:5697] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 11 to 12, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 12 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.615996 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.616256 22017 catalog_manager.cc:5697] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:41.617336 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 147958us
I20260709 12:12:41.533896 28215 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:41.627056 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:41.627360 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.541833 28570 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:41.624200 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.630686 22198 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:41.625233 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:41.626152 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.626399 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:41.632175 22269 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:41.631305 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:41.632975 22266 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:41.629565 22017 catalog_manager.cc:5697] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 12 to 15, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 15 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.636294 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:41.637116 22196 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:41.640508 22121 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:41.643436 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:41.656716 22017 catalog_manager.cc:5697] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 14 to 15, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 15 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.661335 22017 catalog_manager.cc:5697] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 14 to 16, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 16 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.644986 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:41.665506 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:41.666551 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:41.666985 22861 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:41.667407 22861 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:41.667703 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:41.667860 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 3630) took 1055 ms. Trace:
I20260709 12:12:41.667505 22017 catalog_manager.cc:5697] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 14 to 16, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 16 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.668284 22121 rpcz_store.cc:276] 0709 12:12:40.612284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.426384 (+814100us) service_pool.cc:224] Handling call
0709 12:12:41.667685 (+241301us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54003ad4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:41.667806 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277688064}
I20260709 12:12:41.670048 22116 raft_consensus.cc:2393] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 14: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:41.670033 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:41.670661 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:41.662171 22114 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:41.672734 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:41.673887 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:41.675962 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:41.676590 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:41.677420 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:41.666445 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:41.686070 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.882334 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:42.085194 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.085203 22123 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 6.
W20260709 12:12:41.929375 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 256675us
W20260709 12:12:42.047600 28686 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.499s	user 0.004s	sys 0.011s
I20260709 12:12:42.053064 28570 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:12:42.091770 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.063426 22114 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:42.063963 22266 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:41.638847 28631 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:41.686703 28591 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 12:12:41.685828 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:41.680621 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.099604 22268 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:41.683864 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:41.683864 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.101202 22116 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:42.102367 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:42.103302 22116 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:42.104154 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:41.677963 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.105376 22121 raft_consensus.cc:2410] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:12:41.682986 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:41.868014 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 381180us
I20260709 12:12:41.739930 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:41.882102 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 396481us
I20260709 12:12:41.685047 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:41.824365 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 349851us
W20260709 12:12:42.055429 28512 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.013s
I20260709 12:12:42.056416 28603 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.067867 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.126252 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:42.055428 28642 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:42.068600 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:41.707546 22017 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 15 to 16, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 16 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:42.131043 22017 catalog_manager.cc:5697] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 13 to 14, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:42.050045 22194 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:12:42.054188 28559 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:42.070586 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.070804 28623 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:42.071456 28509 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.561s	user 0.021s	sys 0.001s
I20260709 12:12:42.071759 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.137681 22122 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:42.049008 28561 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:42.073284 22189 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:12:42.074229 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:42.046847 22861 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:42.055456 28552 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:42.132062 28512 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.058974 22269 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:12:42.134963 28584 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:42.139703 28551 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.147995 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:42.097167 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:42.148360 28551 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.114010 22116 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:42.150218 22116 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:42.150666 28551 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:42.151391 22116 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:42.151793 22272 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:42.141037 22861 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:42.143370 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.153435 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:42.140297 22117 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 9: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:12:42.144163 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 459160us
W20260709 12:12:42.127381 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.127784 22121 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:42.161922 22121 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:12:42.162292 22121 pending_rounds.cc:85] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 9
I20260709 12:12:42.162555 22121 pending_rounds.cc:107] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:12:42.162830 22121 raft_consensus.cc:2889] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:42.146936 22197 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:42.133806 22118 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:42.131553 22087 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:42.138827 22194 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:42.134027 22017 catalog_manager.cc:5697] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 13 to 15, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 15 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:42.134552 28496 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:42.090524 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.180670 22195 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:42.121985 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:38186 (request call id 1575) took 1475 ms. Trace:
W20260709 12:12:42.152549 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 66159.5us
I20260709 12:12:42.091840 28536 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:42.180177 22123 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
W20260709 12:12:42.187798 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 56357.3us
I20260709 12:12:42.181687 22114 rpcz_store.cc:276] 0709 12:12:40.619265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.492993 (+873728us) service_pool.cc:224] Handling call
0709 12:12:42.062255 (+569262us) spinlock_profiling.cc:243] Waited 85.6 ms on lock 0x7b54002558d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddb9a3d 00007fccf2d89cd0 00007fccec30e254 00007fccec30e1e2 00007fccec30e111 00007fccec30e08c 00007fccec30d342 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:42.094203 (+ 31948us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196877696}
I20260709 12:12:42.189733 28691 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:42.190157 28691 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.190197 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3640) took 1209 ms. Trace:
I20260709 12:12:42.190593 28691 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.190619 22120 rpcz_store.cc:276] 0709 12:12:40.981135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.600102 (+618967us) service_pool.cc:224] Handling call
0709 12:12:41.600345 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.600533 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:42.049917 (+449384us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.189829 (+139912us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.189892 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:42.189949 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.190020 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.190140 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":453201,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"thread_start_us":459093,"threads_started":2}
I20260709 12:12:42.196977 28561 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:42.187355 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.203050 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:42.180346 22017 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:42.210973 22017 catalog_manager.cc:5697] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 12 to 14, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 14 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
W20260709 12:12:42.222019 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 60623.1us
I20260709 12:12:42.231771 22017 catalog_manager.cc:5697] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 11 to 13, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 13 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:42.233804 22017 catalog_manager.cc:5697] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 12 to 14, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:42.242997 22861 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:42.146898 28512 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:42.252362 28642 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:42.253008 28642 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.255213 28642 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:42.255824 28690 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:42.200824 28496 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.187182 28552 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:12:42.265715 28552 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:42.266930 28552 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:42.268388 28702 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.212s	user 0.000s	sys 0.004s
W20260709 12:12:42.270903 28698 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.213s	user 0.005s	sys 0.006s
I20260709 12:12:42.272389 28496 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:42.257860 28690 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.273485 28690 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:42.274957 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3090) took 1071 ms. Trace:
I20260709 12:12:42.275417 22197 rpcz_store.cc:276] 0709 12:12:41.203335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.203454 (+   119us) service_pool.cc:224] Handling call
0709 12:12:41.238354 (+ 34900us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:42.165704 (+927350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.274584 (+108880us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54001beed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:42.274867 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088802688}
W20260709 12:12:42.258376 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49024.3us
I20260709 12:12:42.261035 27951 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:42.277190 27951 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:42.263576 28330 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:42.180485 28688 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
W20260709 12:12:42.246440 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59197.8us
I20260709 12:12:42.246488 22017 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 16 to 17, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 17 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:42.282867 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.283092 22017 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 10 to 13, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 13 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:12:42.205421 28627 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.299077 27951 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:42.276492 28690 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:42.142859 28509 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.147406 28584 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.313994 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:42.318630 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.249464 28559 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:42.250432 28450 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:42.281272 28561 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:42.324446 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.205097 28536 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.338950 22272 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:12:42.339418 22272 pending_rounds.cc:85] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 10
I20260709 12:12:42.339643 22272 pending_rounds.cc:107] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:12:42.339879 22272 raft_consensus.cc:2889] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:42.341454 22196 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:42.342602 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.344713 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.309028 28631 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.371134 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.372313 22269 raft_consensus.cc:2410] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:42.318365 28570 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:42.374687 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:42.326610 28496 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:42.377611 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.313912 28627 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:42.406939 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.419667 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:42.395731 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.421429 22269 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:42.422181 28627 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:42.332091 28551 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:12:42.380015 22267 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:42.416316 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:42.427690 22268 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:42.348222 28565 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:42.429081 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.428304 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:42.376004 28661 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:12:42.372394 28591 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:42.372087 28624 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:42.333248 28559 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:42.471608 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.473066 22163 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:42.416118 28561 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:42.342264 28450 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:42.424796 28556 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:42.374394 28631 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:42.528918 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 266949us
I20260709 12:12:42.531880 22864 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:42.532281 22861 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:42.544840 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:42.545548 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:42.546350 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:42.548951 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:42.551973 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:42.558771 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 130508us
I20260709 12:12:42.564043 22268 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
W20260709 12:12:42.574887 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 197335us
I20260709 12:12:42.577435 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:42.477126 28561 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:42.586798 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:42.484123 28331 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:42.586824 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 307273us
W20260709 12:12:42.590924 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.463730 28700 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 12:12:42.518117 28712 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:42.601791 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.577490 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.475543 28591 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.615962 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.619059 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.622519 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.638788 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.477692 28624 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:42.596737 28561 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:42.658332 28631 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:42.587834 28603 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:42.661041 28536 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:42.661919 28536 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:42.662358 28536 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.662834 28624 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:42.663551 28624 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:42.663794 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3637) took 1724 ms. Trace:
I20260709 12:12:42.649928 28627 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:42.650352 28591 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:42.651458 28701 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.592s	user 0.003s	sys 0.000s
W20260709 12:12:42.652452 28706 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:12:42.653594 28705 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:12:42.593003 28623 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:42.654381 28699 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:42.630924 28642 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:42.593264 28709 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:42.656816 28677 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:42.594476 28331 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:42.664374 22115 rpcz_store.cc:276] 0709 12:12:40.939479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.520322 (+580843us) service_pool.cc:224] Handling call
0709 12:12:41.522224 (+  1902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.626175 (+103951us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:42.075980 (+449805us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.313596 (+237616us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.313676 (+    80us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:42.313747 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.377003 (+ 63256us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18000663a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:12:42.663482 (+286479us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400215f54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:42.663547 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.663719 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6081,"prepare.queue_time_us":427971,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":6349,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":10554,"spinlock_wait_cycles":241074432,"thread_start_us":472348,"threads_started":2,"wal-append.queue_time_us":446187}
I20260709 12:12:42.646037 28496 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:42.687354 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 127805us
I20260709 12:12:42.662760 28536 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:42.689296 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.676329 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:42.665274 28551 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:42.712410 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:42.715785 28642 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:42.716545 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:42.716652 28642 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:42.717351 22864 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:42.717828 22864 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:42.715721 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:42.717934 28642 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:42.719214 22864 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:42.721484 22864 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:42.726786 28688 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.727456 28688 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.729799 28688 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:42.731702 22115 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:12:42.732980 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.735069 22121 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:42.736665 22119 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:42.739158 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:42.741531 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.743940 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.745260 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.748441 28688 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:42.749312 22864 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:42.752257 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.755599 28688 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:42.758129 22088 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:42.683935 28591 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:42.766510 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 81128.4us
W20260709 12:12:42.770109 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 278199us
I20260709 12:12:42.772533 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.775846 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:42.776173 22121 pending_rounds.cc:85] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 10
I20260709 12:12:42.776467 22121 pending_rounds.cc:107] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:12:42.776502 22120 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:12:42.776876 22121 raft_consensus.cc:2889] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:42.688259 28550 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:42.778550 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 966) took 1133 ms. Trace:
I20260709 12:12:42.632107 28717 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.160s
I20260709 12:12:42.664108 28624 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.697374 28331 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:42.782393 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.790969 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.792520 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.794312 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.797181 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.798389 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.798403 22272 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:12:42.799320 22268 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:42.800134 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.800881 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.801111 22272 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:42.802662 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.765424 28509 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:42.779119 22858 rpcz_store.cc:276] 0709 12:12:41.645076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.645234 (+   158us) service_pool.cc:224] Handling call
0709 12:12:41.681175 (+ 35941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:41.681563 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.681594 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:41.682079 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.014068 (+331989us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:42.014147 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.014257 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.527128 (+512871us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:42.778192 (+251064us) raft_consensus.cc:1685] finished
0709 12:12:42.778223 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.778474 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34436,"raft.queue_time_us":1895,"raft.run_cpu_time_us":9934,"raft.run_wall_time_us":349301,"spinlock_wait_cycles":39687040,"thread_start_us":331444,"threads_started":1,"wal-append.queue_time_us":376657}
I20260709 12:12:42.791833 22264 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:42.802624 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:42.786433 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 167455us
I20260709 12:12:42.818799 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:42.812602 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.769847 28642 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:42.765797 28584 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:42.630281 28712 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:42.823608 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 54673.7us
I20260709 12:12:42.824998 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:42.822365 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:42.780154 28496 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.835064 22162 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.835927 22268 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:12:42.841554 22265 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:42.816996 28559 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:42.878528 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43558.1us
I20260709 12:12:42.778595 28591 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.831496 28623 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.810916 28450 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:42.839326 28642 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:42.787303 28550 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.846606 28512 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:42.882455 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.845131 28700 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:42.888607 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.887998 28631 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:42.894416 28712 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:42.844313 28496 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:42.914410 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:42.882848 28716 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:42.931258 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:42.938823 28734 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 12:12:42.963187 28720 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:12:42.964570 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:42.965514 22192 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:12:42.953102 22162 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:42.976104 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 173582us
I20260709 12:12:42.978515 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:42.921456 28709 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:42.921558 28678 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:42.990281 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2666) took 1517 ms. Trace:
I20260709 12:12:42.997728 22195 rpcz_store.cc:276] 0709 12:12:41.472646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.472797 (+   151us) service_pool.cc:224] Handling call
0709 12:12:41.473124 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.181232 (+708108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.989943 (+808711us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54002e72d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:42.990193 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626718592}
I20260709 12:12:42.989308 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:43.026340 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47940.3us
I20260709 12:12:43.027475 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:42.941823 28565 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.899531 28623 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:42.978009 28537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.005s	sys 0.022s
W20260709 12:12:43.054021 28537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.006s	sys 0.023s
I20260709 12:12:43.035567 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.021416 28734 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:42.973614 28716 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:43.028987 28730 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:43.040922 28712 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:42.939591 28631 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:42.984009 28561 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:43.091727 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 102516us
I20260709 12:12:43.080374 28711 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:43.134938 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2685) took 1063 ms. Trace:
I20260709 12:12:43.140483 28330 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.140012 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:12:43.083657 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 54894.3us
I20260709 12:12:43.145783 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.093122 28734 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:43.107674 28727 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:43.141258 22198 rpcz_store.cc:276] 0709 12:12:42.071192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.071338 (+   146us) service_pool.cc:224] Handling call
0709 12:12:42.071754 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:42.134705 (+ 62951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.134749 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:42.135330 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.267349 (+132019us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b48000ce358. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf2cebaa1 00007fccf2ce2b37 00007fccf2ce29ca 00007fccf2dda26f 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508 00007fccf2dee488 00007fccf2dee443 00007fccf2ded6ec 00007fccf1d17a96
0709 12:12:42.541811 (+274462us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:42.541861 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.541925 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:43.121735 (+579810us) raft_consensus.cc:1685] finished
0709 12:12:43.121767 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.134848 (+ 13081us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62491,"raft.queue_time_us":80398,"raft.run_cpu_time_us":2967,"raft.run_wall_time_us":85030,"spinlock_wait_cycles":31046912,"thread_start_us":333615,"threads_started":1,"wal-append.queue_time_us":651199}
I20260709 12:12:43.115499 28694 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:43.153465 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:43.061311 28565 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:43.163841 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.165576 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.136216 28551 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:43.081432 28678 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:43.159909 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:43.126652 28700 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:43.177670 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.142755 28688 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:43.187615 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.149354 28537 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:43.162448 28512 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:43.163596 28699 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:43.170048 28730 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:12:43.196868 28694 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:43.142088 28330 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.125272 28642 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:43.197075 28744 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
I20260709 12:12:43.195755 28537 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.156960 28753 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:43.199121 28699 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:43.166601 28727 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:43.210359 28726 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:12:43.180250 28624 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:43.243045 28631 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:43.234397 28537 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:43.210793 28734 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.244453 28623 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:43.245137 28734 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.211814 28757 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:43.239858 28699 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:43.247048 28757 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:43.248734 28713 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:12:43.249430 28757 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:43.179721 28551 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.222424 22269 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:43.219923 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 402744us
I20260709 12:12:43.212216 28709 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:43.198478 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 245602us
I20260709 12:12:43.188967 28750 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:43.207242 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:43.202118 28730 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:43.195214 28711 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:43.260818 28711 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:43.261279 28711 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:43.261719 28721 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:12:43.263258 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1584) took 1015 ms. Trace:
I20260709 12:12:43.200785 28760 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:43.264189 28537 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.265118 28760 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:43.267097 28691 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.076s	user 0.003s	sys 0.011s
I20260709 12:12:43.267572 28691 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:43.210928 28719 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260709 12:12:43.246462 28727 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.263717 22122 rpcz_store.cc:276] 0709 12:12:42.247831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.247984 (+   153us) service_pool.cc:224] Handling call
0709 12:12:42.248439 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:42.260349 (+ 11910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.260390 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:42.260971 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.528556 (+267585us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:42.533851 (+  5295us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.535109 (+  1258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.535207 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:43.262987 (+727780us) raft_consensus.cc:1685] finished
0709 12:12:43.263011 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.263189 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11405,"prepare.queue_time_us":4547,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":13648,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":220,"thread_start_us":267148,"threads_started":1,"wal-append.queue_time_us":820917}
I20260709 12:12:43.251569 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:43.223556 28450 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:43.254248 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2687) took 1180 ms. Trace:
I20260709 12:12:43.259023 28512 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.260293 28730 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:12:43.267820 28537 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.270030 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2057) took 1123 ms. Trace:
I20260709 12:12:43.201850 28694 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:43.272965 28700 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.273904 28496 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.233913 28550 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:43.275943 28678 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.277695 28330 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.277844 28565 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.198372 28688 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.251080 28591 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:43.257726 28741 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.279s	user 0.001s	sys 0.001s
W20260709 12:12:43.264117 28733 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:12:43.241918 28716 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:43.280290 28536 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.000s
W20260709 12:12:43.280732 28718 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.506s	user 0.009s	sys 0.013s
I20260709 12:12:43.373937 28551 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:43.302771 28764 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:43.381322 28764 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.386114 28691 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.289350 22191 rpcz_store.cc:276] 0709 12:12:42.074092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.074244 (+   152us) service_pool.cc:224] Handling call
0709 12:12:42.074526 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:42.135542 (+ 61016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.135572 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:42.135990 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.480173 (+344183us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:42.789101 (+308928us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.805008 (+ 15907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.805103 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:43.253989 (+448886us) raft_consensus.cc:1685] finished
0709 12:12:43.254011 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.254173 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90064,"prepare.queue_time_us":720010,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":4943,"raft.queue_time_us":128435,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":41600,"thread_start_us":652251,"threads_started":2,"wal-append.queue_time_us":836544}
I20260709 12:12:43.393731 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.394655 22192 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:43.293753 22162 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.267699 28760 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:43.231784 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 44276.2us
I20260709 12:12:43.298384 22270 rpcz_store.cc:276] 0709 12:12:42.146932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.153933 (+  7001us) service_pool.cc:224] Handling call
0709 12:12:42.225705 (+ 71772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:42.225951 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.225987 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:42.245195 (+ 19208us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.586631 (+341436us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:42.586678 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.586770 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:43.269792 (+683022us) raft_consensus.cc:1685] finished
0709 12:12:43.269818 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.269964 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":256481,"threads_started":1,"wal-append.queue_time_us":591664}
I20260709 12:12:43.301033 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:43.301638 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:43.297691 28487 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:43.318535 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.319581 22122 pending_rounds.cc:85] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 12
I20260709 12:12:43.422937 22122 pending_rounds.cc:107] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:12:43.297890 28561 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.351833 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:43.430804 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2683) took 1747 ms. Trace:
I20260709 12:12:43.301396 28694 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.355367 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:43.291430 28450 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.359045 28688 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:43.423269 22122 raft_consensus.cc:2889] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:43.432862 22190 rpcz_store.cc:276] 0709 12:12:41.683895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.684040 (+   145us) service_pool.cc:224] Handling call
0709 12:12:41.684392 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:42.083561 (+399169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.083598 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:42.089318 (+  5720us) log.cc:844] Serialized 52 byte log entry
0709 12:12:42.481825 (+392507us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:42.481870 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.481946 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:43.280051 (+798105us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:43.389165 (+109114us) raft_consensus.cc:1685] finished
0709 12:12:43.389198 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.430725 (+ 41527us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":442975,"raft.queue_time_us":410395,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":26208,"spinlock_wait_cycles":120746880,"thread_start_us":340605,"threads_started":1,"wal-append.queue_time_us":536038}
I20260709 12:12:43.425949 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.439651 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:12:43.428640 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 135413us
I20260709 12:12:43.442416 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.445763 28734 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:12:43.429651 28701 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:12:43.444365 28591 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:43.446631 28734 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:43.447108 28734 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:43.449985 28450 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.453994 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.455394 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.462193 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:43.462476 22162 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.417294 28764 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.465767 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.429960 28751 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:43.392200 28536 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.471406 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:43.464192 28623 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:43.470888 28537 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:43.466187 28591 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:43.473006 28710 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:43.430459 28699 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.454918 28550 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:12:43.528455 28740 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:43.493429 28678 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:43.537889 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 65624.5us
I20260709 12:12:43.473779 28624 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:12:43.463963 28750 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:12:43.459931 28709 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:12:43.537201 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:43.539703 28712 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:43.548321 28331 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.003s
I20260709 12:12:43.556636 28331 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.537766 28710 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.551138 28624 consensus_queue.cc:1243] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:12:43.549649 28767 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:12:43.546072 28623 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:12:43.547569 28760 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:43.556679 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:43.568347 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:43.569434 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:43.570606 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:43.571580 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:43.574069 22115 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 19: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:43.573294 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:43.576548 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:43.538776 28751 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:12:43.560839 28774 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:43.545814 28512 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:12:43.559090 28331 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.598671 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:43.582295 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:43.578094 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:43.604408 22122 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:43.604913 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:43.605629 22114 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:43.584332 28536 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:43.584642 28699 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.584928 28709 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:43.612691 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:43.585222 28624 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:43.586334 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:43.615280 22117 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:12:43.616048 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:43.588892 28710 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:43.579386 28552 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:43.624461 28552 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:43.624682 28749 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:43.624979 28552 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:43.625190 28749 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:43.625610 28749 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.625867 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.626772 22195 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:43.627151 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.627583 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.628364 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.628710 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:43.629055 22197 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:43.630435 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.630890 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.632229 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.632901 22195 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:43.570785 28550 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:43.633620 28550 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:43.590788 28712 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:43.572285 28561 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:12:43.581506 28691 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:43.581293 28688 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:43.642058 28688 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.642693 28688 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:43.594800 28716 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.595626 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:43.596725 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.644248 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.645196 22192 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:12:43.645258 22198 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:43.547410 28766 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:12:43.580263 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:43.611223 22190 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:43.582873 28760 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:43.603157 28758 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:43.661681 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 81513.8us
I20260709 12:12:43.635682 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:43.638469 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:43.638871 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.613248 28709 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:43.647696 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:43.649546 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:43.649528 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:43.650520 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:43.661862 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:43.598836 28774 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:43.664467 22270 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:43.636385 28330 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:43.667666 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:43.669907 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:43.668129 22267 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:43.668426 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:43.634716 28550 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.683666 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.684010 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.685041 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.685269 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:43.682760 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.671444 28559 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:43.668761 28551 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:43.669386 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:43.672318 28561 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:43.674024 28734 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.675038 28724 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:43.675115 28711 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.630395 22114 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:43.677711 28760 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.699191 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:43.647694 28712 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.647482 28691 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.679942 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.679778 28774 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.681908 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.682947 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.704174 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:43.671160 22268 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:43.698984 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:43.678449 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:43.705554 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.700613 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:43.706764 22122 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:43.700505 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:43.707719 22190 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:43.682834 28330 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:43.711494 22263 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:43.706772 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:43.712683 22117 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:43.702368 28565 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:43.713321 28694 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.714033 28565 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:43.714520 28565 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.715818 28694 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:43.704849 22114 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:43.689503 28559 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:43.717165 28559 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:43.692373 28551 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.722270 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:43.722949 28565 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.724920 22190 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:43.690577 28717 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.726677 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:43.655936 28716 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.692889 28724 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:43.730985 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.692549 28331 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:43.733424 28776 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:43.734388 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 171909us
I20260709 12:12:43.708285 28550 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:43.706125 28691 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:43.724759 28330 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:43.745550 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.748394 22197 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:43.739387 28774 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:43.735185 28724 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.669283 28758 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.730280 28717 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.741210 28331 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.782099 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2060) took 1634 ms. Trace:
I20260709 12:12:43.744824 28536 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:12:43.750172 28750 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:12:43.731349 28709 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.742022 28776 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.822213 28734 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:43.783356 28738 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:43.754448 28623 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:12:43.853902 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:43.784098 22266 rpcz_store.cc:276] 0709 12:12:42.147849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.150144 (+  2295us) service_pool.cc:224] Handling call
0709 12:12:42.150431 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.150656 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:42.528197 (+377541us) log.cc:844] Serialized 14 byte log entry
0709 12:12:43.781687 (+1253490us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18003defa0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fcceddba060 00007fcceddcc716 00007fccedddd287
0709 12:12:43.781771 (+    84us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:43.781806 (+    35us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:43.781840 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.781934 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.782052 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30392,"prepare.queue_time_us":500106,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":126300,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":31434,"spinlock_wait_cycles":31063808,"thread_start_us":800905,"threads_started":3,"wal-append.queue_time_us":449527}
I20260709 12:12:43.866669 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:43.860029 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:43.860711 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:43.868252 22264 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:43.868356 22271 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:43.864557 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:43.861076 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:43.869253 22269 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:43.873667 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:43.874403 22270 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:43.875941 22116 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:43.877303 22267 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:12:43.884615 22272 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
W20260709 12:12:43.866542 28730 consensus_meta.cc:287] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.001s
I20260709 12:12:43.925688 28730 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.929028 22265 raft_consensus.cc:1240] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:12:43.888746 28709 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:43.933807 28750 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:43.934613 28750 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:43.937505 28750 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:43.938330 28331 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:43.939477 28779 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:12:43.941164 28716 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.941164 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:43.942130 22864 raft_consensus.cc:2393] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 19: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:43.944977 22272 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:43.945078 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:43.946010 22267 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:43.945078 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:43.928422 28730 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:43.891269 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.893175 28776 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:43.894975 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.894975 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:43.896304 22198 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:43.951946 22194 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:43.953431 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:43.953824 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.899217 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:43.902889 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:43.904109 28565 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:43.911324 28559 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.919473 28740 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:43.939916 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:43.953864 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.958498 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:43.962862 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.963821 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:43.889539 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.967960 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:43.974821 22193 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:43.976233 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:43.980262 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:43.982553 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:43.989418 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:43.984419 22117 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:43.992319 22189 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:43.995218 22194 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:44.005488 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:44.012562 22189 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:43.895128 28552 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:43.985245 28730 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:44.010334 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:44.014961 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:44.016060 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:44.024698 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 146775us
I20260709 12:12:44.029294 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:44.004010 28536 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:44.042649 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:44.053603 28781 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:12:44.036825 28711 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:44.065243 28330 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.067306 28691 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.068291 28536 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.068460 28330 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.070086 28749 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.004514 28774 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:12:44.023061 28584 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:44.027751 28496 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:44.076272 28717 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.077358 28565 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:44.032670 28758 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.020690 28730 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.081879 22196 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:44.087707 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:44.088817 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.091269 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:44.020658 28561 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:44.072671 28559 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.106761 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:44.114950 28561 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:44.114944 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 92842us
I20260709 12:12:44.115648 28559 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.115760 28561 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:44.116281 28559 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.116411 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:44.118791 28559 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.119374 28559 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:44.119837 28559 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:44.123692 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.125015 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.126291 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:44.133677 22117 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:44.127707 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.093951 28536 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:44.148056 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:44.112353 28496 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.134567 28776 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:44.109100 28584 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:44.113580 28724 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.134560 28774 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:44.136377 28709 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:44.129690 28730 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:44.161090 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:44.165112 22117 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:44.189553 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 61898.9us
I20260709 12:12:44.190582 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.158411 28496 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:44.202986 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:44.160460 28623 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:44.162024 28584 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:44.153527 28559 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.216632 28778 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:44.204695 28712 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.217417 28778 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.219841 28778 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:44.220368 28778 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:44.220880 28778 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.223125 28778 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:44.223717 28778 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.241094 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:44.242276 22123 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 17: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:44.245369 22123 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:12:44.250316 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 60868.8us
I20260709 12:12:44.255743 22117 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:44.256634 22123 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:44.256903 22117 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:44.259891 28709 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:44.223177 28800 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:44.267746 28796 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:12:44.270442 28712 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:44.283886 22861 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:44.326658 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:44.333262 28797 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:44.336135 28808 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:44.336830 28808 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.333981 28797 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:44.338753 28797 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:44.343498 22117 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:44.339128 28808 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:44.344621 28799 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:44.386219 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:44.346159 22117 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:44.390497 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:44.329811 28800 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:44.395887 28784 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:12:44.401866 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:44.342706 28691 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.406661 22269 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:12:44.399065 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:44.346900 28552 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.409982 22117 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:44.411576 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 221071us
W20260709 12:12:44.411471 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 208568us
I20260709 12:12:44.414105 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.415212 28749 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:44.414839 22117 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:44.407366 28780 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.412s	user 0.003s	sys 0.000s
W20260709 12:12:44.407665 28802 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:44.422233 22263 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:44.418061 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:44.420872 22831 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.423827 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:44.428325 22117 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:12:44.428892 22117 pending_rounds.cc:85] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 9
I20260709 12:12:44.429694 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:44.431305 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.431483 22193 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:44.432590 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:44.429154 22117 pending_rounds.cc:107] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:12:44.347785 28799 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.433426 22117 raft_consensus.cc:2889] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:44.435460 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:44.435969 22087 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:44.437287 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:44.438901 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:44.439252 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:44.436957 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:44.438207 28794 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:44.441707 28798 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:12:44.429301 28709 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.428232 28805 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:44.449831 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:44.452235 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:44.439512 28803 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:44.426950 28753 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:44.448814 28805 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:44.454522 28552 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:44.455559 28805 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:44.456104 28792 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:12:44.451123 28806 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:12:44.457442 28688 consensus_meta.cc:287] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.814s	user 0.014s	sys 0.000s
I20260709 12:12:44.447577 28748 consensus_queue.cc:1059] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:12:44.457834 28688 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.458534 28748 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:44.458884 28748 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:44.459704 28748 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.461330 28748 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:44.466378 28799 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:44.445437 28804 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:44.469050 28803 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.469693 28803 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:44.449959 28794 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:44.412272 28800 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.473999 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 3908) took 1268 ms. Trace:
I20260709 12:12:44.474154 28623 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:44.450167 28724 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.475106 28023 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.474520 28800 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:44.479771 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.480611 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:44.455065 28561 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.474436 22265 rpcz_store.cc:276] 0709 12:12:43.205890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.206838 (+   948us) service_pool.cc:224] Handling call
0709 12:12:43.238342 (+ 31504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.929535 (+691193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.473764 (+544229us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400226fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:44.473932 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1587860736}
I20260709 12:12:44.480996 28691 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:44.483955 28688 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.485097 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:44.504351 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:44.484941 28730 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.505455 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:44.488083 28550 consensus_meta.cc:287] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.003s
I20260709 12:12:44.489928 28496 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.492091 28797 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.494079 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:44.526177 22194 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.496508 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:44.527688 22237 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.546192 22237 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.523576 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:44.548223 28691 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:44.554620 28797 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.555821 28561 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.551359 28550 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:44.557073 28753 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:44.557480 28730 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:44.558218 28730 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:44.558656 28730 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:44.558396 28805 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.559502 28730 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.560850 28805 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:44.527942 28806 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:12:44.562126 28806 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:44.475631 28023 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.562503 28806 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:44.562482 28809 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:12:44.565730 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:44.574244 22194 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
W20260709 12:12:44.574751 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 48549us
I20260709 12:12:44.575220 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:44.579993 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:44.582348 22830 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:44.585337 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:44.586197 22191 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:44.499692 28536 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.551618 28799 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:44.501677 28584 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.560699 28730 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:44.593091 28797 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:44.598915 28764 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:44.640235 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:44.630327 28722 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.643457 28496 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.643869 28584 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:44.634096 28764 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:44.652098 28764 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.663180 28803 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.665518 28797 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:44.665809 28803 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:44.696627 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 116512us
I20260709 12:12:44.702710 22087 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:44.726377 22192 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:44.716461 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:44.737233 22114 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:44.751101 22861 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
W20260709 12:12:44.640849 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 127195us
I20260709 12:12:44.752981 22863 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011db458534b4bc8876e63453a07b86b"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:44.754087 22863 raft_consensus.cc:606] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:44.751258 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.754858 22858 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:44.754776 22831 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:44.757557 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:44.764495 28496 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:44.645391 28722 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.774004 22193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:44.774993 28803 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:44.780015 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:44.786911 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:44.787802 28450 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:44.763154 28023 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.798149 28584 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:44.801059 22193 raft_consensus.cc:606] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:44.814970 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.817488 28751 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:44.818351 28496 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:44.819494 28496 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.822403 28722 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:44.825860 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3102) took 1148 ms. Trace:
I20260709 12:12:44.826704 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:44.828006 22263 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:44.828222 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3099) took 1200 ms. Trace:
I20260709 12:12:44.828986 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:44.822785 28496 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:44.828610 22197 rpcz_store.cc:276] 0709 12:12:43.627939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.629705 (+  1766us) service_pool.cc:224] Handling call
0709 12:12:43.630039 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.748891 (+118852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.827512 (+1078621us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400177d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:44.827977 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271094016}
I20260709 12:12:44.823655 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.815068 28536 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:44.802323 28450 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.826534 22196 rpcz_store.cc:276] 0709 12:12:43.677546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.678102 (+   556us) service_pool.cc:224] Handling call
0709 12:12:44.825429 (+1147327us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54000fc3d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:44.825627 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644854016}
I20260709 12:12:44.849826 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:44.870675 28450 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:44.872638 22858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44711cbd4d234e36807a94726a691570"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:44.873740 22858 raft_consensus.cc:606] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.876533 28749 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:44.883103 28750 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:44.893483 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:44.897387 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:44.915115 28749 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.916168 28734 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:44.916709 28734 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:44.917979 28749 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.898396 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:44.918236 28734 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.899078 22270 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:44.900597 22271 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:44.913367 28624 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:44.926863 28624 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:44.928442 22269 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:44.928726 28624 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.930341 28624 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.931159 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:44.915535 22268 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:44.926272 28734 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:44.934098 22861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:44.934798 22861 raft_consensus.cc:606] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.935179 22861 raft_consensus.cc:614] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:44.913419 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 98865.1us
I20260709 12:12:44.937320 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.938704 28724 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.939196 22162 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.940505 28699 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:44.942816 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.946516 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:44.906210 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:44.950759 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 127522us
I20260709 12:12:44.951042 28281 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:44.951381 22858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:44.951820 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:44.952169 22858 raft_consensus.cc:606] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:44.952003 28281 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:44.953138 28750 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:44.951112 22831 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:44.954874 28281 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:44.955628 28281 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:44.956516 28281 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.956665 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:44.957103 28281 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:44.965206 28787 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.564s	user 0.001s	sys 0.003s
I20260709 12:12:44.968243 22858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:44.969165 22858 raft_consensus.cc:606] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:44.969461 28790 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.644s	user 0.004s	sys 0.003s
I20260709 12:12:44.973066 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2606) took 1093 ms. Trace:
I20260709 12:12:44.973551 22116 rpcz_store.cc:276] 0709 12:12:43.879319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.879467 (+   148us) service_pool.cc:224] Handling call
0709 12:12:43.884656 (+  5189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:43.885044 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:43.885072 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:43.885516 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:12:44.094355 (+208839us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:44.094403 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.094591 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:44.968532 (+873941us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:44.972464 (+  3932us) raft_consensus.cc:1685] finished
0709 12:12:44.972489 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:44.972851 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":41039,"spinlock_wait_cycles":14424960,"thread_start_us":208499,"threads_started":1,"wal-append.queue_time_us":354358}
I20260709 12:12:44.977864 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:44.979983 22864 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:44.975970 28806 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:44.981042 28806 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:44.982447 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3117) took 1225 ms. Trace:
W20260709 12:12:44.989557 28570 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
W20260709 12:12:44.992898 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51840.7us
I20260709 12:12:44.920418 28551 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:44.999089 22263 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:45.001353 22861 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:45.007143 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:45.008286 28612 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:44.982905 22195 rpcz_store.cc:276] 0709 12:12:43.756982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.757237 (+   255us) service_pool.cc:224] Handling call
0709 12:12:43.757632 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:43.759491 (+  1859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:43.759540 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:43.777145 (+ 17605us) log.cc:844] Serialized 26 byte log entry
0709 12:12:44.109766 (+332621us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:44.109829 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.109930 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:44.964558 (+854628us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b24000ddf18. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceab5b9c4 00007fcceab59acb 00007fccead14dc9 00007fccead14a55 00007fccead1409d 00007fcced94610e 00007fcced95d88c 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221
0709 12:12:44.981985 (+ 17427us) raft_consensus.cc:1685] finished
0709 12:12:44.982014 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:44.982270 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1290,"raft.queue_time_us":1595,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":21145,"spinlock_wait_cycles":16978176,"thread_start_us":237903,"threads_started":1,"wal-append.queue_time_us":476483}
I20260709 12:12:45.014175 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:45.017001 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:45.018362 22192 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:45.021610 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:45.025326 22191 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:45.027040 28750 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:45.028972 28724 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:45.030575 28612 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:45.030622 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 67703.7us
W20260709 12:12:45.031626 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.028275 28750 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.032298 28612 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:45.033540 28612 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:45.035404 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 51690.7us
W20260709 12:12:45.035615 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 82382.9us
W20260709 12:12:45.042604 28690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.412s	user 0.026s	sys 0.025s
W20260709 12:12:45.043376 28690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.419s	user 0.026s	sys 0.025s
I20260709 12:12:45.044142 22163 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:45.053305 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.044179 28612 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.058949 28699 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:45.077210 28512 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:45.094700 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:45.058465 22830 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:45.079504 28551 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
W20260709 12:12:45.087361 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 43617.2us
W20260709 12:12:45.097934 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 61735.2us
I20260709 12:12:45.078161 28751 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:45.100653 28814 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:12:45.101475 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 158927us
W20260709 12:12:45.102631 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.103659 28613 raft_consensus.cc:993] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:45.103711 28814 raft_consensus.cc:993] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:45.104256 28450 raft_consensus.cc:1081] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:45.104307 28814 raft_consensus.cc:1081] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:45.103672 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:45.107587 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:45.109133 28716 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:45.108950 28591 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 12:12:45.109592 28716 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:45.110738 28716 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.112229 28716 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:45.124979 28699 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:45.133458 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.133200 22088 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:45.147114 28591 consensus_queue.cc:1243] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:12:45.149567 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:45.156304 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:45.150089 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 125689us
I20260709 12:12:45.164414 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:45.172039 28804 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:45.172426 28710 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:45.173096 28710 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:45.173542 28710 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:45.151185 28724 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:45.177981 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 69168.5us
I20260709 12:12:45.189965 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:45.191419 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:45.203138 28281 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.208051 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:45.213510 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:45.216859 22267 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:45.195190 22116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44711cbd4d234e36807a94726a691570"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:45.208925 28764 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:45.209630 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 130065us
I20260709 12:12:45.183992 28749 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:45.228152 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:45.228843 22266 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:45.229262 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:45.229951 22272 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:45.212594 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:45.249586 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:45.250761 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.253548 22118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "011db458534b4bc8876e63453a07b86b"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:45.254189 22118 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:45.254549 22118 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:45.261238 28709 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:45.261435 28536 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.261890 28709 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.262094 28536 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.182737 28804 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.217623 22116 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:45.264132 22116 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:45.264350 28709 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.268023 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.269647 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:45.269845 28709 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:45.270516 28709 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.271164 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:45.272513 28559 consensus_queue.cc:1059] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:45.213021 22269 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:45.273674 28559 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:45.274049 28559 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:45.275262 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:45.275105 28559 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:45.276006 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57865.8us
I20260709 12:12:45.211982 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:45.276881 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:45.214391 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:45.277611 28730 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:45.277922 22265 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:45.278110 28730 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:45.279253 28730 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.280504 28730 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.225162 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:45.226511 28281 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:45.196403 28724 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.272862 28709 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.212399 28642 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:45.281363 28734 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.282172 28536 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.289682 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:45.211920 22271 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:45.290020 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:45.291780 22270 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.294055 22266 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:45.276562 28559 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:45.297601 22265 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:45.300832 22116 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.309612 22269 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:45.311048 22831 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:45.319918 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:45.299991 28722 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:45.298580 28551 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:45.329073 22120 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:45.345077 22267 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:45.353519 22272 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
W20260709 12:12:45.358765 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47827.6us
I20260709 12:12:45.362169 22116 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:45.370919 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.330018 28722 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.310904 28734 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.374197 28722 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:45.376901 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 269414us
I20260709 12:12:45.378693 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:45.378937 28764 raft_consensus.cc:993] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:45.379433 28764 raft_consensus.cc:1081] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:45.375015 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:45.385174 28729 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:45.388427 28544 raft_consensus.cc:993] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:45.389045 28544 raft_consensus.cc:1081] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:12:45.348426 28750 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:45.392216 28750 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.394708 28750 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.394980 28710 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.392091 28722 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.397747 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.398275 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.399003 22123 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:45.399194 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.400882 22119 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.408182 28722 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.412128 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:45.412379 22114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:45.369288 28613 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:45.408881 28551 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.412873 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:45.412930 22114 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:45.450908 22114 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.413146 22121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:12:45.454732 22121 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:45.457729 22121 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:45.453467 28591 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.461349 28591 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.463198 28833 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:45.463994 28591 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:45.466216 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.466706 28750 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.467491 28750 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.468688 28709 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:45.469412 28709 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.471732 28709 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.471820 28750 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.414784 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:45.459648 22118 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.481109 22270 raft_consensus.cc:2410] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:45.476835 22114 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:45.483886 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.425246 28716 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:45.434504 28734 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.422753 28804 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.412694 28699 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:45.497110 22114 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:45.422107 28724 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:45.501080 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:45.504413 22120 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:45.473228 28591 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:45.473877 28613 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:45.509291 22267 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:12:45.511569 22118 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:45.492367 28716 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:45.500381 28642 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:45.540341 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 263550us
W20260709 12:12:45.535882 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 135749us
I20260709 12:12:45.494784 28806 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:45.498425 28750 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:45.507228 28709 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:45.539297 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.545202 22119 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:45.551909 28709 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.553130 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:12:45.554273 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.554699 28709 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:45.547405 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.547863 28832 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:45.570003 28832 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:45.571174 28832 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.574734 22192 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:12:45.577199 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:45.512836 28734 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:45.577863 22193 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:45.578183 28734 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:45.560227 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.561352 22272 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:12:45.547598 28806 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.554448 28613 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.524988 28591 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.590515 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:45.596830 22118 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:45.598865 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45851.5us
I20260709 12:12:45.597903 22831 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:45.542469 28716 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:45.605270 28487 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:12:45.609715 22192 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:45.609747 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:45.601217 22121 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.611459 22193 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:45.612349 22119 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:45.618289 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:45.619482 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:45.602564 28512 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:45.621070 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:45.621984 22194 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:12:45.622843 28544 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:45.623278 28544 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:45.621304 28512 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:45.624477 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.600631 28559 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:12:45.621757 28642 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:45.622895 28751 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:12:45.621882 28591 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.629402 28699 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:45.603704 28710 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:45.624146 28544 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.638051 22121 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:45.610751 28734 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.631400 28512 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:45.643589 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 265028us
I20260709 12:12:45.608327 28729 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 12:12:45.613214 28750 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:45.652025 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.662413 28544 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.662273 27951 consensus_queue.cc:1059] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:12:45.663604 27951 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:45.663982 27951 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:45.665028 27951 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.667164 27951 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:45.668150 28750 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:45.662457 28797 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:45.671569 22162 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:45.673082 28762 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:45.631141 28496 consensus_queue.cc:1059] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:12:45.677300 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:45.639374 28699 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:45.701422 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 81887.1us
I20260709 12:12:45.704126 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:45.714757 28842 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:45.700078 28699 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:45.718536 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47127.1us
I20260709 12:12:45.709411 28690 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:45.716236 28751 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:45.724098 28813 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:45.738795 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:45.712069 28724 consensus_queue.cc:1059] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:12:45.726833 28551 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:45.732304 28559 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:45.733814 28690 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:45.745450 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:45.760578 28751 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:45.761966 22162 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:45.764743 28834 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:45.746161 28496 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:45.744550 28813 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.768550 22121 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:45.765825 28496 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:45.752915 28559 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:45.742000 28797 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:45.785033 22861 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:45.785223 22019 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.786628 22864 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:12:45.788221 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:45.792685 28496 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.794190 28496 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:45.794570 28834 consensus_queue.cc:1059] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:12:45.795670 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:45.796295 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:45.796591 28836 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:12:45.797407 28835 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:12:45.797752 28847 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.798525 28836 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:45.798416 28847 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.796456 22860 raft_consensus.cc:3055] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:45.766676 28806 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:45.797010 22857 raft_consensus.cc:3055] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:45.777329 28813 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.800838 22857 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:45.771929 28841 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:45.799842 22860 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:45.755235 28642 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:45.808570 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.809666 22121 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:45.811971 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.778771 28833 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:45.816248 28847 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:45.805485 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:45.819037 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.823844 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.825189 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.826045 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.827309 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.829273 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.830654 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.831969 22114 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:45.833276 22116 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:45.835268 22119 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
W20260709 12:12:45.838477 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 76628.7us
I20260709 12:12:45.836548 22118 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:45.842053 22121 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:45.839507 22857 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.842949 22117 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:45.846982 22120 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:45.837644 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 93583.7us
I20260709 12:12:45.847888 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:45.849653 22123 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 12: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:45.850781 22115 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:45.856469 22857 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:45.860737 28833 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:45.836236 28797 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:45.865338 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:45.866469 22122 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:12:45.866871 28839 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.111s	user 0.000s	sys 0.002s
W20260709 12:12:45.863119 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68976.4us
I20260709 12:12:45.862840 28833 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:45.879729 28833 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:45.883920 22865 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:12:45.842653 28690 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:45.845798 28841 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 12:12:45.898870 22088 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:45.912138 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:45.919272 22863 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:45.921437 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 131731us
W20260709 12:12:45.945637 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:45.952661 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.912396 28570 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:45.919026 28841 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:12:45.969390 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68099.2us
I20260709 12:12:45.969390 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:45.964440 28806 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.913004 28751 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:12:45.993707 22267 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:46.001336 28832 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:45.971210 28734 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.969751 28570 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:46.008045 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:46.013762 22861 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 12: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:45.988890 28841 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:45.987119 28842 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:46.051103 22271 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:46.028990 28852 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:12:46.030611 28834 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:45.956815 28642 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.033264 28848 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.003882 28806 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.038395 28838 raft_consensus.cc:3055] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:12:46.040832 22860 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:46.042893 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 86267.6us
I20260709 12:12:46.058979 22857 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:46.045020 28797 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:46.049125 22019 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 13 to 15, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:46.010223 28804 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:46.091281 22272 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 12:12:46.092032 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 96929.5us
I20260709 12:12:46.093129 28838 raft_consensus.cc:740] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:46.095925 28570 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.010964 28734 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:46.102069 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.020388 28851 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:46.073060 28847 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.070449 28834 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:46.100394 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:46.095283 28699 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.100384 28852 consensus_queue.cc:1243] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:46.125255 28847 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.125686 28496 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:46.126652 28496 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:46.127808 28847 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:46.137617 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.138243 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.146588 22272 raft_consensus.cc:1240] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 6. Current term is 7. Ops: []
I20260709 12:12:46.147012 28842 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.148594 22264 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:46.149533 28734 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:46.150266 28848 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:46.152480 28854 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:46.154668 28806 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.145016 28804 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.139582 28512 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.157441 28804 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.159442 28512 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.160392 28841 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.097455 28838 consensus_queue.cc:260] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.167677 28512 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:46.169358 28751 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:46.170039 28751 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:46.168910 28797 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.170219 28813 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:46.178452 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.118045 28851 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:46.182430 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.183574 28833 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.186609 28833 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.180624 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:46.188232 22863 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
W20260709 12:12:46.189411 28544 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.526s	user 0.014s	sys 0.000s
I20260709 12:12:46.190194 28834 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.191846 28834 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:46.127954 28496 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.160567 28843 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:12:46.193787 28843 consensus_queue.cc:1243] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:46.194496 28843 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:46.194957 28843 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:46.161052 28859 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:12:46.172641 28797 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.131196 28716 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.196956 28851 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.197026 22858 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:46.198911 28716 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.188463 28751 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.200882 28751 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:46.201349 28848 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.203675 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:46.177026 28838 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:12:46.206318 28848 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:46.206836 28848 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:46.207854 28848 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.160324 28804 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.209075 28833 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:46.211184 28833 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:46.211580 28833 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:46.212567 28833 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.213987 28833 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:46.221494 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.209434 28804 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:46.210379 28848 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.226617 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:46.230336 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:46.220711 28859 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:46.250617 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:46.252699 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:46.255702 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:46.257611 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:46.247437 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:46.249126 22269 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:46.264683 22263 raft_consensus.cc:2410] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:12:46.253328 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:46.234094 28804 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.269439 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:46.274437 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:46.275213 22267 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:46.277552 22268 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:46.279946 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:46.280375 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:46.280582 22268 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.280965 22267 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:46.285331 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:46.266649 28730 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:46.286192 22265 raft_consensus.cc:2393] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:46.287833 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:46.288878 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:46.291610 22266 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:46.271580 28709 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:46.289189 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:46.275940 28804 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:46.297590 22265 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:46.275224 28716 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:46.307446 22119 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:46.310340 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:46.311136 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:46.196298 28843 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.279044 28734 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:46.274813 28852 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:46.317229 28813 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.317647 28709 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:46.301018 28730 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:12:46.324633 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.326174 22272 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:46.330129 22270 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 16 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:12:46.344591 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:46.348099 28836 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:46.332154 28852 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:46.332001 28734 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.332860 28750 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.335331 28709 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.395390 28872 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:46.396191 28872 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.344270 28842 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:12:46.349790 28857 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 12:12:46.352752 28832 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:46.413817 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 69379.4us
I20260709 12:12:46.430016 22267 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:46.431545 22265 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:46.433930 22267 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:46.434542 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:46.435143 22265 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.435746 22270 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:12:46.436355 22270 pending_rounds.cc:85] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 9
I20260709 12:12:46.436611 22270 pending_rounds.cc:107] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:12:46.436921 22270 raft_consensus.cc:2889] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:46.435611 28281 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:12:46.439841 28729 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.440436 28729 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.442764 28729 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:46.445415 22265 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:12:46.446501 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:46.447616 22831 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:46.452812 28832 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:46.453608 28833 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:46.454440 28833 consensus_queue.cc:1243] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:46.454375 28832 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.456317 28833 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:46.419150 22266 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:12:46.353037 28734 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.344129 28642 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:12:46.467087 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:46.468966 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:46.469715 22119 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
W20260709 12:12:46.470118 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 569486us
I20260709 12:12:46.471380 22268 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:46.467422 28849 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:46.411448 28842 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:46.353232 28730 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.348760 28836 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.404230 28716 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.403851 28750 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.452183 28847 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:46.452186 28729 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:46.492298 28844 raft_consensus.cc:2764] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:46.489717 28806 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:46.493289 28875 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:12:46.461238 28871 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:46.481173 28710 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:46.477694 28849 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:46.484617 28842 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:46.477445 28856 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:46.352720 28852 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:46.519769 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.522553 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50824.4us
I20260709 12:12:46.543653 28876 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:46.544173 28852 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:46.520607 28840 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.720s	user 0.005s	sys 0.000s
I20260709 12:12:46.553063 28856 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:46.554239 28865 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:12:46.555856 28856 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.559612 28851 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.561059 28871 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:46.562232 28716 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.562959 28716 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:46.542887 28872 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.508440 28806 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:46.518913 28710 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:46.504426 28751 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:12:46.513216 28729 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:46.581784 28882 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:46.510895 28847 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.498943 28559 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:46.600620 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.612411 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.544298 28876 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:46.593730 28864 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:46.628152 28834 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.627830 28872 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:46.645267 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.613078 28841 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:46.642753 28487 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:46.655555 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.662992 22237 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:46.663380 28876 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.664108 28876 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.664551 28876 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.665710 28883 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:46.666162 28883 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.666501 28883 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.646703 28834 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.646711 28729 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.657421 28487 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.671126 28487 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.672443 28734 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.673452 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:46.673969 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:46.674158 22863 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:46.674666 28734 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:46.674712 22858 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:46.613412 28849 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.676501 22237 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:46.676812 28876 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:46.677616 28876 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:46.681741 28876 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:46.682850 28876 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.689653 28847 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.691382 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:46.613274 28882 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.681354 22116 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:46.680833 28709 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.709977 22265 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:46.630954 28806 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:46.712534 28874 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:12:46.648092 28872 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.716650 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:46.714643 28851 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.728154 28836 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.725703 22271 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:12:46.733359 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.646999 28710 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.734951 28710 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.743695 28709 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:46.744498 28876 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.750154 28699 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.751360 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:46.752225 28876 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:46.753463 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.754305 28612 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:46.754772 28612 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.755159 28612 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:46.757607 28806 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:46.693101 28804 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.767416 28750 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:46.768734 28804 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:46.769850 28851 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:46.770622 28851 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.771376 22863 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:46.771898 22117 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:46.715039 28591 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.774115 22116 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:46.785728 28847 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:46.783382 28813 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.788007 28813 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.731987 28883 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.790401 28813 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.790830 22266 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:46.790927 28886 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:46.793612 28882 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.795430 28849 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.796633 28843 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:46.799530 22858 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:46.805182 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:46.806253 22268 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 17: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:46.807181 22237 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:46.804615 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:46.774487 28848 consensus_meta.cc:287] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.001s
I20260709 12:12:46.809238 22271 raft_consensus.cc:2410] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:12:46.810508 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:46.814246 22865 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:46.814419 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:46.772706 28851 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.817641 28872 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:46.819839 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:46.840022 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:46.819782 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:46.844270 22264 raft_consensus.cc:2368] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17.
I20260709 12:12:46.846954 22263 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:46.839859 28873 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:46.851086 28873 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.853384 28873 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.855283 28751 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:46.857044 28751 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.859212 28751 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.859694 28751 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:46.860174 28751 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.841801 28797 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:46.860787 28847 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:46.861200 28797 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.862327 28751 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.861819 28847 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.863445 28797 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.864354 28847 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.864585 28883 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.866492 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:46.867081 28851 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:46.867782 22864 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:46.867758 28851 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.871078 28851 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:46.873492 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:46.874383 22193 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:46.876560 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:46.876865 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:46.877070 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:46.877616 22191 raft_consensus.cc:2368] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:12:46.878727 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:46.879074 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:46.880133 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:46.880887 22192 raft_consensus.cc:2368] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:12:46.881213 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:46.882221 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:46.882822 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:46.883175 22193 raft_consensus.cc:2393] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:46.883908 22194 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:46.885526 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:46.885785 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:46.886380 22193 raft_consensus.cc:2410] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:46.886469 22195 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.890348 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:46.891654 22190 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:46.891754 22194 raft_consensus.cc:2410] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:46.883092 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:46.896903 22865 raft_consensus.cc:2393] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:46.899048 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:46.902138 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:46.902863 22117 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:46.906927 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:46.906927 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:46.907966 22115 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.909760 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:46.910523 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.913182 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:46.913430 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:46.913813 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:46.914425 22119 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:46.915580 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:46.916157 22118 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.914392 22864 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.921083 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:46.921782 22120 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:12:46.923019 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:46.923995 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:46.923458 28842 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.924816 28847 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:12:46.913838 22116 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:46.925354 28847 raft_consensus.cc:697] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:46.911755 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:46.930122 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:46.926605 28847 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.941596 22269 raft_consensus.cc:2368] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16.
I20260709 12:12:46.942742 22192 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 17: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:46.943186 22864 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:46.815631 28882 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:46.954545 28842 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:46.941140 28860 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:46.961005 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:46.961393 28860 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:46.961871 22120 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:46.962321 28860 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:46.963640 28860 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.970841 22115 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:46.971323 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:46.972018 22118 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:46.972754 22191 raft_consensus.cc:2410] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
W20260709 12:12:46.982779 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.805107 28591 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:46.986758 22237 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:46.995517 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:46.996223 22192 raft_consensus.cc:2376] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14. Re-sending same reply.
I20260709 12:12:46.985785 28570 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.997898 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:46.987311 28813 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.004889 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:47.005571 22118 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:46.983774 28882 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:12:46.994522 22236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.819s (SENT) [suppressed 10 similar messages]
I20260709 12:12:46.995642 28730 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:47.006786 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.011175 22115 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:47.014446 22192 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:47.015175 22863 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:47.023377 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:47.028499 22195 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:47.017902 28730 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:47.031129 28730 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.032110 22192 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:47.032198 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.029116 28882 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.033187 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.033039 22191 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 7.
I20260709 12:12:47.033114 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.035075 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.035398 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.035737 22191 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
W20260709 12:12:47.036614 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.037005 22193 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:47.035421 22196 raft_consensus.cc:2410] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:47.019863 28856 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:47.040019 28856 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.042238 28797 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:47.042819 28797 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:47.043731 28797 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.046726 22163 leader_election.cc:400] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17.
I20260709 12:12:47.047096 22163 leader_election.cc:403] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:47.048413 28878 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:12:47.049948 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.051275 28841 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:47.051986 22116 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:47.051828 28841 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.053169 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:47.009706 28813 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.054280 22860 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:47.055186 22120 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:47.055888 28813 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:47.053185 28559 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:47.061061 22115 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:47.061393 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.062079 22193 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:47.062261 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.062980 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.063437 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.061573 22197 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:12:47.064066 22197 pending_rounds.cc:85] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 8
I20260709 12:12:47.064224 22189 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:47.064402 22197 pending_rounds.cc:107] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:12:47.064839 22197 raft_consensus.cc:2889] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:47.061277 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.066798 22163 leader_election.cc:400] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16.
I20260709 12:12:47.067202 22118 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:47.067523 22163 leader_election.cc:403] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:47.068720 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.069576 22197 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:47.070313 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.071122 22195 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 12: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:47.071317 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.072155 22193 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:12:47.073446 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:47.074146 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.073480 22117 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:47.062995 22198 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:12:47.078506 22194 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:47.078470 22191 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:47.079557 22121 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:47.074747 22190 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:12:47.081312 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.089561 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.091205 22860 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 9.
I20260709 12:12:47.090440 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.094282 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.095188 22191 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:47.093528 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:47.098644 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.099249 22196 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:12:47.100690 22120 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:47.095357 22116 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:47.089756 22189 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:47.103545 22860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 992) took 1302 ms. Trace:
I20260709 12:12:47.107556 22019 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.109196 22197 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:47.104998 28613 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:12:47.115178 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.115666 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.115903 22117 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:47.111408 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.117533 28591 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:47.118697 28873 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:47.120926 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.121152 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.121767 22197 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:47.121093 28847 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:47.122910 28844 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:47.123486 28844 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.123904 28842 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:47.124485 28842 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.125347 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.094228 28838 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:47.126459 28872 consensus_queue.cc:1059] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:47.128203 28876 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:47.128590 28876 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:47.128855 28612 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.129467 28876 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.130631 28876 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:47.131078 28612 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:47.132351 22862 raft_consensus.cc:2368] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14.
I20260709 12:12:47.134865 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.136948 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.137607 22190 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
W20260709 12:12:47.137003 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.139837 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.140722 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.141141 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.141341 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.141750 22190 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:47.142680 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.143337 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.144050 22265 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:47.144402 22194 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:47.104020 22860 rpcz_store.cc:276] 0709 12:12:45.788986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.795180 (+  6194us) service_pool.cc:224] Handling call
0709 12:12:46.040347 (+245167us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4c0044cdc0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec08ea20 00007fccec09fa29 00007fccec065644 00007fccec08cf2d 00007fccec08cb93 00007fcceddbd18b 00007fcceddbdcb5 00007fcceddb8f30 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17
0709 12:12:47.053722 (+1013375us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b58005d6ed0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd1e0aa 00007fccedda0447 00007fcceddb8fe7 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c
0709 12:12:47.091702 (+ 37980us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1437248512}
I20260709 12:12:47.144970 28834 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:47.145795 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.146981 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.148685 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.148890 28856 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:47.149222 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.149513 22266 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:47.150076 22197 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:47.150862 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:47.151387 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:47.152539 28841 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:47.154335 22195 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:47.155786 22265 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:47.105154 28512 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:12:47.154278 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.156716 22192 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:12:47.156908 28512 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:47.157392 28512 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:47.153793 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.157373 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.160059 22270 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:47.159891 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:47.161772 27951 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:47.162127 27951 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.162420 27951 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.169566 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.169595 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.170893 22266 raft_consensus.cc:2393] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:47.171000 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:47.171427 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.172058 22270 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:47.174175 22163 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:47.174458 22270 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:47.177680 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.179420 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:47.181841 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.182477 22192 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:47.191879 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.192700 22191 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:47.193166 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.194088 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.194190 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.194770 22195 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:12:47.195271 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.195493 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.176707 28722 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:12:47.196491 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.196851 28722 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:47.197187 22120 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:47.198230 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:47.193189 28849 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:47.199569 28849 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:47.199637 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.199988 28849 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:47.193096 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.197234 28722 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:47.216441 22271 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:47.225895 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.226691 22119 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:47.211959 22194 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 7.
I20260709 12:12:47.213083 22190 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:12:47.214389 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.214393 27951 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.228675 22118 raft_consensus.cc:2368] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16.
I20260709 12:12:47.215932 28842 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:47.218297 22121 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:47.218796 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.228677 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:47.232487 22270 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:47.229669 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 180275us
W20260709 12:12:47.233280 22087 leader_election.cc:336] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.650s (SENT)
I20260709 12:12:47.233664 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:47.239806 22265 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:47.241617 22120 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:12:47.241235 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.242714 27951 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:47.246178 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:47.245558 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.241232 28834 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.260932 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:47.255949 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.262926 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.263765 28876 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:47.264134 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.265749 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.264195 28876 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.267011 28876 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:47.268126 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:47.268736 22087 leader_election.cc:336] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.697s (SENT)
W20260709 12:12:47.269610 22087 leader_election.cc:336] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.720s (SENT)
I20260709 12:12:47.269695 28882 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:47.269991 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.270188 28882 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:47.270632 28882 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:47.270915 28804 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:47.272480 28804 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:47.272626 28844 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:47.272936 28804 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:47.273449 28804 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:47.273877 22115 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:47.279922 22268 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:47.280550 22857 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:47.165285 28512 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:47.273068 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.283651 22088 leader_election.cc:400] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14.
I20260709 12:12:47.283957 22088 leader_election.cc:403] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:47.284680 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.286550 22192 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:47.286794 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.287287 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.250583 28856 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:47.294595 22268 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:47.291249 28750 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:47.297104 28750 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:47.297467 22087 leader_election.cc:336] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.758s (SENT)
W20260709 12:12:47.298760 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.297535 28750 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:47.289804 28281 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:12:47.301373 28512 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:47.301357 28873 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:47.305168 28873 consensus_queue.cc:1243] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:47.305655 28873 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:47.305967 28873 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:47.306746 28873 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.308238 28873 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:47.313313 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:47.314178 28559 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:47.315586 28722 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.316588 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:47.317235 28722 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:47.325474 22019 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 16 to 17, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 17 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.272955 28591 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:47.329025 28591 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:47.329437 28591 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:47.327656 22019 catalog_manager.cc:5697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.331135 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.331032 22019 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:47.332790 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45931.1us
I20260709 12:12:47.333146 22117 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:12:47.333516 22117 pending_rounds.cc:85] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 12
I20260709 12:12:47.333724 22117 pending_rounds.cc:107] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:12:47.332949 22019 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 16 to 17, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:12:47.333177 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.333878 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:47.331823 22121 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:12:47.335189 28710 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:47.340673 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.341607 22120 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:12:47.341711 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.342126 22120 pending_rounds.cc:85] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 12
I20260709 12:12:47.342432 22120 pending_rounds.cc:107] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:12:47.342689 22120 raft_consensus.cc:2889] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:47.333956 22117 raft_consensus.cc:2889] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:47.345323 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:47.346053 28878 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17.
I20260709 12:12:47.346949 22197 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:47.347723 22087 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.348057 28847 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:47.349756 28841 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:47.344107 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.342736 22115 raft_consensus.cc:2410] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:12:47.351045 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.344175 22198 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:47.334690 22019 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.352172 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.350606 22120 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:12:47.288846 28842 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:47.354382 28730 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:47.354948 28730 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:47.355348 28730 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:47.291147 28734 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:47.357340 28734 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.357456 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 249) took 10793 ms. Trace:
I20260709 12:12:47.357828 28734 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:47.290925 28872 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:12:47.361110 28716 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:47.361577 28841 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:47.361636 28872 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:47.362497 28512 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:47.362896 28872 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:47.362790 28751 consensus_queue.cc:1059] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:47.363922 28872 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.364297 28710 raft_consensus.cc:3055] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:47.286312 28834 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.365039 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:47.365698 28872 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:47.365921 28699 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:47.366631 28512 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:47.366964 28834 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:47.369519 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.374244 22019 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.371464 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.367733 28512 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.382287 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:47.384720 22270 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
W20260709 12:12:47.383643 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 210118us
I20260709 12:12:47.380016 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.364907 28710 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:47.391551 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:47.357961 22017 rpcz_store.cc:276] 0709 12:12:36.561875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.562058 (+   183us) service_pool.cc:224] Handling call
0709 12:12:47.355526 (+10793468us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:43.364435 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:43.365350 (+   915us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:43.365406 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:12:43.365433 (+    27us) tablet.cc:662] Decoding operations
0709 12:12:43.367634 (+  2201us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:43.367718 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:43.367760 (+    42us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:12:43.562375 (+194615us) tablet.cc:701] Row locks acquired
0709 12:12:43.562400 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:12:43.562558 (+   158us) write_op.cc:270] Start()
0709 12:12:43.562680 (+   122us) write_op.cc:276] Timestamp: P: 1783599163562505 usec, L: 0
0709 12:12:43.562704 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:12:43.643372 (+ 80668us) log.cc:844] Serialized 7565 byte log entry
0709 12:12:44.658048 (+1014676us) op_driver.cc:464] REPLICATION: finished
0709 12:12:44.667111 (+  9063us) write_op.cc:301] APPLY: starting
0709 12:12:44.667213 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:44.931396 (+264183us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:44.931578 (+   182us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:45.414253 (+482675us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:45.414849 (+   596us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:12:45.414915 (+    66us) write_op.cc:312] APPLY: finished
0709 12:12:45.416155 (+  1240us) log.cc:844] Serialized 172 byte log entry
0709 12:12:45.491814 (+ 75659us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:45.582447 (+ 90633us) write_op.cc:454] Released schema lock
0709 12:12:45.582530 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:45.583241 (+   711us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:45.583281 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":253,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":8725,"apply.run_cpu_time_us":36028,"apply.run_wall_time_us":915928,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83585,"num_ops":19,"prepare.queue_time_us":891136,"prepare.run_cpu_time_us":46504,"prepare.run_wall_time_us":441837,"raft.queue_time_us":195232,"raft.run_cpu_time_us":8843,"raft.run_wall_time_us":16908,"replication_time_us":1092854,"thread_start_us":395678,"threads_started":4,"wal-append.queue_time_us":236964,"wal-append.run_cpu_time_us":90980,"wal-append.run_wall_time_us":2541430}]]}
I20260709 12:12:47.392271 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.393323 22263 raft_consensus.cc:2410] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:47.390348 22019 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 12 to 13, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 13 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:47.390131 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:47.387228 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:47.400525 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.396709 22019 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 12 to 14, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:12:47.286526 28860 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 12:12:47.422775 22019 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.383301 28709 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:47.436534 22162 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:47.389257 28883 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:47.388605 28851 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:47.441350 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 90361.9us
I20260709 12:12:47.442531 22087 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.398120 28834 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:47.425534 28699 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:47.383628 28878 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:12:47.461555 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:47.459503 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 79594.6us
I20260709 12:12:47.425413 28612 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:47.423553 28487 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:47.447310 28512 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:47.446745 28883 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.446892 28851 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:47.480796 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.444644 28709 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.401924 28281 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:12:47.465843 28806 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:47.463505 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.451906 28834 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:47.490154 28834 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:47.469102 28612 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:47.528342 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:47.524214 28903 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:12:47.487671 28709 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:47.487792 28851 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:47.533692 28699 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:47.489027 28487 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:47.459512 28849 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.488041 28797 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:47.576213 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 114766us
I20260709 12:12:47.526221 28612 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:47.468441 28750 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.488106 28883 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:47.485044 28710 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:47.586925 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 150542us
I20260709 12:12:47.589478 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:47.579587 28911 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:47.569083 28876 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.572674 28591 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.606668 22162 leader_election.cc:400] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16.
I20260709 12:12:47.610818 22162 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:47.614930 22087 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:47.615607 28907 log.cc:927] Time spent T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:12:47.616057 28896 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:12:47.617152 28905 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:12:47.618045 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.625070 28487 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.642488 28876 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:47.644034 28612 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.612643 28716 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:47.661063 28716 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:47.661501 28716 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:47.664284 28836 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:47.596284 28838 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16.
W20260709 12:12:47.665658 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.667084 28912 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:47.667708 28912 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.609370 28699 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.669166 28699 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.670728 28912 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:47.671471 28699 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:47.675158 28849 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:47.676024 22189 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:47.677390 28750 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:47.678831 28804 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.681226 28804 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:47.684083 28612 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:47.684973 28710 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:47.659216 28709 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:47.664443 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 53722.3us
I20260709 12:12:47.689143 28730 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.689702 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.691104 28699 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:47.691331 28730 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:47.691772 28699 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:12:47.700105 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.704191 28912 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.704874 28912 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.705436 22860 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:12:47.706480 28699 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.707109 28912 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:47.704437 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:47.709687 22862 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:47.698237 28570 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:47.734493 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.690749 28709 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:47.738673 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.738812 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:47.740527 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:47.739394 22263 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:47.596315 28882 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.743184 22265 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:47.743355 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:47.743934 22263 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:47.698577 28841 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:47.737341 28902 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.275s	user 0.001s	sys 0.003s
I20260709 12:12:47.702358 28909 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:47.725428 28750 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:47.776286 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 54049.9us
I20260709 12:12:47.789938 28591 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:47.792374 28806 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:47.779317 28896 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.793361 28716 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.793380 28909 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.798254 28882 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:47.797938 28734 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.798828 28842 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14.
W20260709 12:12:47.799552 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 181585us
I20260709 12:12:47.775454 28570 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:47.802192 28883 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.777915 28877 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.782833 28841 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.804361 28834 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.806214 28851 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.808049 28512 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.813274 28797 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:47.813998 28750 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:47.858954 22270 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:47.784265 28559 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:12:47.863168 22193 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:12:47.820087 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:47.823335 22163 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:47.823786 28860 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.824344 28751 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.825796 22857 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:47.864470 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:47.830675 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.865175 22119 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:47.864684 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.868964 22198 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.870105 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:47.870934 22189 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:47.843894 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 380441us
I20260709 12:12:47.849370 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.849466 28911 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:47.851222 22197 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:47.854646 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.873364 22116 raft_consensus.cc:2410] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:47.854508 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.868795 22163 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:47.873070 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.857621 22121 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:47.857621 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.818984 22858 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:47.863590 22193 pending_rounds.cc:85] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 14
I20260709 12:12:47.876839 22193 pending_rounds.cc:107] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:12:47.877166 22193 raft_consensus.cc:2889] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:47.876417 22123 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:47.875892 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.879737 28913 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:12:47.907348 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:47.902365 22198 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:12:47.906399 22162 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:47.931253 22117 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:47.932382 22116 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:47.843602 28896 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.910789 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:47.879863 28922 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:47.874653 28710 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:47.893126 28915 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:47.891913 28873 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:47.974344 28873 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.974759 28873 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:47.968263 28750 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:47.958024 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 103594us
I20260709 12:12:47.981453 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:47.981854 22270 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:47.981956 22087 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:47.959039 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48392us
I20260709 12:12:47.986107 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.873802 28912 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:47.997318 28912 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.997745 28912 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:47.998430 28834 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:47.965512 28883 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:47.965293 28911 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.001734 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:48.001925 28915 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:48.001760 28834 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:47.967137 28851 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:47.967424 28570 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.968017 28909 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:47.873605 28751 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.002983 28915 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.968995 28916 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:47.969774 28716 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:47.933168 28797 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:47.970121 28841 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:47.970610 28921 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.972324 28896 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:47.973552 28919 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:12:47.862582 28512 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:47.859306 28877 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.042794 28512 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:47.958531 28922 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:48.043681 28922 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:47.963829 28806 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:48.044983 28806 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.045351 28806 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:48.047077 28873 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:47.873735 28860 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.050391 28860 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:47.986131 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:47.987804 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:48.051627 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 63914us
I20260709 12:12:48.052699 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:48.054315 28856 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:47.960474 22119 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:48.057822 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:48.058696 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:48.058785 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:47.995224 22189 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 23.
I20260709 12:12:47.995966 22263 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:47.874936 28882 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 12:12:47.996388 28559 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:12:47.996254 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:48.002573 22857 raft_consensus.cc:2368] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21.
I20260709 12:12:47.966971 28734 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:48.006585 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.006862 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.008131 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.063289 22123 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.065172 22163 leader_election.cc:400] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21.
I20260709 12:12:48.065693 22163 leader_election.cc:403] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260709 12:12:48.019567 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 113247us
I20260709 12:12:48.020520 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.021196 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.068147 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:48.020689 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.027098 27951 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:48.027477 28764 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:48.066571 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:48.029227 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.030174 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:48.073063 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:47.893013 28918 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
W20260709 12:12:48.061388 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 71944.5us
I20260709 12:12:48.021020 28847 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:48.077543 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.070149 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:48.028009 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:48.068864 22263 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:48.079485 22266 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:48.056330 28751 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.072206 22862 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:48.034580 28842 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:12:48.042845 28877 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.034799 28797 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:48.080672 22119 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:48.082427 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:48.086246 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.060701 28559 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:48.094131 27951 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:48.094012 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 66121.9us
I20260709 12:12:48.096988 27951 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:48.100087 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:48.075802 28909 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.056907 28896 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:12:48.097386 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:48.101686 27951 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:48.103305 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.076112 28841 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:48.116860 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:48.117139 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.116959 28841 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:48.117602 22114 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:48.118371 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.107896 22163 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:48.098016 28559 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:12:48.121050 28734 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:48.121737 28836 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:48.122162 28836 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.122475 28836 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:48.105798 28751 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:48.124356 28751 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.124744 28751 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:48.125025 28709 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:48.126616 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:48.127269 22266 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:48.076824 28843 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:12:48.109339 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.110620 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:48.097334 28281 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:48.115324 28856 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:48.115546 28931 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21.
I20260709 12:12:48.115643 28834 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:48.093451 28923 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:48.118228 28917 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:48.123893 22118 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
I20260709 12:12:48.170565 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:48.135361 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.136148 22123 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:12:48.095358 28750 raft_consensus.cc:2764] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 12:12:48.154398 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 71831.5us
W20260709 12:12:48.190917 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 124408us
I20260709 12:12:48.191469 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:48.162420 22266 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:48.192018 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:48.035537 28921 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:48.166302 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:48.193622 22190 raft_consensus.cc:2376] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13. Re-sending same reply.
I20260709 12:12:48.194113 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:48.168262 22198 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:48.169521 22197 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:48.177047 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:12:48.177412 28937 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.005s
I20260709 12:12:48.131785 28873 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.200379 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:48.161191 28923 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:48.221254 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:48.222023 22194 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.222707 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.104146 28847 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:48.179286 22193 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:48.224049 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:48.179905 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:48.186913 28699 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:48.180814 28917 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 23 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:48.137530 28911 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:48.185642 22263 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:48.186088 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:48.220155 28882 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:12:48.131592 28909 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:48.194608 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:48.232331 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:48.196039 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:48.176911 28912 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.143708 28281 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:48.217423 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:48.144232 28642 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:12:48.231815 22195 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:48.188657 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:48.201953 28844 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:48.218272 28570 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:48.244056 22266 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:48.228106 28834 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:48.252836 22194 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
W20260709 12:12:48.246151 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 110885us
I20260709 12:12:48.257997 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.253517 28844 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:48.229735 28699 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:48.258885 28844 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.259268 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:48.259456 28699 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.260838 28699 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.262274 28912 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.262774 28570 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:48.254189 28716 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:48.247794 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 51876.7us
I20260709 12:12:48.263927 28716 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:48.249459 22122 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:48.224911 28923 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.252786 22163 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:48.268280 22117 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:48.219875 28843 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:12:48.244606 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.262892 28943 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:48.264165 28570 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:48.251122 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51207.9us
I20260709 12:12:48.272866 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:48.249850 28842 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:48.248544 28882 raft_consensus.cc:697] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:48.284106 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:48.285038 22263 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:48.285133 28930 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:12:48.287340 28878 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:48.288319 28512 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:48.288681 28512 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:48.289245 28921 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:48.289659 28512 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.291246 28512 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.292937 28860 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:48.294973 28843 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:48.295053 28836 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.296237 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:48.297704 28935 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:48.300566 28847 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:48.273427 28883 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:48.301937 28883 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:48.302888 28883 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.304109 28559 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.305541 28716 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:48.308089 22270 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:48.279155 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:48.310932 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:48.314994 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:12:48.317685 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52899.1us
I20260709 12:12:48.320570 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.314329 22860 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:48.327163 22270 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:48.328429 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:48.275255 28916 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:48.273195 28750 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:48.331303 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:48.333788 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.340152 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:48.347932 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:48.348110 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:48.349226 22191 raft_consensus.cc:2410] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:48.243810 28797 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.350600 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:48.351475 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:48.353355 22118 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:48.362948 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.331341 28860 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:48.370389 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.363731 22115 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.372318 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:48.369903 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 97231.2us
I20260709 12:12:48.373948 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:48.382970 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.386878 28941 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:48.387055 28932 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:48.386901 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 113945us
I20260709 12:12:48.388581 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.390403 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.391270 28709 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:48.391634 28882 consensus_queue.cc:237] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.392725 28918 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:48.330881 28917 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:48.393442 28918 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:48.394099 28918 consensus_queue.cc:1243] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:48.354219 28716 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:48.395071 28716 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.395430 28716 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:48.392030 28750 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:48.335783 28943 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:48.355818 28913 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:48.363507 28916 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:48.351200 28813 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:12:48.364259 28921 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:48.364215 28842 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:48.384588 28860 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:48.354601 28873 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:12:48.429558 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:48.421217 28751 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.443924 22198 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:48.444147 28922 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.445904 22266 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:48.446184 28922 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:48.354858 28281 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:48.449549 28836 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.451052 28911 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:48.413080 28913 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.398039 28710 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:12:48.455849 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.431164 28860 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:48.534196 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 142649us
I20260709 12:12:48.408569 28806 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.449055 28947 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.375075 28834 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:48.553083 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 182845us
I20260709 12:12:48.551569 22263 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:48.538875 22115 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
W20260709 12:12:48.554204 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48123.7us
I20260709 12:12:48.417109 28943 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.458771 28913 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.464711 28842 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:48.565168 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:48.574050 28921 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:48.576153 22115 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:48.581921 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:48.562400 28842 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.584324 28851 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:48.561556 28947 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.584937 22268 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:12:48.608758 22270 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:48.587203 28915 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:48.623924 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:48.622717 28917 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.627705 28917 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:48.614269 28709 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:48.629990 28917 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.630184 28709 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.633726 28943 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.584631 28842 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:48.636674 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 184791us
I20260709 12:12:48.650924 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:48.595504 28806 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.585606 28734 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:48.596851 28856 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:48.590498 28909 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:48.584728 28851 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:48.571413 28932 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
W20260709 12:12:48.693184 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 314618us
W20260709 12:12:48.695276 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 67548.3us
I20260709 12:12:48.594110 28844 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.743721 28947 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.579173 28916 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.710172 28716 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:48.697280 28856 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:48.756884 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:48.757926 22263 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:12:48.744210 28913 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.709692 28559 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:48.771534 28955 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.053s	user 0.002s	sys 0.004s
I20260709 12:12:48.768275 28844 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.760179 28716 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:48.793700 22830 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.794176 28949 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:48.785374 28851 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.795846 28949 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:48.796957 28487 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:48.796988 28967 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:48.801666 28836 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:48.802208 28836 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:48.793473 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:48.784790 28913 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.816340 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:48.826332 22196 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:48.840492 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:48.840929 22117 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:48.841661 28487 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:48.842305 28487 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.842732 28487 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.846122 28969 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:12:48.846619 28844 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:48.847647 28844 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:48.849107 28915 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:48.850224 28915 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.852691 28844 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:48.825467 28716 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.860219 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:48.862196 22114 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 20: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:48.862974 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.863883 22116 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:12:48.864939 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 297480us
I20260709 12:12:48.865729 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:48.866648 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 165736us
I20260709 12:12:48.868973 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:48.869921 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.870731 22119 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:48.835897 28512 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.874616 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:48.875586 22862 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:48.882480 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:48.888147 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:48.899401 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.900436 22114 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.901803 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:48.902251 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:48.903676 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:48.866837 28716 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.910729 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.907630 28932 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.926224 22195 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:12:48.913069 28965 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.881209 28512 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:48.915167 28923 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.636s	user 0.014s	sys 0.000s
I20260709 12:12:48.927049 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.894723 28570 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:12:48.927784 28882 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:48.938853 22191 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:48.912351 28911 raft_consensus.cc:2764] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:48.939935 22114 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:48.941512 22862 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:48.947464 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.954226 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:48.955087 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:48.967214 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.969130 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:48.948818 28709 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:48.933382 28965 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.928376 28983 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:12:48.934598 28512 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:48.935446 28923 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:48.972175 28710 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:48.905444 28836 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.979064 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:48.980854 28909 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:48.938251 28932 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:48.981956 28965 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:48.984220 28970 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.243s	user 0.002s	sys 0.000s
I20260709 12:12:48.989704 22191 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:48.913461 28487 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:48.969480 28913 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:48.997753 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:48.998636 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:48.966675 28570 consensus_queue.cc:1243] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:49.003643 22114 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:49.010228 22120 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.990590 28911 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:48.999939 28882 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:48.996387 28751 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.031388 22860 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:49.014421 28965 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.065110 28965 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:49.065718 28971 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.330s	user 0.000s	sys 0.004s
I20260709 12:12:49.067711 28570 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.068220 28570 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.070483 28570 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.067349 28965 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:49.003436 28710 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:49.011778 28954 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:49.085916 28954 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:49.085642 28710 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.086789 28954 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:49.012787 28913 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:12:49.089545 28976 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:12:49.097971 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:49.082231 28487 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.003756 28709 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 12:12:49.138275 22114 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:49.162083 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:49.162972 22114 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:49.176842 28932 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.178071 28913 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:49.138238 28751 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.186441 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:49.182798 22120 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 23.
I20260709 12:12:49.187459 22121 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:49.176486 28923 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:49.165858 28931 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.199321 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:49.200264 22114 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:49.205051 28716 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:49.214676 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:49.191860 28860 consensus_meta.cc:287] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.005s
W20260709 12:12:49.224535 28842 consensus_meta.cc:287] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 12:12:49.252630 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:49.265784 28992 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:49.193058 28751 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.215814 28931 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:49.289848 28958 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.548s	user 0.005s	sys 0.007s
I20260709 12:12:49.290669 28751 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:49.291191 28985 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
W20260709 12:12:49.292546 28980 log.cc:927] Time spent T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 12:12:49.294727 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:49.320333 22192 raft_consensus.cc:2393] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 7: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:49.295161 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:49.240175 28860 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:49.277070 28842 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:49.247195 28856 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.310148 28931 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.313401 28956 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.313839 28838 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.315057 28716 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.337637 22198 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:49.301874 28952 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.580s	user 0.004s	sys 0.028s
I20260709 12:12:49.315403 28281 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:49.325222 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:49.342593 22267 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:49.343739 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:49.345475 22267 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:49.329962 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:49.347106 22194 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:49.348158 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:49.349027 22194 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:49.332700 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:49.319711 28883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.009s	sys 0.007s
I20260709 12:12:49.332046 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:49.332126 28911 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:49.335369 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:49.354394 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4001) took 1060 ms. Trace:
I20260709 12:12:49.337188 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:49.334365 22272 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:49.356972 22271 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:49.359735 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:49.354954 22266 rpcz_store.cc:276] 0709 12:12:48.282070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.283060 (+   990us) service_pool.cc:224] Handling call
0709 12:12:48.330918 (+ 47858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:48.446260 (+115342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.341747 (+895487us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540026c5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:49.341933 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264038144}
I20260709 12:12:49.363147 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:12:49.350814 28883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.009s	sys 0.007s
I20260709 12:12:49.377260 28896 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:49.351830 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:49.332458 28734 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.353170 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:49.340801 28838 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.381232 28734 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.381232 28797 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:49.383337 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:49.377921 28896 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:49.386279 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:49.342430 28716 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.337898 28956 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.403610 22192 raft_consensus.cc:2393] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:49.399667 28797 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.404574 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:49.404477 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:49.408571 22197 raft_consensus.cc:2368] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23.
I20260709 12:12:49.427099 28923 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.429015 28923 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.431216 28923 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.431325 28922 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:49.431821 28922 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:49.432673 28922 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.433686 28922 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:49.434142 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 1645) took 1100 ms. Trace:
I20260709 12:12:49.434532 22120 rpcz_store.cc:276] 0709 12:12:48.333349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.333518 (+   169us) service_pool.cc:224] Handling call
0709 12:12:49.433952 (+1100434us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54002ae4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:49.434061 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542048000}
I20260709 12:12:49.428998 29001 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 12:12:49.427663 28860 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:49.425905 28856 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.410429 28896 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.455804 22163 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:49.461033 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.455154 28896 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:49.486286 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:49.489642 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:49.490670 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:49.495540 22272 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:49.496177 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:49.497129 22266 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:49.498294 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:49.499043 22266 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
I20260709 12:12:49.503520 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:49.505661 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:49.506939 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:49.507516 22265 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
W20260709 12:12:49.507599 28942 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.201s	user 0.002s	sys 0.005s
I20260709 12:12:49.424479 28842 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:49.508724 28860 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:49.509352 28860 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:49.509678 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1764) took 1385 ms. Trace:
I20260709 12:12:49.510262 28860 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.482276 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:49.514390 22267 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:49.510066 22189 rpcz_store.cc:276] 0709 12:12:48.124673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.126538 (+  1865us) service_pool.cc:224] Handling call
0709 12:12:48.126940 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:48.127278 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:48.127308 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:48.127799 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:12:48.205374 (+ 77575us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:48.404615 (+199241us) log.cc:844] Serialized 14 byte log entry
0709 12:12:48.405278 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:48.405391 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:49.432678 (+1027287us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:49.509369 (+ 76691us) raft_consensus.cc:1685] finished
0709 12:12:49.509472 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:49.509616 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2145,"prepare.queue_time_us":290888,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":1501,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":9217,"spinlock_wait_cycles":13682048,"thread_start_us":224708,"threads_started":2,"wal-append.queue_time_us":122338}
W20260709 12:12:49.531522 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.537083 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:49.542701 22120 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:12:49.513196 28836 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:49.513501 28909 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:49.525418 28751 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.558251 22267 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:49.560566 22267 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:49.537649 28842 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.541191 28974 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.565359 22189 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:49.528818 28710 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:12:49.547528 28838 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.566910 28842 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:49.574442 29004 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:12:49.576346 28998 log.cc:927] Time spent T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:12:49.589479 22121 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:49.591584 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:49.595264 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.602448 28956 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.561983 28909 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:49.608683 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:49.609750 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:49.610960 22858 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:49.611469 22196 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:49.612059 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:49.621134 22119 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:49.621971 22120 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:49.622221 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:49.588392 29000 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 12:12:49.596681 28734 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:49.562916 28751 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.613171 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:49.612140 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:49.628288 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:49.585768 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:49.617698 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:49.629871 22266 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:49.618533 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:49.624643 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:49.625094 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:49.631976 22196 raft_consensus.cc:2393] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:49.635752 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:49.631251 22121 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
W20260709 12:12:49.640645 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 54971.3us
I20260709 12:12:49.642379 22087 leader_election.cc:400] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23.
I20260709 12:12:49.642699 22087 leader_election.cc:403] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:12:49.569278 28913 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.620374 28990 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:49.624542 29008 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:49.645437 22272 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:49.647138 22162 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:49.654978 22196 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:12:49.570250 28974 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.617933 28797 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.655499 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:49.620601 28710 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:49.625576 28956 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.639101 28838 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:49.659515 28995 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:49.661130 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:49.644879 28716 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.649478 28923 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:49.668545 29009 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:12:49.651640 28856 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23.
I20260709 12:12:49.675103 22116 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:12:49.678782 22272 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:49.653789 28913 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:49.684257 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:49.685088 22197 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:49.686129 22197 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:49.666507 28838 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.690212 22197 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:49.667802 28995 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.695283 22197 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260709 12:12:49.697044 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:49.697698 22265 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.700194 28877 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:49.656894 28990 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:49.700606 28877 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:49.702451 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3092) took 1090 ms. Trace:
I20260709 12:12:49.703797 28990 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:49.702819 22268 rpcz_store.cc:276] 0709 12:12:48.611596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.611800 (+   204us) service_pool.cc:224] Handling call
0709 12:12:48.628670 (+ 16870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:48.634618 (+  5948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:48.634673 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:48.635493 (+   820us) log.cc:844] Serialized 26 byte log entry
0709 12:12:48.693915 (+ 58422us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:48.694838 (+   923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:48.695033 (+   195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:48.994853 (+299820us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:49.698344 (+703491us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b24003d63b8. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceab5b9c4 00007fcceab59acb 00007fccead14dc9 00007fccead14a55 00007fccead13fb0 00007fcced98a488 00007fcced98abe8 00007fcced962398 00007fcced95d76a 00007fcced95cbb6
0709 12:12:49.702209 (+  3865us) raft_consensus.cc:1685] finished
0709 12:12:49.702240 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:49.702393 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9571,"raft.queue_time_us":52373,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":27282,"spinlock_wait_cycles":113791616,"thread_start_us":56514,"threads_started":1,"wal-append.queue_time_us":80405}
I20260709 12:12:49.667234 28281 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:49.671108 28834 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:49.686182 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:49.671386 28923 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.710067 22197 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:49.714663 28974 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.669766 28956 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.718948 28956 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.665212 28806 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:12:49.724942 28834 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.725545 28834 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:49.726181 22265 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:12:49.727870 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:49.729115 28923 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:49.729420 28969 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:49.730077 28969 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:49.671070 28710 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:49.731081 28969 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:49.732543 28710 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:49.687914 28842 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.706048 28838 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.679980 28873 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:12:49.705739 28995 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:49.701514 28877 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.745951 28856 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:49.746655 29015 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:12:49.761327 28909 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:49.756340 28974 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.770298 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:49.773666 22862 raft_consensus.cc:2368] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14.
I20260709 12:12:49.746001 28281 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:49.770128 28961 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.006s	sys 0.021s
I20260709 12:12:49.766520 28842 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:49.769652 28856 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.782261 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:49.783128 22114 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:49.787276 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:49.797274 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:49.798224 22115 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 7.
I20260709 12:12:49.799770 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:49.779083 28961 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.006s	sys 0.021s
I20260709 12:12:49.802989 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:49.811122 22115 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:49.778429 28877 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:49.814293 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:49.818907 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:49.815780 28975 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:49.791813 28856 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.776125 28974 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:49.839658 22237 leader_election.cc:400] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14.
I20260709 12:12:49.840085 22237 leader_election.cc:403] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:49.816469 28751 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.781622 28842 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.825946 28849 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:49.848263 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.850358 28913 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:49.826699 28873 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:49.823894 28847 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.827929 28949 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:49.830651 28964 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:49.855629 28281 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.827792 28975 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.856406 28954 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14.
I20260709 12:12:49.874329 28847 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.863430 28873 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.861392 28849 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.874130 28964 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.872289 28949 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:49.914917 28959 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.176s	user 0.008s	sys 0.000s
I20260709 12:12:49.919648 28923 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:49.940479 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:49.919797 28834 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:49.920732 29006 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.415s	user 0.000s	sys 0.001s
I20260709 12:12:49.925676 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 1022) took 1044 ms. Trace:
I20260709 12:12:49.909979 28873 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.929617 28975 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.931218 22194 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:49.911487 28849 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.941442 22197 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:49.920439 28838 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:49.938112 28916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.189s	user 0.024s	sys 0.033s
I20260709 12:12:49.907370 28878 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:49.946837 22858 rpcz_store.cc:276] 0709 12:12:48.881233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.881598 (+   365us) service_pool.cc:224] Handling call
0709 12:12:49.925393 (+1043795us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b540019f5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:49.925568 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673820416}
I20260709 12:12:49.913491 28964 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.939091 28949 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:49.963081 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:49.969149 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:49.972271 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:49.961115 28916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.025s	sys 0.033s
I20260709 12:12:50.018810 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:50.021006 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:50.021333 22266 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:50.021895 22266 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:50.022624 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:50.023855 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:50.024959 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:50.028180 22265 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:50.038482 28923 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:49.965315 28878 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.023464 28913 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.047582 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3170) took 1699 ms. Trace:
I20260709 12:12:50.050436 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 3717) took 1829 ms. Trace:
I20260709 12:12:50.050735 22118 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:50.072968 22118 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:50.021930 22263 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:50.071667 22123 rpcz_store.cc:276] 0709 12:12:48.220980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.222466 (+  1486us) service_pool.cc:224] Handling call
0709 12:12:50.050145 (+1827679us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400311fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:50.050356 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406804224}
I20260709 12:12:50.078481 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:12:50.078598 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.059542 22268 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:50.069087 22190 rpcz_store.cc:276] 0709 12:12:48.348266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.358259 (+  9993us) service_pool.cc:224] Handling call
0709 12:12:48.360711 (+  2452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:48.361348 (+   637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:48.361388 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:48.372496 (+ 11108us) log.cc:844] Serialized 52 byte log entry
0709 12:12:48.558383 (+185887us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:48.865197 (+306814us) log.cc:844] Serialized 14 byte log entry
0709 12:12:48.871517 (+  6320us) log.cc:844] Serialized 14 byte log entry
0709 12:12:48.871831 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:48.871952 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:48.886428 (+ 14476us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b48000ce358. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf2cebaa1 00007fccf2ce2b37 00007fccf2ce29ca 00007fccf2dda26f 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508 00007fccf2dee488 00007fccf2dee443 00007fccf2ded6ec 00007fccf1d17a96
0709 12:12:49.310176 (+423748us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b18002e3d80. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd5522 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:12:49.885358 (+575182us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:50.047259 (+161901us) raft_consensus.cc:1685] finished
0709 12:12:50.047287 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:50.047493 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9088,"prepare.queue_time_us":44102,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":5511,"raft.run_cpu_time_us":3525,"raft.run_wall_time_us":523335,"spinlock_wait_cycles":57815168,"thread_start_us":432783,"threads_started":2,"wal-append.queue_time_us":338471}
I20260709 12:12:50.023146 22266 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.083340 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:50.083897 22266 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:50.017297 28968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.008s	sys 0.020s
I20260709 12:12:50.088587 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:50.092242 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:50.092949 22190 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:12:50.094890 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:50.058936 28922 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.625s	user 0.004s	sys 0.007s
I20260709 12:12:50.090339 22118 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.097046 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2760) took 1195 ms. Trace:
I20260709 12:12:50.085588 28873 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.089607 28896 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:50.043923 28838 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:50.089694 28968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.008s	sys 0.021s
I20260709 12:12:50.054236 29030 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:50.042733 28842 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.041927 28974 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:50.101649 22191 rpcz_store.cc:276] 0709 12:12:48.901416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.901549 (+   133us) service_pool.cc:224] Handling call
0709 12:12:50.096871 (+1195322us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54002369d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:50.096983 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83443072}
I20260709 12:12:50.041942 28878 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:50.045306 28847 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.106484 22267 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:12:50.101028 22118 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:50.040690 28834 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.099822 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2762) took 1197 ms. Trace:
I20260709 12:12:50.111269 29018 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:50.105742 28965 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.112242 28710 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.132143 22195 rpcz_store.cc:276] 0709 12:12:48.902101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.903337 (+  1236us) service_pool.cc:224] Handling call
0709 12:12:50.099649 (+1196312us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b540011a154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:50.099767 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49803520}
I20260709 12:12:50.102775 28716 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.051445 28913 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.105818 28896 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:50.085908 28797 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:12:50.118003 28916 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.143839 22266 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 12:12:50.119055 28923 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:50.152968 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:50.155038 22195 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:50.156980 22162 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:50.174242 22266 pending_rounds.cc:85] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 9
I20260709 12:12:50.179318 22266 pending_rounds.cc:107] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:12:50.179679 22266 raft_consensus.cc:2889] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:50.176234 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:50.124197 28932 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:50.177127 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:50.181391 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:50.181569 22117 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:50.182019 22120 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:50.180365 22195 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:50.183665 22195 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:12:50.185511 22123 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:50.188935 28751 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:50.189507 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:50.190284 28751 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:50.190791 22163 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:50.191427 28751 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:50.192255 28751 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:12:50.192598 28751 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.192834 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:50.192989 28751 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:50.196504 28838 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:50.196906 28838 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.197247 28838 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:50.201680 28281 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:50.201840 28751 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.202469 28281 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.204761 28281 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:50.204988 28751 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.205904 22163 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:50.208786 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:50.209247 28834 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:50.209859 28834 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:50.209966 28878 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:50.210903 28834 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:50.218760 29021 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:50.141932 29020 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:50.221691 22121 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:50.228540 22121 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:50.150799 28873 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.228014 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:50.228889 22190 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:12:50.229422 22121 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.223616 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:50.159137 28896 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:50.237807 28751 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:12:50.232426 22121 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:50.258942 28913 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:50.237370 22117 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:12:50.120996 29030 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.265373 29030 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:50.269141 28932 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:50.272718 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45729.3us
I20260709 12:12:50.184614 28916 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.275403 28916 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.145154 28965 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.278183 28965 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.145398 28710 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.278339 28916 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:50.280886 28710 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.153169 28716 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.281934 22121 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:12:50.282368 22121 pending_rounds.cc:85] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 8
I20260709 12:12:50.282580 22121 pending_rounds.cc:107] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:50.282797 22121 raft_consensus.cc:2889] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:50.283694 28716 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:50.283986 28896 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.289609 28896 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:50.294277 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:50.301728 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1768) took 1497 ms. Trace:
I20260709 12:12:50.302238 22198 rpcz_store.cc:276] 0709 12:12:48.804626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.806280 (+  1654us) service_pool.cc:224] Handling call
0709 12:12:48.813602 (+  7322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:49.338062 (+524460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.301455 (+963393us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54000ed654. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:50.301658 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204739328}
W20260709 12:12:50.308498 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.285368 28916 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:50.286515 28856 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.317654 28851 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:50.325178 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:50.328292 22862 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:50.363595 22266 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:50.328616 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:50.244910 28941 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:50.329679 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:50.370630 22116 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:50.331148 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:50.372341 22858 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:50.331856 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3175) took 1427 ms. Trace:
I20260709 12:12:50.324267 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:50.333217 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.334913 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:50.336742 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:50.337046 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:50.343364 22087 leader_election.cc:336] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.746s (SENT)
I20260709 12:12:50.382391 22267 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:50.344575 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:50.384027 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59914.9us
I20260709 12:12:50.384948 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:50.382400 22271 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:50.373287 22194 rpcz_store.cc:276] 0709 12:12:48.904734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.404117 (+499383us) service_pool.cc:224] Handling call
0709 12:12:50.331669 (+927552us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b540004bad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:50.331795 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1205936512}
I20260709 12:12:50.387462 22198 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:50.238201 22120 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:50.349442 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:50.357548 28995 consensus_meta.cc:287] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.586s	user 0.012s	sys 0.000s
I20260709 12:12:50.333936 28969 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:50.397627 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:50.366865 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 278342us
I20260709 12:12:50.398597 22194 raft_consensus.cc:2410] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:50.381448 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:50.398816 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:50.399415 22268 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:50.388254 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:50.387521 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:50.402554 22265 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:50.361335 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:50.396059 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:50.405793 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:50.406471 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:50.407506 22163 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:50.406440 22122 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:50.411939 22267 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:12:50.350519 28913 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.350046 28916 consensus_queue.cc:1243] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:50.417013 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:50.444639 22198 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:50.448027 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:50.449434 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:50.393983 29002 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:50.429646 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:50.393267 29026 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:50.431623 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:50.394290 28965 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:50.466881 22194 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:12:50.468509 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:50.412266 28975 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:50.472466 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:50.473063 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:50.477725 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:50.479072 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3091) took 1867 ms. Trace:
I20260709 12:12:50.480706 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:50.481650 22857 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:50.424149 22266 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:50.393975 28999 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:12:50.451097 29016 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:50.517715 22116 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:50.405161 28995 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.400880 28710 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:12:50.446534 28847 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:50.446969 28932 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:50.455233 28974 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:50.547451 22198 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:50.452174 28954 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:50.455546 29020 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:50.554968 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:50.518291 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:50.470047 28990 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.415946 28838 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.413486 28969 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.558913 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:50.564044 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 164504us
I20260709 12:12:50.469355 28965 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.570590 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:50.511631 28964 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 12:12:50.447340 28843 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 12:12:50.477929 28975 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.578680 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:50.584715 22116 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:50.479640 22270 rpcz_store.cc:276] 0709 12:12:48.611218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.612916 (+  1698us) service_pool.cc:224] Handling call
0709 12:12:48.613277 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:48.644706 (+ 31429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:48.644753 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:48.798626 (+153873us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b2c000682a8. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:12:48.799052 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:12:48.873955 (+ 74903us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:49.915590 (+1041635us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b18000dd560. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:12:49.931176 (+ 15586us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b18000dd560. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fccf17ba3c7 00007fcceddcc9a7 00007fccedddc0bf 00007fccedddc038
0709 12:12:50.174148 (+242972us) log.cc:844] Serialized 14 byte log entry
0709 12:12:50.476644 (+302496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.476758 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:50.478833 (+  2075us) raft_consensus.cc:1685] finished
0709 12:12:50.478848 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:50.479003 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72296,"prepare.queue_time_us":19290,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":92081,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":13321,"spinlock_wait_cycles":40794112,"thread_start_us":599648,"threads_started":3,"wal-append.queue_time_us":88340,"wal-append.run_cpu_time_us":2608,"wal-append.run_wall_time_us":1077018}
I20260709 12:12:50.449604 28913 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.585903 22198 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:50.588007 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:50.589313 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:50.544348 29016 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:50.553951 28797 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:50.570477 28873 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:50.605870 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:50.470471 29002 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:50.583957 28849 consensus_meta.cc:287] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.613s	user 0.006s	sys 0.005s
I20260709 12:12:50.575060 28974 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:50.479367 29026 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.629009 22198 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:50.625502 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:50.651505 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:50.635303 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 82593.5us
I20260709 12:12:50.653328 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:50.654268 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.606459 28965 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.637744 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:50.640206 22192 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:50.585505 29020 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:50.659533 22116 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:50.660058 22116 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:50.661490 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:50.612598 28975 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.608561 22857 raft_consensus.cc:2410] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:50.663522 22198 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:50.616564 28877 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:50.634626 29016 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:50.655922 22193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3169) took 2296 ms (client timeout 1746 ms). Trace:
I20260709 12:12:50.634172 28843 consensus_queue.cc:1243] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:12:50.643585 28642 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:50.669023 22116 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.677577 22116 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:50.585120 28932 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:50.669283 22193 rpcz_store.cc:269] 0709 12:12:48.347975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.349900 (+  1925us) service_pool.cc:224] Handling call
0709 12:12:50.639864 (+2289964us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54002e72d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:50.643915 (+  4051us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3884088576}
I20260709 12:12:50.646098 28974 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:50.581619 28847 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.643754 28916 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:50.616413 28878 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:12:50.662010 28860 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:50.602699 28990 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.648259 28922 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:50.661856 29020 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:50.612412 28964 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.602392 28954 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.678534 28710 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:50.668179 28877 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:50.729688 28949 consensus_meta.cc:287] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.691s	user 0.007s	sys 0.006s
I20260709 12:12:50.740298 22116 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:12:50.682664 28642 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:50.661494 28751 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:12:50.788399 22864 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:12:50.698776 29035 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:50.792264 22116 pending_rounds.cc:85] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 14
I20260709 12:12:50.801011 22116 pending_rounds.cc:107] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:12:50.801517 22116 raft_consensus.cc:2889] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:50.644556 28849 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.695313 29044 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:50.804404 29044 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.805052 22195 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:50.806106 29042 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:50.806809 29044 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:50.806763 29042 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.717314 28999 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.807889 28999 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.809098 29042 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:50.809984 28999 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.806046 28849 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.754609 28916 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:50.765734 28856 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.830159 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1775) took 1517 ms. Trace:
I20260709 12:12:50.832633 22190 rpcz_store.cc:276] 0709 12:12:49.317103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.110653 (+793550us) service_pool.cc:224] Handling call
0709 12:12:50.111024 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:50.232106 (+121082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.829755 (+597649us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000fcdd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:50.830062 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252448640}
I20260709 12:12:50.690418 29023 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 12:12:50.792620 28877 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:50.791808 29045 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:50.795306 28710 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:50.803102 28642 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:50.770994 28922 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.829034 29035 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:50.856848 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 220992us
I20260709 12:12:50.858825 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:50.862785 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:50.863981 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:50.854228 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 202515us
I20260709 12:12:50.872888 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:50.875355 22122 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:12:50.797394 28949 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.883633 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:50.879014 28995 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.864315 29042 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:50.904958 22863 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:50.870008 28999 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:50.876643 29030 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:50.909662 22162 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:50.914646 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:50.917186 22162 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:50.895957 29036 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.252s	user 0.001s	sys 0.001s
W20260709 12:12:50.929361 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.919540 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:50.926424 22859 raft_consensus.cc:2368] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:12:50.930464 22116 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:12:50.935616 22123 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:50.936129 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:50.937227 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:50.941263 22121 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:50.938057 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:50.938930 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:50.945230 22114 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:50.946516 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:50.947203 22114 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:50.939756 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:50.949620 22115 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:50.950922 22119 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 19: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:12:50.952562 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 79777.5us
I20260709 12:12:50.955508 22123 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:50.894416 28842 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:12:50.973099 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:50.974743 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.851266 29045 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.908099 28995 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:50.876364 28860 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:12:50.913254 28969 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.906422 28913 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.037014 29064 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:50.983338 29037 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
W20260709 12:12:50.984253 29043 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:12:51.039007 28849 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:12:50.882099 28916 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:50.958321 28878 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:51.044740 29019 log.cc:927] Time spent T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.262s	user 0.000s	sys 0.012s
I20260709 12:12:51.045962 28973 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.041280 28995 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:51.049072 28954 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:51.049672 28990 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.051044 28838 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:51.052134 29048 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:12:51.051682 22114 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:50.989827 22121 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:51.038565 29026 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.927477 29042 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:50.978996 29030 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 12:12:50.970561 29035 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.062124 28949 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:51.062669 28964 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.065923 28923 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:51.067392 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2775) took 1443 ms. Trace:
I20260709 12:12:51.068109 28961 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:51.068921 28932 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.070034 28922 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:51.069928 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3180) took 2140 ms. Trace:
I20260709 12:12:51.048622 28734 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:12:51.075593 28975 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:50.978128 29040 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.281s	user 0.001s	sys 0.001s
I20260709 12:12:51.077212 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1778) took 1574 ms. Trace:
I20260709 12:12:51.173550 22195 rpcz_store.cc:276] 0709 12:12:49.624022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.184381 (+560359us) service_pool.cc:224] Handling call
0709 12:12:50.184645 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:50.805702 (+621057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.067120 (+261418us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54000fbed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:51.067326 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412514688}
I20260709 12:12:51.177575 22191 rpcz_store.cc:276] 0709 12:12:49.503176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.148910 (+645734us) service_pool.cc:224] Handling call
0709 12:12:50.149229 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:50.321826 (+172597us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:12:50.321862 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:50.322475 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 12:12:50.483979 (+161504us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:50.484041 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.076812 (+592771us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400142dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:51.076861 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:51.076909 (+    48us) raft_consensus.cc:1685] finished
0709 12:12:51.076925 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.077148 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"spinlock_wait_cycles":395819776,"thread_start_us":161068,"threads_started":1,"wal-append.queue_time_us":362459}
I20260709 12:12:51.087630 29002 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:51.089274 28642 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.183188 28642 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.183588 22120 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:51.185266 28975 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:50.907802 28710 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.035732 29061 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:51.038410 29045 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:51.109253 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:51.110255 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 213125us
W20260709 12:12:51.130309 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 176360us
W20260709 12:12:51.110942 28851 consensus_meta.cc:287] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.002s
I20260709 12:12:51.134204 28842 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.134567 28797 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:51.137338 28878 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.146739 28849 raft_consensus.cc:697] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:51.172384 22192 rpcz_store.cc:276] 0709 12:12:48.929070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.450641 (+521571us) service_pool.cc:224] Handling call
0709 12:12:50.640033 (+1189392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:50.658232 (+ 18199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.069602 (+411370us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002e72d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:51.069830 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2734380416}
I20260709 12:12:51.188800 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3735) took 1600 ms. Trace:
I20260709 12:12:51.146821 29049 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:51.198348 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:51.188449 28961 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:51.203426 22118 rpcz_store.cc:276] 0709 12:12:49.590496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.591263 (+   767us) service_pool.cc:224] Handling call
0709 12:12:50.050537 (+459274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:50.251731 (+201194us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:50.251765 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:50.251809 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:50.251849 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.251918 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.188460 (+936542us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400311fd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:51.188663 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14866,"raft.queue_time_us":14989,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":90,"spinlock_wait_cycles":1018933120}
I20260709 12:12:51.215198 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:51.204264 22197 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:51.171993 28923 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:51.144258 28973 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.232465 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:51.232759 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3194) took 1454 ms. Trace:
I20260709 12:12:51.232915 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3182) took 2256 ms. Trace:
I20260709 12:12:51.140196 28965 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.234627 22189 rpcz_store.cc:276] 0709 12:12:48.977236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.570880 (+593644us) service_pool.cc:224] Handling call
0709 12:12:49.617821 (+ 46941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:49.683241 (+ 65420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:49.683289 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:49.687683 (+  4394us) log.cc:844] Serialized 26 byte log entry
0709 12:12:49.774190 (+ 86507us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:50.010397 (+236207us) log.cc:844] Serialized 14 byte log entry
0709 12:12:50.010764 (+   367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.290776 (+280012us) spinlock_profiling.cc:243] Waited 62.7 ms on lock 0x7b5400179154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:50.290834 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:51.044399 (+753565us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b24000ddf18. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceab5b9c4 00007fcceab59acb 00007fccead14dc9 00007fccead14a55 00007fccead1409d 00007fcced94610e 00007fcced95d88c 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221
0709 12:12:51.232610 (+188211us) raft_consensus.cc:1685] finished
0709 12:12:51.232637 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.232838 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4255,"prepare.queue_time_us":61072,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":1430,"raft.queue_time_us":5424,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":8549,"spinlock_wait_cycles":226650624,"thread_start_us":187746,"threads_started":2,"wal-append.queue_time_us":37168}
I20260709 12:12:51.239727 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:51.234237 22196 rpcz_store.cc:276] 0709 12:12:49.778436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.295419 (+516983us) service_pool.cc:224] Handling call
0709 12:12:50.295773 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:50.296217 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:50.296248 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:50.345721 (+ 49473us) log.cc:844] Serialized 26 byte log entry
0709 12:12:50.548689 (+202968us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:50.548750 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.548878 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:51.232466 (+683588us) raft_consensus.cc:1685] finished
0709 12:12:51.232492 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.232657 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7835,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":146447,"threads_started":1,"wal-append.queue_time_us":425630}
I20260709 12:12:51.200546 28975 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:51.197687 28922 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:51.197917 28843 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:51.202574 28878 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:51.258563 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.201761 28964 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:51.251101 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:51.229420 28716 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.231887 28932 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:51.259915 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:51.240427 28851 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:51.263197 22118 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 22. Ops: []
I20260709 12:12:51.263996 22120 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260709 12:12:51.230748 28842 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.268407 28716 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.274961 22120 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:51.268639 28964 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:51.230508 28797 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:51.295534 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.302284 22121 raft_consensus.cc:1240] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: []
I20260709 12:12:51.302579 22191 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:51.304821 22121 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:51.232364 29020 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.308054 22118 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:51.298966 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:51.310863 22192 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:51.287964 28913 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.311846 28913 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.312680 28965 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.313974 28913 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.299697 28849 consensus_queue.cc:237] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.291756 28642 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.317162 28642 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.276019 28842 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.319290 28842 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:51.319413 28642 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.319941 28642 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:51.319796 28842 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:51.321280 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:51.321848 22114 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:51.321280 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.322731 22121 raft_consensus.cc:2410] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:12:51.324538 28842 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:51.320437 28642 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:51.258008 29061 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:12:51.261312 28843 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:51.259914 28922 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.257387 28923 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.261395 29065 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 12:12:51.232463 29049 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:51.325120 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.325743 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.327462 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:51.329602 22121 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:51.359423 22121 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:51.260440 28990 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 12:12:51.335551 22114 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:51.258932 28975 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.358060 22196 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:51.352550 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:51.351989 22117 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:51.361478 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:51.355261 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.332121 22830 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:51.247336 28995 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:51.412117 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 80110.6us
I20260709 12:12:51.418414 22114 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:51.420159 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.422488 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:51.336210 29061 raft_consensus.cc:2764] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:12:51.330950 28973 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:51.356081 29049 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:51.333680 28642 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:51.292853 29045 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.125s
I20260709 12:12:51.340322 28843 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:51.419548 28969 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:51.425690 22194 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:51.343586 28923 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:51.349750 28734 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:51.414134 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:51.351832 29020 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.333616 28964 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:51.334365 29042 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:51.476758 29071 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.342523 28922 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:51.427106 28877 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.002s
I20260709 12:12:51.344448 29065 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:51.418985 28913 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:51.465891 28969 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:51.397720 29016 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.710s	user 0.013s	sys 0.000s
I20260709 12:12:51.468006 28932 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.288326 28961 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:51.495203 22271 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:12:51.472856 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 58791.2us
W20260709 12:12:51.496443 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 264073us
I20260709 12:12:51.469599 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:51.426004 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.478987 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:51.471298 28734 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:51.480074 29071 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.455780 22117 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:51.499095 22269 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:51.497452 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:51.481998 29068 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:51.515720 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:51.516533 22271 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:51.489578 28969 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:51.511739 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:51.523221 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 78144us
I20260709 12:12:51.499993 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:51.529465 22162 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:51.531360 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.531599 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:51.532199 22114 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:51.532258 22271 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:12:51.502801 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:51.486531 28877 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.514040 28922 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:51.506657 28964 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:51.523023 29061 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:12:51.492184 29016 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:51.552106 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:51.488241 29065 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:51.493062 28913 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.550547 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:51.560587 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.495954 28932 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:51.543082 28974 consensus_meta.cc:287] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.001s
I20260709 12:12:51.531281 29068 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:51.566035 22189 raft_consensus.cc:2368] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20.
I20260709 12:12:51.548506 28990 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:51.573253 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.541580 28851 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:51.574700 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:51.590199 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.548815 28797 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:51.518204 29070 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:12:51.530577 29042 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:12:51.579363 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.548897 28965 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:51.554620 28964 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.614271 28964 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:51.617334 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.617812 29042 consensus_queue.cc:1243] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:12:51.618227 28932 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.618458 29042 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:51.618902 29042 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:51.589759 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.619525 29071 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.575404 29076 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.620201 22192 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:51.619783 29042 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.620348 29076 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.622056 22831 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:51.622602 29076 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:51.622737 28729 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:51.623227 22831 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:51.623517 28281 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:51.623889 28281 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:51.624238 28281 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:51.624435 22831 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:51.593389 22195 raft_consensus.cc:2368] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20.
I20260709 12:12:51.600502 29065 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:51.539825 29072 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 12:12:51.601524 29068 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:51.602615 29049 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:12:51.604185 29066 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:51.608421 22859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 1028) took 1062 ms. Trace:
W20260709 12:12:51.595753 28806 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 12:12:51.608914 29016 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:51.609186 28975 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.610220 28877 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.565922 28922 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:51.542675 29069 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:12:51.611081 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.701591 29069 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:51.701720 22198 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:51.702111 29069 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:51.701893 28922 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.703293 29069 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.582119 28974 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.521481 29051 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:12:51.637887 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.618764 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.626896 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:51.706976 28974 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.626509 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:51.698835 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.624571 28729 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:51.708521 22119 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:51.709507 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:51.710079 22119 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:51.639205 22831 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:51.625486 22860 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:12:51.632309 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:51.625939 28965 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:51.641346 22196 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
W20260709 12:12:51.714535 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 126045us
I20260709 12:12:51.682305 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.716094 22121 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:51.618569 28716 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.686810 22859 rpcz_store.cc:276] 0709 12:12:50.546125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.569635 (+ 23510us) service_pool.cc:224] Handling call
0709 12:12:51.608210 (+1038575us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b540019f5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:51.608359 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671703936}
I20260709 12:12:51.608911 29077 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.625133 28851 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:51.643350 29045 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.629786 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:51.630847 28913 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.629230 29084 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:51.712977 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 73857.7us
I20260709 12:12:51.628734 28847 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.681542 28949 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:51.717715 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:51.553939 28734 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:51.686045 29049 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:51.684626 29020 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:51.744580 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.712204 28729 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:51.745374 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.686085 29042 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:51.685834 29070 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.727941 22120 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:51.704696 29069 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:51.732231 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:51.714236 28967 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:51.752240 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:51.752676 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 202194us
I20260709 12:12:51.754522 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.755193 22123 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:51.728850 29084 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.760448 22088 leader_election.cc:400] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:12:51.763608 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:51.765079 22088 leader_election.cc:403] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:51.755920 22087 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:51.740643 28949 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:51.769927 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.757274 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:51.751322 28729 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:51.776268 22087 leader_election.cc:400] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20.
I20260709 12:12:51.777082 22087 leader_election.cc:403] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:51.770658 22121 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:51.777449 22119 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:51.778488 28941 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:12:51.778715 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:51.779249 29083 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:12:51.780042 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.780202 29087 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:51.787632 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:51.729259 28878 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:51.827615 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 186259us
I20260709 12:12:51.763537 28797 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:51.768726 28734 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:51.839296 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.830221 22119 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:51.728753 29077 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.738240 29045 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.775044 28949 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:51.933025 22190 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:51.933794 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:51.885444 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:51.926122 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.936200 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:51.936476 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:51.937634 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:51.940514 22267 raft_consensus.cc:2393] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:51.938050 22270 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:51.905452 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.886381 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.768376 29084 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:51.948103 22264 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:51.782001 28847 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:51.752444 29020 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.871752 28797 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:51.970911 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.970717 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:51.971889 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:51.976473 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:51.976709 22272 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:51.790820 28877 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:51.977203 22270 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:12:51.930409 28941 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20.
I20260709 12:12:51.979853 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:51.980302 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 240204us
I20260709 12:12:51.977586 22264 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:51.828722 28281 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:51.985138 29085 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:51.987214 28281 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.978642 28877 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.988655 28877 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:51.992556 28878 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:51.790448 28965 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.994513 22270 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 17: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:51.994652 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:51.755457 29070 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.995239 22264 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:51.981686 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:51.998535 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:51.999281 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:51.974684 29089 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:12:52.010244 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:51.980540 28797 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:51.980000 28974 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.014767 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.015592 22272 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:52.019279 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:51.872675 29049 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.877559 28851 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:51.980376 28847 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.030951 28847 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:52.031034 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.031945 22267 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:52.032287 22263 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:52.022403 28941 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.032792 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.033721 22267 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:12:52.033581 28941 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.034502 22263 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:12:52.025373 22195 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:52.026731 22087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.922s (SENT) [suppressed 10 similar messages]
I20260709 12:12:52.020829 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.037869 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.038996 22267 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 20 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:52.048046 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.015648 28856 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.054983 22196 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:12:52.056492 22268 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:52.067744 29078 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.246s	user 0.001s	sys 0.001s
I20260709 12:12:52.046468 28896 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:52.061787 28856 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.078570 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.083216 22268 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:12:52.092423 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.093242 22266 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:52.099985 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:52.092657 29097 log.cc:927] Time spent T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:12:52.020834 28974 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.113809 22266 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:12:52.062232 29049 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:52.117146 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.147732 22267 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 19: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:52.067087 28847 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:52.096593 29080 log.cc:927] Time spent T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.483s	user 0.005s	sys 0.005s
I20260709 12:12:52.157536 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.158788 29070 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:52.159076 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.159795 22267 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:52.116631 29044 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:52.165441 29044 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.168030 29044 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:52.119055 28941 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:52.119928 28974 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:52.119953 28923 consensus_meta.cc:287] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.001s
I20260709 12:12:52.124325 29084 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.170219 22123 raft_consensus.cc:2410] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:12:52.171281 29084 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:52.127020 28964 consensus_meta.cc:287] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.003s
I20260709 12:12:52.172005 28964 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.173087 22192 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:52.174019 28964 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:52.127094 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.174759 22272 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:52.174947 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:52.176674 22863 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:12:52.176944 29076 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:52.177201 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:52.176679 22116 pending_rounds.cc:85] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 8
I20260709 12:12:52.177999 22116 pending_rounds.cc:107] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:12:52.177577 29076 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.178278 22116 raft_consensus.cc:2889] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:52.128408 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.179342 22263 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:52.131953 28856 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:52.135845 29020 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:52.136688 29045 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:52.058669 29091 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:52.153374 22264 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:12:52.113324 29051 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:52.154294 28847 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:52.115690 29065 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.169080 29077 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:52.190021 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.202921 22264 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:52.209249 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:52.195508 22267 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:52.210821 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.210814 22272 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:52.231233 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.233412 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.238030 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.276078 22263 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:52.277879 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.302886 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.303833 22267 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:52.327335 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.328760 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.196295 29072 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.128s
I20260709 12:12:52.185093 28729 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:52.340709 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.345295 22272 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:52.342178 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:52.343793 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.347313 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.348245 22267 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:52.205588 29051 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:52.202867 29091 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.205418 29065 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.372885 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.375245 22272 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:52.379671 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.383679 22858 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:52.384579 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 357846us
I20260709 12:12:52.413651 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.419042 22266 pending_rounds.cc:85] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 8
I20260709 12:12:52.419471 22266 pending_rounds.cc:107] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:12:52.419770 22266 raft_consensus.cc:2889] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:52.426201 22272 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:12:52.439968 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.467461 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.464757 28856 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:52.470945 28856 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:52.411324 29020 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:52.473084 29020 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:52.475384 29020 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:52.475957 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.476068 28964 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.476922 29070 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.477424 29070 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:52.492820 22267 raft_consensus.cc:2410] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 12:12:52.449620 29042 consensus_meta.cc:287] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.689s	user 0.008s	sys 0.004s
I20260709 12:12:52.497555 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:52.448483 29076 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:52.476732 28964 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:52.508002 28964 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:52.509055 29070 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:52.516489 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.522392 29065 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:52.526786 29051 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:52.534735 29069 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.781s	user 0.005s	sys 0.005s
I20260709 12:12:52.531069 28729 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:52.532064 28856 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:52.538728 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:52.529930 28797 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.001s
I20260709 12:12:52.541898 29091 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:52.550158 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 227295us
W20260709 12:12:52.543088 28949 consensus_meta.cc:287] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.001s
I20260709 12:12:52.543613 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.543886 22270 raft_consensus.cc:2410] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:12:52.565656 22263 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:12:52.544535 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:52.548079 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:52.557482 22264 raft_consensus.cc:2410] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 12:12:52.558578 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.566747 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.567544 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:52.563999 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:52.549223 28969 consensus_meta.cc:287] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 1.011s	user 0.008s	sys 0.004s
W20260709 12:12:52.544137 28877 consensus_meta.cc:287] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.002s
I20260709 12:12:52.568463 22114 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:52.568899 22267 raft_consensus.cc:2410] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:52.561523 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:52.569502 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:52.594455 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:52.597708 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.597868 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.549377 28847 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:52.598464 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:52.598585 22267 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:52.598654 22263 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.627475 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 3774) took 1108 ms. Trace:
I20260709 12:12:52.628301 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:52.554668 29051 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:52.597956 29049 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.632751 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:52.642434 28642 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.643066 28642 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.643743 29049 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:52.644410 29049 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.645442 28642 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:52.648114 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 86734.6us
I20260709 12:12:52.594942 29076 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:12:52.649052 29076 consensus_queue.cc:1243] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:52.632596 28806 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:12:52.650277 28806 raft_consensus.cc:3055] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:52.597800 29091 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.650622 28806 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:52.651098 29091 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:52.651541 22189 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3203) took 1357 ms (client timeout 1635 ms). Trace:
W20260709 12:12:52.653594 22189 rpcz_store.cc:269] 0709 12:12:51.294001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.294188 (+   187us) service_pool.cc:224] Handling call
0709 12:12:52.651339 (+1357151us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001beed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:52.651481 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359043456}
I20260709 12:12:52.653604 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:52.651895 28806 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:52.655160 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:52.652383 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:52.638150 29077 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:52.661727 29077 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:52.662569 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.566054 28797 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:52.661163 22163 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:52.594609 28877 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.579380 29069 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 12:12:52.573726 29065 consensus_queue.cc:1059] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:12:52.573136 28954 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:12:52.635891 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.627944 22114 rpcz_store.cc:276] 0709 12:12:51.518811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.540331 (+ 21520us) service_pool.cc:224] Handling call
0709 12:12:52.567363 (+1027032us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:12:52.627394 (+ 60031us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4050304}
I20260709 12:12:52.644883 29049 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:52.654492 28964 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.601778 29072 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 12:12:52.594338 28969 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:52.695955 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.591950 28949 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:52.662140 29077 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:52.699097 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:52.717561 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:52.702688 22115 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:52.706423 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:52.701583 29051 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.662300 29076 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:52.675724 29071 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:52.682049 29042 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:52.723131 29069 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.702105 28873 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:52.708418 28806 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:52.728811 28964 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:52.743309 28969 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:52.744379 28797 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:52.739521 28873 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.730381 29071 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:52.751278 22197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3195) took 2820 ms (client timeout 1922 ms). Trace:
W20260709 12:12:52.751957 22197 rpcz_store.cc:269] 0709 12:12:49.930603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.968882 (+ 38279us) service_pool.cc:224] Handling call
0709 12:12:52.751047 (+2782165us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400109ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:52.751192 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2838910848}
I20260709 12:12:52.704661 28965 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:52.708130 28973 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:52.699083 28842 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:12:52.714303 22265 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:52.735271 29070 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:52.760797 22860 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:52.765475 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:52.766717 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.767804 29026 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:52.768615 29026 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:52.769330 22117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 3765) took 1835 ms (client timeout 1879 ms). Trace:
W20260709 12:12:52.769932 22117 rpcz_store.cc:269] 0709 12:12:50.934286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.937772 (+  3486us) service_pool.cc:224] Handling call
0709 12:12:52.769099 (+1831327us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54003ad4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:52.769232 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936562944}
I20260709 12:12:52.771222 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:52.772248 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:52.719784 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:52.780156 22114 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 13: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:52.768062 22265 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:52.797149 22858 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:52.797593 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:52.798247 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:52.799578 22864 raft_consensus.cc:2410] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:12:52.729116 29051 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.754915 29071 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:52.804600 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:52.810079 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:52.806090 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:52.813180 22114 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:52.815419 22265 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:52.816376 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:52.774679 28969 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:52.739717 29069 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.825642 22267 raft_consensus.cc:2410] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:12:52.801578 28965 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:52.833717 22263 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:12:52.834450 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:52.832253 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:52.836208 22265 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:52.813851 28842 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:52.815119 28797 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:52.839598 22831 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:52.840380 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:52.841717 28873 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:52.845134 29117 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:12:52.831018 29091 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:52.849813 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:52.862704 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2787) took 1271 ms. Trace:
I20260709 12:12:52.864111 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2671) took 1579 ms. Trace:
I20260709 12:12:52.865121 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1678) took 1546 ms. Trace:
W20260709 12:12:52.851644 29104 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.505s	user 0.000s	sys 0.002s
I20260709 12:12:52.947749 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:52.872462 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:52.876473 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:52.772202 28973 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:52.881390 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:52.828941 28642 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:52.874186 29072 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:52.869859 29118 log.cc:927] Time spent T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:52.990598 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:52.838754 28922 raft_consensus.cc:2764] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 12:12:52.883285 29081 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.271s	user 0.002s	sys 0.009s
W20260709 12:12:52.902137 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 184673us
I20260709 12:12:52.880003 28843 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.873723 29026 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:52.889469 28990 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:52.889124 29042 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:53.033761 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.035895 22265 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:53.033862 22189 raft_consensus.cc:1240] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:12:53.038130 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:52.831558 28969 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:53.068459 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 192091us
I20260709 12:12:53.067584 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:12:52.905720 28734 consensus_meta.cc:287] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.959s	user 0.014s	sys 0.000s
I20260709 12:12:53.046557 29065 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:53.041118 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:53.041229 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 159914us
I20260709 12:12:53.083734 22194 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:53.084139 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:53.084915 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:52.889072 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 261024us
W20260709 12:12:52.990650 28995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.384s	user 0.018s	sys 0.108s
I20260709 12:12:52.891656 28964 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.889381 29070 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:12:53.046816 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 197167us
I20260709 12:12:53.097743 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.098672 22194 raft_consensus.cc:2368] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18.
I20260709 12:12:53.043758 22122 rpcz_store.cc:276] 0709 12:12:51.318629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.321358 (+  2729us) service_pool.cc:224] Handling call
0709 12:12:51.321675 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:51.396640 (+ 74965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.396700 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:51.396765 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:51.396835 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.864818 (+1467983us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b5400084654. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:52.864888 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.865046 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171628288}
I20260709 12:12:52.990522 28931 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:53.048300 22163 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:52.934965 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.006868 22114 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:52.993289 29090 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.882715 28856 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.161s
I20260709 12:12:52.997651 29091 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.907753 28797 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:53.077134 22831 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:53.051702 28642 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:53.053583 29117 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:12:53.086380 22269 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:12:52.950388 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.042997 22190 rpcz_store.cc:276] 0709 12:12:51.591750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.629349 (+ 37599us) service_pool.cc:224] Handling call
0709 12:12:51.629701 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:51.947709 (+318008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.862290 (+914581us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54001f45d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:52.862607 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696897408}
I20260709 12:12:53.041368 22120 rpcz_store.cc:276] 0709 12:12:51.284794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.284982 (+   188us) service_pool.cc:224] Handling call
0709 12:12:51.309752 (+ 24770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:51.751701 (+441949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.863760 (+1112059us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400328054. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:52.864028 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961210112}
I20260709 12:12:53.086452 28877 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.089114 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:53.092875 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:53.065573 28843 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.139479 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.143285 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.100992 22162 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:53.098982 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:53.108309 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:53.089939 28995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.018s	sys 0.110s
W20260709 12:12:53.118628 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 70466us
I20260709 12:12:53.087291 29065 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:53.083041 29119 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:53.121121 28931 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.243858 28931 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:53.253310 29127 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:53.254266 29127 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.132400 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.134341 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.270689 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.090070 28990 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 18 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:53.271835 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.094087 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.273065 22121 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:53.136667 22193 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:53.137368 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.274693 22119 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:12:53.131995 29123 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:12:53.149885 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72893.6us
I20260709 12:12:53.115470 29126 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:53.116799 28954 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:53.157605 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.065263 28965 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.116237 28949 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.139605 29103 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:53.142742 28642 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:53.173682 28989 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:53.166692 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:53.293236 22120 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.103385 28964 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.184867 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:53.189538 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 88649.6us
W20260709 12:12:53.195778 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 96865.3us
I20260709 12:12:53.195838 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:53.127712 29090 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.088722 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.131081 29072 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:12:53.198550 29065 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:53.201781 29119 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.186162 29051 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:53.185218 28877 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.205255 29064 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:53.209066 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.209308 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.209765 29067 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:53.211639 28797 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.211009 28969 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.222672 28973 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:53.224298 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4047) took 1107 ms. Trace:
I20260709 12:12:53.225349 29122 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:53.116500 29070 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.236109 29124 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:53.237157 29069 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:53.240577 28843 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.131824 29091 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.241219 22117 raft_consensus.cc:2410] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:12:53.272676 22265 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:53.336297 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.337747 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:53.341459 29119 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:53.314574 29064 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:53.285698 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.199492 28716 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:53.351800 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.352857 22265 raft_consensus.cc:2393] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:53.287065 22198 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:12:53.285137 29129 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.063s	user 0.008s	sys 0.008s
W20260709 12:12:53.285359 29130 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.064s	user 0.002s	sys 0.013s
I20260709 12:12:53.298198 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:53.300338 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:53.289528 29113 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.379s	user 0.003s	sys 0.001s
W20260709 12:12:53.301682 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 105931us
I20260709 12:12:53.302325 28931 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:53.300449 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:53.359848 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 59496.9us
I20260709 12:12:53.310148 22193 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:12:53.360363 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:53.301362 29049 consensus_meta.cc:287] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.001s
I20260709 12:12:53.319319 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.321245 22268 rpcz_store.cc:276] 0709 12:12:52.117029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.117148 (+   119us) service_pool.cc:224] Handling call
0709 12:12:52.117440 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:52.147651 (+ 30211us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:52.354007 (+206356us) log.cc:844] Serialized 14 byte log entry
0709 12:12:52.612316 (+258309us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:52.632257 (+ 19941us) log.cc:844] Serialized 26 byte log entry
0709 12:12:52.632407 (+   150us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:52.632440 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.632512 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.223987 (+591475us) raft_consensus.cc:1685] finished
0709 12:12:53.224021 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.224213 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23120,"prepare.queue_time_us":373077,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":47271,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":4788,"thread_start_us":419787,"threads_started":2,"wal-append.queue_time_us":373611}
I20260709 12:12:53.326143 22189 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:12:53.326274 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3215) took 1424 ms. Trace:
I20260709 12:12:53.320462 28877 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.295787 29103 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:53.373867 29103 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.362792 28843 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:53.377802 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.304077 28989 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:53.342605 29124 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.346182 22120 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:12:53.384672 29124 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:53.385167 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.385896 22120 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:53.386788 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:53.387292 22120 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:53.365202 28995 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:53.403524 28995 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:53.404083 28995 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:53.405872 28964 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.408099 22192 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:53.408514 29064 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.409881 28961 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:53.354902 28642 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.414729 28877 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:53.347457 22119 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
W20260709 12:12:53.357993 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59926.2us
I20260709 12:12:53.290131 29126 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.292711 29123 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:53.365795 29049 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.377452 28843 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:53.368227 28932 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.012s	sys 0.033s
W20260709 12:12:53.433023 28932 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.012s	sys 0.033s
I20260709 12:12:53.433152 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 4053) took 1300 ms. Trace:
I20260709 12:12:53.432492 28843 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:53.433614 22264 rpcz_store.cc:276] 0709 12:12:52.132318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.230866 (+ 98548us) service_pool.cc:224] Handling call
0709 12:12:53.432959 (+1202093us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54002283d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:53.433091 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746627968}
I20260709 12:12:53.434810 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:53.371457 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 3775) took 1852 ms. Trace:
I20260709 12:12:53.435921 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.389302 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3784) took 1688 ms. Trace:
W20260709 12:12:53.346870 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68151.2us
I20260709 12:12:53.333654 29122 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.355098 28990 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.393986 29090 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.395711 28873 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:53.397087 29134 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:12:53.401929 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 4056) took 1268 ms. Trace:
I20260709 12:12:53.409423 28989 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.417208 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:53.467046 22121 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:53.461982 22267 rpcz_store.cc:276] 0709 12:12:52.133258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.663893 (+530635us) service_pool.cc:224] Handling call
0709 12:12:53.401707 (+737814us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400202e54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:53.401864 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255591296}
I20260709 12:12:53.418097 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:53.369729 22195 rpcz_store.cc:276] 0709 12:12:51.902219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.056813 (+154594us) service_pool.cc:224] Handling call
0709 12:12:53.325568 (+1268755us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b5800196598. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:12:53.325770 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:53.325946 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:53.325970 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:53.326012 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:53.326048 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.326101 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.326213 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8836864}
I20260709 12:12:53.468518 22265 raft_consensus.cc:2368] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18.
W20260709 12:12:53.468968 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50960.2us
I20260709 12:12:53.281112 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.424088 22120 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:53.431159 22119 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:53.380998 22196 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:53.436676 22264 raft_consensus.cc:2368] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20.
I20260709 12:12:53.436825 28995 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.458932 29122 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:53.446063 29091 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.436050 22123 rpcz_store.cc:276] 0709 12:12:51.519096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.779783 (+260687us) service_pool.cc:224] Handling call
0709 12:12:53.371232 (+1591449us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400327b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:53.371393 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895373568}
I20260709 12:12:53.460340 22860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 1038) took 1386 ms. Trace:
I20260709 12:12:53.486567 22860 rpcz_store.cc:276] 0709 12:12:52.060028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.060195 (+   167us) service_pool.cc:224] Handling call
0709 12:12:52.060507 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.764470 (+703963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.446141 (+681671us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54002f9c54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:53.446447 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1609815424}
I20260709 12:12:53.483973 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:53.462455 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 98246.9us
I20260709 12:12:53.463860 22831 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:53.440411 22116 rpcz_store.cc:276] 0709 12:12:51.701256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.176184 (+474928us) service_pool.cc:224] Handling call
0709 12:12:52.176499 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:52.178902 (+  2403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.178943 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:52.179411 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:12:52.635376 (+455965us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:52.635440 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.635535 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.226168 (+590633us) spinlock_profiling.cc:243] Waited 83 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:53.388948 (+162780us) raft_consensus.cc:1685] finished
0709 12:12:53.388980 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.389229 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190890880,"thread_start_us":455649,"threads_started":1,"wal-append.queue_time_us":652181}
I20260709 12:12:53.474972 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:53.488924 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:53.430205 29123 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.489566 22119 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:53.490070 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:53.491521 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:53.493222 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:53.494709 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.497318 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:53.497016 22120 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:12:53.499562 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.501173 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.501509 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:53.502184 22264 raft_consensus.cc:2368] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20.
I20260709 12:12:53.502692 22119 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:53.503201 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.503597 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:53.504217 22862 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:53.506536 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:53.507148 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:53.508515 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.512223 22264 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:12:53.513283 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:53.514374 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:53.491425 29090 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:53.511076 29070 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.515209 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:53.495669 29139 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:53.515895 29070 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:53.518326 22862 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:12:53.512538 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:53.524290 22831 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:53.524797 29070 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:53.525210 29070 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.525559 29070 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:53.525756 29120 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:53.526203 29120 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:53.526579 29120 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:53.516129 29139 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.529692 29139 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:53.529058 29142 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:53.531008 29142 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.531339 29142 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:53.531594 22116 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:53.515237 29090 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:53.533170 29090 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:53.498617 29091 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:53.498837 29093 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:53.529043 29069 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:53.535179 29069 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:53.535476 29049 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:53.485620 28856 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:53.536155 29069 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.537441 28995 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.536363 28856 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.491273 28922 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.545823 22859 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:12:53.546449 28922 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.519660 29122 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:53.550757 29071 consensus_meta.cc:287] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.732s	user 0.012s	sys 0.000s
I20260709 12:12:53.551254 29071 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.552856 29063 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.553440 29063 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:53.511123 29077 consensus_meta.cc:287] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.781s	user 0.015s	sys 0.000s
I20260709 12:12:53.554934 29077 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.561134 22191 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:53.562741 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:53.565948 22116 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:12:53.561748 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.504427 29067 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:53.524333 22121 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:53.570027 29091 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:53.574894 22123 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: [12.8-16.10]
I20260709 12:12:53.509483 29124 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:53.529433 28877 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:53.549539 28856 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.581326 22860 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: [9.10-10.11]
I20260709 12:12:53.569383 22264 raft_consensus.cc:2410] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:53.582867 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:53.548717 28922 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:53.589283 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:53.590009 29049 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:53.590472 28734 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:53.590844 29126 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:53.591013 28734 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:53.592588 28954 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:53.593672 29077 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:53.594352 29077 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.594767 29077 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.589221 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.597505 22116 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:12:53.593227 28954 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.598578 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:53.607493 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:53.587329 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.609401 22264 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:12:53.592672 28973 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.614336 28973 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.616811 28856 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:53.582445 29067 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:53.582794 29091 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.618010 29067 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.618781 28954 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:53.619865 29144 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:53.616544 28973 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:53.605710 28877 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:53.606691 29126 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.621610 29126 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.621783 28877 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.623893 29126 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.586906 29072 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:53.625236 29072 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:53.625617 29072 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:53.632511 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 116130us
I20260709 12:12:53.633975 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:53.635426 29126 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:53.612566 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.592080 28734 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.660086 28856 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:53.900655 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.965564 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2681) took 2410 ms. Trace:
I20260709 12:12:53.814975 29142 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.924532 29070 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.969376 22115 rpcz_store.cc:276] 0709 12:12:51.554801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.974022 (+419221us) service_pool.cc:224] Handling call
0709 12:12:51.974247 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.721587 (+747340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.965303 (+1243716us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54002c15d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:53.965497 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674760064}
I20260709 12:12:53.970674 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:53.915055 28642 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:53.971614 22268 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 10.
I20260709 12:12:53.645437 29071 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.924083 22263 raft_consensus.cc:3055] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:12:53.979480 22263 raft_consensus.cc:740] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:53.915562 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:53.966727 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.980785 22194 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:53.922638 29127 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:53.923314 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.982372 22122 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:12:53.984510 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:53.985023 22269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 2180) took 2475 ms (client timeout 1919 ms). Trace:
I20260709 12:12:53.718892 29120 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:53.985755 22269 rpcz_store.cc:269] 0709 12:12:51.509900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.511385 (+  1485us) service_pool.cc:224] Handling call
0709 12:12:53.984758 (+2473373us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b540026b6d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:53.984926 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3596463360}
I20260709 12:12:53.986474 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:53.986922 22862 raft_consensus.cc:2393] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:53.988003 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.988653 22122 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:12:53.988941 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.989868 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.710988 29090 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.968137 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:53.680817 28806 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:53.991528 28806 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.914646 29063 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:53.993503 28806 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:53.994393 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.995093 22122 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 23.
I20260709 12:12:53.993476 29090 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.988040 29120 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.675375 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:54.016331 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 341038us
W20260709 12:12:54.012562 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.017908 29124 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:54.018347 29124 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.018684 29124 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:54.021531 29136 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:53.971237 22115 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.022158 29136 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:54.023309 29136 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:54.024477 29136 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:53.972862 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:54.028157 22268 raft_consensus.cc:2410] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
W20260709 12:12:53.676127 29107 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.201s	user 0.002s	sys 0.003s
I20260709 12:12:53.973274 29070 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:54.032734 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:53.678242 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:53.905608 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 546302us
I20260709 12:12:54.034013 22117 raft_consensus.cc:2410] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:53.907346 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.973873 28856 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:54.036710 22117 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:53.703397 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:53.797693 29069 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.670984 28954 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:53.675599 29122 consensus_queue.cc:1059] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.300s
I20260709 12:12:53.638492 29119 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.337s
I20260709 12:12:53.636325 22264 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:53.676931 29077 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:53.976136 29153 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:12:53.587535 28797 consensus_queue.cc:1059] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.389s
I20260709 12:12:54.045645 28797 raft_consensus.cc:3055] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:54.046175 28797 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:54.046806 29002 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:54.047259 28797 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.714555 29065 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:54.049947 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:54.050793 22190 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 17: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:54.050894 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3779) took 2404 ms. Trace:
I20260709 12:12:54.050963 29065 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:53.976846 22162 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:54.052256 28965 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:54.052910 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 76185.8us
I20260709 12:12:54.053771 28965 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:54.055387 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:53.892616 28843 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:53.798136 29139 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.737694 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:53.701434 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:53.978294 22270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 3110) took 1979 ms (client timeout 1857 ms). Trace:
I20260709 12:12:53.673660 28973 consensus_queue.cc:1059] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.305s
I20260709 12:12:53.989995 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2687) took 1314 ms. Trace:
I20260709 12:12:53.998885 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:53.999953 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:54.062778 22114 rpcz_store.cc:276] 0709 12:12:52.676039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.988569 (+1312530us) service_pool.cc:224] Handling call
0709 12:12:53.989918 (+  1349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:54.000550 29091 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:53.967396 22859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 1045) took 1407 ms. Trace:
I20260709 12:12:53.971477 29142 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:53.971957 28642 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:54.006310 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:54.006660 29064 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:54.008031 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3130) took 1632 ms. Trace:
I20260709 12:12:54.013325 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4045) took 1897 ms. Trace:
I20260709 12:12:54.071413 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:53.636041 29126 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:12:53.947518 29128 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.820s	user 0.000s	sys 0.002s
I20260709 12:12:54.081650 22830 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:54.025177 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:54.026036 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:53.719420 29132 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:53.804798 28931 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:54.027136 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:54.032618 22115 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:12:54.101604 22830 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:54.102054 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 74976.5us
W20260709 12:12:54.103046 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 77079us
I20260709 12:12:54.103499 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:54.104075 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:53.838524 29072 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:53.675777 29150 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:54.026516 29133 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.037429 22860 raft_consensus.cc:606] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:54.035740 29071 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:54.051293 22118 rpcz_store.cc:276] 0709 12:12:51.646361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.121254 (+474893us) service_pool.cc:224] Handling call
0709 12:12:52.121572 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:52.121899 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.121927 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:52.122417 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:12:52.394289 (+271872us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:52.394329 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.395259 (+   930us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.675477 (+1280218us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:54.050587 (+375110us) raft_consensus.cc:1685] finished
0709 12:12:54.050612 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.050827 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3941,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":47187840,"thread_start_us":271538,"threads_started":1,"wal-append.queue_time_us":352061}
I20260709 12:12:54.122972 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:54.054289 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:54.062158 22270 rpcz_store.cc:269] 0709 12:12:51.998925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.999081 (+   156us) service_pool.cc:224] Handling call
0709 12:12:53.978035 (+1978954us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b5400240254. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:53.978203 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250512768}
I20260709 12:12:54.067225 22859 rpcz_store.cc:276] 0709 12:12:52.560182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.560356 (+   174us) service_pool.cc:224] Handling call
0709 12:12:53.967226 (+1406870us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54005073d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:53.967333 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2185776000}
W20260709 12:12:54.125643 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 71461.1us
I20260709 12:12:54.068993 22121 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:54.061088 29122 consensus_queue.cc:1243] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:12:54.072649 22266 rpcz_store.cc:276] 0709 12:12:52.116346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.116479 (+   133us) service_pool.cc:224] Handling call
0709 12:12:52.125506 (+  9027us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:52.420430 (+294924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.420465 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:52.421104 (+   639us) log.cc:844] Serialized 52 byte log entry
0709 12:12:52.711870 (+290766us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:52.711908 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.012967 (+1301059us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54000ea954. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:54.013011 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:54.013056 (+    45us) raft_consensus.cc:1685] finished
0709 12:12:54.013068 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.013270 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1257,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2955,"spinlock_wait_cycles":674484096,"thread_start_us":290429,"threads_started":1,"wal-append.queue_time_us":336547}
I20260709 12:12:54.074273 28877 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:54.074448 28843 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:54.144107 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:54.054670 28954 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:54.047387 29002 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:54.076380 29139 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:54.076723 22120 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:54.078685 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:12:54.097738 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72663.2us
I20260709 12:12:54.154945 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:54.105508 22122 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: [18.12-20.13]
I20260709 12:12:54.071245 22271 rpcz_store.cc:276] 0709 12:12:52.375530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.980882 (+1605352us) service_pool.cc:224] Handling call
0709 12:12:53.981374 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:53.981600 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:54.002177 (+ 20577us) log.cc:844] Serialized 14 byte log entry
0709 12:12:54.007616 (+  5439us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:54.007693 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:54.007748 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.007816 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.007967 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19890,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":414,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":101,"thread_start_us":21526,"threads_started":2,"wal-append.queue_time_us":4711}
I20260709 12:12:54.119875 28806 raft_consensus.cc:2764] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:54.116660 22087 leader_election.cc:400] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18.
I20260709 12:12:54.160665 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:54.054315 28965 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:54.121146 29065 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:54.126742 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:54.138325 28931 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:54.131003 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2795) took 1196 ms. Trace:
I20260709 12:12:54.133391 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:53.638068 29149 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.463s
I20260709 12:12:54.041282 29069 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:54.141185 22268 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:54.041464 29070 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.077s
I20260709 12:12:54.021625 22269 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:54.182127 22088 leader_election.cc:400] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20.
I20260709 12:12:54.146865 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:54.183133 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:54.183302 22270 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:54.139204 29063 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:54.156435 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:54.188012 22271 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:54.113730 22116 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 17. Current term is 18. Ops: [15.10-17.11]
I20260709 12:12:54.143399 28716 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:54.117353 29091 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:54.115803 29090 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:54.118574 28973 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:54.161002 22087 leader_election.cc:403] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:54.118942 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:54.116762 28964 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:54.150813 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:54.119829 29055 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:12:54.165872 28931 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:54.135380 29127 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:54.182147 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 85610.2us
I20260709 12:12:54.187116 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:54.205045 22270 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:54.182693 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4067) took 1660 ms. Trace:
I20260709 12:12:54.206431 22269 rpcz_store.cc:276] 0709 12:12:52.522354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.020971 (+1498617us) service_pool.cc:224] Handling call
0709 12:12:54.021290 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.182428 (+161138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.182639 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:54.207671 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:54.197285 22272 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:54.190310 22191 rpcz_store.cc:276] 0709 12:12:52.934448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.934606 (+   158us) service_pool.cc:224] Handling call
0709 12:12:54.130802 (+1196196us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b540004bad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:54.130934 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1039848192}
W20260709 12:12:54.198210 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 81763.1us
I20260709 12:12:54.199553 22088 leader_election.cc:400] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20.
I20260709 12:12:54.210124 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:54.201308 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:54.198325 28975 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18.
I20260709 12:12:54.202461 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:54.211166 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:54.212594 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:54.186178 29139 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:54.189245 29126 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:54.239243 22269 raft_consensus.cc:2410] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:54.229732 29072 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:54.154138 29138 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:12:54.231145 29124 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:54.283322 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.120474 29132 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:54.286736 29132 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:54.198886 29077 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:54.287449 29077 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:54.232020 29069 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:54.136267 29133 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:54.291263 29133 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:54.205593 29123 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:54.292047 29123 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.293030 22123 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:54.235110 28954 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:54.236238 28642 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:54.184191 28843 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:54.248507 22272 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:54.139428 29071 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:54.295874 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2192) took 1504 ms. Trace:
I20260709 12:12:54.204020 28931 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:54.282984 22266 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:54.292541 29123 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:54.204237 28716 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:54.136850 29150 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:54.299538 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2191) took 1759 ms. Trace:
I20260709 12:12:54.331743 22266 rpcz_store.cc:276] 0709 12:12:52.539635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.278453 (+1738818us) service_pool.cc:224] Handling call
0709 12:12:54.282816 (+  4363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.299188 (+ 16372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.299467 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:54.319061 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:54.319456 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:54.321529 22271 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:54.337843 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:54.338541 22271 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:54.338596 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:54.296269 22272 rpcz_store.cc:276] 0709 12:12:52.791328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.295005 (+1503677us) service_pool.cc:224] Handling call
0709 12:12:54.295363 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.295562 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:54.295590 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:54.295629 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:54.295673 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.295725 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.295816 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:54.340487 22271 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:54.341445 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2193) took 1549 ms. Trace:
I20260709 12:12:54.341908 22271 rpcz_store.cc:276] 0709 12:12:52.792285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.339949 (+1547664us) service_pool.cc:224] Handling call
0709 12:12:54.340264 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.341105 (+   841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.341374 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:54.343969 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2195) took 1550 ms. Trace:
I20260709 12:12:54.318779 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:54.344434 22271 rpcz_store.cc:276] 0709 12:12:52.793958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.342878 (+1548920us) service_pool.cc:224] Handling call
0709 12:12:54.343310 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.343545 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:54.343584 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:54.343644 (+    60us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:54.343698 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.343766 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.343896 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:54.339541 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 151183us
I20260709 12:12:54.348685 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2198) took 1442 ms. Trace:
I20260709 12:12:54.348955 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:54.349141 22271 rpcz_store.cc:276] 0709 12:12:52.906088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.347943 (+1441855us) service_pool.cc:224] Handling call
0709 12:12:54.348227 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.348399 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:54.348425 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:54.348465 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:54.348500 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.348550 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.348638 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:54.350994 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:54.351797 22191 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:54.352897 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2196) took 1558 ms. Trace:
I20260709 12:12:54.353514 22266 rpcz_store.cc:276] 0709 12:12:52.794838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.343929 (+1549091us) service_pool.cc:224] Handling call
0709 12:12:54.352194 (+  8265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.352432 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:54.352469 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:54.352517 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:54.352588 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.352656 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.352820 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:54.229792 29065 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.365355 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:54.372174 22265 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:54.378893 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:54.296725 29071 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:54.320830 29072 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:12:54.385805 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.304142 29002 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:54.379820 22859 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:54.392318 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:54.394793 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 259760us
I20260709 12:12:54.340727 29069 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:54.406829 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:54.308001 28716 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:54.894390 29064 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.802s	user 0.021s	sys 0.022s
I20260709 12:12:54.320075 29119 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 12:12:54.890671 29069 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:54.288611 29077 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:54.305706 29030 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 12:12:54.302795 28965 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:54.768855 22264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.005s	sys 0.001s
W20260709 12:12:54.968037 22264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.006s	sys 0.002s
I20260709 12:12:54.914417 22859 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:54.914901 22865 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:54.442793 29072 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:54.768260 22162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.002s	sys 0.005s
W20260709 12:12:54.976980 22162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.004s	sys 0.006s
W20260709 12:12:54.977662 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 850909us
I20260709 12:12:54.978470 22162 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:54.310374 29150 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:54.376111 29065 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:54.378533 28954 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.897722 29142 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:12:54.891336 22266 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:54.989806 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:54.897188 22831 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:54.919701 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:54.909225 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3785) took 1847 ms. Trace:
I20260709 12:12:54.925432 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2204) took 1428 ms. Trace:
W20260709 12:12:54.929145 22270 consensus_meta.cc:287] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.005s
I20260709 12:12:54.921334 29071 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:54.971294 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4070) took 2448 ms. Trace:
I20260709 12:12:54.945654 29124 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:54.990382 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3138) took 1872 ms. Trace:
I20260709 12:12:55.006707 22266 rpcz_store.cc:276] 0709 12:12:53.117899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.391515 (+1273616us) service_pool.cc:224] Handling call
0709 12:12:54.890934 (+499419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.990067 (+ 99133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.990321 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:54.991169 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 94089.9us
I20260709 12:12:54.991569 22120 rpcz_store.cc:276] 0709 12:12:53.061671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.500273 (+438602us) service_pool.cc:224] Handling call
0709 12:12:53.500543 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.154007 (+653464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.493935 (+339928us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54002544d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:54.909136 (+415201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324447488}
I20260709 12:12:54.997136 22264 rpcz_store.cc:276] 0709 12:12:52.523075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.043041 (+1519966us) service_pool.cc:224] Handling call
0709 12:12:54.043415 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.056714 (+ 13299us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:54.073662 (+ 16948us) log.cc:844] Serialized 14 byte log entry
0709 12:12:54.968703 (+895041us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:54.970945 (+  2242us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:54.971038 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.971114 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.971230 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41819,"prepare.queue_time_us":19234,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":63271,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":3596,"thread_start_us":887835,"threads_started":2,"wal-append.queue_time_us":210862}
I20260709 12:12:55.009516 22264 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:54.991926 22270 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:54.956310 29169 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:55.003005 29177 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.004118 29072 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:54.995963 28954 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:54.990636 22862 raft_consensus.cc:606] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:54.991708 22269 rpcz_store.cc:276] 0709 12:12:53.496817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.907889 (+1411072us) service_pool.cc:224] Handling call
0709 12:12:54.908326 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.908593 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:54.908632 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:54.908692 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:54.908743 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.925237 (+ 16494us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.925372 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:55.006129 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.011498 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3154) took 1455 ms. Trace:
W20260709 12:12:55.056259 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48012.8us
I20260709 12:12:55.056504 22270 rpcz_store.cc:276] 0709 12:12:53.556410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.010760 (+1454350us) service_pool.cc:224] Handling call
0709 12:12:55.011029 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.011195 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:55.011220 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:55.011258 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:55.011302 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.011352 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.011449 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:55.002668 28967 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:55.012071 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3152) took 1506 ms. Trace:
I20260709 12:12:55.058321 22264 rpcz_store.cc:276] 0709 12:12:53.506159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.008968 (+1502809us) service_pool.cc:224] Handling call
0709 12:12:55.009282 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:55.009870 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.012021 (+  2151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:55.059773 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2207) took 1006 ms. Trace:
I20260709 12:12:55.056278 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2206) took 1485 ms. Trace:
I20260709 12:12:55.061260 22269 rpcz_store.cc:276] 0709 12:12:53.570902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.055446 (+1484544us) service_pool.cc:224] Handling call
0709 12:12:55.055748 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.055954 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:55.055980 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:55.056024 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:55.056054 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.056103 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.056211 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:55.063118 22270 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:55.063433 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2205) took 1564 ms. Trace:
I20260709 12:12:55.063714 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3159) took 1039 ms. Trace:
I20260709 12:12:55.064141 22270 rpcz_store.cc:276] 0709 12:12:54.024623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.057573 (+1032950us) service_pool.cc:224] Handling call
0709 12:12:55.057828 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.063489 (+  5661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.063663 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:55.060098 22264 rpcz_store.cc:276] 0709 12:12:54.053921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.059062 (+1005141us) service_pool.cc:224] Handling call
0709 12:12:55.059313 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.059476 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:55.059503 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:55.059544 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:55.059580 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.059627 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.059723 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:55.053469 22267 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:12:55.063954 22266 rpcz_store.cc:276] 0709 12:12:53.499381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.007665 (+1508284us) service_pool.cc:224] Handling call
0709 12:12:55.062731 (+ 55066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.062985 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:55.063024 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:55.063098 (+    74us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:55.063151 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.063222 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.063359 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:55.071571 22269 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:55.074709 22269 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:12:55.075196 22269 pending_rounds.cc:85] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 10
I20260709 12:12:55.075459 22269 pending_rounds.cc:107] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:12:55.075737 22269 raft_consensus.cc:2889] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:55.061959 28873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.026s	sys 0.013s
W20260709 12:12:55.096692 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 118315us
I20260709 12:12:55.060598 29124 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.989337 29064 consensus_queue.cc:1059] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.089s
W20260709 12:12:55.112265 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 135055us
I20260709 12:12:55.121855 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 3803) took 1187 ms. Trace:
I20260709 12:12:55.107290 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:55.112962 22266 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:12:55.106511 28873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.027s	sys 0.013s
I20260709 12:12:55.122355 22123 rpcz_store.cc:276] 0709 12:12:53.934067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.998590 (+ 64523us) service_pool.cc:224] Handling call
0709 12:12:55.121667 (+1123077us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54002c10d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:55.121793 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524062976}
I20260709 12:12:55.120548 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3802) took 1190 ms. Trace:
I20260709 12:12:55.123414 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4075) took 1013 ms. Trace:
I20260709 12:12:55.129698 22266 rpcz_store.cc:276] 0709 12:12:54.110338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.069814 (+959476us) service_pool.cc:224] Handling call
0709 12:12:55.112443 (+ 42629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.123130 (+ 10687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.123355 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:55.138415 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 928284us
I20260709 12:12:55.109777 28877 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:55.139375 22087 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:55.140440 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2200) took 2065 ms. Trace:
I20260709 12:12:55.071422 28990 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
W20260709 12:12:55.151786 22267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 3148) took 2031 ms (client timeout 2059 ms). Trace:
W20260709 12:12:55.152426 22267 rpcz_store.cc:269] 0709 12:12:53.121943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.497058 (+375115us) service_pool.cc:224] Handling call
0709 12:12:55.151561 (+1654503us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540026c0d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:55.151706 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3327982976}
I20260709 12:12:55.146528 22271 rpcz_store.cc:276] 0709 12:12:53.075191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.350816 (+1275625us) service_pool.cc:224] Handling call
0709 12:12:54.351034 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.351218 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:54.374812 (+ 23594us) log.cc:844] Serialized 14 byte log entry
0709 12:12:55.139970 (+765158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:55.140046 (+    76us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:55.140105 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.140199 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.140367 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29015,"prepare.run_cpu_time_us":9205,"prepare.run_wall_time_us":494498,"raft.queue_time_us":447537,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":384460,"threads_started":2}
I20260709 12:12:55.064654 29177 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.160082 22162 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:55.126921 29020 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:55.119371 29124 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.105947 29167 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 12:12:55.144841 29091 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:55.197736 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.200917 29090 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:55.201480 29090 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:55.148633 29046 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:55.201975 29090 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:54.990239 29175 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 12:12:55.209794 22272 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:12:55.208065 29072 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:55.160089 28877 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.185426 29182 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:55.221629 28931 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.924s	user 0.006s	sys 0.009s
I20260709 12:12:55.254968 28931 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:55.258585 29123 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.958s	user 0.019s	sys 0.006s
I20260709 12:12:55.259281 29123 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.216135 28716 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:55.231901 29002 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:55.228339 29175 consensus_queue.cc:1243] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:55.237917 28873 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:55.220829 29046 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.285773 29042 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:55.303683 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 1050) took 1182 ms. Trace:
I20260709 12:12:55.314978 22858 rpcz_store.cc:276] 0709 12:12:54.121697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.124107 (+  2410us) service_pool.cc:224] Handling call
0709 12:12:54.124357 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.184807 (+ 60450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:54.184842 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:54.184890 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:54.184923 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.301647 (+1116724us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b5400431554. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:55.303392 (+  1745us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.303600 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138470144}
I20260709 12:12:55.291976 29069 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:55.298614 29174 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:55.241995 29072 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.294308 29002 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:55.301497 29065 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:55.308655 28873 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:55.316915 29042 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:55.285537 29182 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.339136 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4073) took 1229 ms. Trace:
I20260709 12:12:55.302481 29189 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:12:55.322857 28954 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:55.342175 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.339802 28967 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:55.341658 28873 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:55.344628 29071 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:55.355191 22858 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11. Ops: [9.10-10.11]
I20260709 12:12:55.344296 22270 rpcz_store.cc:276] 0709 12:12:54.109632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.064951 (+955319us) service_pool.cc:224] Handling call
0709 12:12:55.066283 (+  1332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.066526 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:55.096117 (+ 29591us) log.cc:844] Serialized 14 byte log entry
0709 12:12:55.338714 (+242597us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:55.338773 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:55.338826 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.338895 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.339040 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27545,"prepare.queue_time_us":29941,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":2219,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":4013,"thread_start_us":239998,"threads_started":1}
I20260709 12:12:55.348923 28990 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:55.352284 29177 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:55.354722 29189 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:55.362778 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:55.358714 29124 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:55.361697 29063 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.150s	user 0.010s	sys 0.002s
I20260709 12:12:55.370059 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:55.363936 29189 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:55.361470 29002 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.374487 29123 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:55.363726 28990 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:55.377591 29188 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:12:55.378150 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:55.379338 22862 raft_consensus.cc:2393] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:55.360611 29042 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.381704 29042 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:55.384904 28967 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.379269 28990 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:55.375440 29063 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.010s	sys 0.003s
I20260709 12:12:55.389242 29063 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:55.395586 29046 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:55.396104 28877 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:55.375768 28931 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:55.367198 29167 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:12:55.407393 28989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.332s	user 0.005s	sys 0.000s
W20260709 12:12:55.407996 28989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.332s	user 0.005s	sys 0.000s
I20260709 12:12:55.408469 29182 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:55.409400 29189 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.410593 29189 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:55.416224 29172 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.197s	user 0.003s	sys 0.001s
I20260709 12:12:55.420534 28797 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:55.390486 29090 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.407060 29167 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.390174 29063 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.401118 29072 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:55.428865 29071 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.453390 29090 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:55.459388 28873 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.466254 28734 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:55.471607 29077 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:55.477880 29167 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:55.464021 28873 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:55.484301 29002 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:55.485893 29151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.253s	user 0.031s	sys 0.069s
I20260709 12:12:55.490810 29191 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:55.496685 29191 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:12:55.493558 29151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.031s	sys 0.070s
I20260709 12:12:55.500993 29191 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.505735 29191 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:55.547441 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3809) took 1578 ms. Trace:
W20260709 12:12:55.186687 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.186911 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 975718us
I20260709 12:12:55.554615 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:55.548489 22119 rpcz_store.cc:276] 0709 12:12:53.968525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.084478 (+115953us) service_pool.cc:224] Handling call
0709 12:12:54.084930 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.085209 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:54.896588 (+811379us) log.cc:844] Serialized 14 byte log entry
0709 12:12:55.546144 (+649556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:55.546313 (+   169us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:55.546536 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.546715 (+   179us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.547065 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":416362,"prepare.queue_time_us":59575,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"thread_start_us":552778,"threads_started":2,"wal-append.queue_time_us":366981}
W20260709 12:12:55.555737 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 395566us
I20260709 12:12:55.579660 22088 leader_election.cc:400] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18.
I20260709 12:12:55.580044 28797 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:55.390833 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4086) took 1235 ms. Trace:
W20260709 12:12:55.561764 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.566431 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.566104 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:12:55.571266 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.573700 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:55.373508 22263 consensus_queue.cc:260] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.591598 22237 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:55.641347 29020 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:55.653597 29020 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:55.654259 29020 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:55.650452 28856 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:55.656029 28856 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:55.644155 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64930us
W20260709 12:12:55.547845 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 408342us
I20260709 12:12:55.572575 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:55.641750 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:55.674573 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 99249.5us
I20260709 12:12:55.676887 28797 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:55.678109 28797 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.667300 22269 rpcz_store.cc:276] 0709 12:12:54.154975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.076716 (+921741us) service_pool.cc:224] Handling call
0709 12:12:55.083231 (+  6515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:55.161419 (+ 78188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:55.161457 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:55.162018 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:12:55.361981 (+199963us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:55.362022 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.362087 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:55.388541 (+ 26454us) raft_consensus.cc:1685] finished
0709 12:12:55.388688 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.390314 (+  1626us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80602,"raft.queue_time_us":85858,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":14759,"thread_start_us":157488,"threads_started":1,"wal-append.queue_time_us":200063}
I20260709 12:12:55.682070 29150 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:55.682874 22192 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 23. Current term is 24. Ops: []
W20260709 12:12:55.691363 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.689976 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:12:55.700897 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 120187us
I20260709 12:12:55.701048 29136 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.704636 29136 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.705416 29204 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:55.128857 22114 rpcz_store.cc:276] 0709 12:12:53.930611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.064402 (+133791us) service_pool.cc:224] Handling call
0709 12:12:54.064831 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.065130 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:54.098522 (+ 33392us) log.cc:844] Serialized 14 byte log entry
0709 12:12:54.191430 (+ 92908us) log.cc:844] Serialized 14 byte log entry
0709 12:12:54.317405 (+125975us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b18003d1a40. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceaca32a6 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1
0709 12:12:54.319200 (+  1795us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b18003d1a40. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:12:55.119974 (+800774us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b18003d1a40. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceac4fc0a 00007fccf438f219 00007fcceacd7a40 00007fcceacd24e4 00007fcceacd2455 00007fcceddba060 00007fcceddcc716 00007fccedddd287 00007fccedddd208
0709 12:12:55.120158 (+   184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:55.120208 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:55.120261 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.120338 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.120483 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":930501,"prepare.queue_time_us":35039,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":3574,"raft.queue_time_us":936060,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":18233,"spinlock_wait_cycles":40680832,"thread_start_us":92272,"threads_started":1,"wal-append.queue_time_us":212087}
I20260709 12:12:55.710817 29204 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:55.711241 28856 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:55.712833 29204 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.714288 22196 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:55.714807 22196 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:55.715766 22864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:55.716888 22864 raft_consensus.cc:606] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:55.722132 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4066) took 3199 ms. Trace:
I20260709 12:12:55.720479 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:55.722574 22265 rpcz_store.cc:276] 0709 12:12:52.522090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.018231 (+1496141us) service_pool.cc:224] Handling call
0709 12:12:54.018602 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.372928 (+354326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.721394 (+1348466us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b540029c7d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:55.721873 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812467456}
I20260709 12:12:55.723333 22194 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:55.720505 22189 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:55.726204 28856 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:55.727370 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:55.729902 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2209) took 1412 ms. Trace:
I20260709 12:12:55.734613 22272 rpcz_store.cc:276] 0709 12:12:54.317409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.106544 (+789135us) service_pool.cc:224] Handling call
0709 12:12:55.125248 (+ 18704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.210307 (+ 85059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.729281 (+518974us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b54001ad454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:55.729611 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193302784}
I20260709 12:12:55.734215 22021 catalog_manager.cc:5697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.730846 22865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:12:55.728157 28856 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.738320 22865 raft_consensus.cc:606] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:55.738814 22865 raft_consensus.cc:614] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:55.739841 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:55.699501 28797 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:55.741356 29151 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:55.740418 29207 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:12:55.745747 29151 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:55.746296 29151 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:55.748121 28797 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:55.748805 28797 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.749249 28797 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:55.749306 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46975.6us
I20260709 12:12:55.728392 22189 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:12:55.747987 29151 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.752526 22865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
W20260709 12:12:55.752885 22268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 3160) took 1727 ms (client timeout 2084 ms). Trace:
I20260709 12:12:55.753378 22865 raft_consensus.cc:606] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:55.753463 22268 rpcz_store.cc:269] 0709 12:12:54.024920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.032366 (+  7446us) service_pool.cc:224] Handling call
0709 12:12:55.752380 (+1720014us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54002279d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:55.752584 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246603520}
I20260709 12:12:55.755568 29151 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:55.755712 22264 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:55.732074 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 519424us
I20260709 12:12:55.758930 22189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:12:55.759859 22189 raft_consensus.cc:606] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:55.759924 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:55.762971 29063 raft_consensus.cc:993] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:55.763703 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3810) took 1788 ms. Trace:
I20260709 12:12:55.763964 28967 raft_consensus.cc:1081] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:55.765417 29184 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:55.766137 29184 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:55.766777 29063 raft_consensus.cc:993] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:55.767506 29000 raft_consensus.cc:1081] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:55.767630 29184 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.760408 22189 raft_consensus.cc:614] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:55.773313 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4074) took 1663 ms. Trace:
I20260709 12:12:55.716252 22196 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.773329 29000 raft_consensus.cc:993] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:55.775324 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:55.774957 22264 rpcz_store.cc:276] 0709 12:12:54.109998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.065594 (+955596us) service_pool.cc:224] Handling call
0709 12:12:55.755094 (+689500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.756308 (+  1214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.773004 (+ 16696us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54002279d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:12:55.773228 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584704256}
I20260709 12:12:55.764261 22115 rpcz_store.cc:276] 0709 12:12:53.975404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.113437 (+138033us) service_pool.cc:224] Handling call
0709 12:12:54.121667 (+  8230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.206512 (+ 84845us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:54.218858 (+ 12346us) log.cc:844] Serialized 14 byte log entry
0709 12:12:55.138215 (+919357us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:55.138278 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:55.138350 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.763086 (+624736us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b5400311fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:55.763155 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.763437 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":919013,"prepare.queue_time_us":112887,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":925392,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":14602,"spinlock_wait_cycles":194517376}
I20260709 12:12:55.777140 29167 raft_consensus.cc:1081] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:12:55.782610 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:55.788528 22189 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:55.786861 29136 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:55.771255 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 108967us
W20260709 12:12:55.753381 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 89508.6us
I20260709 12:12:55.763974 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:55.793147 29173 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:55.794705 22263 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:12:55.794863 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:55.789213 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49580.3us
I20260709 12:12:55.786406 29063 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:55.804468 29090 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:55.805563 22223 heartbeater.cc:646] Failed to heartbeat to 127.20.102.254:38171 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.102.254:38171 timed out after 15.000s (SENT)
I20260709 12:12:55.807230 29173 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:55.807365 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:55.807829 29173 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:55.808750 29090 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:55.809710 29173 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.811909 29173 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:55.813212 28734 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.813468 29175 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:55.813334 29183 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.814194 29175 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:55.814072 28734 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.815227 29183 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.817320 28734 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:55.823571 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:55.824404 22114 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:55.824536 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:55.825449 22115 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:55.825861 29183 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:55.828624 29090 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:55.829748 29090 consensus_queue.cc:1243] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:12:55.830384 29091 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:55.831383 29181 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:55.831703 28716 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:55.836369 29090 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:55.837056 29090 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:55.837584 29175 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:55.838804 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:55.839210 29150 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:55.840461 29175 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.840128 29150 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.841115 29175 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.842972 22267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:12:55.843714 22267 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:55.843771 29150 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:55.844087 29175 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:55.845621 22272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:12:55.846213 22268 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:55.846400 22272 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:55.846601 29136 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:55.845122 22264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:12:55.844187 22267 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:55.849383 29090 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.846942 22272 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:55.853636 22019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 155) took 11353 ms (client timeout 15000 ms). Trace:
I20260709 12:12:55.801580 28856 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:55.875507 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.879202 29090 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:55.880038 22264 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:55.884037 22264 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:55.884128 22114 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:55.922442 22196 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:55.906018 29077 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.925050 22021 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 18 to 21, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 21 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.925849 29077 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.927371 22021 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 18, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 18 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:12:55.930774 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.932454 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:55.932184 29149 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:12:55.933665 29070 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:55.855974 22019 rpcz_store.cc:269] 0709 12:12:44.435353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:44.443182 (+  7829us) service_pool.cc:224] Handling call
0709 12:12:55.788988 (+11345806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:47.824647 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:47.825510 (+   863us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:47.825579 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:12:47.825610 (+    31us) tablet.cc:662] Decoding operations
0709 12:12:47.827116 (+  1506us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:47.827237 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:47.827276 (+    39us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:12:47.828699 (+  1423us) tablet.cc:701] Row locks acquired
0709 12:12:47.828760 (+    61us) write_op.cc:260] PREPARE: finished
0709 12:12:47.844812 (+ 16052us) write_op.cc:270] Start()
0709 12:12:47.853000 (+  8188us) write_op.cc:276] Timestamp: P: 1783599167842845 usec, L: 0
0709 12:12:47.853031 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:12:47.894224 (+ 41193us) log.cc:844] Serialized 4850 byte log entry
0709 12:12:48.496258 (+602034us) op_driver.cc:464] REPLICATION: finished
0709 12:12:48.741592 (+245334us) write_op.cc:301] APPLY: starting
0709 12:12:48.741768 (+   176us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:49.307640 (+565872us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:49.307753 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:49.507548 (+199795us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:49.507839 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:12:49.507892 (+    53us) write_op.cc:312] APPLY: finished
0709 12:12:49.508171 (+   279us) log.cc:844] Serialized 113 byte log entry
0709 12:12:49.916093 (+407922us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcceacb80ac 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b
0709 12:12:50.121133 (+205040us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:50.147729 (+ 26596us) write_op.cc:454] Released schema lock
0709 12:12:50.150238 (+  2509us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:50.262817 (+112579us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:50.262853 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1449683,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":191556,"apply.run_cpu_time_us":50835,"apply.run_wall_time_us":1442949,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54311,"num_ops":12,"prepare.queue_time_us":178963,"prepare.run_cpu_time_us":22465,"prepare.run_wall_time_us":260554,"raft.queue_time_us":229719,"raft.run_cpu_time_us":8357,"raft.run_wall_time_us":283423,"replication_time_us":577087,"spinlock_wait_cycles":46337280,"thread_start_us":1083535,"threads_started":5,"wal-append.queue_time_us":727862,"wal-append.run_cpu_time_us":39047,"wal-append.run_wall_time_us":2252459}]]}
W20260709 12:12:55.930559 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 119586us
W20260709 12:12:55.935220 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 103291us
I20260709 12:12:55.906884 29020 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:55.935202 29077 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:55.955552 22263 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:12:55.956362 22263 pending_rounds.cc:85] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 5
I20260709 12:12:55.959913 22263 pending_rounds.cc:107] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:12:55.967175 22263 raft_consensus.cc:2889] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:55.975436 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:55.988076 22119 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:55.989820 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:55.991582 22115 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:55.974258 29063 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:12:55.993155 29002 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:55.993681 29002 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:55.993835 29063 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:12:55.995494 29063 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:12:55.997773 29000 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:55.998284 29000 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:55.999768 29000 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.002096 29070 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:56.005926 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.006621 28716 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:55.994231 29002 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:56.009428 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.984390 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:55.981525 22021 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 19, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 19 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.992542 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:12:56.019102 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 43837.1us
I20260709 12:12:56.026436 28734 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.027143 28734 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:56.018060 28716 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:56.018345 29070 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:56.020915 29063 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:56.059115 28856 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:56.059877 28856 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:12:56.060525 29076 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:12:56.061125 28856 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:56.066287 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:56.070604 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.084601 22087 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:56.091070 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.071617 29063 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:56.082662 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4064) took 3941 ms. Trace:
I20260709 12:12:56.102707 22263 rpcz_store.cc:276] 0709 12:12:52.135610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.837865 (+702255us) service_pool.cc:224] Handling call
0709 12:12:52.843455 (+  5590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:53.923959 (+1080504us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400287420. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc41c0 00007fcceddc5231 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c
0709 12:12:55.373013 (+1449054us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400287420. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd4006f 00007fcceddb8f60 00007fcceddba7de 00007fcceddc4b49 00007fcceddc5416 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62
0709 12:12:56.053425 (+680412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:56.076634 (+ 23209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706614272}
I20260709 12:12:56.071651 22264 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.107156 22272 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:56.131453 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 56665.1us
I20260709 12:12:56.131870 22272 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:56.139091 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.109037 29177 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.140242 22123 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:12:56.132616 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:12:56.152449 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.152607 22264 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:56.152556 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 200629us
W20260709 12:12:56.155416 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.130105 29020 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:56.179373 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:12:56.179052 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 88716.1us
I20260709 12:12:56.180011 22858 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:56.178926 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:56.180405 22858 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:56.183369 22864 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:56.185840 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.186688 22115 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:56.185071 22864 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:56.109508 28716 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:56.173390 29136 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:56.189687 22858 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:56.198019 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 65549.1us
I20260709 12:12:56.182646 29091 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:56.207139 22858 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:56.209110 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 216725us
I20260709 12:12:56.200338 22021 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 11 to 13, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 13 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.198006 29191 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:56.198411 29136 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.163250 29177 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:56.221930 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:56.227607 29071 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.203390 29091 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:56.209558 22864 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.229108 22864 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:56.230571 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.230748 22123 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:12:56.231463 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.224524 29136 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:56.219913 29191 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:56.237097 29191 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:56.232164 29091 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.249125 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.250207 22114 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 17: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:56.251428 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.252250 22114 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
W20260709 12:12:56.252954 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.254084 29215 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:56.254751 29215 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:56.255564 29216 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:12:56.256851 22123 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:56.258512 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:56.233176 22267 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.278023 29215 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:56.280397 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:56.280496 29224 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.280843 22270 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:56.281256 29224 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.283799 29224 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:56.283934 22269 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:56.309260 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 107004us
I20260709 12:12:56.202418 29063 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.311712 22267 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:56.312009 22264 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:56.319190 22858 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:56.269596 29184 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:56.320219 22864 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:56.321432 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:56.329010 22196 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 12:12:56.328441 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 95469.4us
I20260709 12:12:56.228241 29071 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:56.330056 29151 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.333933 29151 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:56.332784 28964 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:12:56.336057 29151 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:56.336936 29091 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.338201 22122 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:56.339216 22117 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:56.341889 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1819) took 1991 ms. Trace:
I20260709 12:12:56.342314 22196 rpcz_store.cc:276] 0709 12:12:54.350220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.350383 (+   163us) service_pool.cc:224] Handling call
0709 12:12:54.350736 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.713920 (+1363184us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400151420. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc41c0 00007fcceddc5231 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c
0709 12:12:55.887745 (+173825us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b580043cad0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd1e0aa 00007fccedda0447 00007fcceddb8fe7 00007fcceddba7de 00007fcceddc4b49 00007fcceddc5416 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4
0709 12:12:56.329505 (+441760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:56.341810 (+ 12305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1421842048}
I20260709 12:12:56.340760 29091 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:56.350121 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:56.361004 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.365417 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.369191 29204 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:56.369928 29204 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:56.371223 22116 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:56.372318 29204 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:56.375555 28873 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.379694 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:56.381978 28734 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:56.384436 22117 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:12:56.384964 28716 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:56.385792 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.386617 22117 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:12:56.376384 28873 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.385967 29071 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:56.390450 29173 consensus_meta.cc:287] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.578s	user 0.014s	sys 0.002s
I20260709 12:12:56.382789 22121 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:12:56.393334 28797 consensus_meta.cc:287] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.643s	user 0.015s	sys 0.000s
I20260709 12:12:56.390517 28873 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:56.393425 29070 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.395290 22021 catalog_manager.cc:5697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 16 to 17, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.397951 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.396584 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.399441 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:12:56.400985 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 63517.7us
I20260709 12:12:56.402364 22237 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:56.402940 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:56.403729 22268 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 9.
I20260709 12:12:56.405200 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:56.405911 22858 raft_consensus.cc:3055] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:56.406217 22858 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:56.407138 22858 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.408231 22858 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:56.404490 22237 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:56.409930 29076 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:56.410627 29183 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:56.411198 29183 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:12:56.412714 29090 consensus_meta.cc:287] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.002s
I20260709 12:12:56.412133 29183 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.410487 29076 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:56.439357 28797 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:56.468515 29000 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.469635 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.471817 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.472497 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.474190 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.474809 22191 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
I20260709 12:12:56.475323 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.476130 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.476822 22191 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:56.477612 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:56.478474 22191 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:56.478793 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:56.479884 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.480311 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:56.480561 22021 catalog_manager.cc:5697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 16 to 17, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:56.481815 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.482075 29204 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:56.482746 29204 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:56.483938 29177 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:56.483803 29204 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.485080 22118 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:56.485441 29076 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.487407 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.489193 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.490715 22114 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:56.491397 29063 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:56.491854 22114 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:56.476603 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:56.492570 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:56.493785 29214 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.341s	user 0.006s	sys 0.000s
I20260709 12:12:56.497684 22191 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:56.499378 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.499675 22118 raft_consensus.cc:1240] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:12:56.500844 22269 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:56.489137 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.501981 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:56.506909 22858 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
W20260709 12:12:56.510494 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 109974us
I20260709 12:12:56.505961 22831 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:56.514228 22237 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:56.518414 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.519277 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:56.520172 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:56.533241 22122 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:56.540616 22114 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 10.
W20260709 12:12:56.531416 22087 connection.cc:256] RPC call timeout handler was delayed by -1.8479078380000828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 12:12:56.548072 22087 connection.cc:256] RPC call timeout handler was delayed by -1.6283078379999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 12:12:56.548492 22087 connection.cc:256] RPC call timeout handler was delayed by -1.5068078379999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 12:12:56.548866 22087 connection.cc:256] RPC call timeout handler was delayed by -1.1666078380001181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2291s for a response
I20260709 12:12:56.550483 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:56.518131 29167 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:56.527737 29177 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:56.555315 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 182662us
I20260709 12:12:56.557248 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.559795 22021 catalog_manager.cc:5697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 16, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 16 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:56.567898 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.557087 28967 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:12:56.572537 28734 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:56.573056 28734 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.573412 28734 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:56.577247 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.578032 22189 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:12:56.587774 28734 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:56.589635 29077 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:56.593757 29077 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:56.594206 29030 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:56.594782 29030 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:56.595193 29030 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:56.596012 29077 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:56.589893 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.590472 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.591336 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:56.591909 22195 raft_consensus.cc:1240] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:12:56.597536 29224 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:56.597970 22191 raft_consensus.cc:2410] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:12:56.598690 29177 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:56.592325 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.599862 29177 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.554966 29167 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.600807 28734 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:56.601133 29167 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:56.601787 29070 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:56.603660 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.517244 29191 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:56.606724 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.517999 29002 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.616588 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.618829 22114 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
W20260709 12:12:56.629606 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.637208 22864 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:56.638876 22197 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:56.639715 29191 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:56.647308 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.648867 28734 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:56.649534 28734 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:56.651991 28734 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:56.613819 29091 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.669757 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.673472 22192 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:56.657239 28797 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:56.685711 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:56.691684 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.694576 22123 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:56.678150 29091 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:56.733178 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 179134us
W20260709 12:12:56.740171 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.747593 22263 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:12:56.750250 29002 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:56.753909 29091 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:56.754542 29091 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.755136 29091 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:56.756196 22114 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:12:56.748346 22263 pending_rounds.cc:85] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 10
I20260709 12:12:56.782032 22263 pending_rounds.cc:107] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:12:56.782615 22263 raft_consensus.cc:2889] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:56.747684 29136 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.004s
I20260709 12:12:56.784729 22190 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:56.793017 29183 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:56.840180 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.818082 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.855329 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.817548 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.812743 22268 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:12:56.842767 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.819701 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.855229 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.813196 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:56.860060 22195 raft_consensus.cc:2410] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:12:56.821476 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:56.804713 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 104016us
I20260709 12:12:56.860558 22197 raft_consensus.cc:2410] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
W20260709 12:12:56.863515 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.814038 22265 pending_rounds.cc:85] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 10
I20260709 12:12:56.864212 22265 pending_rounds.cc:107] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:12:56.864496 22265 raft_consensus.cc:2889] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:56.825261 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.825870 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.872000 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.872735 22189 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:12:56.872720 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:56.874107 22194 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
W20260709 12:12:56.878403 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 261832us
I20260709 12:12:56.880190 29063 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.884788 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:56.894863 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.902462 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.903589 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:56.905189 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.902671 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:56.907833 22123 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:56.894531 22198 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:12:56.918059 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:56.918955 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:56.919356 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.919703 22268 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:12:56.919984 22189 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:56.920912 22271 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:56.921113 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.918990 22266 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:12:56.922360 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.920970 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.923420 22189 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:56.923553 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:56.925432 28964 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:12:56.926191 22196 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:56.924156 22191 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:56.928699 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:56.931524 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:56.932041 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.928938 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:56.933717 22268 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:12:56.931169 22189 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 24: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:12:56.937705 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.938129 22191 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:56.938438 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.941865 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.953068 22195 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:56.961632 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:56.888085 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 372438us
I20260709 12:12:56.882681 29063 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.976680 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:56.974982 22196 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:12:56.976400 22191 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:56.981630 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:56.982856 29245 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:12:56.982959 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:56.905925 29183 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:56.987375 29183 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:56.989167 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:56.991030 29000 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.001s
I20260709 12:12:56.998317 22195 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
W20260709 12:12:56.978756 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 54194.3us
I20260709 12:12:57.007359 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:57.013348 22264 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:12:57.013840 22264 pending_rounds.cc:85] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 9
I20260709 12:12:57.014073 22264 pending_rounds.cc:107] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:12:57.014317 22264 raft_consensus.cc:2889] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:56.862594 29136 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:57.027892 22117 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 20: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:12:57.025990 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.028385 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:57.028000 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:57.039686 22194 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:57.045769 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:57.048337 22121 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:57.027148 28964 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:12:57.053858 22859 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 18 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:57.054922 22194 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:57.055259 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.055994 22115 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:57.056489 29136 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:57.057111 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:57.057979 22115 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:12:57.058677 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.058745 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.059511 22115 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 14: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:57.060007 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.061302 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.062525 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.062878 29063 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:57.063716 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:57.074203 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 92456.4us
I20260709 12:12:57.077211 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.076468 22858 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:12:57.064567 29030 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:57.081169 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:57.085744 22116 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:12:57.049226 29204 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:12:57.075045 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:57.094241 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.092717 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.101824 22189 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:57.101045 22862 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 24.
I20260709 12:12:57.105450 22859 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:57.054922 29091 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:57.105521 22087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.084s (SENT) [suppressed 46 similar messages]
I20260709 12:12:57.107187 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:57.091514 29222 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.114955 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.116592 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:57.091995 29136 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.133570 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:57.133908 29136 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:57.112694 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:57.125034 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:57.130229 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.127027 22271 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:57.125968 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.124212 28964 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:57.134346 22194 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:57.143085 22196 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:12:57.148132 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.150107 22189 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:57.126506 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3817) took 1029 ms. Trace:
I20260709 12:12:57.143846 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:57.145082 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.125458 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:57.143474 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.172652 22114 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:57.173234 22195 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
W20260709 12:12:57.171551 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 58946.9us
W20260709 12:12:57.173938 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 43752.6us
I20260709 12:12:57.144613 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:57.175010 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56837us
I20260709 12:12:57.179083 22117 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:57.186769 29070 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:57.187280 29070 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.187631 29070 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:57.191685 29077 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:57.192957 29177 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:57.193398 29177 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:57.197261 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.198791 22189 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:57.171307 22119 rpcz_store.cc:276] 0709 12:12:56.096826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.097003 (+   177us) service_pool.cc:224] Handling call
0709 12:12:56.125181 (+ 28178us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:56.529318 (+404137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:56.529364 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:56.566480 (+ 37116us) log.cc:844] Serialized 52 byte log entry
0709 12:12:56.789742 (+223262us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:56.866862 (+ 77120us) log.cc:844] Serialized 14 byte log entry
0709 12:12:56.867190 (+   328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:56.867300 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:57.126295 (+258995us) raft_consensus.cc:1685] finished
0709 12:12:57.126315 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.126446 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":73458,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":9290,"raft.queue_time_us":18436,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":17067,"thread_start_us":570977,"threads_started":2,"wal-append.queue_time_us":509066}
W20260709 12:12:57.201360 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.202577 29030 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:57.179337 28964 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.204118 28964 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:57.205348 22198 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:57.204144 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:57.206669 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:57.209591 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:57.120957 29248 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:57.215070 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:57.179136 29167 consensus_meta.cc:287] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.523s	user 0.013s	sys 0.000s
I20260709 12:12:57.219440 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:57.220350 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:57.126016 29224 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.136718 29136 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:57.120997 28716 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
W20260709 12:12:57.241767 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:57.391333 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.225201 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.423986 29256 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.281240 22192 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:57.424594 29256 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:57.430409 22193 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:57.433610 29070 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:57.436225 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:57.369532 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.438309 22195 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:57.223835 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.237993 22116 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:57.236088 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:57.349216 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:57.421375 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.421957 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.225610 22197 raft_consensus.cc:2410] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:12:57.437115 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:12:57.330438 29223 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:12:57.331301 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:57.286731 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 63458.1us
I20260709 12:12:57.440747 22196 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:57.444859 22860 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:57.445552 22192 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:57.180588 29222 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:57.450568 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.451397 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.457707 29234 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:57.451475 22859 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:57.453227 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:57.452194 29070 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:57.455427 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.216704 29248 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:57.247076 29167 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:57.457646 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 242381us
I20260709 12:12:57.448618 22114 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 10.
I20260709 12:12:57.457767 28964 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:57.455657 29224 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:57.468981 22864 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:57.474807 22862 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 11.
W20260709 12:12:57.482081 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 133015us
I20260709 12:12:57.476671 22194 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:12:57.476868 22860 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:57.466349 29076 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.486457 29076 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:57.489292 29256 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:57.466264 22266 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:57.490185 29076 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:57.490645 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.490875 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.494448 22196 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:57.491524 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:57.489202 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.495317 22121 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:57.491505 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.425072 29177 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:57.490103 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:57.497346 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.497541 29177 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:57.497923 22189 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 17: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:57.498073 22119 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:12:57.468479 28964 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:57.499992 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.474788 28716 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:57.492650 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:57.493041 22192 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:57.502851 22120 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:57.493356 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.493618 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.491927 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.505162 22122 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:12:57.504905 29183 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:57.496424 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:12:57.469125 29244 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:12:57.505827 29224 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:57.511670 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:57.511838 22122 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
W20260709 12:12:57.512794 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.513065 28716 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:57.513283 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.513724 28716 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:57.514814 28716 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:57.523627 22117 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:12:57.458266 29234 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:57.463371 29248 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:57.512800 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:57.521328 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:57.526232 29234 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:57.528810 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.531690 22237 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:57.533880 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.544229 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.545312 22163 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:12:57.546572 29076 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:12:57.546792 29258 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:57.553826 29257 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:57.554610 22122 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:57.554838 29257 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 24 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:57.557256 22115 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:57.533429 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:57.537571 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:57.558660 22270 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:12:57.558046 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 86336.8us
I20260709 12:12:57.579998 22118 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:57.535593 29030 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:57.580464 22118 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:12:57.583315 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:57.584203 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.590246 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.591243 22119 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:12:57.592370 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:57.593127 22269 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:57.554965 29091 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.553841 29258 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.609223 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:57.603893 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:57.613374 22266 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:57.580413 28964 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:57.608815 22118 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:57.619099 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 69255.5us
I20260709 12:12:57.584159 29030 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.574364 29136 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:12:57.642223 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.672231 22118 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:57.672447 22119 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:12:57.668754 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.581188 28873 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:12:57.589030 29183 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 12:12:57.669272 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 46214.7us
I20260709 12:12:57.622181 28964 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.583887 29256 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:12:57.556331 29257 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:57.674739 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.616449 29258 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:57.677506 22123 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:57.678870 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.595613 28716 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:12:57.669766 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:57.675086 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 94121.2us
I20260709 12:12:57.639966 29030 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:57.675139 29136 consensus_queue.cc:1243] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:12:57.704398 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 101101us
I20260709 12:12:57.692447 28964 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:57.705235 22271 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:12:57.638186 29091 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:57.708889 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.693487 29222 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:57.709158 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:57.723846 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.747231 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:57.749163 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51417.9us
W20260709 12:12:57.750630 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 43537.6us
I20260709 12:12:57.772367 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:12:57.773754 22194 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:12:57.777702 22269 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:12:57.773092 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:57.705920 29167 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:57.791297 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 65017.7us
W20260709 12:12:57.797430 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.811921 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:57.793783 22271 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
W20260709 12:12:57.785435 29263 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.206s	user 0.002s	sys 0.000s
I20260709 12:12:57.821120 22122 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:57.821460 22123 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:57.822988 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:57.821518 22831 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:57.826376 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.831086 28961 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 12:12:57.835906 29262 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 12:12:57.837603 29271 log.cc:927] Time spent T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:12:57.848949 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:57.846041 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:57.855707 22270 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:12:57.841703 29256 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:12:57.865249 29191 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:57.871052 29233 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:57.842167 29268 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:12:57.889835 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:57.891649 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 187455us
I20260709 12:12:57.931236 22122 raft_consensus.cc:2410] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:57.889128 29191 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.938856 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:57.894332 29136 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:12:57.953733 29136 consensus_queue.cc:1243] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:57.891254 29167 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:12:57.961951 29091 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:57.976136 22118 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:12:57.976001 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:57.981235 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:57.988417 22118 pending_rounds.cc:85] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 9
I20260709 12:12:57.980646 29030 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:57.990543 29274 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:12:57.990764 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.991722 29030 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:57.992537 22118 pending_rounds.cc:107] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:12:57.992978 22118 raft_consensus.cc:2889] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:57.994155 29177 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:57.995184 29077 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:57.995775 29077 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:57.995872 22831 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:57.996977 29063 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:57.996729 29077 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:57.943341 29191 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:58.002410 29077 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:57.998806 29063 raft_consensus.cc:697] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:12:58.003643 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64864.5us
I20260709 12:12:58.003911 29063 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:58.004433 22163 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:58.005720 29272 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:58.006145 29272 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.006445 29272 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:58.009320 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 69360.3us
I20260709 12:12:57.935751 29264 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 12:12:58.019879 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:12:58.039140 22266 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 23.
I20260709 12:12:58.058440 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:58.061514 22268 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:12:58.041481 29273 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.207s	user 0.002s	sys 0.002s
I20260709 12:12:58.068085 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:58.070477 22270 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:58.031961 29070 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:58.031878 29091 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:58.042289 29136 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:58.075276 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 325237us
I20260709 12:12:58.084532 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:12:58.085055 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 214474us
I20260709 12:12:58.085670 22264 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:58.085875 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:58.099115 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:58.123102 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 51109.1us
I20260709 12:12:58.087384 29136 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:58.096439 29265 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.261s	user 0.000s	sys 0.004s
I20260709 12:12:58.063591 29177 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
W20260709 12:12:58.153141 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 87879.9us
I20260709 12:12:58.158699 22270 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
W20260709 12:12:58.132095 29248 consensus_meta.cc:287] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.003s
I20260709 12:12:58.161633 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:58.167589 29248 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:58.138096 29224 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:12:58.175249 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.155957 29136 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:58.189653 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:58.190300 22189 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:12:58.193843 29234 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.004s
I20260709 12:12:58.193607 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:58.194288 29234 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:58.121824 29091 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:58.202979 22191 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:58.209323 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 124957us
I20260709 12:12:58.211884 22194 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:58.247030 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:58.207962 29279 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:12:58.182760 29264 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:58.203858 29257 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:58.269493 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 61273.6us
I20260709 12:12:58.264191 29224 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:12:58.277112 29286 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 12:12:58.278043 29280 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 12:12:58.256217 29030 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:58.279729 29030 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:12:58.280894 29030 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:58.284142 29259 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:12:58.285120 29259 consensus_queue.cc:1243] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:58.285708 29259 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:58.286046 29259 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:58.287132 29259 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:58.289067 29290 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.290038 29290 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:58.293239 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:58.276680 29224 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:58.294230 22863 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:12:58.300952 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:58.256539 29268 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:12:58.292629 29258 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.586s	user 0.001s	sys 0.007s
I20260709 12:12:58.318468 22859 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:58.321165 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:58.321826 22120 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:58.323227 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:58.322947 29290 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:58.297118 29259 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:58.351024 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.372226 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:58.374862 22118 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 17: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:12:58.372682 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:12:58.327754 28964 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.005s
I20260709 12:12:58.393453 29288 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:58.407728 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.295156 29264 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:58.422224 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:58.423174 22118 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:12:58.328336 29258 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:58.369861 29268 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:58.383642 28964 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:58.438108 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 56794.3us
W20260709 12:12:58.453444 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 135789us
I20260709 12:12:58.457759 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:58.459021 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:58.471205 22265 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 12: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:58.385771 29070 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:58.394281 29288 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:58.480759 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3245) took 1337 ms. Trace:
I20260709 12:12:58.482398 22189 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:58.430317 29191 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:58.481419 22191 rpcz_store.cc:276] 0709 12:12:57.143640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.143822 (+   182us) service_pool.cc:224] Handling call
0709 12:12:57.367848 (+224026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:58.203409 (+835561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:58.480354 (+276945us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400177d54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:12:58.480666 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920172288}
I20260709 12:12:58.488029 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:12:58.488984 22194 raft_consensus.cc:2368] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16.
I20260709 12:12:58.469827 29234 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:58.474262 29091 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:58.493254 29284 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:12:58.467916 29248 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:58.506067 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.475049 29076 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:58.528976 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:58.534610 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:58.604095 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 69375.2us
I20260709 12:12:58.604975 22860 raft_consensus.cc:2368] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:12:58.607407 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:58.624841 22830 leader_election.cc:400] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16.
I20260709 12:12:58.625211 22830 leader_election.cc:403] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:12:58.625923 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:58.577728 29076 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:58.623174 29091 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.636078 29282 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:58.716339 29076 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:58.731091 29091 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:58.732048 29294 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:58.732479 29294 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.732824 29294 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:58.733583 29091 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:58.734470 29277 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.734970 29277 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:58.641963 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 113065us
I20260709 12:12:58.736418 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:58.736936 28716 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:58.737865 29298 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
W20260709 12:12:58.740250 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 114401us
I20260709 12:12:58.737529 28716 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:58.623518 29261 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.327s
W20260709 12:12:58.872712 22162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.002s	sys 0.009s
I20260709 12:12:58.727831 29307 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:58.888525 22161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.008s	sys 0.003s
W20260709 12:12:58.874922 29257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.002s	sys 0.009s
W20260709 12:12:58.875955 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 415637us
W20260709 12:12:58.883162 22162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.003s	sys 0.009s
W20260709 12:12:58.897078 22161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.009s	sys 0.004s
W20260709 12:12:58.905732 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 695385us
W20260709 12:12:58.906495 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.906474 22162 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:58.901988 29277 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:58.887053 29292 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.347s	user 0.001s	sys 0.001s
W20260709 12:12:58.921908 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 185515us
I20260709 12:12:58.726714 29070 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:58.908494 29257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.003s	sys 0.009s
I20260709 12:12:58.919843 29288 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:58.936475 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:58.954676 29310 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:58.956818 29289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.010s	sys 0.004s
W20260709 12:12:58.957468 29289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.011s	sys 0.004s
W20260709 12:12:58.958918 29312 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:12:58.960109 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 53715.9us
I20260709 12:12:58.961040 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:12:58.961826 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.962636 29322 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:58.935540 29268 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:58.963213 29277 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:58.931701 29257 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:58.964112 29277 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:58.965261 29302 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.288s	user 0.002s	sys 0.017s
I20260709 12:12:58.964895 29257 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:58.965801 29277 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:58.967252 29297 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:12:58.967851 29297 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:58.969614 29305 log.cc:927] Time spent T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
W20260709 12:12:58.972100 29272 consensus_meta.cc:287] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.965s	user 0.006s	sys 0.005s
I20260709 12:12:58.976349 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:58.993007 22120 consensus_meta.cc:287] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.005s
I20260709 12:12:58.993809 22120 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 11.
I20260709 12:12:58.969182 29320 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:59.005391 29320 consensus_queue.cc:1243] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:59.007874 29320 consensus_queue.cc:1059] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:12:58.995337 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 149436us
I20260709 12:12:58.954013 29258 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:58.963264 29322 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.062384 29294 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:59.048311 29312 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:12:59.054132 29325 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:59.055791 29300 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.466s	user 0.001s	sys 0.000s
I20260709 12:12:59.056209 29319 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:59.056165 29296 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:59.057276 29308 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:12:59.057899 29324 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:59.075193 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 138809us
W20260709 12:12:59.091142 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 183498us
W20260709 12:12:59.092500 22088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.000s	sys 0.009s
W20260709 12:12:59.058089 29306 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.499s	user 0.002s	sys 0.000s
I20260709 12:12:59.059755 29297 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:59.051812 29309 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:59.112979 29183 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:59.085819 29319 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:12:59.092849 22088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.000s	sys 0.009s
I20260709 12:12:59.065876 29322 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:58.978638 29272 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:59.111689 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 128270us
I20260709 12:12:59.113546 29183 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:12:59.106477 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.088140 29325 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:59.121711 22088 connection.cc:256] RPC call timeout handler was delayed by -3.4094967240000642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
I20260709 12:12:59.108291 29294 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:12:59.138816 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:59.137176 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.125622 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4121) took 1106 ms. Trace:
W20260709 12:12:59.139525 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 163296us
I20260709 12:12:59.140142 22269 rpcz_store.cc:276] 0709 12:12:58.019059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.020560 (+  1501us) service_pool.cc:224] Handling call
0709 12:12:58.052608 (+ 32048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:58.059551 (+  6943us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:58.059594 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:58.071790 (+ 12196us) log.cc:844] Serialized 26 byte log entry
0709 12:12:58.317068 (+245278us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:58.317136 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:58.317241 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:59.125377 (+808136us) raft_consensus.cc:1685] finished
0709 12:12:59.125405 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:59.125553 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":508,"raft.queue_time_us":102,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":14488,"thread_start_us":123206,"threads_started":1,"wal-append.queue_time_us":288714}
W20260709 12:12:59.070843 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 145216us
W20260709 12:12:59.150378 29136 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.926s	user 0.012s	sys 0.000s
I20260709 12:12:59.123135 29319 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:59.151018 29136 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:59.138161 29325 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:59.152438 22116 raft_consensus.cc:2368] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16.
I20260709 12:12:59.157285 29183 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:59.158397 29183 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:59.158943 29077 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.156s	user 0.012s	sys 0.001s
I20260709 12:12:59.122663 29309 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:12:59.162927 22088 connection.cc:256] RPC call timeout handler was delayed by -2.2127364289999605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 12:12:59.163399 22088 connection.cc:256] RPC call timeout handler was delayed by -1.863536429000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23010000000000003s for a response
W20260709 12:12:59.163784 22087 leader_election.cc:336] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.534s (SENT)
I20260709 12:12:59.168022 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:59.168696 22859 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:59.171741 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:59.172541 22864 raft_consensus.cc:2393] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:12:59.163120 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 53154.1us
I20260709 12:12:59.121845 29317 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:59.201397 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 62939.5us
I20260709 12:12:59.203872 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:59.203157 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:59.202425 22859 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:12:59.150588 29272 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:59.105140 29324 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:59.216898 22088 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:12:59.093644 29296 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:59.215243 22237 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:12:59.217047 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53312.9us
W20260709 12:12:59.219156 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.219604 22193 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:59.161108 29222 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:59.224922 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 63578us
I20260709 12:12:59.130121 29289 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:12:59.217617 29317 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:59.234742 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:59.218381 29294 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:59.235010 22120 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:59.238758 22269 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:59.227783 29259 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.851s	user 0.013s	sys 0.001s
I20260709 12:12:59.240101 22268 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:59.241479 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:59.244093 22122 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:59.160552 29309 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:59.234572 29268 raft_consensus.cc:2764] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:59.258803 29332 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.259320 29323 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:12:59.260023 29314 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:59.273715 22269 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:12:59.274384 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:59.248068 29338 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:59.233273 29222 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:59.276718 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:12:59.278106 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6315660600000683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 12:12:59.275167 22264 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
W20260709 12:12:59.288264 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6261660600000596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
I20260709 12:12:59.261715 29297 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:59.288842 22236 connection.cc:256] RPC call timeout handler was delayed by -1.5955660600002375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 12:12:59.299613 22236 connection.cc:256] RPC call timeout handler was delayed by -1.5881635309999638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
I20260709 12:12:59.301162 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:12:59.303177 22270 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:12:59.307536 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:12:59.309494 22264 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.312284 22859 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
W20260709 12:12:59.317090 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 67715.2us
W20260709 12:12:59.322258 29321 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:12:59.323419 29136 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:59.323474 22236 connection.cc:256] RPC call timeout handler was delayed by -1.3759660600001098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 12:12:59.324548 22236 connection.cc:256] RPC call timeout handler was delayed by -1.3615660600000865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 12:12:59.284608 29340 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:59.325157 29340 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:12:59.325829 29324 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:59.326150 29340 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:12:59.329090 22236 connection.cc:256] RPC call timeout handler was delayed by -1.3138660600002368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 12:12:59.328840 22087 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.778s (SENT)
W20260709 12:12:59.329625 22236 connection.cc:256] RPC call timeout handler was delayed by -1.3080814400000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 12:12:59.330427 22236 connection.cc:256] RPC call timeout handler was delayed by -1.2531814399999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 12:12:59.330873 22236 connection.cc:256] RPC call timeout handler was delayed by -1.2060694260001128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2977s for a response
W20260709 12:12:59.331270 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1833660600000258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 12:12:59.341930 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1545660600002066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 12:12:59.342743 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1541814400000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 12:12:59.343113 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1176660600001469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 12:12:59.343484 22236 connection.cc:256] RPC call timeout handler was delayed by -1.054281440000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 12:12:59.343844 22236 connection.cc:256] RPC call timeout handler was delayed by -1.0065814399999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 12:12:59.346504 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:59.318830 29310 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16.
I20260709 12:12:59.278422 29314 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:59.306608 29297 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:59.357999 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:59.358979 22864 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:12:59.355697 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:59.278720 29332 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:59.361738 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 100367us
W20260709 12:12:59.357811 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 156141us
I20260709 12:12:59.365343 22237 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:59.318656 29317 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:59.370390 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:12:59.372175 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:12:59.366844 29268 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:59.353073 29076 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:59.374554 29338 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:59.375379 22269 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:12:59.385484 29256 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:59.386008 29256 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:12:59.386384 29256 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:59.362058 29299 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.360909 29136 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:59.381409 29346 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:59.369360 29183 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:59.398945 22264 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:12:59.345292 29325 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:12:59.424206 22087 leader_election.cc:336] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.913s (SENT)
I20260709 12:12:59.424818 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:12:59.441071 29332 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:59.441810 29297 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:59.445439 29345 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:12:59.527292 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 137393us
W20260709 12:12:59.505102 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 81062.5us
W20260709 12:12:59.507333 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43774us
W20260709 12:12:59.530777 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.397127 29350 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:59.590631 29344 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 12:12:59.401338 29183 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.605168 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:12:59.552635 29222 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:59.604235 22122 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:12:59.406311 29299 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:59.554570 29360 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:12:59.615012 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.490975 29296 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:59.505486 29259 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:59.488161 29268 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:59.702337 29369 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:12:59.703543 29257 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:59.704129 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 105176us
I20260709 12:12:59.704399 29361 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:59.601601 29350 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:59.400466 29341 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.203s
W20260709 12:12:59.705930 29354 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:12:59.516672 29289 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:12:59.600504 29233 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.405937 29319 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:59.600199 29076 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:59.708968 29339 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.892740 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:12:59.596556 29338 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:12:59.952937 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:59.969509 22122 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:12:59.954414 22858 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:59.850658 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.904512 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:12:59.956547 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 355014us
I20260709 12:12:59.792783 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:12:59.923012 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:12:59.972968 22123 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:12:59.637110 29183 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:59.708702 29367 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.991030 29367 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:59.993232 29367 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:12:59.993685 29367 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:12:59.994165 29367 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:59.975680 29259 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:59.996129 29367 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:12:59.859654 29322 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.000s
I20260709 12:12:59.996869 29259 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:12:59.987151 22087 leader_election.cc:336] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.084s (SENT)
I20260709 12:12:59.997983 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:12:59.977494 29339 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:00.002554 29339 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:59.975925 29257 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:12:59.997248 29322 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:00.005445 29257 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:00.006659 29322 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:12:59.987838 22863 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
W20260709 12:12:59.938329 29256 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260709 12:12:59.987911 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:12:59.975055 29360 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.007709 29256 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.010389 29256 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:00.010682 29360 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:12:59.974924 29233 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:12:59.990200 29299 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:00.014578 29296 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:13:00.015239 29296 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:00.015435 29350 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:00.016299 22087 leader_election.cc:336] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.291s (SENT)
I20260709 12:12:59.722007 29314 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:00.017419 22191 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:00.016476 29296 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:00.018975 29319 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:00.017156 22087 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:00.023557 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:00.020628 29233 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:00.024403 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56389.3us
W20260709 12:13:00.028405 22087 leader_election.cc:336] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.301s (SENT)
I20260709 12:13:00.029610 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:00.017154 29299 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:00.030426 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.031234 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.038049 29289 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:00.036942 29268 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:00.042482 29289 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:00.044008 29289 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:59.978305 29369 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.026031 29367 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:13:00.025419 29322 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:00.030400 29339 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:00.049844 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.051853 22195 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:13:00.050961 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:00.062269 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:00.063349 22194 raft_consensus.cc:2368] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:13:00.061542 22192 raft_consensus.cc:2376] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16. Re-sending same reply.
I20260709 12:13:00.065964 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.066152 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.066416 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.067219 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.068127 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.068825 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:00.069751 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:00.071660 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:00.074234 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 99631.7us
I20260709 12:13:00.077330 22121 pending_rounds.cc:85] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 7
I20260709 12:13:00.077634 22121 pending_rounds.cc:107] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:13:00.077555 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:00.077725 22198 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:00.078511 22191 raft_consensus.cc:2368] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21.
I20260709 12:13:00.078128 22121 raft_consensus.cc:2889] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:00.078117 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:00.079536 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.075415 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.081194 22123 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:00.081210 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:00.083271 22196 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:00.049171 29267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.765s	user 0.015s	sys 0.015s
I20260709 12:13:00.086854 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.087571 22122 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:00.087467 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.089838 22191 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:13:00.093554 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.063014 29259 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:00.064553 29339 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:00.103400 29371 consensus_queue.cc:1059] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:13:00.080719 29076 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:00.081719 29333 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:00.109498 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.056493 29277 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:13:00.084551 29268 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:00.118227 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.056233 29256 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:13:00.123494 22198 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:13:00.133699 22196 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
W20260709 12:13:00.097579 29267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.813s	user 0.015s	sys 0.015s
I20260709 12:13:00.150837 22118 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
W20260709 12:13:00.151811 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 83718us
I20260709 12:13:00.152758 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.120600 29339 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:00.123211 29322 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:00.165517 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 79095.1us
I20260709 12:13:00.123908 29363 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.119163 29367 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:00.094094 29314 consensus_queue.cc:1059] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:13:00.081063 29338 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:00.107041 29299 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:13:00.179317 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:00.196316 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.197222 22192 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:00.174238 29259 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:00.174737 29371 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:13:00.198429 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.240937 29371 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:00.242172 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.205796 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.242455 29371 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.243659 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.244323 29371 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:00.206738 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:00.207221 29373 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:13:00.208828 22190 pending_rounds.cc:85] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 8
I20260709 12:13:00.292712 22190 pending_rounds.cc:107] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:13:00.293113 22190 raft_consensus.cc:2889] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:00.209041 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:00.210345 29372 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:13:00.211855 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.301451 22195 raft_consensus.cc:2410] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:13:00.213634 29183 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.181658 29367 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.217097 29328 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:00.219000 29301 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:00.222831 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.227837 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.315043 22120 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:13:00.176393 29363 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.235826 29314 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:13:00.236135 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56972.8us
I20260709 12:13:00.236675 29369 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:00.193171 29360 raft_consensus.cc:3055] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:13:00.173180 29322 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:00.238812 29342 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.915s	user 0.007s	sys 0.005s
I20260709 12:13:00.239363 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:00.337586 22196 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:00.199961 22191 pending_rounds.cc:85] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 5
I20260709 12:13:00.338078 22191 pending_rounds.cc:107] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:13:00.338393 22191 raft_consensus.cc:2889] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:00.244920 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:00.245807 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:00.206472 29375 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:13:00.267338 29191 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:00.268105 29379 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:00.269219 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:00.270047 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:00.286580 22162 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:00.300266 22123 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:00.348141 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.319576 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.322448 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.324944 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.324994 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.350924 22268 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:13:00.351341 22196 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:13:00.351501 22189 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:13:00.351985 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.325847 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:00.329882 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:00.353106 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 66630.4us
I20260709 12:13:00.353479 22120 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:13:00.353118 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:00.339525 29224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.010s	sys 0.009s
I20260709 12:13:00.340550 22198 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:00.343103 22192 raft_consensus.cc:2368] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21.
I20260709 12:13:00.354113 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:00.313621 29328 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:00.360553 29328 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:00.360795 29369 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:00.327148 29360 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:00.345674 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.349398 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.362968 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:00.363571 22123 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:00.323755 29314 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:00.348209 22859 raft_consensus.cc:2376] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16. Re-sending same reply.
I20260709 12:13:00.357942 22271 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:00.313885 29301 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:00.312319 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.364830 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.369576 29379 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.371157 22198 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:00.361864 29380 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:00.375161 29380 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.375559 29380 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:00.375974 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.365285 29204 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:00.376842 29204 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.377226 29204 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:00.377154 29301 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.378561 29301 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:00.379494 29317 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:00.380697 29363 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:00.382277 22192 raft_consensus.cc:2368] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21.
I20260709 12:13:00.365058 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:00.374395 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.374323 29322 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:00.384514 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:00.358525 29224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.010s	sys 0.010s
I20260709 12:13:00.387266 22272 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:00.389186 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.389586 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.391114 22271 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:00.393205 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:00.378800 29183 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:00.402441 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.363224 29340 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:00.408913 22864 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 12. Current term is 13. Ops: []
I20260709 12:13:00.408829 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:00.465138 22271 raft_consensus.cc:2368] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19.
I20260709 12:13:00.467108 22123 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:00.468745 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.471446 22272 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:00.478618 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:00.411590 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.479349 22268 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:00.412602 22120 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:00.484390 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:00.484922 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.400184 29322 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:13:00.495543 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:00.496219 22859 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:00.389819 29384 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:00.494763 22123 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:13:00.509987 29333 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:00.399667 29332 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:00.463423 29317 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:00.408576 29268 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:13:00.504856 29314 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:00.512919 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 101403us
I20260709 12:13:00.408962 29191 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:00.532277 22268 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:13:00.529812 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:00.544420 22859 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:00.545576 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:00.525858 29340 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:00.523205 29317 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:00.550011 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 81074.4us
I20260709 12:13:00.560492 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:00.574391 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.562564 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:00.409409 29360 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:00.534368 28967 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:13:00.545120 29384 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:00.513294 29339 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:00.592175 22270 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:00.581051 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 184072us
I20260709 12:13:00.584468 28964 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:00.578626 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:00.569133 29076 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:00.577694 29317 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:00.593566 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:00.604303 22271 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:00.545091 29333 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
W20260709 12:13:00.601468 29389 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:13:00.611115 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:00.545040 29191 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.585871 29322 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:00.602927 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.604882 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:00.621323 22263 raft_consensus.cc:2368] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:13:00.609954 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.610185 22859 raft_consensus.cc:2368] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19.
I20260709 12:13:00.586308 29314 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:00.618485 22831 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:00.590319 29384 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:00.594848 29360 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:00.594103 29268 consensus_queue.cc:1243] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 23.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:13:00.469411 29378 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.202s
W20260709 12:13:00.615161 29390 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:13:00.647162 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.653082 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1720) took 2214 ms. Trace:
I20260709 12:13:00.625470 29322 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:00.663093 22116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 1725) took 2143 ms (client timeout 1577 ms). Trace:
I20260709 12:13:00.654053 22119 rpcz_store.cc:276] 0709 12:12:58.431038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.431767 (+   729us) service_pool.cc:224] Handling call
0709 12:12:58.432205 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:00.280224 (+1848019us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b1800435100. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fcceddba060 00007fcceddbabfb 00007fcceddc564b
0709 12:13:00.280451 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:00.280486 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:00.281346 (+   860us) log.cc:844] Serialized 52 byte log entry
0709 12:13:00.340070 (+ 58724us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:00.628270 (+288200us) log.cc:844] Serialized 14 byte log entry
0709 12:13:00.628753 (+   483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:00.628872 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:00.645175 (+ 16303us) raft_consensus.cc:1685] finished
0709 12:13:00.645274 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.645470 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":297071,"raft.queue_time_us":155907,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":8061,"spinlock_wait_cycles":18035072,"thread_start_us":475762,"threads_started":3,"wal-append.queue_time_us":128358}
I20260709 12:13:00.633484 29167 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:13:00.664369 22116 rpcz_store.cc:269] 0709 12:12:58.494285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.528166 (+ 33881us) service_pool.cc:224] Handling call
0709 12:13:00.635143 (+2106977us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54002adad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:00.637908 (+  2765us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250379520}
I20260709 12:13:00.631430 29384 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:00.608961 29204 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:00.691560 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:00.692541 22269 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:13:00.695263 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:00.699851 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.670601 29322 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:00.732893 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 112576us
I20260709 12:13:00.690376 29167 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:00.760187 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.760351 22237 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:00.763247 22272 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:13:00.766784 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:00.771730 22265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 2239) took 3244 ms (client timeout 4083 ms). Trace:
W20260709 12:13:00.772260 22265 rpcz_store.cc:269] 0709 12:12:57.518793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.518949 (+   156us) service_pool.cc:224] Handling call
0709 12:13:00.762898 (+3243949us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b540026cad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:00.763080 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093587200}
I20260709 12:13:00.757232 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:00.780529 22236 leader_election.cc:336] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.625s (SENT)
I20260709 12:13:00.771322 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:00.781082 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:00.797472 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.773922 29333 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:00.794301 22831 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.804802 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.806196 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.807816 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.815826 29002 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:13:00.817641 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.801755 22269 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
W20260709 12:13:00.821090 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 226146us
I20260709 12:13:00.823359 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.824150 22123 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
W20260709 12:13:00.825228 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.825099 22265 raft_consensus.cc:2368] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21.
W20260709 12:13:00.826534 29313 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 2.102s	user 0.022s	sys 0.019s
I20260709 12:13:00.827777 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.878050 22123 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:00.828436 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.828518 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.829178 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.829588 22087 leader_election.cc:400] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21.
W20260709 12:13:00.835671 29371 consensus_meta.cc:287] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 12:13:00.836747 29340 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:00.837387 29167 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.838501 29333 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:00.844051 29191 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:00.849128 29325 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:00.852223 22861 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:13:00.872818 29257 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:00.853806 22120 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:00.910048 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:00.909945 29257 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.910889 22196 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:00.911243 29264 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:00.912308 29257 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:00.909967 22120 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:00.854297 29401 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:13:00.858040 28716 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:00.860929 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:00.803576 29367 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:00.818244 29339 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:00.863411 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:00.863773 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:00.864343 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:00.865455 22860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 1052) took 2890 ms (client timeout 2075 ms). Trace:
I20260709 12:13:00.865864 22858 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:00.867053 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:00.868844 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.869135 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:00.868582 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.872637 29297 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:00.876405 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:00.879393 22087 leader_election.cc:403] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:00.879719 22265 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 12:13:00.924932 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 144429us
I20260709 12:13:00.882766 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:00.929710 22236 leader_election.cc:336] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.636s (SENT)
I20260709 12:13:00.886103 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:00.930244 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.930653 22863 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:00.887306 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.931805 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:00.881798 22263 raft_consensus.cc:2410] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:13:00.932823 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.933455 22196 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:00.933895 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.934700 22263 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:00.935945 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.935580 29333 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.885922 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:00.853514 29406 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:13:00.937364 28716 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:00.938205 28716 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:00.890049 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.939073 28716 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:00.939847 22269 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:00.927192 22195 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
W20260709 12:13:00.937477 29380 consensus_meta.cc:287] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.000s
I20260709 12:13:00.914187 22120 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:00.937243 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51432.5us
I20260709 12:13:00.953722 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.955852 29322 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:00.956755 29309 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:00.958272 29257 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:00.961781 29319 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:00.963967 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.964999 29303 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:00.965866 22163 leader_election.cc:400] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19.
I20260709 12:13:00.966274 22163 leader_election.cc:403] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:13:00.966993 29303 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19.
I20260709 12:13:00.970597 29380 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:00.973492 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.974900 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.976070 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.950040 29297 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:00.979122 29297 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:00.979682 29257 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:00.981833 29380 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:00.925890 22860 rpcz_store.cc:269] 0709 12:12:57.975493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.975704 (+   211us) service_pool.cc:224] Handling call
0709 12:13:00.865195 (+2889491us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b540071f054. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:00.865338 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380447104}
I20260709 12:13:00.943276 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:00.984827 22269 raft_consensus.cc:2410] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:13:00.985663 29191 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:00.986039 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.985674 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.986948 22269 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:00.986966 22115 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:00.936597 22263 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:13:00.976643 22265 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
W20260709 12:13:00.879503 29313 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 2.155s	user 0.022s	sys 0.020s
I20260709 12:13:00.934099 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:00.988879 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:00.990443 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:00.990657 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.991523 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:00.947314 22271 raft_consensus.cc:2410] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:13:00.993178 22115 raft_consensus.cc:2368] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11.
I20260709 12:13:00.992288 22267 raft_consensus.cc:2376] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11. Re-sending same reply.
I20260709 12:13:00.993845 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:00.994581 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.994863 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.995402 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.995774 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:00.996025 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.997133 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.997736 22271 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:00.998734 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:00.998921 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:00.943264 29204 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:01.002687 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:01.000424 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 70741.3us
I20260709 12:13:01.008467 22265 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:01.008495 22236 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.660s (SENT)
I20260709 12:13:01.009338 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:00.924260 29340 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:13:01.010829 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:00.992941 29401 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:13:01.012084 22269 raft_consensus.cc:2410] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:13:01.012609 22263 raft_consensus.cc:2368] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:13:00.988488 29191 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:01.014056 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:01.020867 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:01.064061 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:01.075409 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.084285 22269 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:01.097234 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 98576.2us
I20260709 12:13:01.098266 22163 leader_election.cc:400] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19.
I20260709 12:13:01.099924 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:01.099939 22263 raft_consensus.cc:2410] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:13:01.003635 29380 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:01.100896 22267 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 13. Current term is 14. Ops: []
W20260709 12:13:01.098357 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 89914.9us
I20260709 12:13:01.107216 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:01.011322 29339 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:01.060915 29204 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:01.118036 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.031044 29309 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:01.114257 22267 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:13:01.103252 22269 raft_consensus.cc:1217] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-14.9]   Dedup: 11.7->[12.8-14.9]
I20260709 12:13:01.061262 29411 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:13:01.123152 29301 consensus_meta.cc:287] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.741s	user 0.006s	sys 0.010s
W20260709 12:13:01.123333 29279 log.cc:927] Time spent T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 2.733s	user 0.010s	sys 0.026s
W20260709 12:13:01.123620 29328 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.762s	user 0.014s	sys 0.001s
I20260709 12:13:01.120620 29360 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:01.132877 29297 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:01.134624 29322 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:01.138091 29299 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:13:01.139305 29191 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:01.140925 22264 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:01.141947 22267 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:01.143060 22269 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: [9.6-14.9]
W20260709 12:13:01.166076 22830 connection.cc:256] RPC call timeout handler was delayed by -1.2904765980001685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 12:13:01.166138 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 59866.7us
I20260709 12:13:01.111325 28716 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:01.142655 29380 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:01.167479 22236 leader_election.cc:336] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.711s (SENT)
I20260709 12:13:01.171334 22267 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:01.177145 29281 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.180879 29281 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:01.183218 29281 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:01.162351 29299 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:01.196377 22236 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.869s (SENT)
I20260709 12:13:01.163583 29384 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.198833 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.202147 22268 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:01.160584 29328 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:01.195259 29317 consensus_meta.cc:287] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.000s
W20260709 12:13:01.196260 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 78339.3us
I20260709 12:13:01.206763 22163 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:01.206889 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 293238us
I20260709 12:13:01.215420 22271 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:01.217995 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:01.201900 29384 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:01.219715 22236 leader_election.cc:336] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.133s (SENT)
I20260709 12:13:01.220234 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:01.222806 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:01.223403 22264 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:01.221014 28716 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:01.207964 29297 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:01.221971 22269 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:01.220302 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:01.226713 28716 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.217880 29258 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:01.229746 28716 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:01.234877 29328 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:01.199352 29299 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:01.236747 22862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 1123) took 3219 ms. Trace:
I20260709 12:13:01.209975 29317 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.237251 22862 rpcz_store.cc:276] 0709 12:12:58.017212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.034553 (+ 17341us) service_pool.cc:224] Handling call
0709 12:12:58.034911 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:58.035307 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:58.035338 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:58.041468 (+  6130us) log.cc:844] Serialized 26 byte log entry
0709 12:12:58.170271 (+128803us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:58.170331 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:58.170423 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:01.235248 (+3064825us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b2400343c58. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceab5b9c4 00007fcceab59acb 00007fccead14dc9 00007fccead14a55 00007fccead13fb0 00007fcced98a488 00007fcced98abe8 00007fcced962398 00007fcced95d76a 00007fcced95cbb6
0709 12:13:01.236360 (+  1112us) raft_consensus.cc:1685] finished
0709 12:13:01.236383 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:01.236654 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6381,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6083,"spinlock_wait_cycles":23080704,"thread_start_us":82799,"threads_started":1,"wal-append.queue_time_us":208150}
I20260709 12:13:01.243157 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:01.248135 29317 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:01.246114 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:01.252399 22269 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:01.257292 22864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 1060) took 1655 ms. Trace:
I20260709 12:13:01.257741 22272 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:13:01.258278 22272 pending_rounds.cc:85] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 10
I20260709 12:13:01.258731 22272 pending_rounds.cc:107] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:13:01.257828 22864 rpcz_store.cc:276] 0709 12:12:59.613036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.706493 (+ 93457us) service_pool.cc:224] Handling call
0709 12:12:59.706886 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:00.467632 (+760746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.184466 (+716834us) spinlock_profiling.cc:243] Waited 46.2 ms on lock 0x7b54006a0520. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc5a02 00007fcceddc1dd6 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:13:01.256581 (+ 72115us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54006a0254. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:01.257153 (+   572us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1720198784}
I20260709 12:13:01.259013 22272 raft_consensus.cc:2889] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:01.237023 29299 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:01.251889 28716 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:01.264256 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:01.275833 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47951.1us
I20260709 12:13:01.281322 22269 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 23.
W20260709 12:13:01.280311 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 58397.6us
I20260709 12:13:01.297910 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:01.299346 22264 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:01.303465 22264 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:01.289851 29317 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:01.309252 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 92343.8us
W20260709 12:13:01.312119 22236 leader_election.cc:336] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.190s (SENT)
I20260709 12:13:01.312677 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:01.302488 28716 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:01.344110 29328 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:01.290512 29303 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.041s
I20260709 12:13:01.308993 29288 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:01.358322 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46237.6us
W20260709 12:13:01.359163 22236 leader_election.cc:336] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.205s (SENT)
I20260709 12:13:01.359577 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.363777 29379 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:01.365295 29324 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:01.355564 29288 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:01.367660 22269 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:13:01.368731 22236 leader_election.cc:336] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.246s (SENT)
I20260709 12:13:01.369289 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.374224 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:01.378209 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:01.375800 29317 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:01.375283 29324 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.382642 29324 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.380003 29397 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:01.375367 29258 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.386556 29258 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.381758 29328 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:01.389163 29288 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:01.389439 29324 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:01.393118 29258 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:01.396924 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:01.397289 29362 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:01.398478 29361 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:01.398898 29361 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:01.399109 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:01.399715 29288 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:01.400592 22163 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:01.401343 29288 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:01.399302 29361 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:01.401903 29288 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:01.402815 29288 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.395412 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.406616 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.416975 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.427021 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:13:01.430498 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 122401us
I20260709 12:13:01.438874 29339 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:01.439427 29339 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:01.439541 22263 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 10. Current term is 11. Ops: []
I20260709 12:13:01.439879 29339 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:01.441854 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:01.430231 29397 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:01.447669 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:01.449227 29402 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:01.449714 29402 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:01.450630 29402 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.452044 29402 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:01.422426 29328 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:13:01.417985 29258 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:01.428864 29369 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:13:01.454825 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3870) took 1220 ms. Trace:
I20260709 12:13:01.455184 22118 rpcz_store.cc:276] 0709 12:13:00.234690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.582606 (+347916us) service_pool.cc:224] Handling call
0709 12:13:00.583008 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:00.633531 (+ 50523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:00.633578 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:00.646790 (+ 13212us) log.cc:844] Serialized 26 byte log entry
0709 12:13:00.725433 (+ 78643us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:00.771915 (+ 46482us) log.cc:844] Serialized 14 byte log entry
0709 12:13:01.454499 (+682584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.454580 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:01.454627 (+    47us) raft_consensus.cc:1685] finished
0709 12:13:01.454642 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:01.454768 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1441921,"prepare.queue_time_us":46512,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":89089,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":11050,"thread_start_us":80035,"threads_started":2,"wal-append.queue_time_us":151841}
W20260709 12:13:01.457405 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 677947us
I20260709 12:13:01.418238 29304 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:01.461232 29304 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:01.462196 29304 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.447702 29404 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
W20260709 12:13:01.464211 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 634709us
I20260709 12:13:01.464804 29404 consensus_queue.cc:1243] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:13:01.464921 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3871) took 1200 ms. Trace:
I20260709 12:13:01.465106 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:01.461001 29378 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:13:01.465492 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.465981 29378 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:01.466071 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3876) took 1079 ms. Trace:
I20260709 12:13:01.466526 29378 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:01.466554 22123 rpcz_store.cc:276] 0709 12:13:00.386430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.997446 (+611016us) service_pool.cc:224] Handling call
0709 12:13:01.015629 (+ 18183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:01.015989 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:13:01.089154 (+ 73165us) log.cc:844] Serialized 14 byte log entry
0709 12:13:01.465740 (+376586us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:01.465793 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:01.465850 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.465915 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:01.466021 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":320637,"prepare.queue_time_us":77410,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"thread_start_us":55493,"threads_started":1,"wal-append.queue_time_us":92705}
I20260709 12:13:01.469203 29136 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:01.469806 29136 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:01.454012 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3860) took 1261 ms. Trace:
I20260709 12:13:01.470681 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:01.471113 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:01.471653 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:01.470716 29383 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.472625 29383 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:01.473388 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:01.474043 22115 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 24.
I20260709 12:13:01.474836 29383 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:01.475019 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:01.469372 22121 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:01.477144 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:01.471812 22122 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:01.480015 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:01.482369 22114 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:13:01.484011 22197 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:01.419548 29324 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.465411 22119 rpcz_store.cc:276] 0709 12:13:00.264517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.681171 (+416654us) service_pool.cc:224] Handling call
0709 12:13:00.681493 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:00.681691 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:13:00.695913 (+ 14222us) log.cc:844] Serialized 14 byte log entry
0709 12:13:01.464573 (+768660us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:01.464626 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:01.464678 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.464738 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:01.464871 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":489234,"prepare.queue_time_us":22352,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":2540,"raft.queue_time_us":480064,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"thread_start_us":292579,"threads_started":1,"wal-append.queue_time_us":310640}
I20260709 12:13:01.489099 22193 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:13:01.490159 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57700.3us
W20260709 12:13:01.494880 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.470878 22117 rpcz_store.cc:276] 0709 12:13:00.192480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.377047 (+184567us) service_pool.cc:224] Handling call
0709 12:13:00.377347 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:00.377542 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:13:00.614006 (+236464us) log.cc:844] Serialized 14 byte log entry
0709 12:13:01.453658 (+839652us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:01.453716 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:01.453764 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.453835 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:01.453949 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":721569,"prepare.queue_time_us":263818,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":693933,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":279883,"threads_started":2,"wal-append.queue_time_us":240791}
I20260709 12:13:01.530541 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.492522 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:01.542227 22864 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:13:01.477339 29296 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:13:01.557246 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:01.558840 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:01.418557 29303 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 12:13:01.555671 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:01.563163 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.465368 29404 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21.
I20260709 12:13:01.563445 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:01.491221 29258 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:01.571965 29030 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:13:01.575419 29340 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:01.577241 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.575295 29222 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:01.578050 29222 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.578397 29222 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:01.578498 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.579289 29340 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.580013 29340 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.581055 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:01.593320 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:01.581189 29183 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:01.470727 29136 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.610914 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:01.582891 29378 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:01.616916 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.618419 22236 leader_election.cc:400] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11.
I20260709 12:13:01.618767 22236 leader_election.cc:403] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:01.612722 29404 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:01.625391 29404 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.627951 29404 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:01.629007 29411 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.599727 29076 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:01.634059 29076 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:01.634528 29076 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:01.636144 29363 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:01.636590 29363 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:01.611757 29183 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:01.637485 29183 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:01.638300 29234 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:01.638736 29234 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:01.644026 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:01.657929 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:01.658859 22118 raft_consensus.cc:2368] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16.
I20260709 12:13:01.666792 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:01.667891 22122 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:01.640558 29136 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:01.676177 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57924.7us
I20260709 12:13:01.631882 29258 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.677917 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:01.683250 22272 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
W20260709 12:13:01.678043 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 195105us
I20260709 12:13:01.679215 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:01.681298 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:01.685827 22271 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:01.685901 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:01.647636 29317 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:01.691615 22271 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:01.685981 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:01.693508 22272 raft_consensus.cc:2368] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23.
I20260709 12:13:01.687726 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:01.689369 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:01.654212 29328 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 10. Current term is 11.
I20260709 12:13:01.637481 29363 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.757429 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:01.649837 29324 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:01.760439 22198 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:01.757515 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:01.698239 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:01.763223 22265 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
I20260709 12:13:01.781802 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:01.799772 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 112136us
W20260709 12:13:01.807296 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.812203 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:01.695255 29325 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:13:01.820631 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:01.821318 22117 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:01.824275 29439 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 12:13:01.829370 29445 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:13:01.831621 29432 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.831974 22189 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:13:01.833747 22198 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:13:01.758224 29405 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 12:13:01.835172 29405 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:01.835534 29405 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:01.837200 29396 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.843128 29339 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:01.847856 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:01.848955 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:01.797222 29363 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:01.849045 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 131690us
I20260709 12:13:01.832165 29432 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.867259 22088 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:01.701553 28716 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 12:13:01.828132 29076 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:01.806154 29404 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:01.876173 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:01.878614 29136 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:01.882812 29183 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:01.885104 29325 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:01.886986 22264 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:01.888023 22088 leader_election.cc:400] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21.
I20260709 12:13:01.889300 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:01.869138 29447 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:13:01.893380 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:01.694531 29234 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:01.891040 29338 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:01.836365 29405 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:01.908962 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.885874 29222 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:01.894727 29396 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.894157 29136 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.899233 29404 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:01.949201 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 55945.4us
I20260709 12:13:01.899627 29268 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:01.954250 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:01.958412 29268 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:01.958982 29268 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:01.959442 29268 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:01.960224 29412 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 1.051s	user 0.005s	sys 0.000s
W20260709 12:13:01.952929 29447 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:13:01.870258 29328 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:01.904824 29338 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:01.956184 22857 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 25 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 12:13:01.963052 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:13:01.963531 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 113431us
I20260709 12:13:01.969928 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:01.727200 29361 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:01.972494 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:01.965000 29449 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:13:01.968078 22117 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:01.969547 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:01.973680 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:01.962136 29183 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:01.977475 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:01.974920 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:01.965481 29234 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:01.978513 29378 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:01.985260 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:01.966820 29405 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:01.979334 22117 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:01.966630 29328 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.987913 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:02.021811 22198 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:01.976227 29402 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:02.000451 22117 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:02.033994 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:02.034763 22117 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:02.035601 29317 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:02.005846 29222 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 25 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:01.973160 29340 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:13:02.036270 29317 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:02.004397 29234 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:02.013394 22267 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:02.007279 29404 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:02.035672 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:02.016294 29432 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:02.018105 22271 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
W20260709 12:13:02.024415 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.032070 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:02.034159 29421 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:13:02.014122 29076 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:02.044364 22117 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:02.054569 22198 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
W20260709 12:13:02.106897 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.976223 29339 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:01.976121 29396 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:02.123163 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:02.116039 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:02.124209 22267 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 11.
I20260709 12:13:02.116663 22865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56950 (request call id 1006) took 1574 ms. Trace:
I20260709 12:13:02.061551 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:02.120308 22117 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 25.
W20260709 12:13:02.121825 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 144450us
I20260709 12:13:02.128175 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:02.127511 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:02.129652 22117 raft_consensus.cc:2410] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:13:02.132671 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:02.058552 29328 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:02.137904 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:02.125111 22865 rpcz_store.cc:276] 0709 12:13:00.542184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.542382 (+   198us) service_pool.cc:224] Handling call
0709 12:13:00.546917 (+  4535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:00.637985 (+ 91068us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:00.778091 (+140106us) log.cc:844] Serialized 14 byte log entry
0709 12:13:00.998572 (+220481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:00.998631 (+    59us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:00.998704 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.629588 (+630884us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b1800481600. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceaca32a6 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1
0709 12:13:01.630670 (+  1082us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800481600. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:13:01.961275 (+330605us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b1800481600. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceaca32a6 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1
0709 12:13:02.116359 (+155084us) spinlock_profiling.cc:243] Waited 90.7 ms on lock 0x7b54005073d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:02.116434 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:02.116584 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5847,"prepare.queue_time_us":349631,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":8451,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":7392,"spinlock_wait_cycles":324864640,"thread_start_us":292965,"threads_started":2,"wal-append.queue_time_us":227897}
I20260709 12:13:02.140372 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:02.036754 29361 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:02.144742 22857 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:13:02.048621 29183 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:02.150288 22088 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:02.147933 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:02.155117 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:02.129884 29396 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:02.136785 29378 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:13:02.037087 29234 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:02.161931 22117 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:13:02.166441 22117 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:02.162590 22088 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:02.144562 29314 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:02.117352 29257 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:13:02.140303 29339 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:02.144855 29405 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:02.178486 29405 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:02.169863 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.128564 28964 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:13:02.177541 29339 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:02.176160 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:02.164001 29402 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:02.159847 29383 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:13:02.169746 29314 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:02.037087 29338 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:02.190335 22830 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.739s (SENT) [suppressed 40 similar messages]
W20260709 12:13:02.201375 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.168619 29299 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:02.180172 29317 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:02.167769 29396 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:02.189474 22117 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:02.182134 29405 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:02.155821 29183 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:02.210355 22117 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:13:02.205746 29314 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:02.235548 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:02.207669 29378 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:02.207902 29383 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:02.227797 29402 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.237677 29338 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:02.266396 29459 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:13:02.276198 22860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 1138) took 1291 ms. Trace:
I20260709 12:13:02.210043 29268 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:02.275345 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 112839us
I20260709 12:13:02.276703 22860 rpcz_store.cc:276] 0709 12:13:00.985133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.986865 (+  1732us) service_pool.cc:224] Handling call
0709 12:13:00.987163 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:01.114115 (+126952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:01.114163 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:01.114225 (+    62us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:01.114282 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.275796 (+1161514us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54006de554. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:02.275957 (+   161us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:02.276126 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291316608}
I20260709 12:13:02.287921 22088 leader_election.cc:400] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:13:02.288285 22088 leader_election.cc:403] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:13:02.290813 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:02.294293 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 104003us
W20260709 12:13:02.297533 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.446552 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.459164 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 168443us
W20260709 12:13:02.461751 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 289114us
W20260709 12:13:02.434914 29452 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.329s	user 0.000s	sys 0.002s
I20260709 12:13:02.292419 29404 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:13:02.257160 29402 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:02.487751 22117 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:13:02.490917 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:02.493008 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:02.465308 29405 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:02.496605 22117 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:02.300380 29299 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.187s
I20260709 12:13:02.510567 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:02.511287 22118 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:02.497886 29379 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:02.492522 29383 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:02.546103 29268 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:02.535450 29234 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:02.549137 29317 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:02.507298 29404 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:02.552191 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:02.556564 22122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.012s	sys 0.042s
W20260709 12:13:02.556965 22122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.012s	sys 0.042s
I20260709 12:13:02.507591 29183 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:02.552578 29402 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:02.555289 29468 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:02.566982 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:02.576115 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:02.555855 29299 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:02.581044 22088 leader_election.cc:400] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23.
I20260709 12:13:02.581681 22088 leader_election.cc:403] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:13:02.556672 29405 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:13:02.573922 29378 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:02.574190 29468 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:02.582499 29404 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:02.586494 29463 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 12:13:02.600246 22117 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:02.583076 29268 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:02.601482 29268 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:02.601974 29268 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:02.597201 29405 consensus_queue.cc:1243] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:02.585440 29299 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:02.652206 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 213477us
I20260709 12:13:02.652511 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:02.635757 22118 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 23.
W20260709 12:13:02.656658 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.611979 29304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.011s	sys 0.004s
W20260709 12:13:02.700050 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.691054 29304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.011s	sys 0.004s
I20260709 12:13:02.709389 22123 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:02.710909 22123 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:13:02.711459 22117 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 12:13:02.722543 22117 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:02.728179 29299 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:02.730438 29471 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:13:02.731161 29474 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:02.741297 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3875) took 2375 ms. Trace:
I20260709 12:13:02.687979 29378 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23.
W20260709 12:13:02.743043 29450 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.906s	user 0.009s	sys 0.004s
W20260709 12:13:02.750066 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 171681us
W20260709 12:13:02.762827 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.764839 22118 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:13:02.765470 22118 pending_rounds.cc:85] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 11
I20260709 12:13:02.765801 22118 pending_rounds.cc:107] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:13:02.766119 22118 raft_consensus.cc:2889] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:02.753651 29363 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.882s	user 0.015s	sys 0.000s
W20260709 12:13:02.751314 29314 consensus_meta.cc:287] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.008s
I20260709 12:13:02.752950 22116 rpcz_store.cc:276] 0709 12:13:00.366043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.681441 (+315398us) service_pool.cc:224] Handling call
0709 12:13:00.681709 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:01.447969 (+766260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:01.448022 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:01.448631 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 12:13:01.566894 (+118263us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:13:01.590823 (+ 23929us) log.cc:844] Serialized 14 byte log entry
0709 12:13:01.600039 (+  9216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.600120 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:02.737096 (+1136976us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b1800013d80. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:13:02.740876 (+  3780us) raft_consensus.cc:1685] finished
0709 12:13:02.741017 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:02.741215 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":763563,"prepare.queue_time_us":23728,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":776103,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":3756,"spinlock_wait_cycles":44131072,"thread_start_us":117763,"threads_started":1,"wal-append.queue_time_us":169005}
I20260709 12:13:02.769251 29314 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:02.767511 29282 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:02.770130 29282 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:02.770941 29268 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:02.771049 29282 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:02.774519 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:02.772632 29282 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:02.779006 29405 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.779256 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:02.779614 29405 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:02.777208 29299 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:02.773074 29472 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:13:02.783267 29472 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:13:02.783453 29328 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.630s	user 0.012s	sys 0.002s
I20260709 12:13:02.783864 29472 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:02.784161 29328 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:02.786576 29328 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:02.785945 29472 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:02.787815 29472 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:02.788683 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1739) took 1319 ms. Trace:
I20260709 12:13:02.789152 22121 rpcz_store.cc:276] 0709 12:13:01.469833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.477407 (+  7574us) service_pool.cc:224] Handling call
0709 12:13:01.477737 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:01.497840 (+ 20103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:01.497877 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:01.498537 (+   660us) log.cc:844] Serialized 26 byte log entry
0709 12:13:01.685393 (+186856us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:13:01.726368 (+ 40975us) log.cc:844] Serialized 14 byte log entry
0709 12:13:01.737014 (+ 10646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.737119 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:02.742296 (+1005177us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:02.788333 (+ 46037us) raft_consensus.cc:1685] finished
0709 12:13:02.788459 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:02.788617 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10346,"prepare.queue_time_us":81292,"raft.queue_time_us":10947,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":57154,"spinlock_wait_cycles":76280320,"thread_start_us":114073,"threads_started":1,"wal-append.queue_time_us":219562}
W20260709 12:13:02.792876 29338 consensus_meta.cc:287] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 12:13:02.781095 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:02.794157 22116 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 19: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:02.781697 29299 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:02.809273 22268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4153) took 2267 ms. Trace:
I20260709 12:13:02.809667 22268 rpcz_store.cc:276] 0709 12:13:00.541583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.547040 (+  5457us) service_pool.cc:224] Handling call
0709 12:13:00.547439 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:01.204241 (+656802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.809042 (+1604801us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54000ea954. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:02.809221 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505157632}
I20260709 12:13:02.814051 29299 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:02.808563 29268 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:02.809535 29396 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.001s
I20260709 12:13:02.825896 22120 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:02.826467 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:13:02.827220 22862 raft_consensus.cc:606] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:02.829221 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:02.833981 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:02.836021 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:02.836752 22863 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:13:02.839733 29261 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.846846 22120 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:13:02.847994 22120 pending_rounds.cc:85] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 12
I20260709 12:13:02.820960 29396 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:02.852314 29396 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:02.855141 29404 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:02.856020 29261 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:02.856918 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:02.857266 22858 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:02.858429 29261 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:02.848362 22120 pending_rounds.cc:107] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:13:02.863590 22120 raft_consensus.cc:2889] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:02.866474 29332 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260709 12:13:02.866557 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3865) took 2652 ms. Trace:
I20260709 12:13:02.867069 29402 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.867139 22120 rpcz_store.cc:276] 0709 12:13:00.214485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.496417 (+281932us) service_pool.cc:224] Handling call
0709 12:13:00.496718 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:00.853681 (+356963us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540009ed20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc41c0 00007fcceddc5231 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c
0709 12:13:01.463199 (+609518us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b580070a6d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd1e0aa 00007fccedda0447 00007fcceddb8fe7 00007fcceddba7de 00007fcceddc4b49 00007fcceddc5416 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4
0709 12:13:02.825340 (+1362141us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b540009ed20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd37a1d 00007fccedd1e1a4 00007fccedda0447 00007fcceddb8fe7 00007fcceddba7de 00007fcceddc4b49 00007fcceddc5416 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419
0709 12:13:02.866237 (+ 40897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.866494 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642069888}
I20260709 12:13:02.867792 29402 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:02.872020 22119 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:02.872756 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2770) took 1062 ms. Trace:
I20260709 12:13:02.873306 22119 rpcz_store.cc:276] 0709 12:13:01.809900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.810049 (+   149us) service_pool.cc:224] Handling call
0709 12:13:02.856722 (+1046673us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b5800002798. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:13:02.872646 (+ 15924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73819392}
W20260709 12:13:02.895155 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.894994 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:02.895637 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.896111 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.896739 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:02.899580 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:02.902655 29282 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:02.903131 29282 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.903982 29282 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:02.908572 22830 leader_election.cc:400] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16.
W20260709 12:13:02.908761 29462 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.618s	user 0.001s	sys 0.001s
I20260709 12:13:02.909693 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:02.917488 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:02.918485 29472 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:02.919229 29472 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 25 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:02.920147 29472 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:02.923193 29282 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:02.928098 29339 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:02.930894 29222 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.931412 29222 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:02.932176 29402 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:02.933499 29222 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:02.934276 29466 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:13:02.934662 29466 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:02.935607 29466 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:02.939227 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 877731us
I20260709 12:13:02.940187 29405 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:02.943389 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:02.943962 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2879) took 1305 ms. Trace:
I20260709 12:13:02.941376 29177 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:02.958218 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:02.957595 22271 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:02.944470 22190 rpcz_store.cc:276] 0709 12:13:01.643046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.643260 (+   214us) service_pool.cc:224] Handling call
0709 12:13:01.660521 (+ 17261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:01.671893 (+ 11372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:01.671931 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:01.992150 (+320219us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b2c00000448. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:13:01.992603 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:13:02.119643 (+127040us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:02.146547 (+ 26904us) log.cc:844] Serialized 14 byte log entry
0709 12:13:02.146777 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.146850 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:02.907911 (+761061us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:02.943678 (+ 35767us) raft_consensus.cc:1685] finished
0709 12:13:02.943707 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:02.943885 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24833,"prepare.queue_time_us":24449,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":11833,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":13103,"spinlock_wait_cycles":328514176,"thread_start_us":111185,"threads_started":1,"wal-append.queue_time_us":244521}
I20260709 12:13:02.950736 29339 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:02.969594 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:02.974403 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:02.952250 29466 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:13:02.969357 29384 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.045s	sys 0.055s
I20260709 12:13:02.986160 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:02.990749 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:02.992270 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:02.994935 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:02.995957 22119 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:02.975847 29177 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:02.977470 29397 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:02.987715 29384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.045s	sys 0.055s
I20260709 12:13:02.987373 29325 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:02.987499 29328 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.990167 29322 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:02.997107 29456 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:03.012837 22119 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:13:02.975896 29339 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.018810 29405 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.019336 29405 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.020329 29339 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:03.022133 29405 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:03.017386 29328 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.027279 29328 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:03.030663 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:02.994962 29324 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.035789 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:03.034092 22831 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:03.036458 22863 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:03.034766 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:03.038648 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:02.989557 29411 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:13:03.008345 29317 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:13:03.041383 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:03.041641 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.037971 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:03.041875 29234 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:03.045878 22114 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:13:03.037479 29322 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:03.046450 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:03.056380 22118 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:03.016544 29177 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.039546 29222 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:13:03.006424 29282 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:03.051388 29314 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:03.052548 29464 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.572s	user 0.002s	sys 0.000s
I20260709 12:13:03.046079 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:03.054287 22120 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:03.067534 22117 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:03.039651 29325 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:03.042734 29330 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:13:03.007791 29397 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.068302 22088 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:03.071321 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:03.065654 29405 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:03.072830 29402 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:03.080963 29402 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:03.081398 29402 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:03.077189 29468 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.082264 29468 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:03.078502 29330 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:03.083847 29330 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.078684 29397 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:03.077287 29322 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.089556 29325 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.097718 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4179) took 1605 ms. Trace:
I20260709 12:13:03.098430 22263 rpcz_store.cc:276] 0709 12:13:01.492062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.492318 (+   256us) service_pool.cc:224] Handling call
0709 12:13:01.552825 (+ 60507us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:01.569282 (+ 16457us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:13:01.597257 (+ 27975us) log.cc:844] Serialized 14 byte log entry
0709 12:13:02.872318 (+1275061us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b18001b6580. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a 00007fcceddcca2a
0709 12:13:02.967929 (+ 95611us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:03.094370 (+126441us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b2c000682a8. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccec6bba11 00007fccec6cb372 00007fcceddfda01 00007fcceddc243a 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2
0709 12:13:03.095089 (+   719us) log.cc:844] Serialized 52 byte log entry
0709 12:13:03.095271 (+   182us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:03.095310 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.095387 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:03.097454 (+  2067us) raft_consensus.cc:1685] finished
0709 12:13:03.097474 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:03.097649 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143502,"prepare.queue_time_us":27554,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":58,"raft.queue_time_us":89949,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":16961,"spinlock_wait_cycles":35337472,"thread_start_us":22486,"threads_started":1,"wal-append.queue_time_us":1376348}
I20260709 12:13:03.117815 22120 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
W20260709 12:13:03.119560 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 127371us
I20260709 12:13:03.124904 22117 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:03.129778 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:03.133638 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:03.113471 29314 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:03.114352 29261 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:03.150426 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:13:03.152575 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 159341us
I20260709 12:13:03.137260 29324 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:13:03.156718 29258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.317s	user 0.006s	sys 0.016s
I20260709 12:13:03.145972 29314 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:03.132647 29411 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:13:03.157120 29328 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:03.176431 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:13:03.170482 29258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.331s	user 0.006s	sys 0.016s
I20260709 12:13:03.185021 29324 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:03.185509 29324 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:03.186838 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2887) took 1189 ms. Trace:
I20260709 12:13:03.169677 29402 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.186977 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:03.179667 29411 consensus_queue.cc:1243] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:13:03.187296 22195 rpcz_store.cc:276] 0709 12:13:01.997213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.005963 (+  8750us) service_pool.cc:224] Handling call
0709 12:13:02.006318 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:02.006556 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:02.160595 (+154039us) log.cc:844] Serialized 14 byte log entry
0709 12:13:03.186418 (+1025823us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:03.186491 (+    73us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:03.186543 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.186618 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:03.186745 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1025420,"prepare.queue_time_us":26740,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"thread_start_us":151012,"threads_started":1}
I20260709 12:13:03.176724 29314 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:03.189827 22865 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:13:03.185900 29324 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:03.191826 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:03.200820 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:03.201119 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:03.202919 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:03.203895 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:03.204082 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:03.198448 22864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56950 (request call id 1018) took 1422 ms. Trace:
I20260709 12:13:03.206080 22268 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:13:03.196444 29368 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:13:03.205705 22864 rpcz_store.cc:276] 0709 12:13:01.775615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.796748 (+ 21133us) service_pool.cc:224] Handling call
0709 12:13:01.814893 (+ 18145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:01.815284 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:01.815313 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:01.815782 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:13:03.043602 (+1227820us) spinlock_profiling.cc:243] Waited 7.58 ms on lock 0x7b18002f24e0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:13:03.103925 (+ 60323us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:03.103986 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.104094 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:03.198110 (+ 94016us) raft_consensus.cc:1685] finished
0709 12:13:03.198134 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:03.198376 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4239,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":15464,"spinlock_wait_cycles":17426688,"thread_start_us":60046,"threads_started":1,"wal-append.queue_time_us":1328920}
I20260709 12:13:03.202147 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:03.210117 22268 raft_consensus.cc:1217] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-14.9]   Dedup: 11.7->[12.8-14.9]
I20260709 12:13:03.211400 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:03.179410 29493 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:03.241575 22268 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: [9.6-14.9]
I20260709 12:13:03.202239 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:03.242885 22271 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:13:03.180146 29397 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:13:03.244681 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:03.245020 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:03.250447 22114 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:13:03.219295 29368 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.251472 22263 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:03.247872 22117 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:03.247642 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:03.241178 29487 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:13:03.248999 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:03.248083 29402 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:03.251025 29368 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:13:03.253629 22119 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:03.242998 29177 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:03.241206 29258 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:03.248361 29493 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:03.263470 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:03.262490 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:03.269439 22266 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:03.251912 29397 consensus_queue.cc:1243] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:13:03.262126 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:03.271041 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:03.272418 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:03.280982 29183 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:03.281488 29183 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.281908 29183 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:03.285385 29432 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.286149 29258 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:03.286033 29432 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.287119 29258 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.288018 22195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
W20260709 12:13:03.289675 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.290123 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:03.291041 29288 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.291275 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:03.291344 29272 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:03.291548 29288 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.292299 29272 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.294835 29272 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:03.295394 29272 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:03.295879 29272 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.289605 29363 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.288319 29337 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:03.298296 29337 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:03.299347 29337 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.301206 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.302570 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:03.302954 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:03.304257 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.297904 29363 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.270325 29177 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.306155 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:03.288759 22195 raft_consensus.cc:606] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.306793 22191 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:03.306953 22195 raft_consensus.cc:614] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:03.307531 29177 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:03.310653 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.311913 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.313810 29270 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:03.314245 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.314386 29270 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.315582 22198 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:03.316325 22266 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:03.317157 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.317834 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.323474 22196 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:13:03.319496 29362 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.325158 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.324609 22196 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
W20260709 12:13:03.320374 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.302623 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.308277 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.327018 22193 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:03.327664 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:03.327899 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.305505 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.329773 22192 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:03.330224 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.331395 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.326774 22197 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:13:03.330232 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:03.335129 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.336601 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.337224 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.338372 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:03.339778 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.199012 29328 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:03.268821 29384 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:03.344673 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.316565 29270 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:03.351698 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:03.383268 22195 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:13:03.356988 22191 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:03.370352 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.381740 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.381759 22119 pending_rounds.cc:85] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 6
I20260709 12:13:03.384874 22119 pending_rounds.cc:107] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:13:03.385382 22119 raft_consensus.cc:2889] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:03.307536 29363 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:03.325282 29319 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:13:03.354521 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 173741us
I20260709 12:13:03.408067 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:03.405511 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:03.324520 29337 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:03.384757 22192 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:03.408866 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.409967 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:03.389959 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.410130 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.411396 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.413709 29468 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:03.414146 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:03.414889 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 78617.8us
I20260709 12:13:03.332960 29405 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:13:03.411164 22192 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:03.341020 29332 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:03.350776 29136 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.424081 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:03.427616 22192 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:13:03.427522 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 75968us
I20260709 12:13:03.345247 29402 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:13:03.429919 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.386478 29384 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.431655 22198 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:13:03.435664 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.404974 29328 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:03.381953 29456 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:03.338358 29362 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.414245 29468 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.440567 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:03.423729 29332 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.441632 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.451470 22263 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:03.453948 22197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:13:03.454748 22197 raft_consensus.cc:606] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.455210 22197 raft_consensus.cc:614] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:03.459666 29272 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:03.461169 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:03.461876 29472 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:13:03.463001 29503 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:13:03.420841 29319 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.446633 29496 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.464811 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:03.440642 29405 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:13:03.387286 29493 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.446558 29432 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:03.451269 29332 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:03.499418 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:03.501564 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.468035 29402 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.431820 29369 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:13:03.446563 29456 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:03.502099 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 131816us
I20260709 12:13:03.463474 29324 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.475669 29282 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:03.512173 22117 pending_rounds.cc:85] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 12
I20260709 12:13:03.512496 22117 pending_rounds.cc:107] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:13:03.478876 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.479590 29338 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:03.512737 22117 raft_consensus.cc:2889] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:03.495067 29272 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:03.476408 29490 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 12:13:03.552172 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 74297.4us
I20260709 12:13:03.560678 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.563445 22263 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:13:03.567225 22267 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:03.511127 29402 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.579914 29402 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:03.517517 29505 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:03.489216 29496 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.517818 29504 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:03.586519 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.601334 22192 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:13:03.557273 29282 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:03.565527 29432 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:03.554965 29507 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:13:03.624823 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 166106us
W20260709 12:13:03.603257 29508 log.cc:927] Time spent T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:13:03.545396 29338 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.633044 29456 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:03.596335 29505 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:03.646044 29510 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:13:03.603848 29369 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:03.625391 29490 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:03.609412 29272 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:03.627208 29295 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 12:13:03.610738 29504 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:03.685132 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 56902.3us
I20260709 12:13:03.700424 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:03.511798 29328 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.709098 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:03.709319 22120 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:03.716840 22114 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 17: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:03.628641 29282 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.703586 29505 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:03.705760 29490 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:13:03.758519 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.711391 29504 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:03.695531 29513 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.123s
W20260709 12:13:03.793592 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 178306us
I20260709 12:13:03.757598 29261 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:03.767850 29468 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:03.767912 29511 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:03.829035 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.790153 29514 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:13:03.847625 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 126116us
I20260709 12:13:03.787446 29362 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:03.831095 29261 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:03.859902 22858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:13:03.864429 22858 raft_consensus.cc:606] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.847450 29514 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:03.832408 29288 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:03.850208 29369 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:03.877635 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.868046 29362 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.011s
I20260709 12:13:03.880513 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:03.883391 22864 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:03.886642 29332 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:03.888058 29520 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:03.914660 22858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:13:03.915478 22858 raft_consensus.cc:606] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:03.915917 22858 raft_consensus.cc:614] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:03.894945 29319 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:03.845239 29511 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.874192 29506 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:13:03.845055 29521 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:03.907846 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.856927 29432 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:03.925194 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:03.857601 28964 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:13:03.930034 29521 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.925211 29136 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:03.854434 29490 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:03.971563 29468 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:03.991860 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 124801us
I20260709 12:13:03.909979 29369 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:03.992991 29468 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.001049 29380 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:13:04.001525 29380 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:04.001871 29511 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.002343 29380 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.003021 29468 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.006127 29369 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.008028 29521 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:03.991114 29516 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
W20260709 12:13:03.973038 29519 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 12:13:03.983067 29314 consensus_meta.cc:287] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.740s	user 0.012s	sys 0.002s
W20260709 12:13:03.992039 29183 consensus_meta.cc:287] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.707s	user 0.014s	sys 0.014s
W20260709 12:13:04.031211 29337 consensus_meta.cc:287] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.003s
W20260709 12:13:04.031504 29368 consensus_meta.cc:287] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.711s	user 0.009s	sys 0.002s
I20260709 12:13:04.032080 29368 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.035835 29504 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.021584 29183 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.041886 22193 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:04.043615 29332 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.043706 29338 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.017921 29314 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.078043 29502 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:04.078608 29502 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:04.079612 29502 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.078032 22864 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:04.051743 29467 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:13:04.102633 29522 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.104215 29521 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:04.106556 29456 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.108299 22087 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:04.111364 28964 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:04.112145 29248 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:04.113029 29270 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:04.117528 22119 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:04.117452 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:04.118463 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:04.118896 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:04.165892 22123 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:04.169351 22114 raft_consensus.cc:2368] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15.
I20260709 12:13:04.170542 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:04.119300 22120 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:04.173521 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:04.174927 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:04.175634 22120 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:04.119428 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:04.177122 22118 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:13:04.121268 29177 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.123868 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:04.179219 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:04.179883 22121 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:04.126164 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:04.139233 29512 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.140842 29411 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:04.141592 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:04.143450 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:04.147307 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:04.147622 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:04.133396 29332 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:04.148397 22191 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:13:04.145044 22192 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:04.194029 22192 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:04.182634 22114 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:13:04.184113 22121 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:13:04.184552 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:04.185571 22120 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:04.148324 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:04.191625 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:04.192739 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:04.197203 22198 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:04.182132 22116 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:13:04.196179 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:04.198896 22114 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:13:04.199115 22121 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 14. Current term is 15. Ops: []
I20260709 12:13:04.164615 29468 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:04.204073 22162 leader_election.cc:400] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15.
I20260709 12:13:04.204109 22114 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:04.204488 22162 leader_election.cc:403] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:04.202044 22087 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:04.194852 22192 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.206579 22116 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:04.208252 22116 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:04.205730 22162 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:04.219667 22831 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.001s	sys 0.029s
W20260709 12:13:04.220050 22831 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.001s	sys 0.029s
I20260709 12:13:04.221614 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:04.222936 22087 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:04.224059 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:04.219101 22162 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:04.228319 22265 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:04.229633 22192 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:04.230083 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:04.189050 29502 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:04.191440 29512 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.228873 29311 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:13:04.234277 29296 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:04.204730 29332 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.249825 29314 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:04.219902 29362 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15.
I20260709 12:13:04.198094 29511 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:04.250200 29261 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.203783 29411 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.251106 29303 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:04.292469 22115 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:13:04.266331 22192 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:13:04.281322 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48346.4us
I20260709 12:13:04.166479 29456 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.161789 29521 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.254745 29369 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:04.233609 29136 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:04.233294 29513 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:04.190173 29177 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.315799 29496 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:04.317155 29368 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.235740 29466 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:13:04.161172 29522 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.271333 29296 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.220316 29505 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.325109 29504 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:04.280870 29320 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:13:04.329380 29320 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:13:04.330786 22192 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:13:04.284428 29337 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:13:04.333544 29337 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:04.333966 29337 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:04.301921 29369 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.287640 29270 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:13:04.335881 29369 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:04.336215 29270 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:04.336651 29270 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:04.337199 29512 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.337558 29270 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.338675 29270 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:04.340240 29360 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 12:13:04.341830 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2286) took 1089 ms. Trace:
I20260709 12:13:04.342737 29522 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:04.343776 29324 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:04.343896 29296 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:04.329810 29320 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:04.295137 29511 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.345865 29320 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.347211 29320 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:04.347267 29511 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.350360 29533 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:04.350874 29533 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:04.351804 29533 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.316526 29177 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:04.353421 29530 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.354118 29530 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.354660 29514 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.356124 29514 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:04.307786 29524 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:13:04.309211 29525 raft_consensus.cc:993] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:13:04.255010 29506 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:13:04.309710 29456 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:04.358112 29282 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.295631 29303 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.358837 29303 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.313161 29183 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:04.252976 29338 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:13:04.282995 29468 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:04.360961 29506 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:04.291316 29314 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:04.361166 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:04.361444 29506 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:04.361927 22192 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:04.361698 29314 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.362361 29506 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.363660 29506 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:04.363932 29314 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.334882 29337 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.311801 29521 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:04.365054 29533 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:04.367914 29505 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:04.342325 22267 rpcz_store.cc:276] 0709 12:13:03.252277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.303676 (+ 51399us) service_pool.cc:224] Handling call
0709 12:13:03.303984 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:03.567903 (+263919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.341558 (+773655us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54001db5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:04.341762 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604777856}
I20260709 12:13:04.347390 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3299) took 1019 ms. Trace:
I20260709 12:13:04.370051 22193 rpcz_store.cc:276] 0709 12:13:03.328404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.329931 (+  1527us) service_pool.cc:224] Handling call
0709 12:13:04.347164 (+1017233us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b5400178754. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:04.347289 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604760448}
W20260709 12:13:04.306531 22237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.012s	sys 0.016s
W20260709 12:13:04.382679 22237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.012s	sys 0.016s
W20260709 12:13:04.385803 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52846.2us
I20260709 12:13:04.391077 22192 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
W20260709 12:13:04.381366 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57583.1us
I20260709 12:13:04.366011 29530 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.419718 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:04.399942 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:04.459676 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:04.459957 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:04.460515 22193 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:04.460470 22192 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:13:04.469381 22193 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:04.419015 29521 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.478739 29521 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.493769 29261 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:04.494134 29384 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:04.370009 29332 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:04.507732 22116 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:13:04.507936 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:04.286557 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 435593us
W20260709 12:13:04.510020 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 106959us
I20260709 12:13:04.512054 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:04.513284 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:04.513967 22862 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
W20260709 12:13:04.509964 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 122069us
I20260709 12:13:04.514694 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:04.517632 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:04.509392 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:04.516742 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:04.520884 22270 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:13:04.523000 22271 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:04.514112 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 290105us
I20260709 12:13:04.525462 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:04.373978 29411 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:04.524044 22088 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:04.542137 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:04.531347 22117 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:13:04.546190 22270 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:13:04.547967 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:04.549083 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.549531 22272 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:04.525506 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:04.551384 22087 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:04.497540 29324 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:04.494901 29522 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:04.558712 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46005.7us
I20260709 12:13:04.560693 22865 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:13:04.559567 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:04.562137 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:04.562709 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:04.557071 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:04.566388 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:04.568244 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 51580.4us
I20260709 12:13:04.569005 22830 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:04.570559 22271 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:04.572822 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:04.573472 22862 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:04.573040 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:04.581609 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.505252 29314 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:04.519820 29468 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:04.586452 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:04.519970 29466 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.541437 29332 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.556185 29511 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:04.505478 29282 raft_consensus.cc:1081] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:13:04.583726 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:04.589495 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:04.590561 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:04.601811 22864 raft_consensus.cc:2368] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:04.592720 22863 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:04.595618 22862 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 25 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 12:13:04.587406 22266 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
W20260709 12:13:04.595743 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 82776.4us
I20260709 12:13:04.597422 22271 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 12:13:04.604642 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 45172us
I20260709 12:13:04.612993 22271 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:04.610745 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:04.587137 29513 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:04.625517 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:04.589182 29525 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:04.570024 29530 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:13:04.606890 29338 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.558663 29512 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:13:04.594902 29521 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:04.614924 29505 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:04.611302 29136 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:04.582541 29324 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.610394 29183 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:04.635593 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:04.596014 29522 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.646633 22123 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:13:04.647166 29528 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:04.595247 29314 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.625957 29513 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:04.656530 29546 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:13:04.641530 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:04.630895 29525 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.629395 29507 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.599498 29466 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.599058 29468 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.654982 22271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:13:04.698042 22271 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:04.698520 22271 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:04.608434 29332 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:04.658107 22267 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:13:04.696368 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:04.714939 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 73471.9us
I20260709 12:13:04.715015 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:04.666656 29548 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.661067 29505 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:04.718125 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:04.742628 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:04.743700 22266 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 14. Current term is 15. Ops: []
I20260709 12:13:04.673840 29513 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:04.644284 29338 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:04.730127 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 131574us
I20260709 12:13:04.646531 29535 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.143s
I20260709 12:13:04.694311 29525 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:04.745678 22121 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:13:04.691053 29528 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:04.752131 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:04.743702 22271 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:04.847512 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 245262us
I20260709 12:13:04.719081 29295 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:04.856511 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:04.726941 29177 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:04.870174 22088 leader_election.cc:400] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:04.724001 29362 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:04.870546 22088 leader_election.cc:403] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 12:13:04.873672 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.745136 29304 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:13:04.723698 29562 log.cc:927] Time spent T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:13:04.688171 29552 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 12:13:04.698881 29360 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
W20260709 12:13:04.885198 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.724180 29506 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.145s
I20260709 12:13:04.763664 29515 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:04.860491 29270 consensus_meta.cc:287] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.000s
W20260709 12:13:04.868348 29546 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:13:04.856551 29511 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:04.886837 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 144304us
I20260709 12:13:04.954489 29183 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:04.719316 29369 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:04.964342 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.698737 29507 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.957739 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:05.019586 22857 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:04.895776 29538 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:05.021085 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:04.948274 22263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 3225) took 1734 ms (client timeout 1772 ms). Trace:
I20260709 12:13:05.005057 29560 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:13:05.020001 22857 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:13:05.023823 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 162355us
I20260709 12:13:04.882273 29362 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.024295 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:04.748699 29548 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:04.862807 29296 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:04.980858 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.901262 29536 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.975041 22267 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 12.
W20260709 12:13:05.008704 29542 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.382s	user 0.001s	sys 0.000s
I20260709 12:13:04.907670 29339 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:13:05.021168 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:05.022001 22263 rpcz_store.cc:269] 0709 12:13:03.214086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.253337 (+ 39251us) service_pool.cc:224] Handling call
0709 12:13:04.947618 (+1694281us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002c2ed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:04.948193 (+   575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406479104}
I20260709 12:13:04.949100 22269 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
W20260709 12:13:04.937824 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.030206 29314 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:04.860960 29272 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:05.037964 29544 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.038157 29324 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:05.038949 29556 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:13:05.038650 29544 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:05.040546 29558 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:13:05.025767 22193 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:13:05.027323 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:05.026417 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:05.042627 22195 raft_consensus.cc:2410] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:13:05.042938 22192 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:04.887162 22271 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:05.028406 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:05.029564 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:04.860394 29467 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.088s
I20260709 12:13:05.031978 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:05.047469 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4199) took 1753 ms. Trace:
I20260709 12:13:05.033030 22191 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:13:05.048151 22265 rpcz_store.cc:276] 0709 12:13:03.293843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.327768 (+ 33925us) service_pool.cc:224] Handling call
0709 12:13:03.328050 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.228865 (+900815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.047253 (+818388us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b540026c5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:05.047412 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2069977344}
I20260709 12:13:05.047536 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:05.055394 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 303338us
I20260709 12:13:05.057602 22087 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:05.032836 29549 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 12:13:05.038311 29272 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:05.026207 29533 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.661s	user 0.006s	sys 0.006s
I20260709 12:13:05.030496 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:05.046306 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:05.023784 22857 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.139444 22857 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:05.037390 22263 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: []
I20260709 12:13:05.032912 29543 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:05.061681 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:05.027076 29362 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:05.103005 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:04.956310 29505 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.065277 22189 raft_consensus.cc:2410] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:13:05.109668 22197 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:05.130717 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:05.177563 22270 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:05.131697 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:05.178658 22264 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:13:05.132570 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:05.133652 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:05.141791 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:05.138473 22268 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:05.060518 22190 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 19: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:05.181547 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:05.023314 29183 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.185650 22265 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:05.185693 22271 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:05.195470 29490 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:05.135526 29319 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:13:05.223752 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:05.220362 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:05.190905 29466 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.225914 22858 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
W20260709 12:13:05.227461 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 169970us
I20260709 12:13:05.212100 29564 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:05.233229 29564 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.233634 29564 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:05.234031 29296 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:05.234534 29559 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:13:05.235757 29566 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:13:05.013656 29528 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.179766 29257 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:13:05.200326 29303 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.004s
I20260709 12:13:05.033995 29536 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.252476 22115 raft_consensus.cc:1217] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 8.9->[9.10-12.12]   Dedup: 9.10->[10.11-12.12]
I20260709 12:13:05.264935 22115 pending_rounds.cc:85] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 10
I20260709 12:13:05.265445 22115 pending_rounds.cc:107] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:13:05.266054 22115 raft_consensus.cc:2889] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:05.254321 22114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.000s	sys 0.030s
I20260709 12:13:05.172997 29544 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:05.261976 22270 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:13:05.262640 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:05.267913 22118 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:05.271108 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3913) took 1092 ms. Trace:
I20260709 12:13:05.197229 29522 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:05.236428 29320 consensus_meta.cc:287] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.889s	user 0.013s	sys 0.001s
I20260709 12:13:05.271741 22114 rpcz_store.cc:276] 0709 12:13:04.179080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.228466 (+ 49386us) service_pool.cc:224] Handling call
0709 12:13:04.228827 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.229061 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 12:13:04.526366 (+297305us) log.cc:844] Serialized 14 byte log entry
0709 12:13:05.270546 (+744180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:05.270630 (+    84us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:05.270744 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.270847 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:05.271028 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24848,"prepare.queue_time_us":261014,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":400676,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":12718,"thread_start_us":985551,"threads_started":3,"wal-append.queue_time_us":355195}
I20260709 12:13:05.201501 29468 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:05.297637 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3911) took 1133 ms. Trace:
I20260709 12:13:05.298410 22120 rpcz_store.cc:276] 0709 12:13:04.164453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.200147 (+ 35694us) service_pool.cc:224] Handling call
0709 12:13:04.200466 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:04.200677 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:04.200702 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:04.227823 (+ 27121us) log.cc:844] Serialized 26 byte log entry
0709 12:13:04.705756 (+477933us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:13:04.705814 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.705904 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:05.297274 (+591370us) raft_consensus.cc:1685] finished
0709 12:13:05.297306 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:05.297540 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":452690,"threads_started":1,"wal-append.queue_time_us":605783}
I20260709 12:13:05.301020 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:05.249457 29562 log.cc:927] Time spent T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:13:05.225936 29570 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:05.303812 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:05.289358 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.245644 29319 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:05.305043 29571 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:05.310729 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.315901 22118 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:13:05.273411 29574 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:05.321389 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:05.328161 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:05.328747 22118 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:05.328299 22117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.021s	sys 0.028s
W20260709 12:13:05.329995 22117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.021s	sys 0.029s
I20260709 12:13:05.333981 29507 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.335613 29548 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:05.338680 29564 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.285863 29296 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:05.296648 29522 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:05.343020 29563 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.351189 22118 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:05.187105 29543 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.356395 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:05.261871 29257 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.376519 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.377661 22118 raft_consensus.cc:2410] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:13:05.391759 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.285682 29303 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.346582 29468 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.341953 29493 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:05.418323 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.240100 29511 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.426275 22266 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:05.427217 22118 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 19: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:05.434906 22118 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
W20260709 12:13:05.471264 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 337654us
I20260709 12:13:05.472477 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:05.478196 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:05.425390 29567 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:13:05.390436 29574 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:05.420583 29564 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.356413 29296 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.432267 29339 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:05.508143 22857 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:05.475534 28716 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:13:05.521970 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 195597us
I20260709 12:13:05.475171 29369 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:05.522739 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 50368.5us
I20260709 12:13:05.523073 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:05.527379 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:05.417145 29468 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.489269 29295 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.494344 29544 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:05.503355 29514 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.147s	user 0.005s	sys 0.012s
I20260709 12:13:05.494022 29522 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:05.355762 29571 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.446417 29493 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.559935 22194 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 18. (term mismatch)
I20260709 12:13:05.563395 22194 pending_rounds.cc:85] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 17
I20260709 12:13:05.563890 22194 pending_rounds.cc:107] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 24.18
I20260709 12:13:05.563920 22118 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:05.524020 28716 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:05.565502 22194 raft_consensus.cc:2889] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:05.527666 29272 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:05.389803 29563 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.569952 29317 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:05.534961 29564 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:05.570338 29586 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:05.482074 29319 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.524595 29339 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.585291 29597 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.586427 29303 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.588272 29571 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.572712 29183 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:05.608872 29330 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:05.609429 29330 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:05.589389 29543 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:05.590526 29337 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:05.590150 29574 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.577164 29564 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:05.553840 29295 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.592453 29493 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:05.593950 29468 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.563467 29522 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.562381 29544 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:05.596046 29525 consensus_meta.cc:287] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.728s	user 0.012s	sys 0.000s
I20260709 12:13:05.599808 29584 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:05.568645 29514 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.599910 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3921) took 1048 ms. Trace:
I20260709 12:13:05.600517 28716 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.576972 29317 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:05.603428 29586 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.639673 29564 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:05.641636 29295 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:05.641790 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 114483us
I20260709 12:13:05.696897 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3906) took 1571 ms. Trace:
I20260709 12:13:05.697762 22123 rpcz_store.cc:276] 0709 12:13:04.551368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.749302 (+197934us) service_pool.cc:224] Handling call
0709 12:13:04.749771 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:04.903952 (+154181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:04.903984 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:04.948936 (+ 44952us) log.cc:844] Serialized 52 byte log entry
0709 12:13:05.241011 (+292075us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:05.241047 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.241109 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:05.597851 (+356742us) spinlock_profiling.cc:243] Waited 9.64 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:05.599503 (+  1652us) raft_consensus.cc:1685] finished
0709 12:13:05.599537 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:05.599846 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86101,"raft.queue_time_us":352860,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":42450,"spinlock_wait_cycles":22172416,"thread_start_us":375343,"threads_started":2,"wal-append.queue_time_us":492438}
I20260709 12:13:05.704639 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:05.705116 22119 rpcz_store.cc:276] 0709 12:13:04.125480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.180280 (+ 54800us) service_pool.cc:224] Handling call
0709 12:13:04.185889 (+  5609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.186151 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:04.582761 (+396610us) log.cc:844] Serialized 14 byte log entry
0709 12:13:05.015457 (+432696us) log.cc:844] Serialized 14 byte log entry
0709 12:13:05.146189 (+130732us) log.cc:844] Serialized 14 byte log entry
0709 12:13:05.696431 (+550242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:05.696504 (+    73us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:05.696585 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.696664 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:05.696824 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219525,"prepare.queue_time_us":309270,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":3102,"raft.queue_time_us":715634,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":20647168,"thread_start_us":1270918,"threads_started":4,"wal-append.queue_time_us":146465}
I20260709 12:13:05.710131 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:05.699427 29317 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.698870 29303 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.699560 29533 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.719436 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:05.717517 29296 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:05.717821 29563 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:05.696018 29525 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.727862 29525 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.728560 29587 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:13:05.729898 29586 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:05.730237 29573 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.243s	user 0.002s	sys 0.000s
I20260709 12:13:05.639180 29597 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.698251 29468 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:05.715296 29496 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:05.749755 29589 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:05.750511 29589 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.700590 29514 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.753573 29580 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:05.754191 29580 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.754628 29514 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:05.722993 29177 consensus_meta.cc:287] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.840s	user 0.007s	sys 0.006s
I20260709 12:13:05.729923 29522 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:05.739028 29563 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:05.926870 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 189371us
I20260709 12:13:05.927213 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:05.741046 29513 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.885s	user 0.009s	sys 0.004s
I20260709 12:13:05.933426 22858 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:05.923620 29580 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:05.942329 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:05.944615 29589 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.944931 29571 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:05.945508 29596 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:05.945850 29571 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.946179 29596 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.946864 29339 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:05.721487 29303 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.949085 29571 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.950091 29544 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:05.940522 29496 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:13:05.952414 29597 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:05.953073 29362 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.755s	user 0.002s	sys 0.011s
I20260709 12:13:05.953498 29362 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:05.954553 29586 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:05.954640 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:05.955879 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:05.956175 22198 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:05.722666 29533 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:05.958765 29533 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.943452 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:05.932457 29573 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:13:05.932372 29177 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:05.973878 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.978716 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.969872 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4224) took 1227 ms. Trace:
I20260709 12:13:05.991197 22269 rpcz_store.cc:276] 0709 12:13:04.742314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.742824 (+   510us) service_pool.cc:224] Handling call
0709 12:13:04.948870 (+206046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:05.037291 (+ 88421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.969355 (+932064us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54002c2ed0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:05.969764 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473102080}
I20260709 12:13:05.994402 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.995540 22123 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:05.990444 22115 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 14.
I20260709 12:13:05.997205 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.998577 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.955916 29586 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:13:06.001502 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.002231 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.949260 29303 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.981063 29496 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:06.006866 29598 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:05.948594 29596 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.012967 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.013805 22123 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:06.022432 29533 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.023077 29533 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.025563 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:06.026813 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:06.027256 29362 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.027812 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:06.028179 29571 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.028954 29543 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:06.029289 29598 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:06.028786 29571 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.029975 29598 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:06.030928 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:06.031462 29544 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:06.032240 29598 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:06.029662 29543 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.032895 29598 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:13:06.033461 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3918) took 1482 ms. Trace:
I20260709 12:13:06.034348 29543 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:05.941263 29563 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.036973 29563 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.031383 29571 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:05.999974 29339 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:06.033902 22122 rpcz_store.cc:276] 0709 12:13:04.550681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.631596 (+ 80915us) service_pool.cc:224] Handling call
0709 12:13:04.631959 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:04.864530 (+232571us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:04.864991 (+   461us) log.cc:844] Serialized 14 byte log entry
0709 12:13:05.232963 (+367972us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.233621 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.233819 (+   198us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:05.234080 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 12:13:05.234268 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.234361 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:05.595772 (+361411us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:06.033220 (+437448us) raft_consensus.cc:1685] finished
0709 12:13:06.033245 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.033389 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":335128,"prepare.queue_time_us":7721,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":639517,"raft.run_cpu_time_us":497,"raft.run_wall_time_us":36862,"spinlock_wait_cycles":499841920,"thread_start_us":474846,"threads_started":2,"wal-append.queue_time_us":431180}
I20260709 12:13:06.034412 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:06.039472 22119 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:05.932647 29468 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.028682 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.052141 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:05.960196 29513 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.029083 29322 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:06.061088 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.056231 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.061334 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.055964 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.061906 22267 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:06.057165 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:06.062181 22270 raft_consensus.cc:2410] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:13:06.062551 22265 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:06.058238 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.055636 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.063347 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:06.063859 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.064368 22263 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:06.064148 22270 raft_consensus.cc:2376] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15. Re-sending same reply.
I20260709 12:13:06.058521 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.012841 29496 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:06.061100 22195 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:13:06.056658 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:06.057262 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.067384 22271 raft_consensus.cc:2376] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17. Re-sending same reply.
I20260709 12:13:06.067909 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.065632 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.065052 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.068544 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.069187 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.069777 22264 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:06.070626 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.071071 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.052565 29296 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:06.041708 29586 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:06.073905 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.075731 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.076723 22267 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:06.051239 29522 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:06.074318 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.082959 22272 raft_consensus.cc:2393] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:06.083000 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.082612 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.066394 29544 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:13:06.086510 29496 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:06.077328 29570 consensus_meta.cc:287] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.000s
I20260709 12:13:06.086640 29586 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.089078 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:06.051139 29339 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.090554 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.091286 22267 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:06.080147 29320 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.096513 29533 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.087935 29513 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.097700 29380 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:06.092547 29570 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:06.088404 29317 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.110162 29317 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:06.100929 29467 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.111927 29339 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.073535 29296 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.113188 29538 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:06.113607 29538 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:06.114377 29538 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.115477 29296 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.102583 29468 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:06.102891 29588 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.594s	user 0.005s	sys 0.012s
I20260709 12:13:06.115584 29538 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:06.111979 29467 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.106654 29320 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.133982 29320 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.054024 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:06.309576 22197 raft_consensus.cc:2368] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:06.231040 22114 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:06.305649 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:06.145876 29552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.170s	user 0.011s	sys 0.008s
I20260709 12:13:06.366020 29295 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:06.366597 29552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.015s	sys 0.019s
I20260709 12:13:06.367873 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.367381 29295 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.250432 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:13:06.334911 22163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.006s	sys 0.033s
I20260709 12:13:06.304889 22190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2912) took 1276 ms. Trace:
I20260709 12:13:06.143436 29564 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.150072 29536 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:06.156618 29582 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.594s	user 0.003s	sys 0.008s
I20260709 12:13:06.378130 29548 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:06.379336 29548 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:06.155228 29576 log.cc:927] Time spent T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.669s	user 0.004s	sys 0.008s
I20260709 12:13:06.381239 29560 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:06.382380 29560 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.308061 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.385247 22196 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:06.386240 29561 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:06.165246 29578 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.659s	user 0.006s	sys 0.006s
I20260709 12:13:06.328681 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1877) took 1997 ms. Trace:
I20260709 12:13:06.387323 22194 rpcz_store.cc:276] 0709 12:13:04.331359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.331458 (+    99us) service_pool.cc:224] Handling call
0709 12:13:04.331711 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:05.566221 (+1234510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.328186 (+761965us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000fcdd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:06.328502 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2823645952}
I20260709 12:13:06.389320 29568 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.390236 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.327245 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2913) took 1298 ms. Trace:
I20260709 12:13:06.144089 29467 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.303365 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2917) took 1271 ms. Trace:
I20260709 12:13:06.295814 22120 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:06.270081 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2797) took 1762 ms. Trace:
I20260709 12:13:06.386575 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.376439 29564 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.308370 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:06.394564 22163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.010s	sys 0.037s
I20260709 12:13:06.136634 29332 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.370965 22190 rpcz_store.cc:276] 0709 12:13:05.027915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.028190 (+   275us) service_pool.cc:224] Handling call
0709 12:13:06.304274 (+1276084us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b54001090d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:06.304572 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37280640}
I20260709 12:13:06.277098 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:06.239744 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:06.326052 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.250283 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.238814 22115 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:06.391350 22198 rpcz_store.cc:276] 0709 12:13:05.029000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.030171 (+  1171us) service_pool.cc:224] Handling call
0709 12:13:06.326557 (+1296386us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54002364d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:06.326952 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880450816}
I20260709 12:13:06.304399 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:06.170763 29599 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.222s	user 0.000s	sys 0.002s
I20260709 12:13:06.321527 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.278534 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:06.386797 29338 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.404155 22195 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:06.409333 29572 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:06.409303 29609 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:06.402287 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3916) took 1851 ms. Trace:
I20260709 12:13:06.410916 29572 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:06.415419 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.393373 22121 rpcz_store.cc:276] 0709 12:13:04.507433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.522207 (+ 14774us) service_pool.cc:224] Handling call
0709 12:13:04.522477 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.767190 (+244713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.269350 (+1502160us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400311ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:06.269735 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512247680}
I20260709 12:13:06.416132 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3915) took 1866 ms. Trace:
I20260709 12:13:06.422118 22266 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:06.417846 22117 rpcz_store.cc:276] 0709 12:13:04.549888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.551424 (+  1536us) service_pool.cc:224] Handling call
0709 12:13:04.551751 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:04.555910 (+  4159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:04.555941 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:04.556396 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.331315 (+774919us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:05.333831 (+  2516us) log.cc:844] Serialized 14 byte log entry
0709 12:13:05.343465 (+  9634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.343567 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:06.148793 (+805226us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b480027c0d8. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf2cebaa1 00007fccf2ce2b37 00007fccf2ce29ca 00007fccf2dda26f 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508 00007fccf2dee488 00007fccf2dee443 00007fccf2ded6ec 00007fccf1d17a96
0709 12:13:06.155879 (+  7086us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:06.391119 (+235240us) raft_consensus.cc:1685] finished
0709 12:13:06.395481 (+  4362us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.415928 (+ 20447us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23556,"prepare.queue_time_us":1720,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":25530,"raft.run_cpu_time_us":13734,"raft.run_wall_time_us":825081,"spinlock_wait_cycles":13338368,"thread_start_us":714612,"threads_started":1,"wal-append.queue_time_us":941461}
I20260709 12:13:06.417341 22116 rpcz_store.cc:276] 0709 12:13:04.550196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.550307 (+   111us) service_pool.cc:224] Handling call
0709 12:13:04.550642 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:04.877359 (+326717us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:13:04.895173 (+ 17814us) log.cc:844] Serialized 14 byte log entry
0709 12:13:05.234567 (+339394us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.235053 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.235240 (+   187us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:05.235486 (+   246us) log.cc:844] Serialized 14 byte log entry
0709 12:13:05.235632 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.154620 (+918988us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:06.158251 (+  3631us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b1800305380. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceac4fc0a 00007fccf438f219 00007fccf2ceb328 00007fccf2ce2901 00007fccf2ce28a7 00007fccf2dda288 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508
0709 12:13:06.279652 (+121401us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540025fb54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:06.279761 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:06.391044 (+111283us) raft_consensus.cc:1685] finished
0709 12:13:06.391065 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.402001 (+ 10936us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189784,"prepare.queue_time_us":18214,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":86,"raft.queue_time_us":722222,"raft.run_cpu_time_us":12718,"raft.run_wall_time_us":861305,"spinlock_wait_cycles":678243328,"thread_start_us":348382,"threads_started":2,"wal-append.queue_time_us":494155}
I20260709 12:13:06.427752 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.429275 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.431334 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.390506 29568 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.139763 29466 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:06.416745 29580 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:13:06.437369 29466 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:06.438359 22862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 1159) took 1822 ms. Trace:
I20260709 12:13:06.441116 22194 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
W20260709 12:13:06.441223 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 125507us
I20260709 12:13:06.442566 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.442674 29295 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.444303 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.418766 29609 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.459292 29491 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:06.461138 22271 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:06.468916 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:06.459779 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.459219 29261 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.445159 22194 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:06.463115 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.454461 28716 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:06.461485 22119 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:06.462690 22118 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:06.455120 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.438926 22862 rpcz_store.cc:276] 0709 12:13:04.616060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.620444 (+  4384us) service_pool.cc:224] Handling call
0709 12:13:04.620857 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.621136 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:04.946784 (+325648us) log.cc:844] Serialized 14 byte log entry
0709 12:13:06.164383 (+1217599us) spinlock_profiling.cc:243] Waited 65 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:06.416882 (+252499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:06.432226 (+ 15344us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:06.437768 (+  5542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.437880 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.438120 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1094115,"prepare.queue_time_us":47621,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":1096808,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":276,"spinlock_wait_cycles":149441408,"thread_start_us":664506,"threads_started":2,"wal-append.queue_time_us":540789}
I20260709 12:13:06.453539 29568 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.463711 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.469254 29589 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:06.464349 22192 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 20: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:06.471625 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.471984 29261 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.460119 29314 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:13:06.459926 22267 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:13:06.472640 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.471213 22196 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:06.391922 22189 rpcz_store.cc:276] 0709 12:13:05.031263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.175360 (+144097us) service_pool.cc:224] Handling call
0709 12:13:05.175858 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.176208 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.176250 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.188091 (+ 11841us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.440821 (+252730us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:05.440863 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.440940 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:06.102219 (+661279us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:06.302273 (+200054us) raft_consensus.cc:1685] finished
0709 12:13:06.302373 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.302946 (+   573us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150049152,"thread_start_us":214399,"threads_started":1,"wal-append.queue_time_us":285975}
I20260709 12:13:06.471170 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.471828 29561 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.478968 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.479180 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.480113 22189 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:06.480172 29561 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.480516 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:06.481990 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 1.41856e+06us
I20260709 12:13:06.482509 22194 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:06.483490 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.482566 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:06.481120 22123 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:06.485675 22189 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:06.487676 22189 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:06.489410 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:06.490002 22189 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:06.421099 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 884869us
I20260709 12:13:06.493131 29314 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:06.497036 22198 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:13:06.496750 29314 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.497346 22122 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 25.
I20260709 12:13:06.498692 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.498977 22198 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:13:06.499482 22122 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:06.500689 29261 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.502224 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.506029 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:06.507208 22121 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 19: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:06.508976 29177 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:06.509843 29177 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.471521 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:06.502236 22196 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 25.
I20260709 12:13:06.518036 22116 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 20: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:06.377028 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:06.468820 29491 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.497262 29572 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.477577 29548 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.494135 29609 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.493901 29589 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:06.536827 29257 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.540030 29561 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:06.548914 29561 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.549764 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:06.550392 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2806) took 1296 ms. Trace:
I20260709 12:13:06.550800 22114 rpcz_store.cc:276] 0709 12:13:05.253588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.310326 (+ 56738us) service_pool.cc:224] Handling call
0709 12:13:06.550042 (+1239716us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b5400326c54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:06.550305 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091212672}
I20260709 12:13:06.439174 29466 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.553754 29466 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:06.554066 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.554752 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:06.555426 22857 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:06.557199 22237 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:06.557377 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:06.559988 29411 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:06.560514 29411 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:06.560971 29411 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:06.563318 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:06.565613 22118 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:13:06.536906 29584 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:06.545204 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:06.569808 29584 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.573244 29612 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.575099 29584 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.552397 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:06.543661 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:06.574472 29612 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.583957 29282 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.567768 29330 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.539114 29589 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:06.541716 29560 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.551363 29561 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.604034 22122 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:06.608343 29330 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:06.611680 29177 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.613701 22858 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:13:06.615514 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 1773) took 1360 ms. Trace:
I20260709 12:13:06.539417 29609 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:06.616170 22120 rpcz_store.cc:276] 0709 12:13:05.254725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.303430 (+ 48705us) service_pool.cc:224] Handling call
0709 12:13:06.588488 (+1285058us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54002c10d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:06.615436 (+ 26948us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2146056576}
W20260709 12:13:06.623189 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 79886.6us
W20260709 12:13:06.629774 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 390645us
I20260709 12:13:06.641145 29261 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:13:06.642469 22020 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 16 to 20, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 20 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.655484 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:06.659322 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.656024 29177 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:06.669063 29177 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:06.669509 29177 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:06.635706 29282 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:06.687354 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:06.685177 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.697059 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:06.687836 29314 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:13:06.700820 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 66157.4us
I20260709 12:13:06.653878 29561 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.646654 29609 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:06.692355 22021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 276) took 26341 ms (client timeout 15000 ms). Trace:
I20260709 12:13:06.710204 22857 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
W20260709 12:13:06.712574 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 97550us
W20260709 12:13:06.714322 22265 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.592s	user 0.005s	sys 0.012s
I20260709 12:13:06.711750 22830 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:06.714567 29258 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:06.694192 29572 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:06.714855 22265 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:06.687098 29282 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:06.720424 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.722512 29512 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:13:06.726447 29512 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:06.727636 29512 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.719201 29258 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.736409 22271 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:13:06.739681 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:06.740600 22266 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 19: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:06.736137 29258 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:06.744095 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.745061 29572 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.745968 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:06.746060 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:06.747499 29572 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.748597 22020 catalog_manager.cc:5697] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 12 to 13, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 13 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.751475 22020 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 15 to 17, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 17 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.752097 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:06.754132 29456 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:06.754623 29456 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:06.755034 29456 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:06.754951 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:06.762137 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.764935 22119 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:06.765318 22189 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:13:06.773036 22123 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:13:06.787318 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:06.790519 29587 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:13:06.791833 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.773356 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.805270 29532 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:06.806003 29532 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.808233 29532 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:06.788398 29609 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.758133 29561 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:06.823124 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 166468us
I20260709 12:13:06.801673 29222 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:06.831070 22272 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:06.799736 29491 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.827304 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:06.847339 29234 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:13:06.830860 29222 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.854882 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:06.847796 29380 consensus_meta.cc:287] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.740s	user 0.001s	sys 0.016s
I20260709 12:13:06.869724 22270 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:06.867871 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:06.874938 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:06.875928 22860 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:13:06.877611 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 227710us
I20260709 12:13:06.851586 29234 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:06.860291 29222 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:06.877041 22858 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
W20260709 12:13:06.890784 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 72637us
W20260709 12:13:06.895921 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.898669 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.909031 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:06.908730 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:06.895033 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:06.905557 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:06.886667 29234 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:06.864370 29612 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.884433 29584 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:06.886744 29609 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.934338 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:06.937911 22267 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:06.935513 22864 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:06.946295 29560 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:06.940081 29303 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.940353 29466 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:06.928893 29532 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 12:13:06.710038 22021 rpcz_store.cc:269] 0709 12:12:40.350233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.366229 (+ 15996us) service_pool.cc:224] Handling call
0709 12:13:06.691914 (+26325685us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:57.084057 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:57.184763 (+100706us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b54001b09a8. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf417e9e1 00007fccf417d64c 00007fccf180cd5d 00007fccf17f80a6 00007fccf17f7d58 00007fccf17fc9f1 00007fccf17fc9a9 00007fccf17fc939 00007fccf17fc901 00007fccf17fbb2d 0000000000388634
0709 12:12:57.281696 (+ 96933us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:57.323391 (+ 41695us) write_op.cc:435] Acquired schema lock
0709 12:12:57.329800 (+  6409us) tablet.cc:662] Decoding operations
0709 12:12:57.473585 (+143785us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:57.473690 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:57.473720 (+    30us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:12:57.474635 (+   915us) tablet.cc:701] Row locks acquired
0709 12:12:57.474685 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:12:57.474902 (+   217us) write_op.cc:270] Start()
0709 12:12:57.475211 (+   309us) write_op.cc:276] Timestamp: P: 1783599177474809 usec, L: 0
0709 12:12:57.475240 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:12:57.557294 (+ 82054us) log.cc:844] Serialized 3268 byte log entry
0709 12:12:57.997657 (+440363us) spinlock_profiling.cc:243] Waited 9.87 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:12:58.723534 (+725877us) op_driver.cc:464] REPLICATION: finished
0709 12:13:00.694019 (+1970485us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcceacb80ac 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fccf17f8ef0
0709 12:13:01.018659 (+324640us) write_op.cc:301] APPLY: starting
0709 12:13:01.018899 (+   240us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:01.133690 (+114791us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:01.133737 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:01.139455 (+  5718us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:01.139789 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:13:01.139854 (+    65us) write_op.cc:312] APPLY: finished
0709 12:13:01.172119 (+ 32265us) log.cc:844] Serialized 81 byte log entry
0709 12:13:01.216243 (+ 44124us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:01.224958 (+  8715us) write_op.cc:454] Released schema lock
0709 12:13:01.228389 (+  3431us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:01.314991 (+ 86602us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:01.337219 (+ 22228us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27363,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":2207597,"apply.run_cpu_time_us":26778,"apply.run_wall_time_us":296265,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37583,"num_ops":8,"prepare.queue_time_us":375458,"prepare.run_cpu_time_us":38086,"prepare.run_wall_time_us":631828,"raft.queue_time_us":225515,"raft.run_cpu_time_us":43098,"raft.run_wall_time_us":2362855,"replication_time_us":1246762,"spinlock_wait_cycles":55937408,"thread_start_us":2645193,"threads_started":5,"wal-append.queue_time_us":316357,"wal-append.run_cpu_time_us":21171,"wal-append.run_wall_time_us":2881982}]]}
I20260709 12:13:06.932324 29609 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:06.954524 29561 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.946754 29587 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:13:06.977468 29534 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:06.977484 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:06.978541 29534 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:06.988226 22863 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:06.967732 29560 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.005045 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2821) took 1015 ms. Trace:
I20260709 12:13:07.005615 22121 rpcz_store.cc:276] 0709 12:13:05.989176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.507873 (+518697us) service_pool.cc:224] Handling call
0709 12:13:06.508407 (+   534us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:06.521820 (+ 13413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:06.521868 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:06.577100 (+ 55232us) log.cc:844] Serialized 52 byte log entry
0709 12:13:06.915479 (+338379us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:13:06.915526 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.915687 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:07.004723 (+ 89036us) raft_consensus.cc:1685] finished
0709 12:13:07.004750 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:07.004951 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24693,"raft.queue_time_us":15784,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":10878,"thread_start_us":292451,"threads_started":1,"wal-append.queue_time_us":403062}
I20260709 12:13:07.007113 29560 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:06.991624 29577 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:06.994396 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:06.994930 29609 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:06.964577 29303 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.010856 29532 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:06.982836 29580 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:07.014726 29466 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.026257 29532 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:07.046911 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 119895us
I20260709 12:13:07.031957 29580 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:07.049165 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 54864.6us
I20260709 12:13:07.043051 29324 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:07.052350 29491 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:07.023654 29612 consensus_queue.cc:1059] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:13:07.057426 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:07.059091 29491 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.058435 22020 catalog_manager.cc:5697] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:07.055963 29324 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:07.065635 22865 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 19: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:07.025117 29411 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.070801 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:07.071583 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:07.073067 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:07.074148 22193 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:13:07.080905 22271 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:13:07.074534 29314 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.077078 22020 catalog_manager.cc:5697] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 9 to 13, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 13 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:07.084726 22267 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:07.056447 29534 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:07.094026 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:07.092499 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:07.100184 22266 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:07.092335 29535 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:07.083335 29560 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:07.109584 22265 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:07.065330 29258 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.114205 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:07.081925 29177 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.117973 22268 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:07.120548 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:07.121395 29303 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.123101 29330 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:13:07.123468 29491 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.118862 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:07.123531 29330 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:07.118036 29535 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.125710 29609 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:13:07.138998 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:07.106559 29314 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:07.148267 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68918.5us
I20260709 12:13:07.148206 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:07.150133 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:07.150621 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:07.150997 29614 log.cc:927] Time spent T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.421s	user 0.003s	sys 0.003s
I20260709 12:13:07.135990 29580 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.143386 29324 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.138420 29330 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.157342 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2922) took 1096 ms. Trace:
I20260709 12:13:07.137423 29584 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.163362 29303 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:07.146270 29491 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:07.161012 22194 rpcz_store.cc:276] 0709 12:13:06.057174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.483471 (+426297us) service_pool.cc:224] Handling call
0709 12:13:06.483989 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:06.485744 (+  1755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:06.485791 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:06.486567 (+   776us) log.cc:844] Serialized 26 byte log entry
0709 12:13:06.523595 (+ 37028us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:13:06.523633 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.523694 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:07.150255 (+626561us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:07.153169 (+  2914us) raft_consensus.cc:1685] finished
0709 12:13:07.153195 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:07.153410 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":297,"spinlock_wait_cycles":22996736,"thread_start_us":36519,"threads_started":1,"wal-append.queue_time_us":152286}
I20260709 12:13:07.134814 29560 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:07.170015 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 115519us
W20260709 12:13:07.175827 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 65559.7us
I20260709 12:13:07.166714 29466 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:07.165512 29303 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.182624 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:07.184757 22271 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:07.168747 29491 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.177292 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2822) took 1171 ms. Trace:
I20260709 12:13:07.186551 22116 rpcz_store.cc:276] 0709 12:13:06.005876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.539256 (+533380us) service_pool.cc:224] Handling call
0709 12:13:06.629449 (+ 90193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:06.706151 (+ 76702us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:06.953642 (+247491us) log.cc:844] Serialized 14 byte log entry
0709 12:13:07.175085 (+221443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:07.175123 (+    38us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:07.177045 (+  1922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:07.177123 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:07.177235 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":275445,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":6107,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":6494,"thread_start_us":387748,"threads_started":2}
I20260709 12:13:07.187865 29303 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:07.188297 29330 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:07.189338 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:07.198948 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:07.188313 29618 log.cc:927] Time spent T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.107s	user 0.000s	sys 0.002s
I20260709 12:13:07.181504 29258 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:07.175978 29584 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.203133 29584 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:07.204450 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:07.205228 22858 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:07.189596 29491 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:07.196870 22087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.512s (SENT) [suppressed 14 similar messages]
I20260709 12:13:07.208648 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:07.212373 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.216902 29411 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:07.205318 29324 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:07.229622 29297 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:07.230324 29297 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.230796 29297 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:07.225378 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 2920) took 1169 ms. Trace:
I20260709 12:13:07.226217 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:07.227092 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:07.215889 29282 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:07.253360 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 76223.9us
W20260709 12:13:07.266090 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 76534.5us
I20260709 12:13:07.239499 22193 rpcz_store.cc:276] 0709 12:13:06.055667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.055777 (+   110us) service_pool.cc:224] Handling call
0709 12:13:07.224988 (+1169211us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b54002e72d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:07.225185 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2182659840}
I20260709 12:13:07.265833 29535 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.215765 29177 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:07.265904 29568 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:07.276422 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:07.277139 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:07.276444 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:07.283658 28716 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:07.286368 22194 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:13:07.292987 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.296838 29561 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:07.297736 29589 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.680s	user 0.015s	sys 0.000s
I20260709 12:13:07.298276 29589 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.306761 29560 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.307945 29303 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:07.309041 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 52539us
I20260709 12:13:07.297765 29561 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.310660 28716 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:07.311033 29621 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:13:07.311861 28716 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.313287 29589 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.315641 29303 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:07.315923 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.318837 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:07.321111 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:07.321950 22271 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:07.324239 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.325556 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:07.326241 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.327054 22194 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:07.328011 22195 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:13:07.328706 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:07.329319 22196 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:13:07.331169 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 54833.2us
I20260709 12:13:07.334244 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:07.334646 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:07.335281 22088 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:07.335788 22191 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 20: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:07.339010 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:07.339653 22864 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
W20260709 12:13:07.346743 29456 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.591s	user 0.014s	sys 0.002s
I20260709 12:13:07.355918 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:07.356226 29456 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:07.357491 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.357661 22830 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:07.312129 29561 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.363451 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:07.381085 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.346630 29512 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:07.391947 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.392616 22193 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:07.357221 29380 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.410032 29380 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:07.412518 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 54927.8us
I20260709 12:13:07.394877 29261 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:07.387538 28716 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.416321 22196 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:13:07.362792 29609 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:07.406983 29297 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.409101 29589 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:07.430301 22121 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:13:07.439785 22121 pending_rounds.cc:85] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 7
I20260709 12:13:07.393085 29512 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.432575 28716 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.391795 29561 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.445024 22863 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:07.445686 29512 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.363873 29612 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.067s
I20260709 12:13:07.392437 29314 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:07.447814 22123 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:07.440073 22121 pending_rounds.cc:107] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:13:07.453790 22121 raft_consensus.cc:2889] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:07.457015 22192 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:13:07.432152 29609 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:07.437466 29589 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.460944 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.461835 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.462848 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:07.459437 29234 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.004s
W20260709 12:13:07.467018 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 131847us
I20260709 12:13:07.470445 28716 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:07.469587 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77723.1us
I20260709 12:13:07.477233 22194 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 19: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:07.480713 28716 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:07.464056 29609 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:07.465045 29589 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:07.484529 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:07.470232 29222 consensus_meta.cc:287] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.002s
I20260709 12:13:07.490738 28716 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.489929 22191 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:07.491700 22237 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:07.458148 29561 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.506930 22195 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:13:07.507879 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:07.508104 28716 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.508875 29360 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:07.509063 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:07.509645 29360 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.510488 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:07.485203 29491 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.512074 29360 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:07.513315 29491 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.516817 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:07.531855 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:07.532455 22268 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:07.535852 22198 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:07.541385 22194 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:13:07.542058 22121 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 19: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:07.538442 29314 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:07.543919 29314 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:07.544296 29314 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:07.550920 29631 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:07.560889 29580 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:07.561486 29580 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.561878 29580 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:07.562915 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.565356 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:07.566115 22194 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:07.569639 29456 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:07.570746 29456 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:07.571518 29456 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.577620 29297 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.536841 29560 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:07.499841 29222 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.539742 29584 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:07.581681 29584 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:07.477916 29234 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.582996 29584 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.585043 22862 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: []
W20260709 12:13:07.586931 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47389.1us
I20260709 12:13:07.589156 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:07.601296 22268 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:07.603257 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:07.595037 29621 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:13:07.601357 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:07.609061 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 219991us
I20260709 12:13:07.594741 29380 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.616869 22123 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:13:07.617295 22123 pending_rounds.cc:85] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 12
I20260709 12:13:07.617542 22123 pending_rounds.cc:107] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:13:07.617791 22123 raft_consensus.cc:2889] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:07.616377 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:07.621609 22118 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:13:07.631247 29561 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.633208 22163 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:07.634477 29633 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:07.635303 29633 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:07.637431 28716 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:13:07.598523 29560 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:07.610797 29261 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:07.635198 29639 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:07.636615 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:07.659160 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:07.664798 29456 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:07.667616 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:07.670971 22197 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 12:13:07.681433 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:07.683712 29625 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260709 12:13:07.686790 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 50271.2us
I20260709 12:13:07.687785 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:07.689599 29561 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.671790 29568 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:07.717296 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:07.717212 22194 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:07.668746 29589 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.724570 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:07.725488 22114 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.727191 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:07.727705 22118 raft_consensus.cc:2368] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16.
I20260709 12:13:07.728255 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:07.728404 29177 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:07.732002 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:07.736028 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.740738 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:07.680316 29234 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.743311 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:07.729854 29456 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:07.687260 29330 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:07.744844 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:07.756618 22858 raft_consensus.cc:2368] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:07.761046 22163 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:07.747771 29456 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:07.765195 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:07.766290 22857 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 23: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:07.768975 29466 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:07.748129 29577 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:07.769819 29577 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.770196 29577 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:07.740182 29177 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:07.772894 29177 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:07.742070 29561 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.755895 29324 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:07.775398 29324 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.775770 29324 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:07.684190 29512 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.777441 29589 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.777086 29261 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.778790 29512 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.779238 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:07.780031 22115 raft_consensus.cc:2393] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 15: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:07.779721 29560 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.636566 29633 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:07.786489 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 48737.6us
I20260709 12:13:07.788257 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:07.790918 22115 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:13:07.790175 29257 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:07.797839 29257 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.788043 29234 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:13:07.782939 29380 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:13:07.765223 29456 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:07.800810 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:07.745857 29314 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.809103 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.744522 29535 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:13:07.817345 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:13:07.814976 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 71811.8us
I20260709 12:13:07.818771 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:07.821208 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.826090 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:07.829316 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.829548 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.830119 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.827139 22864 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:13:07.832741 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:07.836134 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.806126 29257 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.837656 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.829557 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:07.837656 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 88460.3us
I20260709 12:13:07.839109 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:07.845160 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.846220 22192 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:07.847586 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.848583 22193 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 23.
I20260709 12:13:07.849131 29512 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:07.849231 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.850617 29642 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:07.851178 29314 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:07.859469 29629 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.379s	user 0.003s	sys 0.000s
I20260709 12:13:07.859191 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:07.860499 29222 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:07.845147 29644 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:07.861471 22115 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:07.897243 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.864092 22191 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:13:07.862118 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:07.899258 22196 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:13:07.899784 22196 pending_rounds.cc:85] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 9
I20260709 12:13:07.862434 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:07.866186 22114 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:13:07.899997 22196 pending_rounds.cc:107] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:13:07.900308 22196 raft_consensus.cc:2889] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:07.901814 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:07.867908 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:07.870924 29609 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:07.905773 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 63461.5us
I20260709 12:13:07.906792 29609 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:07.907184 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:07.873647 22197 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:13:07.909070 29297 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:07.910207 29643 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:07.910781 29643 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.911221 29643 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:07.913450 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:07.935545 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:07.875173 29584 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:07.881000 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:07.883620 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 82930.5us
I20260709 12:13:07.885758 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:07.894101 29466 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:07.915035 22862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 1171) took 1071 ms. Trace:
I20260709 12:13:07.915207 29561 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:07.916013 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:07.916877 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:07.961680 22862 rpcz_store.cc:276] 0709 12:13:06.843251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.847185 (+  3934us) service_pool.cc:224] Handling call
0709 12:13:06.847621 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:07.585594 (+737973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:07.914714 (+329120us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b5400800a54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:07.914956 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695317248}
I20260709 12:13:07.920210 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:13:07.920630 29651 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:13:07.867866 29512 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.963433 29512 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:07.921967 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:07.926677 29644 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:07.965787 29644 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:07.966965 29644 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:07.866489 29624 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:07.928984 29456 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.969115 29624 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.970747 29456 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:07.929463 28716 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:07.971532 28716 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:07.971971 29624 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:07.860693 29324 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.997236 22114 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:13:07.998109 29584 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:07.998611 29584 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:07.999260 22114 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:13:07.873907 29580 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.999534 29584 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.001067 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.001456 29580 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:08.001854 22197 raft_consensus.cc:2368] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:08.002286 22120 raft_consensus.cc:2368] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21.
I20260709 12:13:08.002569 29589 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:08.003167 29589 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:07.918470 22198 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 12:13:07.973433 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.962340 22121 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:13:07.972497 28716 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.007352 28716 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.958624 22189 raft_consensus.cc:2410] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:13:08.017940 22116 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:13:08.001103 22118 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:13:08.021806 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 177571us
W20260709 12:13:08.022619 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48614.2us
I20260709 12:13:07.999387 29324 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:08.030743 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:08.032437 22115 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:08.046164 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:08.051394 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:07.968727 29644 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:08.049896 22163 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:08.054898 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:08.055598 22268 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:08.021818 29584 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:08.057605 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:08.059099 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.057237 29324 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:08.065182 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 178326us
I20260709 12:13:08.043846 29360 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:08.085143 28716 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:08.087494 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.087366 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:08.088167 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:08.094977 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 207827us
W20260709 12:13:08.097074 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.097124 29456 consensus_queue.cc:1059] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:08.098253 29456 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:13:08.098682 29456 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:13:08.101819 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 50552.6us
I20260709 12:13:08.102595 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:08.103358 22123 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:08.103972 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.103717 29360 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.104300 22088 leader_election.cc:400] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:08.105276 22114 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:08.105602 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:08.105813 22189 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:08.104745 22088 leader_election.cc:403] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 12:13:08.119107 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53165.3us
I20260709 12:13:08.119473 22268 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:08.115180 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:08.098863 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:08.126614 22117 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:08.130756 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.131734 22118 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:13:08.135421 29643 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.143698 29643 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:08.144574 29641 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:08.145191 29456 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.146883 29456 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:08.137590 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:08.139710 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:08.157043 29634 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:08.164909 29580 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:08.131907 29589 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:08.170234 29589 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:08.170657 29589 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.171048 29589 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:08.171667 22862 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:08.156153 29466 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:08.174214 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:08.106519 29360 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:08.150223 29257 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.224984 29257 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:08.196235 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:08.230289 29577 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.130369 29560 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:08.233083 22860 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: []
W20260709 12:13:08.218901 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 68312.4us
I20260709 12:13:08.219439 29177 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.237990 29177 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:08.180905 29466 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:08.238778 22265 raft_consensus.cc:1240] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:08.220471 29624 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.254701 29466 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:08.256450 29624 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.258630 29624 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:08.255692 29636 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:13:08.289451 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:08.290108 29661 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:08.290928 29661 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.290274 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:08.289510 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.173530 29535 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:08.292789 22189 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:08.303915 22162 leader_election.cc:400] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16.
I20260709 12:13:08.232676 29577 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:08.308224 22162 leader_election.cc:403] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:08.313129 22271 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:13:08.305830 29314 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:08.309312 29560 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:08.333024 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 158878us
I20260709 12:13:08.334224 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:08.334282 29560 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.335723 29589 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.314085 29535 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:08.336861 29609 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:08.337642 29535 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:08.338877 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 289119us
I20260709 12:13:08.341122 29314 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:08.341626 29314 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:08.341845 29661 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:08.345556 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.347358 22271 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:08.348886 29666 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:13:08.292536 29642 consensus_queue.cc:1059] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 12:13:08.351743 22190 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:08.307493 29324 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 12:13:08.356429 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:08.344367 29512 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.367306 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.374792 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.375635 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:08.375905 22265 raft_consensus.cc:2393] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 19: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:08.379069 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:08.379033 22831 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:08.384406 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:08.386656 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.386839 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:08.387295 22268 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:13:08.394034 22862 raft_consensus.cc:2410] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
W20260709 12:13:08.385970 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 97502.6us
I20260709 12:13:08.395366 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:08.395864 22162 leader_election.cc:400] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21.
I20260709 12:13:08.396194 22162 leader_election.cc:403] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:08.401852 22189 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:08.375221 29532 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:08.408736 22270 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:08.396006 22860 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:08.417789 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:08.422168 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:08.422950 22860 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:08.428109 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 59813.8us
I20260709 12:13:08.427439 22237 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:08.435598 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:08.374981 29624 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:13:08.404008 29642 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:13:08.410661 29532 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.380285 29466 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.426038 29257 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:13:08.451808 22270 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:08.455297 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 121183us
I20260709 12:13:08.461421 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:08.464890 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.467082 29380 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:08.469887 29577 raft_consensus.cc:3055] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:08.470499 29577 raft_consensus.cc:740] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:08.470988 29466 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:08.452786 29532 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:08.481323 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.481685 29512 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:08.482861 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:08.484229 29297 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.484437 29360 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:08.467180 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:08.484838 29297 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.485888 29303 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:13:08.486321 29303 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:08.486673 29634 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:08.487937 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.468508 29380 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:08.489017 29297 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:08.489065 29380 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:08.486698 29303 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:08.490420 29380 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.491765 29380 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:08.494905 22860 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:08.497033 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:08.484257 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:08.502178 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:08.503556 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:08.504489 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:08.505885 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:08.507252 29535 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:08.510783 22115 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:08.511911 29673 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:08.512383 29673 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.512748 29673 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:08.471746 29577 consensus_queue.cc:260] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.514014 29577 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:08.448071 29639 raft_consensus.cc:2764] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:13:08.452270 29561 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:08.527719 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 97354.1us
I20260709 12:13:08.529783 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:08.457296 29324 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:08.536760 22198 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:13:08.538203 22121 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:08.535255 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:08.532390 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 105001us
I20260709 12:13:08.460034 29642 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:08.583932 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.584990 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:08.536499 29568 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:08.591105 29568 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:08.591511 29568 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:08.587504 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.520874 29466 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:08.540867 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.606683 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:08.606779 22123 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:08.519606 29633 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:08.614812 22862 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
W20260709 12:13:08.615235 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 109457us
I20260709 12:13:08.476619 29314 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.539921 29297 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:08.629742 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 145560us
W20260709 12:13:08.618068 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 113660us
I20260709 12:13:08.643314 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:08.589061 29512 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:08.589462 29534 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:08.663262 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55646.4us
I20260709 12:13:08.613266 29609 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:08.616703 29661 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:08.616950 29177 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:08.674219 29303 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.674953 29661 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:08.676029 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.677064 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:08.677399 29661 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:08.678468 22270 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:13:08.678892 22270 pending_rounds.cc:85] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 11
I20260709 12:13:08.679116 22270 pending_rounds.cc:107] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:13:08.679345 22270 raft_consensus.cc:2889] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:08.681751 29456 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:08.682265 29456 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.684247 29456 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:08.660370 29297 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.605237 29324 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.691076 22087 leader_election.cc:400] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:08.631279 29674 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:08.694857 29466 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:13:08.697477 29324 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:08.659585 29633 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:08.662881 29589 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:08.698035 29314 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:08.706625 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:08.671607 29666 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16.
I20260709 12:13:08.657007 29639 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
W20260709 12:13:08.720011 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:08.734391 22117 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.000s
I20260709 12:13:08.734795 22117 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
W20260709 12:13:08.739472 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 66815.4us
I20260709 12:13:08.744065 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:08.701473 29512 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:13:08.721793 29674 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:08.695287 29177 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.675508 29642 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.770010 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:08.736619 29589 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:08.775221 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:08.783561 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 140339us
I20260709 12:13:08.722007 29561 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:13:08.790307 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:08.794376 29568 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.783227 29466 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:08.769614 29512 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:08.773458 29324 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:08.805169 29686 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:13:08.831341 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 61451.2us
I20260709 12:13:08.833782 22163 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:08.824702 29560 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:08.804638 29532 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.826930 29324 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:08.809628 29680 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:13:08.864514 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.866562 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:08.870545 22189 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:08.867650 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.868707 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:08.872938 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:08.873605 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:08.874328 22117 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:13:08.876250 29664 raft_consensus.cc:2764] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:13:08.878015 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:08.878861 29664 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:08.879056 29689 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:13:08.873646 22190 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:08.880357 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:08.871680 29324 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:08.881057 29664 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:08.882318 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:08.882992 29664 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:08.886005 29568 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:08.886336 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:08.886554 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.887540 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.887625 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.888084 22192 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:08.888422 22193 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 26: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:08.888533 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:08.888842 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:08.889520 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:08.890036 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.890758 29177 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:08.891124 29680 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:08.891520 29680 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:08.892073 22191 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:13:08.895031 22264 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 22: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:08.890743 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:08.896986 22193 raft_consensus.cc:2368] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:08.898016 22192 raft_consensus.cc:2410] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:13:08.898188 22193 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:13:08.878147 22115 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:08.833331 29686 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:08.901435 22198 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:08.904260 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:08.904852 22120 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:08.844833 29380 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:08.854593 29560 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:08.923288 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.888011 29532 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:08.911991 22270 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:13:08.922039 22163 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:08.924247 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:08.920295 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:08.923976 22263 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:08.926397 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:08.926785 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:08.927109 22195 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:13:08.927393 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.931281 22189 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:08.927513 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:08.931774 22862 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:08.930567 22857 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 23: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:08.937265 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.938459 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.940218 22116 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 20: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:08.941278 22118 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:08.943598 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.822327 29633 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.809170 29674 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.917675 29686 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:08.924098 22236 connection.cc:256] RPC call timeout handler was delayed by -1.4381865610000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 12:13:08.946595 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:08.957710 22236 connection.cc:256] RPC call timeout handler was delayed by -1.1753865610000958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 12:13:08.958425 22236 connection.cc:256] RPC call timeout handler was delayed by -1.0627328489999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
I20260709 12:13:08.959802 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:08.960322 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.960853 22269 raft_consensus.cc:2368] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:08.961338 29177 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.961890 29177 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:08.963241 22267 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:08.965082 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.966199 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.966863 22857 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 12:13:08.967216 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.922789 29568 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.968170 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.968559 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:08.968995 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.948645 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:08.947970 29666 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:08.951155 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.974370 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:08.892347 29680 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:08.978924 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:08.979856 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.928351 29560 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:08.996982 28716 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:08.999392 22862 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:09.001042 22863 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 26.
I20260709 12:13:09.002432 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:08.989516 22194 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:09.005868 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:09.021458 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:09.021431 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:09.020026 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.976183 29177 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:09.028319 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:08.976063 29664 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:08.993537 29380 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:09.040445 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:09.042455 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:09.029402 28716 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:09.028049 29680 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:09.045403 22191 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:08.985322 29561 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:09.051841 22197 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:13:09.043577 29380 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:09.053350 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:09.054476 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:08.993848 29568 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:09.043210 22267 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:13:09.059666 22191 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:09.061286 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.077847 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:09.066690 29456 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:09.079185 29577 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:09.080107 29456 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:09.080638 29456 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:09.082122 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:09.083194 29577 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:09.083711 29577 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:09.084208 29577 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:09.064612 29380 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:13:09.089359 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49015.5us
I20260709 12:13:09.093003 29177 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:09.093549 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:09.095052 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:09.098022 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:09.101328 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 56295.5us
I20260709 12:13:09.107869 22191 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:09.103739 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:09.115865 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:09.116706 22267 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:13:09.065058 29561 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:09.117926 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:09.118249 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:09.118880 22271 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:09.137130 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:09.146696 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:09.138351 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:09.140408 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:09.151612 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:09.142601 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:09.155371 22264 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:09.155966 22266 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:09.141822 29303 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:09.123525 29234 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 12:13:09.159256 29234 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:09.159723 29234 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:09.137023 29512 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:09.161408 29512 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.164116 29512 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:09.130714 29297 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:09.165866 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:09.166697 22266 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:09.167745 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:09.168995 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:09.119009 29698 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:09.119315 29644 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 12:13:09.095044 29177 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:13:09.173115 29686 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.173622 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:09.113268 29654 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 12:13:09.117126 29257 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.000s
W20260709 12:13:09.181026 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 63214.4us
I20260709 12:13:09.181892 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:09.117601 29324 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.139194 29580 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:09.189002 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:09.237061 29580 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:09.237388 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 48489.9us
I20260709 12:13:09.238174 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:09.238118 29580 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:09.239233 29673 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.004s
I20260709 12:13:09.239979 29673 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.192862 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:09.193933 29568 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:09.241544 29568 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.194975 29561 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.242020 29314 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:09.231094 22265 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:09.242048 29568 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.196560 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:09.193957 29698 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:09.238225 29512 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:09.245474 29512 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:09.245290 29698 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.246467 29512 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.247130 22269 raft_consensus.cc:2368] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21.
I20260709 12:13:09.239236 29580 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:09.185273 29234 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.248706 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:09.249452 29234 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:09.242591 29314 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:09.250422 22265 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:13:09.250885 22265 pending_rounds.cc:85] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 13
I20260709 12:13:09.251135 22265 pending_rounds.cc:107] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:13:09.251390 22265 raft_consensus.cc:2889] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:09.251298 29314 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.198895 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:09.205199 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:09.205956 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:09.206295 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:09.210060 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:09.254011 22263 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:09.254241 22191 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: []
I20260709 12:13:09.255244 22263 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:13:09.181191 29303 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.256816 29535 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:09.212872 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:09.206403 29532 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 12:13:09.218745 29560 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:09.220122 22192 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:09.221083 22267 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:09.221412 29686 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:09.225358 29261 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:09.201923 22266 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:09.257231 29303 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:09.203619 29644 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.271781 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:09.272876 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:09.273563 22271 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:09.274629 22264 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:09.278467 22270 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:09.279320 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 80593.1us
I20260709 12:13:09.229624 29257 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21.
I20260709 12:13:09.281443 28716 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:09.283972 22858 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:09.286067 22265 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:13:09.289033 22267 raft_consensus.cc:1240] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:09.289348 28716 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.310937 28716 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:09.283245 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:09.311631 22270 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:13:09.302806 22196 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:09.314023 22162 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:09.288630 22271 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:13:09.315984 22270 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:09.316581 29257 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:09.321422 22272 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:13:09.319512 29639 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:13:09.335374 29692 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.426s	user 0.003s	sys 0.000s
I20260709 12:13:09.337350 29686 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:13:09.303443 29360 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:09.284235 29624 raft_consensus.cc:2764] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:13:09.316285 29641 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:13:09.345438 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 118158us
W20260709 12:13:09.368549 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 151993us
I20260709 12:13:09.370229 22865 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:13:09.281021 29690 consensus_queue.cc:1059] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:13:09.301136 29589 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:13:09.378494 22194 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:09.312508 29644 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.308367 29456 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.338420 29466 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:09.365171 29324 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:09.302889 22264 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:13:09.338537 29691 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
W20260709 12:13:09.393669 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77478.3us
I20260709 12:13:09.394459 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:09.385905 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 65587.4us
I20260709 12:13:09.390204 28716 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:09.340337 29612 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:13:09.373967 29641 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:09.401954 28716 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:09.403623 22263 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 20. Current term is 21. Ops: []
W20260709 12:13:09.397327 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 191153us
I20260709 12:13:09.408249 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:09.418546 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:09.419212 22863 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:09.427516 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45468.2us
I20260709 12:13:09.432049 22197 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:13:09.459884 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:09.461330 22123 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:09.464023 22863 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:09.466224 22237 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:09.426841 29673 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:09.467815 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:09.401032 29466 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.474813 22114 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:13:09.417596 29257 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:13:09.503126 29456 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:09.537817 29303 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:09.539531 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:09.541071 29589 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:09.478320 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:09.497321 29705 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:09.542229 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:09.542929 29466 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:09.541591 29589 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:09.543932 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.544132 29589 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:09.498879 29644 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:09.506940 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:09.546264 22117 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:09.548346 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:09.549964 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 71730.7us
I20260709 12:13:09.551033 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:09.552386 22191 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:13:09.507974 22266 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:09.476539 29177 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:09.509903 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:09.512531 22195 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:09.513187 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:09.476063 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 83339.2us
I20260709 12:13:09.472736 22163 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:09.561702 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:09.480350 29324 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:13:09.569919 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 99536.1us
I20260709 12:13:09.513976 29380 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:09.570997 22860 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:09.575713 29690 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:09.575881 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:09.578289 29303 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:09.592628 22114 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:09.595714 22123 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:13:09.547595 29560 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:09.598878 22237 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:09.607746 22197 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 23.
W20260709 12:13:09.641572 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 46317.1us
I20260709 12:13:09.608856 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:09.655972 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:09.581786 29705 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:13:09.664098 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 120660us
I20260709 12:13:09.599073 29177 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:13:09.679356 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 128405us
I20260709 12:13:09.662500 29639 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:09.682385 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:09.683784 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:09.593685 29636 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:13:09.561800 29641 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:09.608414 29686 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:13:09.691099 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:09.663789 29705 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:09.714012 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 106313us
I20260709 12:13:09.693761 29532 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:13:09.672924 29560 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:13:09.692086 29678 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:09.696144 29456 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:13:09.742259 29704 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:09.743055 29704 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:09.731626 29678 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:09.744086 29678 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:09.746908 29657 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:09.747527 29657 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:09.734905 29456 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.748947 29456 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:09.748572 29657 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:09.715404 29584 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:09.714566 29705 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:09.741240 29641 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:09.744163 29704 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.809363 29678 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:09.746954 29719 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:13:09.822896 29678 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:09.703858 29324 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:13:09.819911 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:09.824280 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 145199us
I20260709 12:13:09.838587 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:09.846264 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:09.846792 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:09.847859 22123 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:09.848891 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:09.829387 29664 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.823945 29584 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:13:09.856176 29580 consensus_meta.cc:287] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.608s	user 0.016s	sys 0.002s
I20260709 12:13:09.855907 29664 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:09.859110 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:09.861352 29731 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:09.861521 22121 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:13:09.861726 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:09.862063 29731 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.863049 22236 leader_election.cc:400] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:09.863417 22236 leader_election.cc:403] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:09.863292 29739 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:09.863983 29739 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:09.860527 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:09.829931 29177 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.864671 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:09.885596 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 65818.9us
I20260709 12:13:09.887014 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:09.887840 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:09.887969 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:09.846992 29466 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:09.889451 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:09.913741 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:09.913919 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:09.872159 29577 consensus_meta.cc:287] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.008s
I20260709 12:13:09.917193 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:09.864565 29731 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:09.928272 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:09.919894 22191 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:09.923889 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:09.919431 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:09.925295 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:09.931455 22189 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:09.931428 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:09.856067 29722 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:09.930857 22121 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:09.934474 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:09.934914 22863 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:09.914144 29680 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:09.939900 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:09.934568 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:09.916085 29698 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:09.915205 29678 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:09.920410 29532 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:09.919569 29580 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:09.932478 29657 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:09.889424 29735 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:13:09.939970 29715 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:09.963276 29745 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:09.963932 29728 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:13:09.964429 29738 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:09.864969 29739 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:09.842935 29639 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:09.939533 29673 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:09.871089 29584 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:09.927699 29577 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:09.946610 29324 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:09.948074 29736 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.946921 29698 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.955271 29560 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:13:10.014922 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 176484us
I20260709 12:13:09.968669 29680 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:13:10.025214 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.027613 22860 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:10.006204 29657 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:13:10.033712 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 93979.6us
I20260709 12:13:10.006949 29715 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:13:10.034674 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 121138us
I20260709 12:13:10.036921 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.034899 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:10.018139 29698 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:10.025010 29738 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.049520 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:10.051728 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:09.954824 29722 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:10.052508 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.036679 29735 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:10.034533 29257 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:10.054720 29743 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:10.054705 29737 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:10.057739 29753 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:13:10.066159 29577 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.051832 29560 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:13:10.067698 29715 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.058521 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:10.056234 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:10.056314 29680 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:10.052742 29704 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:10.056690 29735 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:10.081712 22190 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:10.054899 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:10.059580 29733 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:13:10.058847 29734 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:13:10.076073 29589 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 12:13:10.024885 29736 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:10.114059 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 59248.9us
I20260709 12:13:10.077194 29743 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:10.059973 29722 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.120792 29735 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.122431 29735 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:10.123876 29734 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:10.118306 29589 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.124542 29734 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:10.125608 29734 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.126672 29589 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.059839 29750 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:13:10.126865 29744 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:13:10.129523 29755 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:13:10.134012 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 75573.5us
I20260709 12:13:10.064599 29580 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:13:10.076875 29560 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:13:10.119736 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:10.077899 29753 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:13:10.076450 29257 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.082818 29673 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:10.141575 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:10.115070 29704 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:10.077706 29737 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:13:10.146112 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:10.152752 22121 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 21: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:10.153308 22236 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:10.157006 22120 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:10.166030 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:10.119099 29680 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:13:10.148712 29360 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:10.158565 29750 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:10.174347 29750 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.190554 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.191471 22266 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 13: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:10.192107 29324 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:10.192322 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.193287 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.193547 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.194586 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.184533 22120 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:13:10.194684 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.195655 22266 raft_consensus.cc:2368] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:10.169180 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:10.199168 22264 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:10.206677 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:10.193944 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.209713 22270 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:13:10.207896 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.213877 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.225790 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.230270 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.167594 29584 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:10.234489 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.235610 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.236521 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:10.172705 29666 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:10.239418 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.196645 29360 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.250075 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.247565 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.250168 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.251154 22264 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 23.
I20260709 12:13:10.252194 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.244577 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:10.254932 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.257099 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.170336 29678 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:13:10.259639 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.260701 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.261552 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2954) took 1333 ms. Trace:
I20260709 12:13:10.262189 29760 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:13:10.265786 29762 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:13:10.258916 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.268602 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.278538 22120 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:13:10.279006 22120 pending_rounds.cc:85] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 14
I20260709 12:13:10.279247 22120 pending_rounds.cc:107] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:13:10.279491 22120 raft_consensus.cc:2889] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:10.241439 29766 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:10.151178 29657 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.210541 29324 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
I20260709 12:13:10.297130 22088 leader_election.cc:400] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19.
I20260709 12:13:10.248909 29666 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:10.303174 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:10.268149 29360 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:10.305190 29767 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:13:10.308846 29324 consensus_queue.cc:1243] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:13:10.273084 29466 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:10.274503 22198 rpcz_store.cc:276] 0709 12:13:08.928589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.933507 (+  4918us) service_pool.cc:224] Handling call
0709 12:13:08.952137 (+ 18630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:09.028803 (+ 76666us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:09.102388 (+ 73585us) log.cc:844] Serialized 14 byte log entry
0709 12:13:09.232858 (+130470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:09.232969 (+   111us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:09.233033 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:10.261299 (+1028266us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b54003b65d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:10.261348 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:10.261492 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":154949,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":33620,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":9821,"spinlock_wait_cycles":127897984,"thread_start_us":193262,"threads_started":2,"wal-append.queue_time_us":133749,"wal-append.run_cpu_time_us":1517,"wal-append.run_wall_time_us":1005449}
I20260709 12:13:10.274324 29758 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:13:10.299726 29737 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:10.322800 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.300565 29642 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.329085 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.295424 29680 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:13:10.335088 29749 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:10.318429 29743 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:10.341678 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.324630 29753 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:10.330052 29466 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:10.299100 29673 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:10.344277 29456 consensus_meta.cc:287] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.005s
I20260709 12:13:10.330808 29736 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.352634 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.343003 29758 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:10.351650 29709 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.886s	user 0.000s	sys 0.004s
I20260709 12:13:10.365621 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:10.349855 29561 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:13:10.347374 29753 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:10.387223 29730 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.462s	user 0.002s	sys 0.000s
I20260709 12:13:10.403789 29765 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:13:10.407473 29757 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:13:10.401446 29698 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.391490 29753 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:10.410116 29674 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:10.374550 29177 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:10.410759 29674 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:10.414151 29674 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.415228 29738 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:10.416085 29674 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:10.381747 22190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3362) took 1500 ms (client timeout 1734 ms). Trace:
I20260709 12:13:10.352694 29666 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.403887 29535 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:13:10.418448 22190 rpcz_store.cc:269] 0709 12:13:08.884988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.893005 (+  8017us) service_pool.cc:224] Handling call
0709 12:13:09.509747 (+616742us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b5800196598. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:13:10.381538 (+871791us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540011ba54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:10.381677 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051797248}
I20260709 12:13:10.418982 29535 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:10.361841 29456 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.375604 29737 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:10.420922 29737 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:10.421247 29456 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:10.421423 29737 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:10.419956 29535 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.423100 29535 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:10.332356 29642 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.424345 22270 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21. Ops: []
W20260709 12:13:10.424239 22269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 3284) took 1385 ms (client timeout 1529 ms). Trace:
I20260709 12:13:10.412855 29177 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:10.427601 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:10.430145 29257 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.431277 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 3263) took 1466 ms. Trace:
W20260709 12:13:10.435531 29705 consensus_meta.cc:287] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.002s
I20260709 12:13:10.398820 29743 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.437538 29711 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.178083 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:10.370662 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.452689 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:10.461201 22269 rpcz_store.cc:269] 0709 12:13:09.039264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.094792 (+ 55528us) service_pool.cc:224] Handling call
0709 12:13:10.423976 (+1329184us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001db5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:10.424147 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348010752}
I20260709 12:13:10.463378 22272 rpcz_store.cc:276] 0709 12:13:08.964956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.969220 (+  4264us) service_pool.cc:224] Handling call
0709 12:13:10.431041 (+1461821us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540026c5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:10.431211 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704564608}
I20260709 12:13:10.469914 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2334) took 1499 ms. Trace:
W20260709 12:13:10.470319 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 99728.1us
I20260709 12:13:10.471978 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.462015 29642 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.474876 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.475486 29753 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.476151 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.476541 29512 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:10.470160 29705 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.477427 29512 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:10.477942 29739 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:10.470471 22267 rpcz_store.cc:276] 0709 12:13:08.967829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.279923 (+312094us) service_pool.cc:224] Handling call
0709 12:13:09.280398 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:09.310359 (+ 29961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:10.466681 (+1156322us) spinlock_profiling.cc:243] Waited 8.44 ms on lock 0x7b54001ad454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:10.466884 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19413888}
I20260709 12:13:10.479378 29705 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:10.480696 29698 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.473450 29750 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:10.482936 29751 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.417s	user 0.001s	sys 0.000s
I20260709 12:13:10.485267 29177 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.486819 29177 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:10.481354 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34878 (request call id 2332) took 1514 ms. Trace:
I20260709 12:13:10.490635 22263 rpcz_store.cc:276] 0709 12:13:08.967312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.256117 (+288805us) service_pool.cc:224] Handling call
0709 12:13:09.256360 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:09.404257 (+147897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:10.481086 (+1076829us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540026b6d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:10.481288 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333235456}
I20260709 12:13:10.477384 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:10.502880 29765 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:10.510514 22120 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:10.512107 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:10.513715 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.518688 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:10.519064 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:10.519554 22115 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:10.521482 22192 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: []
I20260709 12:13:10.525789 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:10.526714 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.540907 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:10.543828 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:10.544538 22190 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:10.472226 29711 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.559296 29360 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.569507 22195 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 19. Current term is 21. Ops: []
I20260709 12:13:10.533334 29680 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:10.585213 22115 raft_consensus.cc:2410] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:13:10.585934 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.593941 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:10.595041 22121 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:10.602077 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:10.603058 22865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 1100) took 1699 ms. Trace:
I20260709 12:13:10.605198 22192 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:13:10.603436 22865 rpcz_store.cc:276] 0709 12:13:08.903795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.904889 (+  1094us) service_pool.cc:224] Handling call
0709 12:13:08.920173 (+ 15284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:09.378528 (+458355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:10.599341 (+1220813us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54005073d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:10.602998 (+  3657us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034149760}
I20260709 12:13:10.630550 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.631541 22267 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:10.646816 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.657444 22121 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:13:10.613924 29680 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:13:10.667364 29532 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.669826 29532 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.670774 22267 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:10.672101 29532 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:10.674350 29657 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.674856 29657 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.675859 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:10.676580 22121 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:10.676909 29678 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.677413 29678 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.677692 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:10.678498 29765 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:10.679080 29765 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:10.679502 29678 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:10.680400 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.683382 22115 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:10.685773 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:10.687678 22123 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:10.688028 22116 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: []
I20260709 12:13:10.619827 29691 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:10.691507 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:10.692448 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.692967 22268 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:10.693871 22267 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:10.694353 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.603590 29760 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:13:10.629519 29753 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.699697 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:10.605127 29456 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:13:10.703228 22116 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 13.
W20260709 12:13:10.691488 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 81654.8us
I20260709 12:13:10.614902 29705 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:13:10.710726 22265 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:10.710942 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.715480 22264 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:13:10.667651 29731 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:10.718202 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.712808 29661 consensus_queue.cc:1059] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:10.712927 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:10.714172 29456 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:10.716132 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.723417 22268 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:10.666321 29684 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:10.711386 22830 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:10.680173 29765 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.710022 29741 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.735198 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:10.736039 22116 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:10.738058 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.710389 29641 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:10.719408 29657 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:10.723125 29456 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:10.772230 22268 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:10.734376 29642 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:10.734275 29535 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.700702 29691 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.741693 29360 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.774358 29753 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.727599 29684 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:10.792764 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.775310 29642 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.833796 29642 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:10.803264 29787 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:10.783528 29535 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.805502 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:10.841624 22120 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:10.806488 29711 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:10.758855 29641 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.846274 29324 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:10.847100 29641 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.846896 29324 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.847278 29691 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.725392 29731 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.850410 29731 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.741019 29741 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.852836 29535 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:10.853771 29684 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.811820 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.825338 29456 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.826680 29568 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:10.827268 29753 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.829160 29770 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:13:10.839924 29742 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.806s	user 0.000s	sys 0.005s
I20260709 12:13:10.782650 29745 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.867192 22120 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:10.853715 29741 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.878863 22266 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 17. (term mismatch)
I20260709 12:13:10.879374 22266 pending_rounds.cc:85] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 16
I20260709 12:13:10.879655 22266 pending_rounds.cc:107] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 20.17
I20260709 12:13:10.879942 22266 raft_consensus.cc:2889] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:10.868122 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 95966.8us
I20260709 12:13:10.892841 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.886875 29745 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:10.904121 29745 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:10.895562 29741 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.905488 29741 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.907863 29741 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:10.910216 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.911474 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.913480 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.914961 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.916354 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.920152 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.925625 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:10.865881 29737 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.961367 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.962148 22268 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:10.965287 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:10.899319 29324 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:10.970676 22267 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:13:10.971613 22267 pending_rounds.cc:85] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 11
I20260709 12:13:10.887892 29684 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:13:10.972229 22267 pending_rounds.cc:107] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:13:10.973505 22123 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:10.977149 22114 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:10.979331 22267 raft_consensus.cc:2889] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:10.927042 29456 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:10.985435 22264 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:13:10.987119 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:10.996083 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.969055 29786 consensus_queue.cc:1059] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.034s
I20260709 12:13:11.007066 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:11.007507 28716 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:13:11.008028 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:11.011297 28716 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:13:11.011744 28716 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:11.014452 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:11.011664 29704 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:13:11.017069 29704 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.017557 29704 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:10.999166 29641 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:11.026818 28716 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:10.995476 29769 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:13:11.041734 28716 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:11.010183 29674 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.025482 29714 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:11.020990 29745 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:13:11.067612 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 138453us
I20260709 12:13:11.028267 29736 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:11.073360 22116 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 23.
I20260709 12:13:11.028318 29360 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.094758 29691 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:11.095854 29691 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:11.097415 29789 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:13:11.088963 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:11.102779 22269 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
W20260709 12:13:11.120386 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 153286us
I20260709 12:13:11.043922 29787 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:13:11.061373 29728 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:13:11.122345 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:11.100868 29691 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.132391 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:11.069154 29674 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.117193 29760 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:11.177713 22271 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:11.127856 29803 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:11.133550 29737 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.086591 29736 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.177325 29753 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.193969 22860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 1208) took 1372 ms. Trace:
I20260709 12:13:11.195000 29805 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:11.196333 29380 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.194649 22860 rpcz_store.cc:276] 0709 12:13:09.821366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.821568 (+   202us) service_pool.cc:224] Handling call
0709 12:13:09.821985 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:10.028642 (+206657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.193644 (+1165002us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400570154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:11.193899 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472347904}
I20260709 12:13:11.197589 29674 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:11.191027 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 68802.2us
I20260709 12:13:11.119381 29360 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.202642 29360 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.203043 29642 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:11.205500 29797 log.cc:927] Time spent T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:13:11.191964 29297 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:13:11.206444 29736 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.207309 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:11.208055 29736 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:11.207358 29297 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:11.208837 29297 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:11.209394 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:11.209846 29297 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.211199 29297 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:11.214279 29794 raft_consensus.cc:3055] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:11.214759 29794 raft_consensus.cc:740] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:11.215525 29684 raft_consensus.cc:3055] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:11.216034 29684 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:11.215768 29794 consensus_queue.cc:260] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.218559 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:11.206473 29642 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.183624 29760 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.252628 29723 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:13:11.268203 29796 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 12:13:11.274948 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 142640us
I20260709 12:13:11.261694 29737 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.188889 29801 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
I20260709 12:13:11.282958 29794 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:11.286185 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.286818 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.289626 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.290398 22198 raft_consensus.cc:2393] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 20: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:11.292912 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.293044 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.294896 22197 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 26.
W20260709 12:13:11.296234 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 95601.2us
I20260709 12:13:11.296471 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:11.301280 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.302178 22196 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:11.304898 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.301957 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:11.258774 29684 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.319576 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:11.326223 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:11.326942 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:11.329411 22189 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.331600 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:11.337447 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:11.287256 29737 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.339651 29684 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:11.326107 29806 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.341753 29806 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.340354 29737 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.344596 29806 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.346851 29760 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:11.347018 22858 raft_consensus.cc:2410] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 27 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 12:13:11.350917 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:11.352072 22858 raft_consensus.cc:2410] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:13:11.318215 29805 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:11.314235 29786 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:13:11.361542 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:11.363992 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.365490 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:11.366405 22271 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:11.367610 22189 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:11.369320 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:11.370152 22264 raft_consensus.cc:3060] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.376351 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:11.384645 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46839.1us
I20260709 12:13:11.371447 29642 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:11.385869 22830 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:11.392748 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.394613 29737 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.386385 29814 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:11.402817 29811 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.427934 22264 raft_consensus.cc:2468] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:11.431954 22831 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:11.392669 29642 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.411664 29786 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:11.477900 29821 raft_consensus.cc:2804] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:11.478710 29821 raft_consensus.cc:697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:13:11.479463 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.484508 22123 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:13:11.408674 29737 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.485112 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.485749 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.486299 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.487078 29737 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.487509 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.488050 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.413923 29814 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.489238 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.490521 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.491703 29814 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.408643 29805 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.486371 22123 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:11.501592 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:11.508448 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.522164 22196 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:13:11.523043 22193 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:11.525318 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 123904us
I20260709 12:13:11.479832 29821 consensus_queue.cc:237] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:11.530776 22118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2844) took 2558 ms (client timeout 1596 ms). Trace:
W20260709 12:13:11.531530 22118 rpcz_store.cc:269] 0709 12:13:08.947478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.947600 (+   122us) service_pool.cc:224] Handling call
0709 12:13:11.505105 (+2557505us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003df9d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:11.505350 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3024133376}
I20260709 12:13:11.533865 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:11.532292 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:11.505776 29723 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.524813 29643 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.521867 29812 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:11.521656 29642 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:11.582705 29661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.004s	sys 0.018s
I20260709 12:13:11.599376 29380 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:11.415254 29811 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:11.598847 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 65065.2us
I20260709 12:13:11.600343 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.602208 29811 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.602625 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:11.603732 29811 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:11.603847 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:11.604962 29714 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:11.605163 29711 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.605480 29714 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:11.604043 28716 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:13:11.599581 29661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.004s	sys 0.018s
I20260709 12:13:11.607681 28716 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:11.605633 29711 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.614253 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:11.614377 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:11.614346 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 182504us
I20260709 12:13:11.616170 28716 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.619813 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.621008 22162 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:11.637557 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:11.636960 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:11.639248 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:11.639488 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3302) took 1445 ms. Trace:
I20260709 12:13:11.607771 29643 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.639513 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:11.639997 22270 rpcz_store.cc:276] 0709 12:13:10.194342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.261675 (+ 67333us) service_pool.cc:224] Handling call
0709 12:13:10.424133 (+162458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:10.460804 (+ 36671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.639276 (+1178472us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54001db5d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:11.639429 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372873472}
I20260709 12:13:11.644083 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:11.636466 29534 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:11.648854 29711 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.649242 29770 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:11.649772 29770 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:11.606914 29723 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.645517 29746 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:11.654515 29643 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.654700 29723 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.656194 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2979) took 1266 ms. Trace:
I20260709 12:13:11.656570 22195 rpcz_store.cc:276] 0709 12:13:10.390140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.390310 (+   170us) service_pool.cc:224] Handling call
0709 12:13:10.402425 (+ 12115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:10.587566 (+185141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.655961 (+1068395us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54002a03d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:11.656133 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363424512}
I20260709 12:13:11.660794 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:11.619747 29698 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:13:11.662603 29746 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:11.663739 22267 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:13:11.672433 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:11.665771 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:11.668025 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:11.632370 29766 consensus_queue.cc:1059] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:13:11.642021 29769 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:11.673106 22267 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:13:11.677963 22863 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:11.678798 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.688225 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:11.688925 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.689586 22190 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 13.
I20260709 12:13:11.689882 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:11.690375 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:11.692354 22121 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:13:11.681308 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.682150 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:11.674533 29704 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.656s	user 0.014s	sys 0.000s
I20260709 12:13:11.684350 22193 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:13:11.667646 29673 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.712308 22123 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:11.712756 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:11.712931 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:11.714673 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:11.716056 22193 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:11.717080 22198 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:11.675521 29803 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:11.723168 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.726871 22121 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:11.727443 22862 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 23 index: 20. (index mismatch)
I20260709 12:13:11.724130 22119 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 12:13:11.728154 22119 pending_rounds.cc:85] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 9
I20260709 12:13:11.728498 22119 pending_rounds.cc:107] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 12:13:11.728868 22119 raft_consensus.cc:2889] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:11.724330 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:11.718309 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:11.738431 22857 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:13:11.736752 22190 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:11.741149 22198 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 23 index: 20. (index mismatch)
I20260709 12:13:11.695103 29380 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:11.747498 22123 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:11.748932 22190 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:11.750473 22121 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 19. Current term is 21. Ops: [19.12-19.12]
I20260709 12:13:11.750582 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.751616 22190 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:11.754947 29822 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:11.756115 29817 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:13:11.747902 29380 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.756711 29810 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:13:11.708565 29761 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:11.757256 29380 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:11.766412 22198 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:11.766076 22858 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:13:11.766233 22195 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:13:11.768193 22119 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:11.767832 22190 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:11.774317 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:11.694886 29739 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 12:13:11.757484 29810 consensus_queue.cc:1243] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:11.718840 29704 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.720021 29673 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.796304 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.802192 22198 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:11.818578 22265 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:13:11.633755 29714 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:11.836966 29832 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 12:13:11.839689 29830 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:13:11.841246 29809 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:13:11.842963 29809 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:11.843803 29809 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:11.844146 29809 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.844477 29809 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:11.849587 22267 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:11.796087 29739 consensus_queue.cc:1243] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 21.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:11.783427 29750 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 12:13:11.853482 22193 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:11.853739 22198 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:13:11.755534 29822 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.757846 29761 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.861223 22860 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:13:11.868243 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:11.855254 29737 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:11.877774 22269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 4280) took 1205 ms. Trace:
I20260709 12:13:11.879979 22269 rpcz_store.cc:276] 0709 12:13:10.672259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.680143 (+  7884us) service_pool.cc:224] Handling call
0709 12:13:11.877480 (+1197337us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b540036bd54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:11.877657 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169687936}
I20260709 12:13:11.886443 22269 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:13:11.875967 29737 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:11.897073 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 122860us
I20260709 12:13:11.900245 29704 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:11.903960 29833 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:13:11.874074 29739 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.023s
I20260709 12:13:11.906450 29737 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.907158 29673 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:11.905231 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:11.908928 29380 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.910243 29750 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.910791 29761 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:11.911000 29834 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:13:11.906405 29822 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.936270 22193 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:11.936092 29750 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.914364 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.937461 22119 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:11.915973 29839 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:11.938681 29750 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:11.939464 29839 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:11.920594 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.920362 29844 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:13:11.920989 29809 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.942695 29380 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:11.943126 29809 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:11.923264 29705 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:11.944018 29705 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:11.944957 29705 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.946164 29705 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:11.928113 29794 consensus_meta.cc:287] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.002s
W20260709 12:13:11.960709 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.968986 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:11.969398 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:11.970315 29698 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:11.970415 22119 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:11.970978 29698 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.971472 29698 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:11.972797 29584 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:11.973248 29584 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:11.974208 29584 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:11.980448 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:11.959581 29770 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:11.985105 22270 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:11.993225 22119 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 23.
W20260709 12:13:11.984426 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 206387us
I20260709 12:13:11.997553 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:11.981796 22123 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:12.001024 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:12.002619 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:12.002794 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.003468 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:12.003830 29746 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:12.000722 22237 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:12.011533 29686 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:12.009392 29843 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:13:12.013767 29843 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.014211 29843 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:12.020445 29177 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:12.021106 29177 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:12.024590 29664 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:12.025015 29686 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.025645 29686 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:12.030126 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:12.031106 22860 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:12.012012 29746 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:12.033118 29568 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:12.033389 29746 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.033823 29568 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.034473 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:12.035283 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:12.036315 29568 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:12.022219 29177 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.038311 29177 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:12.041210 29731 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:12.041728 29731 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:12.042747 29731 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.044163 29731 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:12.048000 29698 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.012786 29846 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:12.051455 29846 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:12.052809 29846 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:12.057508 29820 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.595s	user 0.001s	sys 0.001s
I20260709 12:13:12.061311 29723 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:12.062139 29769 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:12.061998 29723 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.062711 29769 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.064921 29723 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:12.066339 29824 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.427s	user 0.000s	sys 0.000s
I20260709 12:13:12.066532 29843 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.070525 29568 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:12.072572 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:12.073674 29726 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:12.074388 22087 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:12.081158 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.082167 22269 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:12.083353 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:11.989387 29770 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:12.085935 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:12.090374 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.090858 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:12.091428 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:12.091687 22116 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:12.073764 29818 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.598s	user 0.002s	sys 0.002s
W20260709 12:13:12.094966 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.086434 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.088552 29750 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:12.098840 22118 raft_consensus.cc:2393] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 17: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:12.100198 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.102041 22265 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:13:12.074519 29726 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:13:12.065012 29769 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:12.100847 22268 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:12.109808 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 3991) took 1427 ms. Trace:
I20260709 12:13:12.110332 22114 rpcz_store.cc:276] 0709 12:13:10.682383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.682495 (+   112us) service_pool.cc:224] Handling call
0709 12:13:10.682778 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:10.979724 (+296946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.109539 (+1129815us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54002544d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:12.109724 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676567424}
I20260709 12:13:12.098115 29698 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:12.125052 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 211635us
I20260709 12:13:12.126417 22087 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:12.085266 29686 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.089337 29691 consensus_queue.cc:1059] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:13:12.128625 29568 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:12.140152 29726 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:12.140574 29568 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:12.141706 29568 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.142247 29845 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:12.129900 29769 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:13:12.105997 29841 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:13:12.136559 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:12.133867 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:12.143293 29568 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:12.145406 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3310) took 1612 ms. Trace:
I20260709 12:13:12.145447 22196 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:12.147557 22264 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:13:12.137921 22116 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 23.
I20260709 12:13:12.151427 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:12.107165 29761 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:13:12.145957 22263 rpcz_store.cc:276] 0709 12:13:10.532632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.532803 (+   171us) service_pool.cc:224] Handling call
0709 12:13:10.533116 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:10.543207 (+ 10091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:10.543254 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:10.553847 (+ 10593us) log.cc:844] Serialized 26 byte log entry
0709 12:13:11.346216 (+792369us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b18002fc4a0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:13:11.385539 (+ 39323us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:11.385602 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.385708 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:12.073059 (+687351us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:12.145142 (+ 72083us) raft_consensus.cc:1685] finished
0709 12:13:12.145189 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:12.145340 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2494,"raft.queue_time_us":21337,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":16596,"spinlock_wait_cycles":143486464,"thread_start_us":39043,"threads_started":1,"wal-append.queue_time_us":858339}
I20260709 12:13:12.109262 29750 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.041s
I20260709 12:13:12.129952 29666 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:12.144279 29769 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:13:12.219605 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.141731 29726 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:12.287900 22193 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:12.180230 29766 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.237838 29580 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:12.301625 29580 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.302317 29303 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:12.303022 29303 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.233807 29380 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.303977 29580 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:12.305706 29303 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:12.289251 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.234133 29639 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:12.242802 29761 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:12.235389 29769 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:12.330858 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.189950 29843 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:12.194442 29714 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:12.332145 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.290501 29726 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.296543 29847 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:12.335812 29639 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.376559 29847 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.185981 29841 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 12:13:12.333734 29580 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:12.343380 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:12.379477 29580 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:12.336684 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.380707 29580 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.381217 29705 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:12.381181 29847 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:12.382372 29580 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:12.313637 29766 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.321331 29380 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.389586 22272 raft_consensus.cc:1217] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-16.10]   Dedup: 11.7->[12.8-16.10]
I20260709 12:13:12.390115 22272 pending_rounds.cc:85] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 7
I20260709 12:13:12.390437 22272 pending_rounds.cc:107] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:13:12.390870 22272 raft_consensus.cc:2889] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:12.393716 29821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.013s	sys 0.019s
I20260709 12:13:12.398627 22267 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:12.333377 29324 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:13:12.403241 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 257418us
W20260709 12:13:12.405478 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 272904us
W20260709 12:13:12.405447 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 309418us
I20260709 12:13:12.390163 29726 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:12.318331 29261 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 12:13:12.408450 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:12.396835 29821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.013s	sys 0.019s
W20260709 12:13:12.418186 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.401752 29750 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:12.434038 29843 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:13:12.449990 29303 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:12.451186 29843 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:12.458832 29760 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:12.459501 29760 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:12.462124 29848 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:13:12.464828 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:12.466248 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:12.466779 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:12.394923 29841 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:12.396718 29714 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:12.438158 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:12.445649 29819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.018s	sys 0.000s
I20260709 12:13:12.335647 29761 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.443994 29731 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:12.473027 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.416061 29177 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:13:12.447098 29639 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:12.477926 29819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.020s	sys 0.000s
I20260709 12:13:12.411870 29324 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.478237 29812 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:12.513471 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.471428 29843 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:13:12.517670 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:12.518539 22271 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:12.460476 29760 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.474601 29661 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:13:12.474397 29841 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.466040 29750 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.494810 29839 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:13:12.502661 29846 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:12.516409 29812 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:12.540972 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:12.541751 29851 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:13:12.542215 29827 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.894s	user 0.001s	sys 0.001s
I20260709 12:13:12.543663 22865 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56950 (request call id 1048) took 1207 ms. Trace:
I20260709 12:13:12.522106 29360 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.544670 29360 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.550396 22189 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:13:12.545993 29714 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.554011 29841 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:12.546145 29380 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:12.557657 29324 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:12.467842 29769 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.565697 29769 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:12.568905 29812 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:12.573709 29839 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:12.574307 29839 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:13:12.574792 29825 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.856s	user 0.000s	sys 0.011s
I20260709 12:13:12.575474 29839 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.578863 29686 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:12.587311 29584 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:12.496263 29731 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.527783 29661 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:12.544054 22865 rpcz_store.cc:276] 0709 12:13:11.336368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.336554 (+   186us) service_pool.cc:224] Handling call
0709 12:13:11.338332 (+  1778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:11.398690 (+ 60358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:11.398725 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:11.403389 (+  4664us) log.cc:844] Serialized 26 byte log entry
0709 12:13:11.614713 (+211324us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:11.614750 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.614813 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:12.511882 (+897069us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:12.543326 (+ 31444us) raft_consensus.cc:1685] finished
0709 12:13:12.543348 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:12.543595 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16369,"raft.queue_time_us":26109,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8071,"spinlock_wait_cycles":31994624,"thread_start_us":245011,"threads_started":2,"wal-append.queue_time_us":234885}
W20260709 12:13:12.624703 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 216317us
I20260709 12:13:12.628088 29861 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:12.628943 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:12.595292 29839 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:12.621470 29661 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:12.638443 22865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863b392474d94720808349fe27669b5b"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:13:12.639324 22865 raft_consensus.cc:606] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:12.640802 29802 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.638013 29661 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:12.642879 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:12.643049 29831 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.780s	user 0.000s	sys 0.002s
I20260709 12:13:12.658885 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:12.632185 29861 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:12.663026 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:12.636624 29801 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:12.649600 22271 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:13:12.590404 29846 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.645080 29661 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.673043 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:12.685709 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56966 (request call id 1108) took 1004 ms. Trace:
W20260709 12:13:12.596467 29770 consensus_queue.cc:1175] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" responder_term: 21 status { last_received { term: 19 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:12.691541 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:12.686134 22858 rpcz_store.cc:276] 0709 12:13:11.674715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.674985 (+   270us) service_pool.cc:224] Handling call
0709 12:13:11.709455 (+ 34470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:11.767216 (+ 57761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.670166 (+902950us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b54004d3854. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:12.679502 (+  9336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129471232}
I20260709 12:13:12.698701 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:12.666947 29746 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:12.676450 29686 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:12.700464 29686 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.680533 29723 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:12.701488 29723 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.702850 29686 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:12.703529 29723 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:12.683845 29657 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.706001 29862 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:12.705889 29657 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.706739 29846 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:12.644573 29802 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.700388 29746 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:12.711694 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 261672us
I20260709 12:13:12.672297 29801 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:12.682658 29261 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:12.683386 29847 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.708727 29821 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:12.726956 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:12.727679 29847 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.732079 29684 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:12.749545 29684 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:12.750041 29684 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:12.757931 29731 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:12.759758 29756 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:12.760584 29756 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.764016 22269 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:12.710443 29854 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:12.742473 22858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:13:12.774313 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:12.737366 29664 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:12.743162 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:12.741411 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:13:12.777383 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 47999us
I20260709 12:13:12.778993 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:12.782897 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:12.787509 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2985) took 1280 ms. Trace:
I20260709 12:13:12.706843 29862 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.784880 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:12.773625 29821 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.794631 22194 rpcz_store.cc:276] 0709 12:13:11.507208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.507351 (+   143us) service_pool.cc:224] Handling call
0709 12:13:11.507691 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:11.524891 (+ 17200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:11.524927 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:11.531819 (+  6892us) log.cc:844] Serialized 26 byte log entry
0709 12:13:11.643451 (+111632us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:13:11.643509 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.643707 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:12.642397 (+998690us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:12.769787 (+127390us) raft_consensus.cc:1685] finished
0709 12:13:12.769820 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:12.787424 (+ 17604us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34629,"raft.queue_time_us":16888,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":3313,"spinlock_wait_cycles":9695616,"thread_start_us":29434,"threads_started":1,"wal-append.queue_time_us":185815}
W20260709 12:13:12.840018 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 61131.9us
I20260709 12:13:12.840989 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:12.842182 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 57441.2us
I20260709 12:13:12.729247 29754 consensus_queue.cc:1059] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:13:12.770823 29854 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:12.783605 29664 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.854377 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:12.855441 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:12.873212 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.873999 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.883594 22266 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:12.874643 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:12.884572 22263 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.795986 29723 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:12.740772 29812 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:12.793247 29731 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:12.905197 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:12.908906 22119 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 13.
I20260709 12:13:12.909766 22114 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:12.803297 29787 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:12.915167 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:12.915956 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:12.852253 29769 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:12.919260 22196 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:12.911257 29723 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.918561 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:12.925029 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.925601 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 2991) took 1414 ms. Trace:
W20260709 12:13:12.926488 29858 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:13:12.929729 29819 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:12.931263 22196 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:13:12.926017 22189 rpcz_store.cc:276] 0709 12:13:11.510947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.516365 (+  5418us) service_pool.cc:224] Handling call
0709 12:13:11.534039 (+ 17674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:12.550790 (+1016751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.925357 (+374567us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400109ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:12.925543 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336548608}
W20260709 12:13:12.905490 29710 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.416s	user 0.012s	sys 0.022s
I20260709 12:13:12.886690 29664 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:12.881055 29854 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:12.908882 29847 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:12.937469 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:12.936561 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:12.942128 22263 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 23.
W20260709 12:13:12.933272 29710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.443s	user 0.013s	sys 0.022s
I20260709 12:13:12.951738 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:12.941687 22114 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:13:12.958143 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:12.958850 22263 raft_consensus.cc:2376] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20. Re-sending same reply.
I20260709 12:13:12.960407 22263 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 12:13:12.960913 22263 pending_rounds.cc:85] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 13
I20260709 12:13:12.961263 22263 pending_rounds.cc:107] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 12:13:12.961606 22263 raft_consensus.cc:2889] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:12.963266 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:12.969801 22265 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:12.970185 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.971276 22269 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 19: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:12.975867 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:12.887519 29821 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:12.925805 29723 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:12.984874 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:12.934195 29761 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:12.990257 22269 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:13:13.014302 22270 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:13.014964 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.016011 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:13.016317 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 46361.1us
I20260709 12:13:12.935693 29869 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.994205 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.019174 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:12.992920 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.023397 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.024317 22860 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:13:13.025352 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.029426 22862 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:13.033586 22114 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:12.933300 29726 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.042704 29761 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.043577 22088 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:12.985863 29867 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:13.068526 22265 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:13:13.065481 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48159.3us
I20260709 12:13:13.023674 29710 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:13:13.074515 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:13.077521 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.084888 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:13.032816 29802 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.052042 29512 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:13.121901 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 52045.7us
I20260709 12:13:13.108235 22163 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:13.095584 22123 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 21: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:13.113049 29746 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.076825 29380 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.117640 29684 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.073810 29710 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:13.082985 29314 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:13.074321 29722 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:13:13.118954 29866 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:13.121385 29857 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:13:13.123358 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:13.028905 29869 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.131754 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.133412 22114 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:13:13.103521 29861 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 12:13:13.137360 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 283082us
I20260709 12:13:13.156380 22863 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:13.137390 29746 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:13.073037 29761 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.122308 29512 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.154172 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.137233 29314 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:13.139271 29722 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:13.198889 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.199827 22193 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:13.075165 29867 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.165942 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.137189 29380 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.214226 29867 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.214337 29380 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.214986 22197 raft_consensus.cc:1275] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:13.202694 29722 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:13.107084 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:13.216404 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 109403us
I20260709 12:13:13.197675 29314 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.218864 22859 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:13.219465 29869 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.220117 29869 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:13:13.220384 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.221029 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.222096 29723 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:13.222663 29723 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.165975 29864 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:13:13.215682 29661 consensus_meta.cc:287] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.011s
I20260709 12:13:13.208403 22193 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 12:13:13.223570 29864 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.257357 29864 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:13.258715 29723 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:13.260273 29874 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:13:13.263700 29819 raft_consensus.cc:993] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: : Instructing follower ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:13:13.265532 29819 raft_consensus.cc:1081] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Signalling peer ea51e825f0ab4ea2bb6c4d0e29709ca3 to start an election
I20260709 12:13:13.273980 29726 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.230461 29812 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:13.230641 29380 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:13.277595 29839 consensus_meta.cc:287] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.631s	user 0.018s	sys 0.005s
I20260709 12:13:13.278317 29746 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:13.278882 29746 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.284101 29657 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:13.284461 29261 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.003s
I20260709 12:13:13.278007 29380 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.201963 29754 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:13.220544 29869 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:13.232106 29862 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.298658 29746 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.210381 29710 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.297102 29261 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:13.298000 29754 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.292605 29664 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.343585 29821 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.361852 29710 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:13.301378 29854 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.384142 29380 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.384290 29737 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:13.385228 29512 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.386917 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.387303 29722 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.388679 29843 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:13.389248 29843 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.391369 29843 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.393911 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:13.394598 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.395143 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:13.394603 22116 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:13.395788 22121 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:13.399578 22121 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:13:13.401262 22121 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:13.404253 22860 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:13.409600 29754 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.410892 29839 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.411406 29839 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:13.412423 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.413516 29839 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.417162 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:13.420917 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:13.435104 22121 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:13:13.397270 29722 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.441311 22116 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:13.372373 29314 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.441847 22830 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:13.447315 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.452625 22117 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:13.454538 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:13.455190 22857 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:13.451237 22865 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:13.371995 29869 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.466995 28716 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:13.467083 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.468719 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:13.467844 28716 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.471292 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.425681 29810 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:13.474655 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.471513 22162 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:13.477576 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:13.481499 22190 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:13.483764 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:13.487350 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:13.489725 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:13.491997 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.455621 29881 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:13.529564 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:13.532189 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.529093 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.536059 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:13.457870 29754 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:13.500154 28716 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.547299 28716 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:13.595770 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:13.596871 22117 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:13:13.479923 29761 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:13.530998 29885 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:13:13.601397 22190 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:13:13.492933 29722 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:13.486616 29643 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:13.537714 29512 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.625228 22865 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 27 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:13.485927 29871 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.133s
I20260709 12:13:13.484073 29303 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:13.492504 29746 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.134s
I20260709 12:13:13.597723 29839 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:13.643610 28716 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:13.649719 28716 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.486944 29810 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.638211 29303 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:13.540608 29731 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 12:13:13.628640 29664 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.633961 29643 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:13.658566 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 120256us
I20260709 12:13:13.630487 29261 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:13.641592 29787 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:13:13.665921 29880 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 12:13:13.603945 29754 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.654100 29303 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:13.633630 29722 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.661509 28716 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.676723 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:13:13.677556 29888 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 12:13:13.678130 29886 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
W20260709 12:13:13.678835 29889 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:13:13.679714 29891 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:13:13.685343 29868 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.685527 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.717657 22190 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:13.692557 22237 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:13.719038 22237 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:13.693177 29749 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:13.695006 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.698526 22087 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:13.666805 29643 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:13.704017 22864 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 14.
I20260709 12:13:13.644570 29512 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.655718 29839 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.725574 22087 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:13.673735 29787 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.711079 29770 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:13.671373 29261 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.745195 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:13.755666 22192 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 12:13:13.725310 29657 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:13.725090 29812 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:13.764607 29787 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:13.764926 29657 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.765501 29657 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:13.722163 29881 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:13:13.728183 29843 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:13.746299 29761 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:13.749632 29314 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.784289 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.788435 22192 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:13.720541 29868 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.794684 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.795652 22192 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:13:13.769357 29812 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.799676 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.800335 22192 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:13.761193 29893 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:13.807377 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 111188us
I20260709 12:13:13.821002 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:13.822023 22198 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:13:13.822891 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:13.782243 29854 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.761919 29902 consensus_queue.cc:1048] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:13:13.750069 29770 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.771087 29726 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:13:13.831837 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:13.801987 29812 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:13.837582 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 109187us
I20260709 12:13:13.827929 29749 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:13.838713 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:13.838925 29749 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.858587 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:13.859361 22265 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:13.836948 29360 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.841507 29810 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.871238 28716 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.844794 29813 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:13.871810 28716 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.834841 29901 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
W20260709 12:13:13.871659 29864 consensus_meta.cc:287] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.614s	user 0.013s	sys 0.000s
I20260709 12:13:13.872474 29787 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:13:13.895582 29512 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.896813 29766 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:13.877836 29813 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.905362 29813 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:13.887205 29898 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:13:13.911173 29722 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.912710 28716 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.915695 29770 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:13.918192 29684 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 27 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:13.922441 29756 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:13.923444 29756 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.924130 29756 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:13.927240 29756 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:13.928476 29737 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.002s
W20260709 12:13:13.924880 29900 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:13:13.946302 22119 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:13:13.953018 22119 pending_rounds.cc:85] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 15
I20260709 12:13:13.953384 22119 pending_rounds.cc:107] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:13:13.953701 22119 raft_consensus.cc:2889] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:13.955185 29743 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.955699 29743 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.949169 29770 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:13.959008 29770 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:13.960206 29710 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.005s
I20260709 12:13:13.966133 29801 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.967780 29801 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:13.971258 29868 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.971426 29303 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.975052 29750 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.975785 29303 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:13.988179 29887 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
I20260709 12:13:14.001530 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:14.002381 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:14.003127 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:14.004113 22191 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:14.004835 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:14.012571 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:14.037122 22122 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
I20260709 12:13:14.013738 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:14.047250 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:14.048049 22121 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:14.067900 22123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 4028) took 1606 ms. Trace:
I20260709 12:13:14.072158 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2894) took 1124 ms. Trace:
I20260709 12:13:14.073071 22119 rpcz_store.cc:276] 0709 12:13:12.947857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.948682 (+   825us) service_pool.cc:224] Handling call
0709 12:13:12.992864 (+ 44182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:13.954178 (+961314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:14.071778 (+117600us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54003df9d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:14.072068 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2191508224}
I20260709 12:13:14.068073 22118 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 12:13:14.024158 22265 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:14.082659 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:14.083436 22117 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:13:13.929792 29754 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:13.932063 29532 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:14.068506 22123 rpcz_store.cc:276] 0709 12:13:12.461424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.466523 (+  5099us) service_pool.cc:224] Handling call
0709 12:13:14.067587 (+1601064us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54002adfd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:14.067829 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417257216}
I20260709 12:13:13.947919 29864 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:13.929224 29643 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:14.162118 29909 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.061082 29657 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:14.230794 29624 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.262070 29624 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:14.264312 29624 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:14.245325 29766 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:14.274494 29766 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.275676 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2885) took 1540 ms. Trace:
I20260709 12:13:14.277287 29726 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:14.278142 29726 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.276202 22118 rpcz_store.cc:276] 0709 12:13:12.735039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.736443 (+  1404us) service_pool.cc:224] Handling call
0709 12:13:14.067787 (+1331344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:14.074987 (+  7200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:14.275440 (+200453us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54002adfd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:14.275604 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3060748160}
I20260709 12:13:14.281397 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3402) took 1346 ms. Trace:
I20260709 12:13:14.285516 22193 raft_consensus.cc:2368] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:13:14.236097 29913 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:14.282013 22194 rpcz_store.cc:276] 0709 12:13:12.935455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.935587 (+   132us) service_pool.cc:224] Handling call
0709 12:13:12.938378 (+  2791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:12.939848 (+  1470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:12.939891 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:12.940613 (+   722us) log.cc:844] Serialized 26 byte log entry
0709 12:13:13.364177 (+423564us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:13:13.364224 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.364305 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:13.921060 (+556755us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b48000ce358. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf2cebaa1 00007fccf2ce2b37 00007fccf2ce29ca 00007fccf2dda26f 00007fccf2dd9f37 00007fccf2dee55c 00007fccf2dee508 00007fccf2dee488 00007fccf2dee443 00007fccf2ded6ec 00007fccf1d17a96
0709 12:13:13.987402 (+ 66342us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:14.281058 (+293656us) raft_consensus.cc:1685] finished
0709 12:13:14.281091 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:14.281301 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":977,"raft.queue_time_us":1886,"raft.run_cpu_time_us":4200,"raft.run_wall_time_us":955862,"spinlock_wait_cycles":35693824,"thread_start_us":331585,"threads_started":1,"wal-append.queue_time_us":461962}
I20260709 12:13:14.242561 29261 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:14.323429 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.250519 29770 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:14.231225 29532 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.381161 22268 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:14.482329 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:14.493731 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 1.36058e+06us
I20260709 12:13:14.494601 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:14.501195 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:14.315260 29661 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.315614 29767 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:14.326617 29917 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:14.404634 29766 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:14.427466 29303 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:14.481781 29739 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.524116 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:14.518688 29639 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:14.257575 29909 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.332051 29624 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:14.522603 29754 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:14.382222 29813 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:14.336112 29913 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:14.552964 29750 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:14.529157 29917 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.553514 29657 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:14.553612 29750 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.536480 29624 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.555745 29917 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:14.556524 29624 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:14.532472 29904 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:14.524454 29661 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.533342 29766 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:13:14.527662 29767 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.532302 29303 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:14.570218 22266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.023s	sys 0.021s
W20260709 12:13:14.570611 22266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.023s	sys 0.021s
I20260709 12:13:14.533154 29739 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.560431 29726 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:14.580672 29909 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:14.559806 29904 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:14.563210 29918 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:14.564267 29750 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:14.568238 29643 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:14.571300 29864 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:14.610743 29303 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:14.614557 29739 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:14.621570 29532 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:14.624847 29913 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:14.625176 29661 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:14.630326 29813 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:14.633510 29767 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:14.587330 29904 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:14.648651 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:14.662102 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:14.665180 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:14.654263 29882 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.657037 29902 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.660522 29813 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.661510 29684 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:14.706638 29749 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:14.711922 29839 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:14.719532 22088 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:14.717170 29760 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:13:14.732959 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 236207us
I20260709 12:13:14.721580 29739 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 17, Time since last communication: 0.004s
I20260709 12:13:14.701476 29882 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:14.718089 29684 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:14.756067 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:14.754662 22263 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 12:13:14.768097 22263 pending_rounds.cc:85] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 14
I20260709 12:13:14.768373 22263 pending_rounds.cc:107] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:13:14.702874 29902 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:14.768611 22263 raft_consensus.cc:2889] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:14.716509 29813 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:14.755878 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:14.774621 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:14.747228 29698 raft_consensus.cc:3055] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:14.772032 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:14.773176 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:14.773319 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:14.728219 29750 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:13:14.770427 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:14.782337 22265 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:13:14.776726 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:14.779606 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:14.782876 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:14.781132 22271 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
W20260709 12:13:14.781543 22196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.000s	sys 0.033s
W20260709 12:13:14.783818 22196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.001s	sys 0.033s
I20260709 12:13:14.783041 22269 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 23.
I20260709 12:13:14.780651 22263 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:14.765259 29686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.008s	sys 0.010s
I20260709 12:13:14.765726 29639 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.789646 22863 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:14.791692 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:14.795861 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:14.798686 22163 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:14.800400 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:14.802157 22267 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:13:14.746870 29867 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:13:14.780222 29698 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:14.790817 29812 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.943s	user 0.015s	sys 0.000s
I20260709 12:13:14.748719 29760 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.784090 29754 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:14.811724 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:14.814463 22263 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:14.749485 29839 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:13:14.789251 29303 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:14.835242 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:14.830161 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:14.839915 22265 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:14.792508 29750 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:14.800300 29922 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:14.800376 29767 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:13:14.865207 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:14.874281 22115 raft_consensus.cc:2410] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
W20260709 12:13:14.875176 22088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.608s (SENT) [suppressed 23 similar messages]
I20260709 12:13:14.877507 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:14.852806 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:14.869280 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:14.869607 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:14.851362 29754 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:13:14.878984 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48961.4us
I20260709 12:13:14.879554 22194 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:13:14.881371 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:14.883095 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:14.841075 29739 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:14.879629 22123 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:13:14.895493 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:14.900288 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:14.890220 29754 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:14.877890 29731 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:14.903438 29177 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:14.838779 29812 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:14.903915 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:14.904217 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:14.904798 22189 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:14.902876 29750 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:14.906607 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:14.878950 29801 consensus_meta.cc:287] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.911s	user 0.016s	sys 0.000s
W20260709 12:13:14.916489 29926 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:13:14.872516 29726 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.802842 29639 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.919536 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:14.920204 22194 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:14.918622 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:14.922947 22858 raft_consensus.cc:606] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:14.923484 22858 raft_consensus.cc:614] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:14.924438 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3412) took 1456 ms. Trace:
I20260709 12:13:14.924891 22193 rpcz_store.cc:276] 0709 12:13:13.467809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:13.483473 (+ 15664us) service_pool.cc:224] Handling call
0709 12:13:14.924227 (+1440754us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b5400179154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:14.924374 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1841801088}
I20260709 12:13:14.888857 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:14.892390 29756 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:14.892057 29927 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:14.873610 29933 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:14.928076 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:14.951030 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 79362us
I20260709 12:13:14.950699 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:14.921906 29812 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:14.928246 29925 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:13:14.906018 29380 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:14.899241 29739 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:14.907596 29839 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:14.903918 29177 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:14.966578 22197 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:14.967603 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:14.907382 29928 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:13:14.933509 29756 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:14.922596 29303 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:13:14.949332 29923 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:13:14.984248 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77753.6us
I20260709 12:13:14.927350 29726 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:14.961586 29801 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:13:14.977164 29924 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:13:14.975446 29917 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:14.998651 29743 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:15.010808 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:14.952387 29749 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:13:14.980021 29866 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
W20260709 12:13:15.104127 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 228961us
I20260709 12:13:14.921821 29698 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.095108 29917 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:15.110116 22119 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 24.
I20260709 12:13:15.005527 29177 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:15.004396 29882 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.078038 29767 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:13:15.115020 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 104369us
I20260709 12:13:15.158320 22271 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:13:15.159600 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.095651 29936 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:15.011229 29684 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:15.155115 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 178330us
I20260709 12:13:15.105427 29731 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:15.160681 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:15.170975 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 169764us
I20260709 12:13:15.176232 22863 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:15.181316 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:15.116806 29917 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.182036 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:15.189132 22863 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:15.186101 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.095633 29801 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.114236 29380 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:15.095872 29657 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.065s
I20260709 12:13:15.154398 29902 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.163498 29940 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:15.077350 29933 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.093s
I20260709 12:13:15.155633 29767 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.157496 29661 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:15.202844 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.168654 29866 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:15.193742 22267 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:15.197474 29760 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.230326 29869 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:15.232748 29869 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.235278 29869 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:15.240890 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.255124 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:15.180801 29936 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.258129 22272 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:13:15.228159 29767 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:15.226438 29661 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.159327 29756 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.226661 29866 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:15.269423 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 268919us
I20260709 12:13:15.275293 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.278577 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.239923 29946 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.164090 29739 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.282173 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.301640 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45120 (request call id 75) took 2539 ms. Trace:
I20260709 12:13:15.224867 29940 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.306272 22858 rpcz_store.cc:276] 0709 12:13:12.741978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.742238 (+   260us) service_pool.cc:224] Handling call
0709 12:13:15.280913 (+2538675us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54006b0154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddbc853 00007fccf2d8a60a 00007fccec3107d4 00007fccec310762 00007fccec310691 00007fccec31060c 00007fccec30f8c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:15.281106 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4945691904}
I20260709 12:13:15.308449 29940 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.311345 29801 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.313014 22858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:13:15.313848 22858 raft_consensus.cc:606] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:15.314253 22858 raft_consensus.cc:614] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:15.322865 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 150771us
W20260709 12:13:15.277087 29932 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 12:13:15.277315 29639 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.272943 29661 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:15.355295 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.369989 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:15.371052 22858 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:15.301667 29839 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:13:15.273356 29731 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:15.380287 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 215824us
I20260709 12:13:15.408453 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:15.372591 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.353178 29749 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:15.357421 29937 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.346s	user 0.000s	sys 0.002s
I20260709 12:13:15.425105 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.373270 29760 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:15.393090 29726 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.352278 29946 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.440677 29177 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.431506 29861 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:15.424579 29948 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.398660 29953 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:13:15.441622 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 69141.4us
I20260709 12:13:15.442060 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.437814 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:15.368222 29866 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.439237 29760 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.447505 29177 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:15.436950 29936 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.436020 29684 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 12:13:15.459640 29923 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:15.456696 29953 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.469264 29866 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:15.470916 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.473356 22087 leader_election.cc:400] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:13:15.474460 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.477795 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:15.446703 29845 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:15.431592 29749 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.447937 29861 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:15.485178 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:15.488420 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.471349 29760 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:15.446466 29966 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:15.490770 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.493037 22864 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 27 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:15.494447 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.478964 22118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "863b392474d94720808349fe27669b5b"
dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:38186
I20260709 12:13:15.497444 22118 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.497800 22118 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:15.478143 29841 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:15.499277 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.502216 22114 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:15.503304 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.488466 29861 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:15.488981 29963 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:15.504594 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.481375 29845 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:15.507826 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.478417 29767 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.513294 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.515273 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.515901 22120 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:15.515967 22122 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:15.453042 29948 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.491070 29862 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:15.523121 29862 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:15.523677 29862 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:15.517153 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.526115 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.527333 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.515921 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.493291 29966 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:15.528329 29904 consensus_meta.cc:287] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.886s	user 0.015s	sys 0.000s
I20260709 12:13:15.506121 29964 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
W20260709 12:13:15.529000 29962 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:13:15.529526 29964 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:15.529961 29964 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:15.530879 29964 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.532531 29964 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:15.534107 29946 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.535225 29953 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.541132 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.548591 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.550325 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:15.551676 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.553507 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.554596 29913 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:15.554960 29913 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:15.555312 29913 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:15.548151 22118 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.558800 22118 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:15.559983 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.561121 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:15.561671 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.562548 22117 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:15.563838 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.561666 22118 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:15.501894 29841 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.527681 29767 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:15.528272 29966 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:15.514401 29845 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:15.522233 29749 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:15.574697 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.521757 29948 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:15.509550 29963 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:15.595564 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.596985 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.597958 22265 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:15.601094 29177 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:15.601588 29177 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.601962 29177 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:15.593429 22118 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:15.583633 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:15.606370 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:15.617775 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:15.617942 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:15.620800 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:15.621619 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:15.507287 29917 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.583788 29841 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:15.645439 29980 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:15.646049 29980 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.647364 29177 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.648203 29980 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:15.652030 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.652542 22267 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 24: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:15.615851 29680 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:15.649426 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.529008 29904 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.600474 29963 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:15.621260 29869 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:15.655790 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.623919 29750 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:15.588177 29961 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 12:13:15.624003 29953 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:15.625861 29949 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:15.672334 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:15.673355 22268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 2373) took 1841 ms (client timeout 2012 ms). Trace:
W20260709 12:13:15.677261 22268 rpcz_store.cc:269] 0709 12:13:13.831510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:13.831609 (+    99us) service_pool.cc:224] Handling call
0709 12:13:15.673123 (+1841514us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54001ad454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:15.673288 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255228160}
I20260709 12:13:15.678493 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:15.678756 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:15.674278 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.674554 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.642123 29902 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:15.679680 22864 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:15.680365 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:15.681667 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.648751 29980 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:15.657673 29680 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:15.684710 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.705390 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.686096 22859 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 20: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:15.685915 22265 raft_consensus.cc:2393] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:15.708943 22858 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:13:15.706099 22270 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 11.
I20260709 12:13:15.689582 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:15.711596 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 93730.7us
I20260709 12:13:15.711709 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.713768 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:15.671568 29726 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:15.714231 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.714398 22864 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:15.714766 22864 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:15.716223 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.718401 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.676236 29936 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:15.719414 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:15.718567 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.721411 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.715531 22864 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.722772 22864 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:15.702360 29973 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:15.753875 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.754331 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.754550 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.683180 29869 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:15.755625 22121 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:15.757360 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:15.710371 29680 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:15.757838 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:15.768889 22860 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:15.770362 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:15.761612 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.771917 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:15.774013 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:15.777148 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.762344 22858 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:13:15.778298 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.724465 29726 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.785743 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.763273 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.787019 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:15.787299 22270 raft_consensus.cc:2393] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:15.787784 22268 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:15.764029 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.686367 29949 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.789227 22264 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:15.789688 22118 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:13:15.790297 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.790786 29917 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:15.759586 29936 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.791512 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.792344 22264 raft_consensus.cc:2410] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 22 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:13:15.765865 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:15.793071 29754 consensus_meta.cc:287] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.890s	user 0.011s	sys 0.002s
I20260709 12:13:15.793249 29936 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.793534 29754 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.795607 29754 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:15.796144 29661 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.770412 29904 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:15.796904 29869 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:15.798204 29945 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.565s	user 0.004s	sys 0.000s
W20260709 12:13:15.800931 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 525511us
W20260709 12:13:15.802552 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 478019us
I20260709 12:13:15.816062 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:15.816200 29901 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:15.816396 22162 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.804553 22193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:13:15.817466 22193 raft_consensus.cc:606] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:15.817355 29913 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:15.818303 29904 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:15.818701 29904 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:15.818769 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:15.788744 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.819137 29756 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:15.819754 29913 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:15.819877 29965 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:15.820394 29965 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.820716 29965 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.820711 22270 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:13:15.756946 29971 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 12:13:15.824725 29979 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:15.825068 29946 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:15.825167 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:15.825667 29684 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:15.826102 29684 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:15.826489 29684 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:15.808414 22264 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 21. Current term is 22. Ops: [19.10-21.11]
I20260709 12:13:15.828441 29686 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:15.766706 29973 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:15.832342 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.834089 22263 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:13:15.836293 29726 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:15.838080 29958 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:15.838500 29958 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:15.838842 29958 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:15.806874 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45363.8us
I20260709 12:13:15.850008 22118 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:15.813067 29731 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:15.813724 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:15.814043 22266 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 12:13:15.886009 22266 pending_rounds.cc:85] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 11
I20260709 12:13:15.886300 22266 pending_rounds.cc:107] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:13:15.886523 22266 raft_consensus.cc:2889] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:15.790824 29949 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:15.887679 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.889343 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:15.889614 22194 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:13:15.890004 22197 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:13:15.890772 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:15.890957 22830 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.891168 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:15.891793 22195 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:15.817896 22193 raft_consensus.cc:614] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:15.891217 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:15.892928 22194 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:15.809485 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:15.761317 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:15.810735 22860 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
W20260709 12:13:15.894829 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 85441us
I20260709 12:13:15.875991 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:15.876799 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 51697.5us
I20260709 12:13:15.896622 22272 raft_consensus.cc:2368] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:13:15.788720 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.897593 22268 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 23.
I20260709 12:13:15.898912 22864 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:15.891371 22192 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:13:15.816629 29901 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:15.908329 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:15.908602 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:15.909528 22195 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:13:15.912221 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:15.912887 22195 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:15.916417 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:15.918344 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.919709 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:15.944321 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:15.926245 22190 raft_consensus.cc:2393] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 15: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:13:15.948544 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.842129 22017 catalog_manager.cc:5697] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 9 to 14, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.949226 22163 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:15.888988 29917 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.825642 29946 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.923842 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:15.959574 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:15.948879 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:15.953687 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:15.922072 22088 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:15.979333 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:15.992677 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 70708us
I20260709 12:13:15.995467 22865 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 27 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:15.996179 22191 raft_consensus.cc:3060] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:15.997188 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 43597.6us
I20260709 12:13:15.819164 29904 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:15.989670 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:16.002916 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:16.003696 22193 raft_consensus.cc:2393] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 20: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:16.004439 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:15.900542 29639 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:16.008107 22268 raft_consensus.cc:2393] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 14: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:15.963649 22017 catalog_manager.cc:5697] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:16.012444 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:15.992874 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.901023 29928 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:15.957408 29931 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:13:16.030927 22020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 243) took 30633 ms (client timeout 15000 ms). Trace:
I20260709 12:13:15.962952 29864 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:15.947021 29936 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:16.037716 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:16.038928 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:15.923617 29949 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:15.960427 29953 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:16.015110 29946 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:15.992940 29661 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:15.993754 29737 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:16.001531 29743 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:15.993685 29869 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:16.062848 29940 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:15.922036 29941 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.126s
I20260709 12:13:15.963479 29749 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.088s
W20260709 12:13:16.031656 22020 rpcz_store.cc:269] 0709 12:12:45.397447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.400459 (+  3012us) service_pool.cc:224] Handling call
0709 12:13:16.030790 (+30630331us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:07.471463 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:07.549359 (+ 77896us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:07.549413 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:13:07.549446 (+    33us) tablet.cc:662] Decoding operations
0709 12:13:07.550330 (+   884us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:07.550420 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:07.550460 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:13:07.710198 (+159738us) tablet.cc:701] Row locks acquired
0709 12:13:07.710238 (+    40us) write_op.cc:260] PREPARE: finished
0709 12:13:07.710444 (+   206us) write_op.cc:270] Start()
0709 12:13:07.710641 (+   197us) write_op.cc:276] Timestamp: P: 1783599187710368 usec, L: 0
0709 12:13:07.710665 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:13:07.711715 (+  1050us) log.cc:844] Serialized 2109 byte log entry
0709 12:13:08.325496 (+613781us) op_driver.cc:464] REPLICATION: finished
0709 12:13:08.457572 (+132076us) write_op.cc:301] APPLY: starting
0709 12:13:08.457714 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:08.678647 (+220933us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:08.678768 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:08.898159 (+219391us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:08.898431 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:13:08.898478 (+    47us) write_op.cc:312] APPLY: finished
0709 12:13:08.898806 (+   328us) log.cc:844] Serialized 57 byte log entry
0709 12:13:08.911590 (+ 12784us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:08.911704 (+   114us) write_op.cc:454] Released schema lock
0709 12:13:08.911750 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:08.912216 (+   466us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:08.912251 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":357056,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":121970,"apply.run_cpu_time_us":11824,"apply.run_wall_time_us":458108,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25037,"num_ops":5,"prepare.queue_time_us":139931,"prepare.run_cpu_time_us":19070,"prepare.run_wall_time_us":345885,"raft.queue_time_us":179334,"raft.run_cpu_time_us":18987,"raft.run_wall_time_us":57046,"replication_time_us":614664,"thread_start_us":312979,"threads_started":4,"wal-append.queue_time_us":133126,"wal-append.run_cpu_time_us":16163,"wal-append.run_wall_time_us":2053482}]]}
I20260709 12:13:16.017033 29917 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.069211 22017 catalog_manager.cc:5697] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 13 to 15, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:15.961035 29767 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.095s
I20260709 12:13:16.054139 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:16.049322 29936 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:16.105305 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 141202us
I20260709 12:13:16.106456 22237 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:16.052330 29931 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:15.923254 29731 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.116665 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:16.117872 22198 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:16.121846 22237 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:16.122009 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 200182us
I20260709 12:13:16.022341 29726 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 17, Time since last communication: 0.073s
I20260709 12:13:16.070252 29737 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:16.124688 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:16.027571 29639 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.108623 29743 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:16.132438 29661 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:16.052584 29902 consensus_queue.cc:1059] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:13:16.129478 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:16.128778 22017 catalog_manager.cc:5697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 12 to 14, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 14 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:16.152536 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:16.036046 29928 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.110287 29936 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:16.130257 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:16.185403 22115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44372 (request call id 4058) took 1374 ms (client timeout 1773 ms). Trace:
I20260709 12:13:16.125219 29912 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:16.119665 29657 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:16.187079 22193 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:16.188050 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:16.185892 22115 rpcz_store.cc:269] 0709 12:13:14.810996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.811339 (+   343us) service_pool.cc:224] Handling call
0709 12:13:16.185141 (+1373802us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b5400214b54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:16.185325 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88170880}
I20260709 12:13:16.190109 22198 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:13:16.191440 29977 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:13:16.191046 29737 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.193373 29737 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:16.199532 29657 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:16.130927 29973 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:16.200651 29657 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.201298 29973 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:16.201643 29973 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:16.201908 29657 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:16.203575 29743 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.094966 29901 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.142509 22017 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 20 to 22, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 22 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:16.209045 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 78875.8us
I20260709 12:13:16.210611 22830 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:16.201997 29973 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:16.215371 22017 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:16.133739 29953 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:16.220909 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:16.103299 29845 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.130111 29767 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
I20260709 12:13:16.187813 29661 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:16.226512 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:16.248075 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:16.233311 29964 consensus_meta.cc:287] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.010s
I20260709 12:13:16.225448 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 4066) took 1351 ms. Trace:
I20260709 12:13:16.239442 22191 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:16.312316 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:16.241091 22017 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:16.256645 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:16.223811 29953 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:13:16.292483 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 343285us
W20260709 12:13:16.314733 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:16.295243 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 180073us
I20260709 12:13:16.324085 22198 raft_consensus.cc:2393] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 20: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:16.312073 22116 rpcz_store.cc:276] 0709 12:13:14.874082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.874218 (+   136us) service_pool.cc:224] Handling call
0709 12:13:14.874496 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:14.874690 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:15.554799 (+680109us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b180037cb40. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fccf17ba3c7 00007fcceddcc9a7 00007fccedddc0bf
0709 12:13:15.554959 (+   160us) log.cc:844] Serialized 14 byte log entry
0709 12:13:16.224366 (+669407us) log.cc:844] Serialized 14 byte log entry
0709 12:13:16.225051 (+   685us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:16.225111 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:16.225167 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.225244 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.225382 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152875,"prepare.queue_time_us":51815,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":119307,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":9879,"spinlock_wait_cycles":15915264,"thread_start_us":610850,"threads_started":3,"wal-append.queue_time_us":365530}
I20260709 12:13:16.247704 29933 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:16.327878 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:16.319662 22017 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 13 to 14, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:16.316390 29977 log.cc:927] Time spent T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:13:16.346578 22191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:13:16.347472 22191 raft_consensus.cc:606] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:16.347918 22191 raft_consensus.cc:614] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:16.349774 22198 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: []
I20260709 12:13:16.296607 29813 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:16.318157 29953 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:16.365763 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 366222us
I20260709 12:13:16.374532 22195 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
W20260709 12:13:16.393316 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:16.374727 29821 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.010s
W20260709 12:13:16.395694 29821 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.006s	sys 0.010s
W20260709 12:13:16.409317 29986 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:13:16.329272 29965 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.411186 22197 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 25: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:16.356534 29726 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:16.477254 22017 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 17 to 21, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 21 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:16.484299 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:16.254076 29931 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.487138 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:16.339193 29933 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.417735 29917 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:16.416800 29869 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:16.401328 29980 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:16.509887 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 140480us
I20260709 12:13:16.514503 29913 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:16.492493 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:16.375211 29813 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.117s
I20260709 12:13:16.491848 29964 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:16.484433 29949 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:16.484340 29743 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:16.549054 29869 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.507232 29866 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:16.487450 29726 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.568918 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:16.569221 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:16.570026 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:16.369904 29661 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.531812 22017 catalog_manager.cc:5697] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 15 to 16, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 16 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:16.583521 22017 catalog_manager.cc:5697] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:16.569859 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:16.565235 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 149565us
W20260709 12:13:16.567451 29756 consensus_meta.cc:287] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.003s
W20260709 12:13:16.504073 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 293542us
W20260709 12:13:16.571468 29861 consensus_meta.cc:287] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.049s	user 0.014s	sys 0.003s
I20260709 12:13:16.571148 29737 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:16.608294 22866 raft_consensus.cc:2368] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20.
I20260709 12:13:16.578979 29743 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.576882 29964 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.574627 29949 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.647806 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:16.650838 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:16.611747 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:16.638475 29994 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:13:16.608561 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:16.607888 29841 consensus_meta.cc:287] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.959s	user 0.007s	sys 0.006s
I20260709 12:13:16.594715 29917 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.576694 30002 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:13:16.667587 29929 log.cc:927] Time spent T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.684s	user 0.005s	sys 0.001s
I20260709 12:13:16.568115 29980 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.766628 29980 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:16.766992 29958 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.928s	user 0.014s	sys 0.013s
I20260709 12:13:16.767119 29980 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.767704 29980 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.767622 29958 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.687304 29928 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:16.571112 29913 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.632010 29912 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:16.745759 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 137372us
I20260709 12:13:16.749377 29841 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.754209 29917 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.749732 30002 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:16.755455 29731 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:16.756129 29739 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:16.756517 29988 log.cc:927] Time spent T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:13:16.758996 29726 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:16.760190 29904 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.002s
I20260709 12:13:16.761196 29953 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.761633 22114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2918) took 1211 ms. Trace:
I20260709 12:13:16.855917 22114 rpcz_store.cc:276] 0709 12:13:15.550518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.833111 (+282593us) service_pool.cc:224] Handling call
0709 12:13:16.186411 (+353300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:16.186629 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:13:16.334339 (+147710us) log.cc:844] Serialized 14 byte log entry
0709 12:13:16.581316 (+246977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:16.581407 (+    91us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:13:16.581513 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.581598 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.761391 (+179793us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400214b50. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:16.761554 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":316966,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":136,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":20492,"spinlock_wait_cycles":811818368,"thread_start_us":379169,"threads_started":2}
I20260709 12:13:16.858156 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:16.764166 29684 consensus_meta.cc:287] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.937s	user 0.011s	sys 0.000s
I20260709 12:13:16.594859 29866 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.659442 29992 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.842536 29261 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:13:16.776543 22272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 3350) took 1505 ms (client timeout 1987 ms). Trace:
W20260709 12:13:16.750030 29984 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.432s	user 0.001s	sys 0.000s
I20260709 12:13:16.641770 29861 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.887755 22269 raft_consensus.cc:1240] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:13:16.889206 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:16.890173 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:16.649147 29737 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.840525 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:16.843616 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 1958) took 2783 ms. Trace:
I20260709 12:13:16.898844 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:16.899545 22270 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 14.
I20260709 12:13:16.900404 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:16.901998 29966 consensus_meta.cc:287] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.299s	user 0.012s	sys 0.000s
I20260709 12:13:16.902323 29861 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:16.902549 29966 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.903798 29866 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:16.884409 29992 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.906534 29992 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:16.906893 29936 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.000s
W20260709 12:13:16.774537 29963 consensus_meta.cc:287] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.098s	user 0.018s	sys 0.007s
I20260709 12:13:16.859818 22195 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:16.841766 29994 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:13:16.874799 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:16.869982 22830 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:16.882356 22272 rpcz_store.cc:269] 0709 12:13:15.271575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.281839 (+ 10264us) service_pool.cc:224] Handling call
0709 12:13:16.769378 (+1487539us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54001c7854. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:16.776482 (+  7104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331065216}
I20260709 12:13:16.842815 30002 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:16.890854 22266 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:16.929340 22858 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
W20260709 12:13:16.930136 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60250.6us
I20260709 12:13:16.891892 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:16.894876 22264 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 21: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:16.868098 29904 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:16.937835 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:16.908231 29657 consensus_meta.cc:287] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.706s	user 0.016s	sys 0.002s
I20260709 12:13:16.910373 29841 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:16.858814 29912 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:16.912292 29973 consensus_meta.cc:287] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.677s	user 0.006s	sys 0.005s
I20260709 12:13:16.912478 29917 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:16.908550 29743 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:16.913516 30007 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:16.914362 29737 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:16.916077 29913 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:16.779393 29862 consensus_meta.cc:287] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.255s	user 0.010s	sys 0.003s
I20260709 12:13:17.063146 29862 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.881022 29726 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.928548 29963 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.065083 29726 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.065786 29958 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:16.886404 29749 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.066730 30012 raft_consensus.cc:2804] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:17.067328 30012 raft_consensus.cc:697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:17.067241 29749 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.056859 29973 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.070259 29749 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:16.945775 29904 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:16.916698 29760 consensus_meta.cc:287] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.414s	user 0.004s	sys 0.009s
I20260709 12:13:17.071291 29869 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.071686 29973 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.071380 29760 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.927259 29936 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.073841 29760 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:17.074116 29936 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:16.870401 29684 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:16.918167 29964 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.074654 22860 raft_consensus.cc:2368] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:13:16.925489 29966 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:16.941398 29698 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:17.076180 29684 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.060016 29953 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:17.060283 29680 consensus_meta.cc:287] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.252s	user 0.012s	sys 0.000s
W20260709 12:13:17.061357 30011 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 12:13:16.752743 29985 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.407s	user 0.000s	sys 0.010s
I20260709 12:13:16.946928 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:16.946439 29992 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:17.105775 29261 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:17.100114 29680 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.064610 29933 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:17.105820 29946 consensus_meta.cc:287] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.023s	user 0.019s	sys 0.005s
I20260709 12:13:17.107376 29946 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.108104 29680 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:17.109200 29862 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:17.109393 29946 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.068342 30012 consensus_queue.cc:237] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.196655 22115 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
W20260709 12:13:17.197572 22163 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.006s	sys 0.009s
I20260709 12:13:17.198249 22120 raft_consensus.cc:2393] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 17: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:17.198652 22119 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
W20260709 12:13:17.198273 22163 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.006s	sys 0.009s
I20260709 12:13:16.859580 22117 raft_consensus.cc:2368] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
W20260709 12:13:17.201192 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 613596us
I20260709 12:13:17.205821 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.196734 22122 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:16.753155 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:17.213620 22189 raft_consensus.cc:2368] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:13:16.895519 22196 rpcz_store.cc:276] 0709 12:13:14.050326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.050503 (+   177us) service_pool.cc:224] Handling call
0709 12:13:14.051012 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:14.052275 (+  1263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:14.052327 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:14.076431 (+ 24104us) log.cc:844] Serialized 26 byte log entry
0709 12:13:14.784316 (+707885us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:14.796501 (+ 12185us) log.cc:844] Serialized 14 byte log entry
0709 12:13:14.939402 (+142901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:14.939492 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:16.387838 (+1448346us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:16.774179 (+386341us) raft_consensus.cc:1685] finished
0709 12:13:16.833486 (+ 59307us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.833725 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31709,"prepare.queue_time_us":15540,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":51605,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":31245,"spinlock_wait_cycles":4882176,"thread_start_us":683466,"threads_started":2,"wal-append.queue_time_us":643380}
W20260709 12:13:17.215634 22194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.009s
W20260709 12:13:17.216277 22194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.006s	sys 0.009s
W20260709 12:13:16.941527 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 66828.6us
I20260709 12:13:17.221385 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.224539 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.193359 22017 catalog_manager.cc:5697] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 11 to 12, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 12 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:16.916720 22270 raft_consensus.cc:2368] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20.
I20260709 12:13:17.235481 22272 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:17.235862 29680 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:17.237334 29992 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:17.240320 29680 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.234112 22271 raft_consensus.cc:2410] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
W20260709 12:13:17.235014 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 303974us
I20260709 12:13:17.241346 29680 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.227931 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:17.148218 29661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.016s	sys 0.006s
I20260709 12:13:17.268373 29933 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:13:17.280067 30028 consensus_queue.cc:1059] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:17.282539 30028 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:17.283174 30028 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:17.289649 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2923) took 1737 ms. Trace:
I20260709 12:13:17.290305 22115 rpcz_store.cc:276] 0709 12:13:15.551989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.220576 (+668587us) service_pool.cc:224] Handling call
0709 12:13:16.220922 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:17.197664 (+976742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.289045 (+ 91381us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b5400311fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:17.289407 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242272512}
I20260709 12:13:17.292218 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:17.293653 22120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 1836) took 1777 ms (client timeout 1901 ms). Trace:
W20260709 12:13:17.294425 22120 rpcz_store.cc:269] 0709 12:13:15.516368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.516619 (+   251us) service_pool.cc:224] Handling call
0709 12:13:17.293175 (+1776556us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b540012acd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:17.293459 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3806519168}
I20260709 12:13:17.297216 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1833) took 1806 ms. Trace:
I20260709 12:13:17.297689 29904 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:17.298390 29904 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.298532 22118 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:13:17.298868 29904 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:13:17.301940 22117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2924) took 1749 ms (client timeout 1944 ms). Trace:
W20260709 12:13:17.302358 22117 rpcz_store.cc:269] 0709 12:13:15.552288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.584065 (+ 31777us) service_pool.cc:224] Handling call
0709 12:13:17.301599 (+1717534us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400327154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:17.301770 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2846829440}
I20260709 12:13:17.302758 29680 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:17.307585 22121 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:13:17.306869 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3427) took 1416 ms. Trace:
I20260709 12:13:17.305439 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 1835) took 1801 ms. Trace:
W20260709 12:13:17.317095 29661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.017s	sys 0.006s
I20260709 12:13:17.319954 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:17.348973 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:17.320181 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:17.297689 22119 rpcz_store.cc:276] 0709 12:13:15.490348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.788574 (+298226us) service_pool.cc:224] Handling call
0709 12:13:15.788896 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:17.199282 (+1410386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.296829 (+ 97547us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54002acbd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:17.297150 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3240640768}
I20260709 12:13:17.303565 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:17.341327 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2921) took 1789 ms. Trace:
I20260709 12:13:17.340447 22122 rpcz_store.cc:276] 0709 12:13:15.503983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.527086 (+ 23103us) service_pool.cc:224] Handling call
0709 12:13:17.305106 (+1778020us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54003df9d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:17.305344 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3834891648}
I20260709 12:13:17.353396 22118 rpcz_store.cc:276] 0709 12:13:15.551441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.852223 (+300782us) service_pool.cc:224] Handling call
0709 12:13:17.297985 (+1445762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:17.299074 (+  1089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.299766 (+   692us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540012acd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:17.341241 (+ 41475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3323862784}
I20260709 12:13:17.303670 29946 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:17.307760 29931 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:17.363147 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:17.311334 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:17.367933 22193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3433) took 1391 ms (client timeout 1777 ms). Trace:
W20260709 12:13:17.369724 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 142089us
I20260709 12:13:17.371147 29177 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:17.375635 29726 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:17.359185 22267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 3338) took 2199 ms (client timeout 2110 ms). Trace:
I20260709 12:13:17.361740 22264 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:17.356024 22861 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
W20260709 12:13:17.381738 22267 rpcz_store.cc:269] 0709 12:13:15.158702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.259858 (+101156us) service_pool.cc:224] Handling call
0709 12:13:17.314700 (+2054842us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54000ea454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:17.357695 (+ 42995us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857931008}
W20260709 12:13:17.380399 22193 rpcz_store.cc:269] 0709 12:13:15.961952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.012228 (+ 50276us) service_pool.cc:224] Handling call
0709 12:13:17.312112 (+1299884us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54000fc8d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:17.352696 (+ 40584us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393609472}
I20260709 12:13:17.394047 22017 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 17 to 18, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 18 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.396970 22195 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
W20260709 12:13:17.400430 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 97177.1us
I20260709 12:13:17.405937 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.406229 22191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 3033) took 1019 ms. Trace:
I20260709 12:13:17.406642 22191 rpcz_store.cc:276] 0709 12:13:16.386994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.418495 (+ 31501us) service_pool.cc:224] Handling call
0709 12:13:17.310815 (+892320us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5800196598. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2dda0ab 00007fccf2dda131 00007fccf2d880a0 00007fccf2d87984 00007fccec3026d4 00007fccec302662
0709 12:13:17.406130 (+ 95315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4053376}
I20260709 12:13:17.407068 30022 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:17.407523 30022 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:17.408079 30022 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:17.410854 29739 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.006s
I20260709 12:13:17.419912 29946 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:17.338130 22192 rpcz_store.cc:276] 0709 12:13:15.889758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.900673 (+ 10915us) service_pool.cc:224] Handling call
0709 12:13:15.901027 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:16.223223 (+322196us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:13:16.245251 (+ 22028us) log.cc:844] Serialized 14 byte log entry
0709 12:13:16.886380 (+641129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:16.886460 (+    80us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:16.886593 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.306236 (+419643us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54001f45d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:17.306315 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:17.306577 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6397,"prepare.queue_time_us":22115,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":3633,"raft.queue_time_us":264663,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":50288,"spinlock_wait_cycles":794947072,"thread_start_us":630889,"threads_started":2,"wal-append.queue_time_us":675367}
I20260709 12:13:17.421597 29946 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.424513 22123 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:17.425345 29941 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.425889 29941 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.429423 29821 raft_consensus.cc:3055] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:17.429252 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.437422 29821 raft_consensus.cc:740] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:17.451061 22017 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 21 to 23, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 23 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:17.454672 29953 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.455606 29953 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.463624 30030 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:17.464315 22191 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:17.464550 30030 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.465922 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:17.466400 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.467257 30030 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:17.468158 29917 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:17.468837 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:17.469089 29917 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:17.470072 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:17.473444 29754 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:17.469712 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64036us
I20260709 12:13:17.468456 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.383852 30028 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.486944 29845 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.489790 30002 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.492511 30015 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:17.497315 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:13:17.439841 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 123228us
I20260709 12:13:17.484237 29821 consensus_queue.cc:260] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.500852 29821 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:17.505065 29661 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:17.493350 30015 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.507839 29963 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.509430 30015 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.491636 29912 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:17.492707 30002 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.518420 29949 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.531028 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3426) took 1641 ms. Trace:
I20260709 12:13:17.531693 22197 rpcz_store.cc:276] 0709 12:13:15.889528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.890837 (+  1309us) service_pool.cc:224] Handling call
0709 12:13:17.530430 (+1639593us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b540011a154. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:17.530771 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193118208}
I20260709 12:13:17.536684 22189 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:17.537535 22163 leader_election.cc:400] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20.
I20260709 12:13:17.537892 22163 leader_election.cc:403] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:13:17.540657 22194 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:17.548377 29680 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:17.552397 22860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 1136) took 1634 ms (client timeout 1551 ms). Trace:
I20260709 12:13:17.552839 29686 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20.
I20260709 12:13:17.552081 29680 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.513324 29904 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.560149 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:17.560979 29902 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.561127 22268 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:17.562167 29902 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.563206 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:17.564198 22267 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:17.565557 29902 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:17.567091 29680 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:17.568218 29999 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.997s	user 0.010s	sys 0.000s
I20260709 12:13:17.569059 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:17.585011 22271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 3344) took 2424 ms (client timeout 1734 ms). Trace:
I20260709 12:13:17.585446 22267 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:17.587248 22863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 1239) took 1879 ms. Trace:
I20260709 12:13:17.587656 22863 rpcz_store.cc:276] 0709 12:13:15.707207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.707399 (+   192us) service_pool.cc:224] Handling call
0709 12:13:15.707789 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:15.791862 (+ 84073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:15.791890 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:15.791931 (+    41us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:15.791961 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.586768 (+1794807us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b5400434754. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:17.586838 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:17.587020 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192854400}
I20260709 12:13:17.566318 29698 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:13:17.569264 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:17.569964 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:17.570362 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:17.571431 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:17.552955 22860 rpcz_store.cc:269] 0709 12:13:15.918210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.944003 (+ 25793us) service_pool.cc:224] Handling call
0709 12:13:17.551060 (+1607057us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400800a54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:17.552131 (+  1071us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2597025664}
W20260709 12:13:17.573221 30003 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.945s	user 0.001s	sys 0.010s
I20260709 12:13:17.546712 22017 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:17.575171 29894 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:17.540735 29953 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:17.578400 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 110118us
I20260709 12:13:17.579398 29982 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:17.580928 22163 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.583660 29958 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.584647 22857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56950 (request call id 1062) took 1819 ms. Trace:
W20260709 12:13:17.585445 22271 rpcz_store.cc:269] 0709 12:13:15.160672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.181018 (+ 20346us) service_pool.cc:224] Handling call
0709 12:13:17.584736 (+2403718us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54002c3654. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:17.584933 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4716850560}
I20260709 12:13:17.610035 30016 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:17.593464 29894 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:17.622447 22265 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:17.624814 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:17.600425 22857 rpcz_store.cc:276] 0709 12:13:15.765449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.765562 (+   113us) service_pool.cc:224] Handling call
0709 12:13:15.765957 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:15.766239 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:15.896480 (+130241us) log.cc:844] Serialized 14 byte log entry
0709 12:13:17.578441 (+1681961us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b1800472ba0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fcceddba060 00007fcceddcc716 00007fccedddd287
0709 12:13:17.578631 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:17.578720 (+    89us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:17.578854 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.584201 (+  5347us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:17.584407 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":116123,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":28942,"raft.queue_time_us":396302,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"spinlock_wait_cycles":5259776,"thread_start_us":655395,"threads_started":3,"wal-append.queue_time_us":528766}
W20260709 12:13:17.636445 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 55717.4us
I20260709 12:13:17.640039 29904 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.625962 29949 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.643684 29949 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.646972 29949 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:17.630185 30019 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:17.647884 30019 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.650738 30019 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.640161 22267 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:17.658878 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:17.659821 22865 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 27: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:13:17.663888 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.665966 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:17.667557 30012 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.668185 30012 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.669153 29980 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.671058 30012 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.674017 29965 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.619361 22017 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:17.607862 30022 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.687490 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:17.691934 22865 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:17.694712 22861 raft_consensus.cc:2410] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:13:17.702785 29982 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:17.703384 29982 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:17.705204 29917 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.705575 29657 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.705893 29917 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.706451 29657 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.710366 29680 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.711047 29680 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.712656 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:17.712848 22121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2922) took 2161 ms. Trace:
I20260709 12:13:17.713241 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:17.713807 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:17.713937 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:17.714078 22122 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:13:17.713304 22121 rpcz_store.cc:276] 0709 12:13:15.551714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.947358 (+395644us) service_pool.cc:224] Handling call
0709 12:13:17.307118 (+1359760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:17.352906 (+ 45788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.712621 (+359715us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54003df9d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:17.712765 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3126075136}
I20260709 12:13:17.714731 22264 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:17.700404 29639 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:17.719208 22192 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:17.714610 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:17.721585 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.721731 22866 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:17.714711 22272 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 14.
I20260709 12:13:17.628561 29958 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.726263 30022 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.732735 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:17.733619 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.735111 29980 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:17.735809 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.735881 29980 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.736929 29819 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:17.737614 30015 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:17.738065 30015 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:17.738695 29980 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.741094 30040 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:17.740805 29907 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:17.741779 30040 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.739287 30015 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.745309 29958 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.740511 30009 consensus_queue.cc:1059] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:13:17.744454 30040 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.718334 29917 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:17.746316 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 121966us
I20260709 12:13:17.747360 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:17.748946 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.736060 30028 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:17.749637 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.751426 29754 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:17.752588 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:13:17.744678 22123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38186 (request call id 1828) took 2268 ms (client timeout 1935 ms). Trace:
W20260709 12:13:17.754902 22123 rpcz_store.cc:269] 0709 12:13:15.476416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.477512 (+  1096us) service_pool.cc:224] Handling call
0709 12:13:17.744415 (+2266903us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400326c54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:17.744557 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4445764352}
W20260709 12:13:17.755295 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 69549.5us
I20260709 12:13:17.756098 22266 raft_consensus.cc:1240] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:13:17.756546 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:17.757431 22121 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:13:17.757563 29643 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:13:17.759111 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:17.760046 22123 raft_consensus.cc:2368] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18.
I20260709 12:13:17.761411 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:17.762230 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:17.762692 29941 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:17.763082 22119 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:13:17.763995 30005 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.710s	user 0.008s	sys 0.003s
W20260709 12:13:17.764786 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.764885 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:17.764050 30015 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:17.766237 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:17.767918 22264 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:17.764588 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:17.768625 22269 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:17.770673 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:17.773291 29894 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.774767 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:17.767084 22017 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 13 to 14, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 14 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.773912 22163 leader_election.cc:400] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20.
I20260709 12:13:17.783556 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:17.784586 22122 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:17.786659 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:17.793306 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46095.9us
I20260709 12:13:17.790763 29912 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:17.795349 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:17.807040 22269 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:13:17.798143 29992 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:17.822878 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:17.814400 29901 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:17.817018 29894 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:17.818831 22270 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:17.806442 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:17.829742 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 56039.1us
I20260709 12:13:17.829919 22266 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:17.840847 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:17.842754 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:17.845009 29739 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:13:17.847486 29686 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:17.839184 22017 catalog_manager.cc:5697] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 14 to 18, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 18 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:17.850144 22857 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:17.849090 29680 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:17.848574 29686 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:17.854895 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 119230us
I20260709 12:13:17.855475 22861 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:17.859390 30022 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:17.859606 22863 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:17.860391 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:17.861487 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:17.860212 30022 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:17.865594 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:17.867761 22121 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:13:17.870451 30022 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:17.871785 22267 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:13:17.874135 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:17.874909 30002 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:17.875489 30002 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:17.876968 30006 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:13:17.884006 29686 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:17.884920 30002 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:17.885862 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46436us
I20260709 12:13:17.888988 30012 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:17.891476 30012 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:17.892305 30012 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:17.894385 29754 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:17.895743 29754 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:17.896085 29754 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:17.896946 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:17.897753 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 45462.9us
I20260709 12:13:17.898783 29739 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:17.892382 29680 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:17.899355 29739 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:17.894192 30002 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:17.897195 29754 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.900486 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:17.901247 22266 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:13:17.899817 29739 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:17.905954 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:17.906445 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:17.906749 22115 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:17.907069 22270 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:17.907263 29657 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:17.910006 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:17.910349 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:17.912214 22831 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:17.914314 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:17.915342 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:17.916007 22121 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:17.863353 22017 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 8 to 9, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 9 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.917043 22122 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:17.919814 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:17.925107 22267 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:17.929601 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:17.936599 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:17.937019 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:17.938552 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:17.939740 22265 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:17.940308 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:17.941604 22269 raft_consensus.cc:2410] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:13:17.925323 29754 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:17.942559 30026 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:13:17.943403 30026 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:17.939520 29819 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:17.922676 29894 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:17.935890 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:17.950591 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:17.951093 22865 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:17.953492 30037 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:17.953362 30008 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 12:13:17.954041 30037 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:17.954428 30037 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:17.957269 29680 consensus_queue.cc:1059] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:17.958340 29680 raft_consensus.cc:3055] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:17.958691 29680 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:17.959450 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:17.959630 29680 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.960717 30009 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:17.961234 22122 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:17.965078 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.965605 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:17.967054 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:17.945449 22115 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:17.969437 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:17.969432 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:17.972900 22122 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:17.974198 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:17.974867 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:17.974357 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:17.975257 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:17.975611 22197 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 17: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:17.978183 22267 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
W20260709 12:13:17.979740 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 84809us
I20260709 12:13:17.978828 22121 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 27.
I20260709 12:13:17.980403 29907 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:17.950578 29686 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:17.974305 30009 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.996445 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:17.990800 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44639.8us
I20260709 12:13:17.994247 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:17.995538 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:17.944653 30026 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:17.997274 22192 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:18.001433 22263 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:17.998147 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:17.974367 29680 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:17.980954 29941 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:18.004312 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:18.006072 30022 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:18.011585 30022 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:18.012099 30022 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:18.006716 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:18.014645 29739 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.006748 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:18.007824 22197 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:18.017261 22189 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:18.008627 22862 raft_consensus.cc:1240] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:18.009016 22269 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:17.996508 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:18.024214 22270 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:13:18.027004 22122 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 17: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:18.031160 29958 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:18.034150 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:18.029152 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:18.000571 29982 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.001298 30009 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:18.036584 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:18.042464 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:18.044721 22862 raft_consensus.cc:1240] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:18.051349 29739 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:18.054164 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:18.056463 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 137467us
I20260709 12:13:18.057967 29714 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:18.059782 22865 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: []
I20260709 12:13:18.061856 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:18.055917 29657 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:18.065256 29643 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:18.070098 22189 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
W20260709 12:13:18.071382 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 91036us
I20260709 12:13:18.072938 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:18.068712 29698 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.075412 29698 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.076790 29714 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.077975 29698 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:18.079103 29714 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:18.081027 22121 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
W20260709 12:13:18.083240 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.089694 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:18.089018 29864 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:18.068789 29992 consensus_queue.cc:1059] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.023s
W20260709 12:13:18.092110 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 89002.2us
I20260709 12:13:18.088797 30009 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.095721 22860 raft_consensus.cc:2393] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 21: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:18.096006 30037 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.057502 29686 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.103219 30009 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:18.103972 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:18.107595 22115 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 25.
I20260709 12:13:18.110296 22189 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
W20260709 12:13:18.115176 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 151703us
I20260709 12:13:18.125193 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:18.133213 22266 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 25.
I20260709 12:13:18.089774 30028 consensus_queue.cc:1059] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:13:18.136317 22194 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:18.100636 29992 raft_consensus.cc:3055] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:18.142060 29992 raft_consensus.cc:740] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:18.143047 22236 leader_election.cc:400] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:13:18.143440 22236 leader_election.cc:403] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:13:18.091488 29864 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.148557 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:18.155687 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:18.156057 22192 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:18.145735 29739 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:18.154554 29686 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:18.157194 29864 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:18.155059 22191 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:18.155290 29909 raft_consensus.cc:3055] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:18.158576 29909 raft_consensus.cc:740] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:18.159469 29909 consensus_queue.cc:260] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.156935 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:18.161453 22193 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 26.
W20260709 12:13:18.161638 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 134555us
I20260709 12:13:18.160722 29909 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:18.163193 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:18.165278 29982 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:18.165622 30015 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:18.166277 30015 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:18.167550 30015 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.169269 29992 consensus_queue.cc:260] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.170634 29992 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:18.170437 30022 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:18.172353 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:18.173686 30055 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 12:13:18.174602 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 101897us
I20260709 12:13:18.176345 29980 consensus_queue.cc:1059] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:18.177418 29867 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:13:18.177879 29867 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:18.178835 29867 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.180327 29867 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:13:18.182243 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 65073.4us
I20260709 12:13:18.188441 22830 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:18.192072 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.196666 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:18.188978 30028 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:13:18.203439 22194 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:18.208250 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:18.204995 29657 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 12:13:18.219156 22122 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:18.221205 29901 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:13:18.225559 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:18.226198 22270 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:18.227360 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:18.235198 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:18.220296 30012 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.247311 22197 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:18.249228 30012 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:18.253491 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:18.254369 22122 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:13:18.254710 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.259023 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:18.259801 22121 raft_consensus.cc:2376] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 25. Re-sending same reply.
I20260709 12:13:18.260311 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:18.246133 29901 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:18.268927 22189 raft_consensus.cc:1275] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 12:13:18.283820 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.285179 22860 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:18.292273 29941 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:18.271381 30009 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:18.277559 29901 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.238121 29864 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:13:18.303998 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:18.295344 30022 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:18.303356 30009 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.312111 22121 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 17: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:18.315444 22088 leader_election.cc:400] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:13:18.315963 22088 leader_election.cc:403] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:18.325534 22270 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:18.309631 29901 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:18.334425 22122 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 12:13:18.334297 29958 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:18.299355 29680 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
W20260709 12:13:18.337248 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.337786 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:18.343714 22115 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:13:18.344064 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:18.335168 22122 pending_rounds.cc:85] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 10
I20260709 12:13:18.338361 29941 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15.
I20260709 12:13:18.321039 30009 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:18.340814 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:18.346361 22122 pending_rounds.cc:107] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 12:13:18.355435 22122 raft_consensus.cc:2889] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:18.354120 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:18.328405 30037 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:18.313612 30026 consensus_queue.cc:1048] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 12:13:18.373769 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:18.374209 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50012us
I20260709 12:13:18.385075 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:18.383792 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:18.387322 29749 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:13:18.387444 29958 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:18.387953 29749 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:18.388209 29958 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.374518 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:18.390022 22270 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:18.392601 22831 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:18.394433 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 94694.8us
I20260709 12:13:18.363087 29739 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:18.396380 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:18.404186 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:18.405030 22121 raft_consensus.cc:2368] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18.
I20260709 12:13:18.376524 29754 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:18.395727 30037 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:18.399595 30008 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:18.406307 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:18.400379 22163 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:18.411466 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:18.413415 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:18.414921 22860 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: []
I20260709 12:13:18.415933 22864 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:18.416237 29739 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:18.416687 29739 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.416805 29902 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.417147 29739 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:18.417331 29902 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.420301 30008 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:18.424193 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:18.422510 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 191278us
I20260709 12:13:18.423326 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:18.427592 22122 raft_consensus.cc:2393] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:18.409449 29941 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 12:13:18.421087 29864 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:18.434536 22270 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:13:18.425592 29639 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:18.432873 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:18.436498 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:18.425792 29657 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:18.401172 29749 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.446059 22266 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
W20260709 12:13:18.449656 22864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 1065) took 2537 ms (client timeout 2156 ms). Trace:
W20260709 12:13:18.450218 22864 rpcz_store.cc:269] 0709 12:13:15.911913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.921499 (+  9586us) service_pool.cc:224] Handling call
0709 12:13:18.449416 (+2527917us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b540019f5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:18.449560 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4851277696}
I20260709 12:13:18.451320 30008 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.438280 29639 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:18.453357 29639 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:18.454471 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.437009 30015 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:13:18.457316 30015 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:18.441277 29864 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:18.458381 30015 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.459285 29864 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.444368 29901 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.468746 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:18.468593 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:18.469661 22197 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:18.434067 29754 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:18.482901 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 77802.1us
I20260709 12:13:18.485121 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:18.466679 29902 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:18.489079 29940 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:18.489501 30028 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:18.492972 29941 raft_consensus.cc:2804] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:18.481683 29698 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:18.497226 29698 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:18.498138 29698 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.502398 29941 raft_consensus.cc:697] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:18.504405 22270 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:13:18.504503 29941 consensus_queue.cc:237] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.507074 30009 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.509119 29958 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:18.509778 30009 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 28 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:18.493628 29749 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:18.511813 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:18.512396 22197 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Advancing to term 28
I20260709 12:13:18.493474 30028 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:18.517549 30028 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.519061 30028 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:18.493438 29940 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:18.521906 22831 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:18.525352 22197 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 28.
I20260709 12:13:18.526865 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:18.533017 29940 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:18.523180 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:18.493969 30037 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:13:18.545693 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 123002us
I20260709 12:13:18.542462 30037 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.551784 30037 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:18.554183 29894 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:18.554893 29819 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:13:18.556154 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:18.557410 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 122739us
I20260709 12:13:18.558211 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:18.543864 30012 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:18.555194 30004 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:18.545470 29698 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:18.586833 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:18.593194 22864 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
W20260709 12:13:18.593930 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 161298us
I20260709 12:13:18.599300 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:18.599361 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.604338 22269 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:13:18.534283 30060 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:13:18.606907 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:18.610423 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:18.614915 22163 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:18.616909 30058 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:13:18.593466 29754 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.631714 22860 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260709 12:13:18.643326 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 159579us
I20260709 12:13:18.598918 29864 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:18.646059 29739 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.646932 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:18.647826 30066 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:18.658521 30066 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:18.659731 30066 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:18.658545 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.665352 22270 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:13:18.666054 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:18.666882 22266 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:18.648945 29639 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:18.650717 22088 leader_election.cc:336] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.711s (SENT)
I20260709 12:13:18.651818 30060 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.657403 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:18.657187 29940 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.657816 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:18.658027 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:18.673422 22864 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:13:18.671994 22860 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 21: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:18.609584 29894 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 28 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:18.669284 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:18.677558 22862 raft_consensus.cc:1240] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:18.683751 30037 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.685573 22189 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:18.654275 29958 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:18.687052 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:18.694790 29941 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:13:18.676546 29864 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 25 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:18.697393 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 89198.6us
I20260709 12:13:18.699184 30063 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:18.716233 30063 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:18.700209 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:18.718184 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:18.719393 29902 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:18.688930 29958 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:18.700371 29749 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:18.701020 30066 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:18.701458 22162 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:18.685325 30060 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.704540 29901 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:18.706801 29940 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:18.709004 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:18.758010 22194 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:18.687999 29714 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:18.730458 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:18.698602 29819 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:18.721113 29958 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:18.720724 29902 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:18.721326 29980 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:18.690214 30012 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:18.722337 30063 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:18.755647 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.760310 30077 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:18.758833 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:18.767709 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:18.732223 30015 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:18.774114 22266 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
W20260709 12:13:18.775385 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45045.8us
W20260709 12:13:18.756357 29867 consensus_meta.cc:287] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.006s
I20260709 12:13:18.762835 29941 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:13:18.783272 29819 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.769671 29980 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:18.814210 29980 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:18.787173 30012 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:18.792536 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 141890us
I20260709 12:13:18.793201 29864 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:18.818163 22088 leader_election.cc:336] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.734s (SENT)
I20260709 12:13:18.818627 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:18.818845 30063 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.794035 30030 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:18.825631 22865 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 17: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:18.769347 29902 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:18.795605 22194 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:18.830088 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:13:18.806308 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 104929us
I20260709 12:13:18.766961 30008 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.795907 29639 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:18.807080 29698 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:13:18.856560 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 96510.1us
I20260709 12:13:18.827334 30077 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:18.773119 29749 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.838897 30030 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:18.867695 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.883643 29749 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:18.856087 29698 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:18.828716 29902 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:18.901815 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.859539 29941 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:18.858618 30072 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:18.858530 30008 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.903892 29698 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:18.918970 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:18.927136 22860 raft_consensus.cc:2393] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:18.851881 29894 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.856757 30015 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.874259 30022 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:13:18.946059 29698 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.918780 29739 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:18.927426 29941 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:18.973274 29941 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:18.974491 30063 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:18.975203 30077 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.975939 30015 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:18.977613 30060 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:18.980100 30028 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.980615 30028 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:18.935508 30037 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:18.928887 30072 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:18.983867 30072 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:18.990981 29698 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:18.971746 30078 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:19.000725 30030 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.016055 22272 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:19.022548 30069 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:19.025127 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 129371us
W20260709 12:13:19.025717 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 115168us
I20260709 12:13:19.025631 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:19.030462 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:19.031195 22197 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:19.038439 22272 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:19.041112 22197 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:19.029523 22163 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:19.027618 22236 connection.cc:256] RPC call timeout handler was delayed by -1.3296862419999798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 12:13:19.045264 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 81864us
I20260709 12:13:19.051867 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:19.061997 22163 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:19.063356 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:18.936538 29980 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:19.064960 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 225678us
I20260709 12:13:19.070303 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:19.059494 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:19.076089 22272 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:19.048976 29902 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:19.076984 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.077514 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.082767 22265 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:13:19.080049 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:19.083948 22865 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:19.081857 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:19.081140 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:19.085204 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.057960 29698 raft_consensus.cc:2804] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:19.092451 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.093642 22270 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:19.064169 29965 raft_consensus.cc:2764] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:13:19.082134 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:19.070657 30015 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:18.974324 29941 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.105093 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:19.053045 30073 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:13:19.126000 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.126843 22122 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 27.
I20260709 12:13:19.128885 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.129489 22122 raft_consensus.cc:2376] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20. Re-sending same reply.
I20260709 12:13:19.129822 22236 leader_election.cc:400] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:13:19.108480 30070 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:19.109273 30085 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:19.110669 29958 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.073910 30087 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:19.086829 30028 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:19.117172 30060 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:19.121542 29867 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.094288 29739 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:19.135052 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.135500 22121 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:19.137893 30070 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:19.138312 29698 raft_consensus.cc:697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:19.138101 29639 consensus_queue.cc:1059] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:19.164407 29639 raft_consensus.cc:3055] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:19.164896 29639 raft_consensus.cc:740] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:19.165905 29639 consensus_queue.cc:260] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.167589 29639 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.138863 30022 raft_consensus.cc:2764] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 12:13:19.168366 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.168983 22119 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:19.169090 30060 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:19.170245 29657 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.170502 29867 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.170876 29657 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.139490 30008 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:19.045172 30069 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.174268 29941 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.175058 30069 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:19.177109 29739 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:19.178244 29739 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.141016 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:19.143751 22270 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:19.146970 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:19.149430 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 331306us
I20260709 12:13:19.181663 29698 consensus_queue.cc:237] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:19.182719 22088 leader_election.cc:336] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.750s (SENT)
I20260709 12:13:19.183329 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:19.151278 22115 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:19.151872 29980 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.162848 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.147981 30015 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:19.182142 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:19.146656 30087 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:19.158923 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55659.8us
I20260709 12:13:19.196416 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:19.197285 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:19.199627 22194 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:13:19.197355 29754 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:19.196655 22197 raft_consensus.cc:1240] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:19.198086 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.198853 22193 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:19.216490 29958 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:19.217509 30069 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:19.218241 30069 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.220993 30070 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.223412 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:19.224385 30082 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:19.224912 30082 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.225262 30082 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.229206 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.230183 30066 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:19.198684 30087 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.233336 29657 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:19.237381 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:19.238299 22865 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:13:19.239804 22237 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:19.240870 29657 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:19.241272 29657 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.241617 29657 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:19.241716 22120 raft_consensus.cc:2368] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 22. Current term is 23.
I20260709 12:13:19.182847 29940 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:19.246068 30015 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.246662 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.247587 22270 raft_consensus.cc:2368] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:13:19.247828 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.248075 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.248587 22272 raft_consensus.cc:2368] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:13:19.248508 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.248898 22266 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:19.170274 30060 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.249847 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.214226 29754 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:19.252461 29754 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:19.254020 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:19.239260 30082 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.261159 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:19.262042 22193 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 23.
I20260709 12:13:19.259943 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:19.281203 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:19.310814 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 126084us
W20260709 12:13:19.311802 22088 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.110s (SENT)
I20260709 12:13:19.312229 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:19.323057 30077 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:19.304697 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:19.257314 30069 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:19.248925 29867 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.359553 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.365113 22267 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:13:19.351073 22862 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:19.334421 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:13:19.337473 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 79484.9us
I20260709 12:13:19.370288 30002 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.370491 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.371160 22115 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:19.370961 30002 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.372344 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.281069 30073 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:19.305871 29894 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:19.375382 29657 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.375778 30082 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.376390 30002 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.377276 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.303670 30028 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 12:13:19.364408 29902 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:19.379236 30096 log.cc:927] Time spent T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.005s
W20260709 12:13:19.388202 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.390316 22860 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:19.393128 22267 raft_consensus.cc:2410] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:13:19.378091 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.382802 29894 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.393406 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.378161 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.408002 22272 raft_consensus.cc:2393] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 17: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:19.380414 30073 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.409305 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.395395 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:19.328297 30008 consensus_queue.cc:1059] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 12:13:19.406301 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:13:19.408038 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.412621 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.414271 22120 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:19.414862 22266 raft_consensus.cc:2410] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:13:19.404032 29867 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 12:13:19.417449 22115 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:13:19.414909 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:19.399466 29902 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:19.415357 29894 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:19.414247 30073 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:19.427400 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:19.432379 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.338110 29958 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:19.429539 30097 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:19.553416 29965 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.437738 30077 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:13:19.554111 29965 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.442145 29657 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:19.442735 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.556309 29965 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.444165 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.557395 30069 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.447223 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.445688 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.558249 22117 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:19.558017 30069 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.558490 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.558794 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.559743 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.405270 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:19.560307 22122 raft_consensus.cc:2376] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19. Re-sending same reply.
W20260709 12:13:19.560904 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 156455us
I20260709 12:13:19.451397 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.451633 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:19.452095 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.423377 29686 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:13:19.562955 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.563786 22115 raft_consensus.cc:2368] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 22. Current term is 23.
I20260709 12:13:19.448459 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:19.454250 29864 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.564545 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.454116 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.454115 29940 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.565107 22864 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:19.565665 29940 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.567960 29940 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.461179 30028 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:19.446058 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.568574 30028 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:19.569458 22162 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:19.467108 22860 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:19.467804 30002 raft_consensus.cc:3055] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:19.469880 30066 consensus_queue.cc:1059] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:19.571043 30002 raft_consensus.cc:740] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:19.571333 30066 consensus_queue.cc:1243] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 21.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:19.571972 30066 raft_consensus.cc:3055] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:19.572359 30066 raft_consensus.cc:740] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:19.572073 30002 consensus_queue.cc:260] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.573118 29754 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.477737 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:19.573277 30066 consensus_queue.cc:260] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:19.478232 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.481314 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.574666 30066 raft_consensus.cc:3060] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:19.575067 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.575757 30070 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:19.575855 22123 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:19.576471 30070 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:19.489411 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.565148 29864 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.577884 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.578547 22266 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
W20260709 12:13:19.574687 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 97011.7us
I20260709 12:13:19.579126 29864 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.579457 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.493263 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.580063 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.580986 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.580102 22266 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:19.582127 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.582546 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.495517 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.583405 22830 leader_election.cc:400] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 22. Current term is 23.
I20260709 12:13:19.583591 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.584288 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.569768 30028 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.496948 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.586323 30028 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:19.498549 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.498812 22271 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:19.588498 22263 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:19.584249 22123 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:19.589025 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:19.589704 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.590325 22123 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
W20260709 12:13:19.591198 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.526429 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.494096 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:19.543885 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.593423 22831 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:19.595086 30026 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:19.595481 30026 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.595857 30026 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:19.542570 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:19.591207 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.435158 30082 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:19.598176 29864 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:19.598328 30082 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:19.598655 29864 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:19.599156 29864 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:19.599494 30082 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.557511 22119 raft_consensus.cc:2410] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:13:19.601666 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.583204 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.445200 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.561345 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.602901 29940 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:19.563145 22118 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:19.603785 22121 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.605299 22122 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:19.549023 30087 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.569650 22114 raft_consensus.cc:2410] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:13:19.609936 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.610633 22114 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:13:19.611508 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.466180 22163 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:19.602880 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:19.612583 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 146523us
I20260709 12:13:19.613207 30069 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.615759 30022 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:19.616250 29901 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:19.616447 30022 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:19.617590 30022 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.573521 30002 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:19.616237 22118 raft_consensus.cc:2410] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:13:19.621752 29894 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.623193 22118 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:19.598598 22123 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:13:19.485589 22189 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:13:19.471478 22197 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:19.486796 22120 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 28.
I20260709 12:13:19.428524 29902 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.577507 30070 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.583153 22266 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:19.592549 30037 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.553285 30097 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:19.603179 30077 consensus_queue.cc:1059] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:19.565269 22115 raft_consensus.cc:2376] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15. Re-sending same reply.
I20260709 12:13:19.427325 29867 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:19.575127 22268 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:19.643774 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.599182 22116 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:19.644544 22270 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:13:19.632462 22864 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:19.634801 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.603035 22162 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:19.625249 22114 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 8.
I20260709 12:13:19.639070 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:19.646268 22197 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:19.581513 29754 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.647547 22122 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
W20260709 12:13:19.649001 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 46037us
I20260709 12:13:19.649060 22271 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:19.642638 22117 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:19.561733 29965 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:19.639292 30028 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.669173 22119 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:19.651831 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.705284 22116 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:19.657030 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:19.656486 22162 leader_election.cc:400] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18.
I20260709 12:13:19.650890 30030 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:19.642853 30097 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:19.674722 22266 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 23.
I20260709 12:13:19.710693 22263 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:19.658473 22121 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24.
I20260709 12:13:19.675076 30028 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.675765 30077 consensus_queue.cc:1243] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:19.676719 22115 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:19.648362 29867 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:19.677552 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.720016 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.646926 29819 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:13:19.673161 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.722980 22271 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.648155 30037 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.651993 22237 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:19.669811 22264 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:13:19.725432 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 73533us
I20260709 12:13:19.662370 30073 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:19.708645 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 62106.4us
I20260709 12:13:19.709331 22162 leader_election.cc:403] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 12:13:19.712066 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 55134.9us
I20260709 12:13:19.734725 22830 leader_election.cc:400] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for earlier term 22. Current term is 23.
I20260709 12:13:19.732335 22268 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:19.739730 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.723733 30030 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.677526 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.721570 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.751616 22270 raft_consensus.cc:2410] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:13:19.721824 22272 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:13:19.723127 22116 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:19.727972 30037 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.749950 22264 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:19.624141 29894 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:19.732198 29657 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.730602 22831 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:19.768455 22271 raft_consensus.cc:2410] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:13:19.771839 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:19.774995 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.715736 22197 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:19.707806 29864 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.724236 30008 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:19.749740 29867 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.757445 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.757643 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.704316 22122 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 28 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:13:19.744105 30015 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673) with higher term. Message: Invalid argument: T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18.
W20260709 12:13:19.760854 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 111049us
I20260709 12:13:19.732249 30105 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:19.732069 30104 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.775727 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.787611 22270 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 12:13:19.778522 22088 leader_election.cc:336] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.987s (SENT)
I20260709 12:13:19.790333 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.791129 22121 raft_consensus.cc:2393] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 20: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:19.791885 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.792455 22121 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:19.793220 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.793380 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:19.794066 22088 leader_election.cc:336] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.151s (SENT)
I20260709 12:13:19.758778 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.784096 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.758316 30069 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.785053 22266 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 25: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:19.794831 22268 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:19.795819 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.785569 22264 raft_consensus.cc:2393] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 17: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:19.796216 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.786453 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:19.797708 22860 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:13:19.794523 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.794423 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.794499 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:19.799556 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.801271 22117 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:13:19.798578 22121 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.774233 29894 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:19.732398 30026 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.779623 29901 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:19.806820 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.807088 22266 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:19.807101 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.814258 22266 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:19.809015 30072 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.815536 29980 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:19.815981 30072 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.817987 29901 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:19.818634 30072 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.818974 29901 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.819303 30072 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:19.820789 30097 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.821442 30073 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:19.786835 30008 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:19.823524 30097 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:19.824332 30008 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.795028 30069 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.783902 29907 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.044s
I20260709 12:13:19.777354 30037 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 12:13:19.829310 30037 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:19.829099 22266 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.829792 29864 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.830603 29867 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:19.832568 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.833257 22265 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:19.834900 22266 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:19.837087 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.837800 22123 raft_consensus.cc:1275] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:13:19.838176 22123 pending_rounds.cc:85] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 15
I20260709 12:13:19.838419 22123 pending_rounds.cc:107] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:13:19.838656 22123 raft_consensus.cc:2889] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:19.800439 30104 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.842744 22264 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:19.804683 29894 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.843835 29894 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:19.847977 29958 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:19.805038 30105 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:19.787070 30028 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:19.759410 30030 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.851073 30105 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.852593 30030 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.855844 22119 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:13:19.856411 22119 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:19.849494 30104 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:19.849663 22122 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:19.829675 30037 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:19.836930 22117 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:13:19.774885 29657 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:19.877753 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 83726.6us
I20260709 12:13:19.880056 22266 raft_consensus.cc:1275] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:13:19.878499 22088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 2.161s (SENT) [suppressed 46 similar messages]
I20260709 12:13:19.828639 30069 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.884192 22163 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:19.866709 30101 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.328s	user 0.004s	sys 0.000s
I20260709 12:13:19.886406 22120 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:19.886793 22120 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:19.888507 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.893231 22264 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:19.876447 30026 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:19.929352 22118 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:13:19.932525 22118 pending_rounds.cc:85] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 15
I20260709 12:13:19.932845 22118 pending_rounds.cc:107] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:13:19.933123 22118 raft_consensus.cc:2889] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:19.882015 22119 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:19.924894 22120 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.936388 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.937662 22268 raft_consensus.cc:2410] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:13:19.939122 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:19.939689 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:19.937518 22266 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
W20260709 12:13:19.942014 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57929us
I20260709 12:13:19.944617 22120 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:19.941224 22237 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:19.948529 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.949920 22121 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:19.950328 22267 raft_consensus.cc:1240] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:19.953933 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.954351 22117 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:19.954564 22271 raft_consensus.cc:2393] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:19.955282 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.955912 22122 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:13:19.956334 22271 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:19.957908 22271 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
W20260709 12:13:19.959336 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 175587us
I20260709 12:13:19.961199 22119 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:19.961519 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:19.962224 22271 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:19.962999 22266 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:13:19.964458 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:19.968143 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.968740 22120 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:19.972487 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.973237 22120 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:19.973311 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.974114 22122 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:13:19.975178 22266 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:19.978056 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:19.978792 22860 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 15: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:19.978525 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:19.979655 22197 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:19.979916 22831 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:19.980937 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.981873 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:19.983548 22120 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:19.983657 22115 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:19.931416 29958 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:13:19.978921 22271 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:13:19.961448 30097 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:19.961828 30105 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:19.963799 29739 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:19.992690 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:19.977850 30088 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:13:19.964038 30115 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.994264 22189 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:13:19.931732 29902 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:19.997655 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:19.975100 30066 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.005560 22115 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:19.982722 29980 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:20.009553 22189 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:20.006429 22197 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:13:19.995177 30097 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.995397 30105 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.993825 29739 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.001889 30026 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:20.030243 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:19.982221 30094 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:13:20.031744 22864 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:20.005797 30028 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.052409 22120 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:13:20.004884 29867 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.026973 30105 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:20.026613 30097 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:20.045426 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 90183us
I20260709 12:13:20.033033 29739 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:20.042410 30026 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.060563 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:20.064538 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:20.006448 30115 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.013718 30066 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.079181 29686 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:20.055670 30028 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.082536 30107 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:20.083632 30028 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:20.084977 29902 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:20.087885 30066 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:20.089174 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:20.063336 30026 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:20.088613 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.093799 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:20.066890 29980 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:20.072147 22115 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:20.103717 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.104396 22263 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:20.072628 29958 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:13:20.105352 30022 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:13:20.111382 22119 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:13:20.111768 22119 pending_rounds.cc:85] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 8
I20260709 12:13:20.111812 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:20.112711 22865 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:20.113114 22119 pending_rounds.cc:107] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:13:20.113529 22119 raft_consensus.cc:2889] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:20.114356 22163 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:20.066596 30082 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 12:13:20.119029 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 88908.7us
I20260709 12:13:20.103148 30066 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:20.119925 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:20.103709 29657 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:20.132706 22237 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:20.095346 29867 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:20.109274 29980 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:20.144843 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:20.137549 29686 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:20.129364 30066 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.161016 30066 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:20.163498 29864 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.163973 30030 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:20.164166 29864 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.164558 30030 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.148795 29686 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.166186 30115 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:20.166603 29686 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:20.167112 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:20.149478 30109 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.515s	user 0.000s	sys 0.005s
I20260709 12:13:20.152823 29657 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:20.153195 30077 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.176561 22264 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:13:20.154910 29867 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:20.157872 30126 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:20.113767 29958 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:20.169098 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.178467 30028 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:20.178756 30077 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:20.179423 30028 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.179958 30028 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:20.181042 30030 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:20.181456 30077 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:20.174942 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.183185 22189 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:20.178602 29958 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.183594 30087 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:20.173463 30082 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.184481 30082 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.175537 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:20.189764 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.194044 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.195561 22189 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:13:20.196910 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:20.203967 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:20.205170 22865 raft_consensus.cc:2368] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17.
I20260709 12:13:20.206632 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:20.223502 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.207372 22193 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:20.242129 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:20.244215 22197 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:20.241343 29657 raft_consensus.cc:2764] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:13:20.156170 29980 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:20.247927 30124 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:13:20.249285 22191 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260709 12:13:20.293355 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 183506us
I20260709 12:13:20.294248 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.297569 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.298285 22197 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:20.186853 30126 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.299821 22193 raft_consensus.cc:2393] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 20: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:13:20.302680 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 61229.8us
I20260709 12:13:20.303833 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:20.314249 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.263520 29864 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:20.322707 22191 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:20.323443 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.242115 30030 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:13:20.301851 30126 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:20.307214 29867 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:20.240234 29894 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.328006 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:20.342778 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.348001 22265 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
W20260709 12:13:20.350031 30127 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 12:13:20.352829 30125 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.242s	user 0.010s	sys 0.000s
I20260709 12:13:20.352383 30037 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.358959 30066 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:20.353374 30077 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:20.352873 22865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011db458534b4bc8876e63453a07b86b"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
W20260709 12:13:20.354092 30121 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:13:20.360172 22865 raft_consensus.cc:606] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.322379 30087 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:20.360608 22865 raft_consensus.cc:614] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:20.354393 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:20.359397 30037 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:20.360437 30107 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:13:20.371577 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 48335.7us
I20260709 12:13:20.353683 30082 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:20.365571 22860 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
W20260709 12:13:20.367388 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:20.384270 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.325748 30105 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.382937 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:20.385808 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.396214 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.396885 22194 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:20.399168 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.389578 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:20.400084 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:20.368886 29894 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:20.437454 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.438330 22269 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 15.
I20260709 12:13:20.438690 30026 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.439334 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.439951 22269 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
W20260709 12:13:20.440950 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.440953 22194 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:20.441931 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:20.443039 30107 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:13:20.443176 22194 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:13:20.443557 30107 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:20.444017 30107 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:13:20.444389 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:20.444934 30015 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.445514 22194 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:13:20.445480 30015 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:20.446503 22865 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:20.447028 30070 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:20.447541 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.447876 30015 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:20.448360 29867 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:20.449187 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 59708.6us
I20260709 12:13:20.449965 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:20.450378 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:20.452209 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:20.453639 22865 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:13:20.455490 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:20.456158 22194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:13:20.398630 30104 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:20.457229 30026 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:20.457437 30104 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:20.457931 30026 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:20.458334 30026 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.458513 30104 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:20.461087 22270 raft_consensus.cc:3060] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:20.462874 22194 raft_consensus.cc:606] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:20.466216 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 64649us
I20260709 12:13:20.446707 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:20.473949 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:20.485502 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:20.486474 22189 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:20.494673 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.500818 22163 leader_election.cc:400] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17.
I20260709 12:13:20.502167 22163 leader_election.cc:403] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:20.465466 30026 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:20.509320 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 59014.1us
I20260709 12:13:20.440505 30097 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:20.513156 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:20.492586 30132 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:13:20.510083 22830 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:20.520787 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 134488us
I20260709 12:13:20.521430 29958 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:13:20.461876 30073 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.101s
I20260709 12:13:20.488438 29894 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:20.495762 30008 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:20.527575 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:20.525983 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:20.466180 29901 consensus_queue.cc:1048] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 12:13:20.535110 22270 raft_consensus.cc:2468] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:20.542794 22189 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:20.543735 22191 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:13:20.544833 22265 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 23: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:20.507110 29867 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.546516 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.523115 29907 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:13:20.560849 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 170433us
I20260709 12:13:20.543865 30008 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.565364 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:20.562438 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 49477.8us
I20260709 12:13:20.554144 29657 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:20.522300 30087 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:13:20.570878 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.570988 22865 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:13:20.576996 30123 consensus_queue.cc:1059] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:13:20.577059 30140 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:20.578115 30123 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:20.578531 30123 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:20.578589 30140 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:20.579144 30140 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:20.579588 30123 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.579963 30140 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:20.567090 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:20.574681 22265 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:13:20.522099 29980 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.037s
I20260709 12:13:20.558364 29907 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.586155 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.586228 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.578133 30145 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:20.589018 29965 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:20.588846 30145 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:20.589810 29965 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:20.591425 30135 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:20.566756 30115 raft_consensus.cc:2804] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:20.564491 29894 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:20.593552 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:20.604274 22271 raft_consensus.cc:2368] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:13:20.605177 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.556869 29867 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:20.588928 30131 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:13:20.572224 30008 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:20.601004 30123 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:20.593055 29907 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:20.607223 30148 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:20.609228 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.624678 22271 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:20.625648 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.617286 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:20.606871 29657 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:20.623327 22191 raft_consensus.cc:1240] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:20.626616 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:20.634723 22120 raft_consensus.cc:3060] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:20.628506 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.633102 30148 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.637013 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:20.638906 30148 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:20.641806 29941 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:20.639075 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.643355 22272 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:20.643956 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:20.644219 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:20.644726 22191 raft_consensus.cc:2368] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22.
I20260709 12:13:20.641712 22119 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:13:20.650061 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.651551 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.610438 30088 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:13:20.655445 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:20.665777 22197 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:20.653390 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:20.667778 22118 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:20.671945 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:20.673026 22121 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:20.675958 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:20.676959 22271 raft_consensus.cc:2368] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21.
I20260709 12:13:20.676354 22120 raft_consensus.cc:2468] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
I20260709 12:13:20.678013 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:20.687959 22197 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:20.692791 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.693324 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:20.694841 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 52364.1us
I20260709 12:13:20.698650 29754 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:20.698005 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:20.699687 22189 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24.
I20260709 12:13:20.703243 22271 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:20.648298 30140 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:20.710125 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.704100 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.653318 30066 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:20.707298 22264 raft_consensus.cc:2376] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17. Re-sending same reply.
I20260709 12:13:20.714687 22264 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:20.642673 29980 consensus_queue.cc:1059] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 12:13:20.702890 29739 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.001s
I20260709 12:13:20.720743 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:20.730109 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 131961us
I20260709 12:13:20.734416 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:20.734459 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.736868 22860 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 23: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:20.644891 30126 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.743628 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:20.744875 22197 raft_consensus.cc:2393] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:20.703896 30105 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:20.740177 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.750332 30144 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:20.748529 22191 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:20.764108 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.765036 22191 raft_consensus.cc:2393] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:20.769200 22267 raft_consensus.cc:2393] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:20.773306 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.780933 22197 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 12:13:20.784087 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 80071.7us
I20260709 12:13:20.761592 30097 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:20.731627 29754 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.767836 30030 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.791006 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.791329 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:20.762773 30115 raft_consensus.cc:697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:20.792994 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.797737 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.799325 22197 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:20.720273 29894 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.772316 30145 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:20.752135 30066 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:13:20.737418 29739 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.809021 22271 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:20.809485 30088 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:13:20.814373 30028 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.006s
I20260709 12:13:20.814908 30028 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.816308 22268 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 21: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:20.821192 22263 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:20.822407 29754 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:20.822871 30077 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:20.769223 29657 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:20.823391 30077 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:20.833518 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:20.838649 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47395.2us
I20260709 12:13:20.839963 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.842085 22189 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:20.843338 22088 leader_election.cc:400] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17.
I20260709 12:13:20.845404 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:20.849251 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.850445 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:20.853299 22189 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:20.860250 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.876133 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:20.877035 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.877780 22197 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:13:20.880069 22189 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 14. Current term is 15. Ops: []
I20260709 12:13:20.800118 30030 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.889217 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.894284 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.875643 30107 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:20.906509 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:20.904079 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:20.879860 29965 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:20.923404 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:20.934085 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.934499 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:20.938326 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.944276 22120 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:20.953811 22122 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:20.954371 22122 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:20.955653 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:20.956503 22121 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:20.958196 22118 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:13:20.916900 29867 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:20.963699 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:20.967993 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 91946.4us
I20260709 12:13:20.972203 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:20.944198 29686 consensus_meta.cc:287] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.777s	user 0.013s	sys 0.000s
I20260709 12:13:20.941027 30066 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:20.957270 30139 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:13:20.969547 22122 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:20.984724 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.975852 29867 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:20.989192 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:13:20.961586 30138 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:13:20.951476 29941 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:20.961643 30143 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.995467 22194 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:20.988585 29867 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:20.997365 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:21.001966 22121 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 24.
I20260709 12:13:20.999315 22122 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:20.903370 30115 consensus_queue.cc:237] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:20.905515 30077 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 23.20, Last appended by leader: 20, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.031826 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:21.036454 22114 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:20.980455 29686 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:20.961570 30117 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.381s
I20260709 12:13:20.960584 30153 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.337s
I20260709 12:13:20.992142 30126 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.030906 29867 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:21.060921 30159 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:20.964795 30141 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.334s
I20260709 12:13:21.061957 22193 raft_consensus.cc:2368] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21.
I20260709 12:13:21.063019 22191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:13:21.066951 22191 raft_consensus.cc:606] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:20.990114 30066 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.036150 30143 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.036410 29941 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.113899 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:21.059643 30163 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:21.071697 22264 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:21.116465 22114 raft_consensus.cc:2468] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:21.127728 22121 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 21: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:13:21.144352 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 172268us
I20260709 12:13:21.145749 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:13:21.076594 30156 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:13:21.075342 30118 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.972s	user 0.000s	sys 0.013s
W20260709 12:13:21.071162 30158 log.cc:927] Time spent T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 12:13:21.076104 30155 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:13:21.089417 30120 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.026s	user 0.001s	sys 0.012s
I20260709 12:13:21.067968 30162 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:21.069079 30159 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:21.077577 29686 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:21.180610 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 292285us
I20260709 12:13:21.092922 30028 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:21.186146 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 452463us
I20260709 12:13:21.148351 30077 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:21.182714 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:21.068063 30171 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:21.128208 30163 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:21.194710 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:21.197440 22162 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:21.198210 22271 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:21.204161 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:21.200467 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:21.185221 30162 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:21.181257 30144 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:21.202538 30163 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:21.199754 29864 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:21.208134 30022 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:21.206790 29686 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:21.209018 30171 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:21.209642 30176 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:21.250254 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 46202us
W20260709 12:13:21.250272 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 104645us
I20260709 12:13:21.251364 22162 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:21.251528 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:21.222787 30162 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:21.229590 30107 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:21.234131 29980 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:21.191037 30159 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.267351 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 4130) took 1475 ms. Trace:
I20260709 12:13:21.268390 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:21.272637 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:21.258355 22271 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:21.267743 22116 rpcz_store.cc:276] 0709 12:13:19.792394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.859366 (+ 66972us) service_pool.cc:224] Handling call
0709 12:13:19.859745 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:19.860120 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:19.860148 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:19.877463 (+ 17315us) log.cc:844] Serialized 26 byte log entry
0709 12:13:19.975647 (+ 98184us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:13:19.975731 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:19.975891 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:20.899964 (+924073us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:21.257211 (+357247us) raft_consensus.cc:1685] finished
0709 12:13:21.257232 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:21.267285 (+ 10053us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":263,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":53901184,"thread_start_us":94359,"threads_started":1,"wal-append.queue_time_us":121786}
W20260709 12:13:21.250758 30026 consensus_meta.cc:287] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.722s	user 0.012s	sys 0.001s
W20260709 12:13:21.260107 29907 consensus_meta.cc:287] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.611s	user 0.012s	sys 0.000s
I20260709 12:13:21.255925 30030 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.269284 30184 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:21.262854 29980 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:21.294231 29980 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:21.283985 30022 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:21.297592 30159 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.297881 30176 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:13:21.302942 30169 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:13:21.248705 29864 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.307004 29864 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.307705 30175 raft_consensus.cc:993] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:13:21.313259 30143 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:21.314262 29958 consensus_meta.cc:287] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.773s	user 0.012s	sys 0.000s
I20260709 12:13:21.314810 29958 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17.
I20260709 12:13:21.315953 30097 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:21.317044 30184 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:21.317559 30184 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:21.318857 30148 consensus_meta.cc:287] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.000s
I20260709 12:13:21.319947 29867 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.321501 30171 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:21.312215 22830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.009s	sys 0.005s
W20260709 12:13:21.324002 22830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.009s	sys 0.005s
W20260709 12:13:21.324210 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 778244us
I20260709 12:13:21.287237 30172 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 12:13:21.342711 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:21.335989 29941 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.322963 29907 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.292343 30026 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.337399 30144 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.338565 30066 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.271083 30094 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:21.322199 29867 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:21.372457 29867 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.373169 29867 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.375458 29867 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:21.343967 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.379680 29907 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:21.383162 30008 consensus_meta.cc:287] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.748s	user 0.012s	sys 0.000s
I20260709 12:13:21.383661 30008 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.342850 30030 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:21.385545 30037 consensus_meta.cc:287] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 1.004s	user 0.009s	sys 0.003s
I20260709 12:13:21.385296 30030 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.388223 30030 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:21.342974 30148 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.391470 30148 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:21.392408 30117 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.393147 30117 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:21.394767 30133 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.957s	user 0.002s	sys 0.002s
W20260709 12:13:21.395237 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.395370 30028 consensus_queue.cc:1059] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:21.403625 29958 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:21.405330 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:21.342717 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.406513 30088 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:21.407091 30088 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:21.408269 22272 raft_consensus.cc:2368] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18.
I20260709 12:13:21.311120 30175 raft_consensus.cc:1081] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:13:21.409958 30175 consensus_queue.cc:1048] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:13:21.410491 30123 consensus_meta.cc:287] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.000s
I20260709 12:13:21.365304 30137 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.411760 30137 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.412356 30186 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:21.412837 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 2438) took 1026 ms. Trace:
I20260709 12:13:21.413292 22270 rpcz_store.cc:276] 0709 12:13:20.386242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.386385 (+   143us) service_pool.cc:224] Handling call
0709 12:13:21.412649 (+1026264us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b540029d1d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:21.412750 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42529664}
I20260709 12:13:21.414083 30137 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.356230 22268 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 12:13:21.364343 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 96109.5us
I20260709 12:13:21.431519 22088 leader_election.cc:400] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21.
I20260709 12:13:21.364529 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:21.353395 30143 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 12:13:21.396587 30028 raft_consensus.cc:3055] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:21.368755 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:21.446272 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 461624us
I20260709 12:13:21.446695 22197 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:21.415274 30026 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:21.416077 22864 raft_consensus.cc:2393] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:13:21.437986 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 73579.1us
W20260709 12:13:21.417599 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:21.331746 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65846.2us
I20260709 12:13:21.367597 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:21.451673 22163 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:21.421908 22190 raft_consensus.cc:2410] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
W20260709 12:13:21.417003 30164 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.432s	user 0.002s	sys 0.000s
I20260709 12:13:21.446738 22196 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:21.465497 22270 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:21.453114 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:21.461912 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:21.477133 30186 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:21.476281 22088 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:21.481587 30186 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:21.482405 30186 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:21.483707 30186 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.501652 22195 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:13:21.506214 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 138750us
W20260709 12:13:21.427801 29965 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
W20260709 12:13:21.508716 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 57130.8us
W20260709 12:13:21.436266 30140 consensus_meta.cc:287] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.718s	user 0.012s	sys 0.000s
I20260709 12:13:21.511857 22162 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:21.514683 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.521212 22860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:13:21.542188 22860 raft_consensus.cc:606] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:21.521905 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 68857.8us
I20260709 12:13:21.546977 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:21.547477 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:21.464308 30148 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:21.460632 30028 raft_consensus.cc:740] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:21.509409 30137 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:13:21.569638 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57920.6us
I20260709 12:13:21.500730 30066 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:21.572870 22269 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:13:21.408144 30088 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.587661 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:21.587733 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:21.521345 30097 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:21.521318 29965 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:21.522794 30176 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.588589 22269 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:21.589049 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:21.589293 22866 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:21.592242 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:21.595072 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:21.705425 22263 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:21.613963 30148 consensus_queue.cc:1059] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:13:21.644068 30174 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:13:21.649627 30167 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:21.642732 30183 consensus_queue.cc:1059] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.128s
I20260709 12:13:21.646449 30192 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:13:21.569816 30104 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:13:21.589780 30073 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 12:13:21.647110 30182 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:13:21.564739 30180 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:21.739445 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 192579us
I20260709 12:13:21.628880 22191 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:21.625589 30097 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:21.599105 29958 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:13:21.565466 30140 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:21.570022 30159 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:21.593674 30184 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.616701 29980 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.559908 29941 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:13:21.646688 30163 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.650552 22857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:13:21.756425 22857 raft_consensus.cc:606] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:21.591154 30066 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.633267 30171 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:21.642269 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:21.569604 29901 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.520242 30094 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:21.624111 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:21.763108 22198 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:21.708043 30146 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.187s
I20260709 12:13:21.709079 30008 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:21.709153 22263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45844
W20260709 12:13:21.716473 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 121578us
I20260709 12:13:21.747900 30183 consensus_queue.cc:1243] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:13:21.714572 30176 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:21.736810 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 148849us
I20260709 12:13:21.740425 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:21.641145 30175 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 12:13:21.772743 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:21.703325 30126 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:21.634644 30028 consensus_queue.cc:260] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.742148 30177 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:21.764565 30195 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:13:21.709448 30187 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:13:21.767894 22266 raft_consensus.cc:1240] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 8. Current term is 9. Ops: []
I20260709 12:13:21.766541 22263 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.771924 22120 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:21.774762 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:21.776041 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:21.777971 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:21.778128 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:21.796741 22263 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:21.779991 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:21.797715 22115 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:21.797932 22198 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:21.780619 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.797453 22118 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:21.773336 30183 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.804121 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4447) took 1397 ms. Trace:
I20260709 12:13:21.772670 30094 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:21.783936 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 195658us
I20260709 12:13:21.789152 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:21.773444 29902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.322s	user 0.008s	sys 0.016s
W20260709 12:13:21.640067 30115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.064s	sys 0.101s
I20260709 12:13:21.769604 30117 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:21.766463 29901 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.813390 29901 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:21.814036 30028 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:21.816849 30183 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.819157 30183 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.805330 30140 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:21.821317 30140 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.822188 30066 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.786660 30177 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:21.823526 30140 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:21.787274 30126 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.825285 30198 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:21.825990 30198 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.827100 30126 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.828191 30198 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:21.795289 22119 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:13:21.764652 30030 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:21.829370 30030 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.823540 30177 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:21.835446 22118 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:21.806183 22266 rpcz_store.cc:276] 0709 12:13:20.399041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.442895 (+ 43854us) service_pool.cc:224] Handling call
0709 12:13:21.767573 (+1324678us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b5800180398. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9deee 000000000036eb39 00007fccf2d111e0 00007fccf2dda0c4 00007fccf2dda131 00007fccf2d9bfc0 00007fccf2d86929 00007fccf2d863d2 00007fccec2fdbd4
0709 12:13:21.767722 (+   149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:21.796205 (+ 28483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:21.796408 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16576256}
I20260709 12:13:21.788348 30107 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:21.837359 30077 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.003s
I20260709 12:13:21.785344 30171 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:21.836947 22198 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:21.841419 22163 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:21.747025 30180 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:21.811302 29902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.364s	user 0.008s	sys 0.017s
I20260709 12:13:21.791615 30195 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:21.872314 30195 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.873476 30195 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:21.863639 29958 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:21.876873 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:21.877272 29958 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:21.877691 29958 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:21.881472 30163 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:21.882622 29980 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:21.884670 30180 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.852052 22263 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:21.890934 30162 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.001s
I20260709 12:13:21.891300 22263 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:21.851408 30140 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.893158 30140 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.894615 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:21.895395 30140 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.895450 22198 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:21.896560 30184 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.850224 30200 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:13:21.803364 30097 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:21.849102 30115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.065s	sys 0.101s
I20260709 12:13:21.860481 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:21.865928 30176 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.866709 30094 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.910946 22118 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 LEADER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 22. Current term is 23. Ops: [22.17-22.17]
W20260709 12:13:21.914729 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 54350.6us
I20260709 12:13:21.915573 22118 raft_consensus.cc:1240] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:21.917578 22118 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:13:21.918978 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:21.919734 22118 raft_consensus.cc:2393] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 23: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:21.921597 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:21.924297 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:21.924531 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:21.922636 22190 raft_consensus.cc:2376] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17. Re-sending same reply.
I20260709 12:13:21.926458 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:21.926666 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:21.928835 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:21.932233 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:21.933166 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:21.933799 22121 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:21.921572 30200 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:21.934525 30200 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:21.934909 30200 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:21.935177 22270 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:21.911679 29980 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.941098 29980 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.943217 29980 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.908916 30184 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.943851 30184 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.944298 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:21.944945 22191 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:21.945904 30184 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.946623 22196 raft_consensus.cc:2368] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22.
I20260709 12:13:21.946697 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:21.948293 22116 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 17: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:21.949393 29639 consensus_queue.cc:1059] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:21.951296 22192 raft_consensus.cc:2368] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:21.949196 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:21.940146 30177 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:21.962512 22191 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 23.
W20260709 12:13:21.967844 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.968894 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:21.973038 22265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 4450) took 1375 ms (client timeout 1750 ms). Trace:
I20260709 12:13:21.916153 30175 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.969594 22118 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:21.976796 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:21.977596 22118 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 28.
I20260709 12:13:21.978565 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:13:21.973690 22265 rpcz_store.cc:269] 0709 12:13:20.585577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.585985 (+   408us) service_pool.cc:224] Handling call
0709 12:13:21.960333 (+1374348us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000ea454. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:21.960470 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2360718080}
I20260709 12:13:21.923112 30176 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:21.988590 22121 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:21.987236 22088 leader_election.cc:400] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18.
I20260709 12:13:21.989609 22088 leader_election.cc:403] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:13:21.987757 22119 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 24.
I20260709 12:13:21.891446 30162 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:21.989903 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:21.991457 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:21.991783 22190 raft_consensus.cc:2393] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 20: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:21.992597 22116 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 21: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:21.968361 30022 raft_consensus.cc:3055] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:13:21.995957 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:21.997596 22121 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:22.006853 30162 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:22.006882 22116 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:22.008955 22115 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:21.983479 30028 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:22.010123 30144 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.010051 30028 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:22.010638 30144 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.013183 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:22.013489 30144 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:22.014489 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.015827 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.021028 30028 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:22.021106 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:22.063048 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.027022 30177 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:22.027382 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.064500 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.032284 30088 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:21.988996 30175 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:22.065963 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.066772 22192 raft_consensus.cc:2410] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 29 because replica has last-logged OpId of term: 28 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 19.
I20260709 12:13:22.067126 30175 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:21.998236 30176 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.067548 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:22.069192 30176 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:21.997397 30022 raft_consensus.cc:740] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:22.070346 30022 consensus_queue.cc:260] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.071611 30022 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:13:22.053524 22121 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:22.016498 22190 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:22.077679 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:22.079562 22121 raft_consensus.cc:2410] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 17 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:13:22.068599 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.091547 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:22.093608 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 137204us
W20260709 12:13:22.095877 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49051.1us
I20260709 12:13:22.095415 22087 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:22.098925 30177 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:13:22.102948 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.098255 22236 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
W20260709 12:13:22.104750 22197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 3066) took 1198 ms (client timeout 1524 ms). Trace:
W20260709 12:13:22.105232 22197 rpcz_store.cc:269] 0709 12:13:20.906012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.906248 (+   236us) service_pool.cc:224] Handling call
0709 12:13:22.104552 (+1198304us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54000fb4d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:22.104693 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958103296}
I20260709 12:13:22.105954 22189 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:13:22.110193 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:22.111419 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.112107 22192 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:22.112624 29958 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.115036 29958 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:22.115213 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:22.115989 22198 raft_consensus.cc:2376] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24. Re-sending same reply.
I20260709 12:13:22.116991 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.118156 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.119273 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:22.120127 22198 raft_consensus.cc:2410] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:13:22.121968 22192 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:22.122169 22195 raft_consensus.cc:1240] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:13:22.094336 30205 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18.
I20260709 12:13:22.137332 22198 pending_rounds.cc:85] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 13
I20260709 12:13:22.137727 22198 pending_rounds.cc:107] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:13:22.137969 22198 raft_consensus.cc:2889] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:22.103822 30144 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:22.138737 30144 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:22.142609 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:22.143467 22190 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:22.149173 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:22.149755 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.154414 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:22.161383 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 63287us
I20260709 12:13:22.162765 22236 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:22.173511 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:22.156566 30162 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:22.181493 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.181051 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:22.179006 22236 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:22.158776 30176 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:22.155609 30205 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:22.201628 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:22.209224 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:22.210330 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:22.210628 22192 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 16: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:22.211650 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:22.213146 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:22.215477 22864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 1273) took 1226 ms. Trace:
I20260709 12:13:22.216311 22864 rpcz_store.cc:276] 0709 12:13:20.988709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.988878 (+   169us) service_pool.cc:224] Handling call
0709 12:13:22.215253 (+1226375us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54006fc7d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:22.215408 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979266432}
I20260709 12:13:22.219324 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:22.220690 22270 raft_consensus.cc:1240] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:22.211220 22271 raft_consensus.cc:2410] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:13:22.222492 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34878 (request call id 2436) took 1837 ms. Trace:
I20260709 12:13:22.222898 22267 rpcz_store.cc:276] 0709 12:13:20.385393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.385538 (+   145us) service_pool.cc:224] Handling call
0709 12:13:22.222284 (+1836746us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b540026cfd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:22.222435 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856010496}
I20260709 12:13:22.223985 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:22.225423 30140 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:22.175312 30028 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:22.227418 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:22.227869 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.231791 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:22.237558 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:22.242908 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:22.226045 30140 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:22.249984 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:22.250252 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:22.251449 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:22.157143 30097 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 12:13:22.254737 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:22.189965 30163 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:22.254652 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:22.177299 30206 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:22.202581 30104 raft_consensus.cc:2804] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:22.256975 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:22.235397 30166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.284s	user 0.015s	sys 0.017s
I20260709 12:13:22.261353 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:22.262862 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:22.264516 22267 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:13:22.215437 30162 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:22.216534 30209 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:22.272202 22192 raft_consensus.cc:2368] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 22. Current term is 23.
I20260709 12:13:22.250557 30028 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:22.257478 29980 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:13:22.275437 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:22.278297 22270 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:22.278270 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.198668 30184 consensus_queue.cc:1059] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:13:22.279848 22122 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:13:22.263851 30175 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.282081 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:22.259910 30163 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.264544 30077 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:22.216816 30177 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
W20260709 12:13:22.271517 30166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.016s	sys 0.017s
I20260709 12:13:22.286743 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:22.290597 22122 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:22.253265 30205 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.289142 22265 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:22.293975 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:22.291390 30163 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:22.290051 30209 raft_consensus.cc:697] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:22.299078 30209 consensus_queue.cc:237] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:22.295023 30107 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:22.302656 30205 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:22.305054 30087 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:13:22.306551 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 3042) took 1722 ms. Trace:
I20260709 12:13:22.306957 22194 rpcz_store.cc:276] 0709 12:13:20.583856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.583987 (+   131us) service_pool.cc:224] Handling call
0709 12:13:20.584273 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:21.003536 (+419263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.306290 (+1302754us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54002369d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:22.306487 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945173888}
W20260709 12:13:22.311868 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.315629 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:22.316322 22116 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:13:22.317243 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:22.317494 22117 raft_consensus.cc:3055] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:22.317935 22117 raft_consensus.cc:740] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:22.318286 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:22.318737 22117 consensus_queue.cc:260] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.319360 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:22.320035 22117 raft_consensus.cc:3060] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:22.320843 22116 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:22.326256 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 4143) took 1386 ms. Trace:
I20260709 12:13:22.326823 22120 rpcz_store.cc:276] 0709 12:13:20.940538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.946501 (+  5963us) service_pool.cc:224] Handling call
0709 12:13:20.946803 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:21.797164 (+850361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.325879 (+528715us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54003129d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:22.326165 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897162496}
I20260709 12:13:22.276285 30171 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:22.329175 30162 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.333745 30140 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.275439 30104 raft_consensus.cc:697] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:22.278903 30028 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:22.332594 22118 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:22.357240 22118 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:22.345384 22190 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:22.363204 22190 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:22.364892 22190 raft_consensus.cc:1240] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:22.366760 22194 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 12:13:22.351501 22122 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24.
I20260709 12:13:22.280962 30186 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:13:22.353796 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60118.1us
I20260709 12:13:22.380146 22122 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:22.384517 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:22.386407 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:22.336618 30176 raft_consensus.cc:3055] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:22.407500 22117 raft_consensus.cc:1275] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:13:22.366525 30210 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:13:22.433881 22122 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:22.290789 30175 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:22.463630 30213 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.258s	user 0.001s	sys 0.001s
W20260709 12:13:22.440975 30153 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 12:13:22.420675 30176 raft_consensus.cc:740] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:22.479552 22117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 4138) took 1546 ms. Trace:
I20260709 12:13:22.486428 22192 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:22.458066 30126 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:22.485191 22117 rpcz_store.cc:276] 0709 12:13:20.933143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.936046 (+  2903us) service_pool.cc:224] Handling call
0709 12:13:20.936411 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:22.317389 (+1380978us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400045c20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd39dc0 00007fcceddc41c0 00007fcceddc5231 00007fcceddc1d8f 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c
0709 12:13:22.423828 (+106439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.479217 (+ 55389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674462080}
I20260709 12:13:22.443449 30200 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:22.502209 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:22.502562 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.504367 30066 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:13:22.504969 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:22.509791 22864 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 12:13:22.510233 22864 pending_rounds.cc:85] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Aborting all ops after (but not including) 16
I20260709 12:13:22.490348 30144 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:22.510476 22864 pending_rounds.cc:107] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 12:13:22.518464 22864 raft_consensus.cc:2889] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:22.513622 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:22.523780 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:22.527945 22117 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 12:13:22.473325 30104 consensus_queue.cc:237] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:22.532984 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:22.545078 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:22.494961 30177 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.550849 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:22.556372 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:22.554432 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:22.558363 22866 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 24: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:22.560858 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:22.564045 30222 log.cc:927] Time spent T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 12:13:22.564616 30220 log.cc:927] Time spent T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:13:22.565829 29739 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:22.569674 30175 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:22.573966 30200 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:22.576359 30149 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:22.576913 30149 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:22.577769 30149 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:22.578269 30088 consensus_meta.cc:287] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
W20260709 12:13:22.554754 30211 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:13:22.582919 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:22.545346 30144 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:22.584132 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:22.586380 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:22.588882 22268 raft_consensus.cc:3060] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:22.596060 22862 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:22.601882 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:22.605729 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:22.579937 29980 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.609424 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:22.563445 30177 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:22.644784 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:22.562109 30176 consensus_queue.cc:260] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.649772 22266 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:13:22.598668 30144 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:22.608271 30126 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:13:22.652886 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:22.654182 30137 raft_consensus.cc:3055] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:22.655045 22266 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 23.
I20260709 12:13:22.654655 30137 raft_consensus.cc:740] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:22.619171 29980 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:22.677803 30137 consensus_queue.cc:260] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.692948 30137 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:22.693310 30163 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:22.706400 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4466) took 1509 ms. Trace:
I20260709 12:13:22.679878 30176 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:22.708670 22272 rpcz_store.cc:276] 0709 12:13:21.197465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.410394 (+212929us) service_pool.cc:224] Handling call
0709 12:13:21.410677 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:21.410904 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:13:21.411224 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 12:13:22.504460 (+1093236us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b1800045400. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a 00007fcceddcca2a
0709 12:13:22.705986 (+201526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:22.706058 (+    72us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:22.706117 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.706195 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:22.706334 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2007,"prepare.queue_time_us":181,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":2143,"spinlock_wait_cycles":53763328,"thread_start_us":199201,"threads_started":1}
W20260709 12:13:22.724865 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:22.760076 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 349611us
I20260709 12:13:22.750430 30163 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:22.759152 30107 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:13:22.774232 22193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3462) took 2444 ms (client timeout 1752 ms). Trace:
W20260709 12:13:22.945235 22193 rpcz_store.cc:269] 0709 12:13:20.325571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.327746 (+  2175us) service_pool.cc:224] Handling call
0709 12:13:22.769737 (+2441991us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400109fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:22.769907 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655351552}
I20260709 12:13:22.762369 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:22.949365 30218 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.656s	user 0.003s	sys 0.000s
W20260709 12:13:22.813591 30229 log.cc:927] Time spent T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:13:22.950137 30137 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:22.950268 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:22.951303 30241 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:22.951875 30241 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:22.813127 30228 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:13:22.821195 30227 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:13:22.821596 30177 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:22.957648 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 3084) took 1033 ms. Trace:
I20260709 12:13:22.958082 22198 rpcz_store.cc:276] 0709 12:13:21.924442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.120716 (+196274us) service_pool.cc:224] Handling call
0709 12:13:22.137096 (+ 16380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:22.138734 (+  1638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:22.138773 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:22.139289 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:13:22.521780 (+382491us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:22.561311 (+ 39531us) log.cc:844] Serialized 14 byte log entry
0709 12:13:22.561599 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.561703 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:22.957394 (+395691us) raft_consensus.cc:1685] finished
0709 12:13:22.957418 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:22.957570 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39344,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":3774,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":382094,"threads_started":1,"wal-append.queue_time_us":558703}
W20260709 12:13:22.810375 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 202498us
I20260709 12:13:22.961390 30244 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:22.962006 30154 raft_consensus.cc:993] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:13:22.963253 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 4154) took 1037 ms. Trace:
I20260709 12:13:22.964088 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2956) took 1044 ms. Trace:
I20260709 12:13:22.964488 22115 rpcz_store.cc:276] 0709 12:13:21.919439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.919603 (+   164us) service_pool.cc:224] Handling call
0709 12:13:21.937174 (+ 17571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:22.009300 (+ 72126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.963856 (+954556us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b5400311ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:22.964028 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164653824}
I20260709 12:13:22.966015 22197 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:22.966753 22197 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:22.975510 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.935020 30144 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:22.770533 30115 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:13:22.916735 30234 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.112s	user 0.011s	sys 0.005s
I20260709 12:13:22.928872 30240 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:22.929323 29980 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:22.930512 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44372 (request call id 4155) took 1003 ms. Trace:
I20260709 12:13:22.982065 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3479) took 1010 ms. Trace:
W20260709 12:13:22.949561 30028 consensus_meta.cc:287] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.004s
I20260709 12:13:22.982895 30030 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:22.981722 22120 rpcz_store.cc:276] 0709 12:13:21.927033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.327819 (+400786us) service_pool.cc:224] Handling call
0709 12:13:22.328189 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:22.336664 (+  8475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:22.336712 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:22.337366 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 12:13:22.611962 (+274596us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:22.654972 (+ 43010us) log.cc:844] Serialized 14 byte log entry
0709 12:13:22.655198 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.655271 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:22.930283 (+275012us) raft_consensus.cc:1685] finished
0709 12:13:22.930306 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:22.930447 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56454,"prepare.queue_time_us":40010,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":28269,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":21342,"thread_start_us":191391,"threads_started":1,"wal-append.queue_time_us":383202}
I20260709 12:13:22.976181 22197 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.963783 22116 rpcz_store.cc:276] 0709 12:13:21.925362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.321616 (+396254us) service_pool.cc:224] Handling call
0709 12:13:22.321913 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:22.322286 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:22.322319 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:22.322790 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:13:22.518878 (+196088us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:22.747625 (+228747us) log.cc:844] Serialized 14 byte log entry
0709 12:13:22.750172 (+  2547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.750267 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:22.962922 (+212655us) raft_consensus.cc:1685] finished
0709 12:13:22.962953 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:22.963163 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":60147,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":1108,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":1918,"thread_start_us":389847,"threads_started":2,"wal-append.queue_time_us":287347}
W20260709 12:13:22.949455 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 187166us
I20260709 12:13:22.982581 22195 rpcz_store.cc:276] 0709 12:13:21.971583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.123020 (+151437us) service_pool.cc:224] Handling call
0709 12:13:22.123322 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:22.159852 (+ 36530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:22.159892 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:22.169688 (+  9796us) log.cc:844] Serialized 26 byte log entry
0709 12:13:22.619392 (+449704us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:22.619437 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.619507 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:22.981793 (+362286us) raft_consensus.cc:1685] finished
0709 12:13:22.981825 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:22.981999 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47211,"raft.queue_time_us":37193,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7737,"thread_start_us":390920,"threads_started":1,"wal-append.queue_time_us":562933}
I20260709 12:13:22.988921 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:22.912207 22268 raft_consensus.cc:2468] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 23.
I20260709 12:13:22.941612 30215 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:22.975512 30241 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:22.984872 30144 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:22.993865 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:22.986130 30240 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:22.957646 30137 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:22.998564 30240 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:22.992362 22197 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:22.998366 22236 leader_election.cc:400] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22.
I20260709 12:13:23.005002 22236 leader_election.cc:400] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:22.982910 30028 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:22.985265 30115 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.000983 30241 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:23.025038 22197 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24.
I20260709 12:13:23.018538 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:22.993772 30104 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:13:23.031241 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:22.993096 30215 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.001189 30144 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.033102 30240 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:23.045873 29864 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
W20260709 12:13:23.046020 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 83506.3us
I20260709 12:13:23.054735 30186 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.055418 30186 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.057561 30186 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.051739 30104 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:23.064752 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 3068) took 2133 ms. Trace:
I20260709 12:13:23.065258 22189 rpcz_store.cc:276] 0709 12:13:20.930372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.932893 (+  2521us) service_pool.cc:224] Handling call
0709 12:13:22.104728 (+1171835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:22.106363 (+  1635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:23.063184 (+956821us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000fb4d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:23.063373 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2693845760}
I20260709 12:13:23.062811 30137 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.071835 22236 leader_election.cc:400] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 22. Current term is 23.
I20260709 12:13:23.073012 22236 leader_election.cc:403] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
W20260709 12:13:23.072305 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.077430 30215 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:23.078104 30144 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:23.078460 30149 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:23.083364 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:23.084125 22268 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:23.075616 30107 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 22. Current term is 23.
I20260709 12:13:23.085103 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:23.086205 30240 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.086517 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:23.086705 30240 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.087390 30241 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:23.087967 30241 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.088418 30241 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:23.088541 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:23.088960 30177 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:23.089330 30177 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.089530 30209 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:13:23.097293 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.103135 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.105402 22193 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:13:23.106766 22116 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:23.089672 30177 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:23.113647 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:23.092905 30144 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:23.122313 22192 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:23.076156 30148 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:13:23.124403 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:23.124742 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.093956 30240 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:23.107415 30244 raft_consensus.cc:1081] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:13:23.141914 30144 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:23.142236 30255 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.098443 30182 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.107388 29980 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.142942 30255 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.164208 30070 consensus_queue.cc:1059] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:13:23.153256 29980 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.155768 30254 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:13:23.170858 30250 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:13:23.149950 30182 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.165432 30154 raft_consensus.cc:3055] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:13:23.179064 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 124783us
I20260709 12:13:23.170845 30028 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:23.172434 30115 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.143077 30144 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:23.194810 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.190075 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:23.205833 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:23.206239 29980 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.186623 30215 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:23.212667 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 84559.6us
I20260709 12:13:23.216673 22831 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:23.226648 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:23.183920 30154 raft_consensus.cc:740] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:23.210392 30215 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.185278 30254 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.227967 30115 raft_consensus.cc:2804] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:23.227475 30037 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:23.195535 30246 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:13:23.258805 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.259799 22862 raft_consensus.cc:2410] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:13:23.255239 30037 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.294416 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.282995 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:23.279762 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:23.302065 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:23.273340 22194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 3089) took 1038 ms. Trace:
I20260709 12:13:23.303476 22194 rpcz_store.cc:276] 0709 12:13:22.235242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.339486 (+104244us) service_pool.cc:224] Handling call
0709 12:13:22.364303 (+ 24817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:22.367427 (+  3124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:23.273148 (+905721us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b54000fc3d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:23.273279 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56190720}
I20260709 12:13:23.278294 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:23.278633 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:23.278916 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.286384 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:23.291162 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:23.291875 22269 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 12:13:23.306206 22269 pending_rounds.cc:85] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 12
I20260709 12:13:23.306612 22269 pending_rounds.cc:107] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:13:23.306840 22266 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:23.306993 22269 raft_consensus.cc:2889] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:23.308002 22116 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 12:13:23.296850 22087 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:23.309267 22263 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:23.270597 30215 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:23.317664 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:23.320858 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:23.321455 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.321564 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:23.322010 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.311920 29980 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.273340 30255 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.317183 30186 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:23.271747 30258 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:23.309267 30037 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:23.274116 30182 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.276990 30140 consensus_queue.cc:1059] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:13:23.311946 30066 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.339007 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.270437 30261 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 12:13:23.327696 30159 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.356166 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.353813 30066 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:23.359941 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.318428 30149 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:13:23.368796 30149 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:23.369371 30149 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:23.257860 30154 consensus_queue.cc:260] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.380595 22862 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:23.342190 30254 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:23.377259 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 150714us
I20260709 12:13:23.343641 22236 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:23.344611 30182 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.337519 30137 consensus_queue.cc:1059] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:13:23.387579 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:13:23.388118 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44859.5us
I20260709 12:13:23.390870 30209 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:23.331524 29980 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.386802 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:23.393210 30066 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.401891 29980 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:23.403303 30066 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.403960 30066 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:23.405563 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.407653 30066 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:23.408301 29754 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.409140 29754 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.410149 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:23.411914 30254 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:23.412154 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:23.412408 30254 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.412467 29754 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.413039 30254 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:23.413636 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:23.414541 30258 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:23.415185 30258 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 24 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:23.417198 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.419631 22116 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:23.421056 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:23.421675 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.421631 22194 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:23.423218 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:23.423619 22198 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:23.424470 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.429181 22116 raft_consensus.cc:2410] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 20 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:13:23.428551 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:23.429487 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.430409 22198 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:13:23.431562 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.433442 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:23.434345 22117 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:23.437665 22114 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:13:23.438476 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.394129 30186 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:23.441198 22119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1886) took 1521 ms. Trace:
I20260709 12:13:23.372232 30159 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.440919 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:23.446695 22119 rpcz_store.cc:276] 0709 12:13:21.920239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.995062 (+ 74823us) service_pool.cc:224] Handling call
0709 12:13:21.995435 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:22.047316 (+ 51881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:22.047352 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:22.050436 (+  3084us) log.cc:844] Serialized 26 byte log entry
0709 12:13:23.193561 (+1143125us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b18004108c0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced9620d1 00007fccedd7da0f
0709 12:13:23.293677 (+100116us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:23.326662 (+ 32985us) log.cc:844] Serialized 14 byte log entry
0709 12:13:23.430572 (+103910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:23.430649 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:23.430771 (+   122us) raft_consensus.cc:1685] finished
0709 12:13:23.440968 (+ 10197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:23.441134 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56360,"prepare.queue_time_us":14955,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":128666,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":44517,"spinlock_wait_cycles":11677312,"thread_start_us":198194,"threads_started":2,"wal-append.queue_time_us":1285991}
I20260709 12:13:23.450444 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:23.450868 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.452225 22264 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:23.397535 30209 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.416458 29686 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.442615 22118 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:13:23.443220 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:23.444245 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:23.444933 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:23.445091 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:23.457441 22114 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 20: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:23.446314 22120 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:23.446254 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.417836 30115 raft_consensus.cc:697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 23 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:23.459734 22192 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:23.461690 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:23.457515 22198 raft_consensus.cc:2376] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17. Re-sending same reply.
I20260709 12:13:23.422791 30246 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:23.394290 30182 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.475893 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:23.474576 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 144464us
I20260709 12:13:23.441141 30154 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:23.482997 22194 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:13:23.437675 30240 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.486052 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:23.489289 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.446765 30104 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.421555 30137 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:13:23.486302 22189 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:23.496639 22193 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:13:23.464295 30209 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:23.498184 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:23.477523 30267 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:13:23.499464 22193 pending_rounds.cc:85] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 10
I20260709 12:13:23.501731 22193 pending_rounds.cc:107] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:13:23.502017 22193 raft_consensus.cc:2889] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:23.503139 22117 raft_consensus.cc:1240] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22. Ops: [21.12-21.12]
W20260709 12:13:23.503154 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 87608.5us
I20260709 12:13:23.505264 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.470116 30144 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.519554 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.521272 22196 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:23.479312 29980 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.479890 30271 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:23.538004 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.473173 29686 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.547799 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.521888 30162 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:23.520289 30273 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:23.475812 30149 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.493604 30240 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.564153 22865 raft_consensus.cc:1275] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:13:23.574458 22268 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:23.574709 30153 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:23.576116 30153 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:23.577000 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:23.562011 30246 consensus_queue.cc:1059] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:13:23.504544 30265 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 12:13:23.569880 30186 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.514117 30104 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.524086 30066 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:13:23.513851 30268 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.065s
I20260709 12:13:23.574458 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:23.583108 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:23.584861 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 86835.8us
I20260709 12:13:23.585966 22162 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:23.584865 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 61994.1us
I20260709 12:13:23.587934 22270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:13:23.588598 22270 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.589010 22270 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:13:23.567677 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.590801 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.591583 22866 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
W20260709 12:13:23.587486 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72009.1us
I20260709 12:13:23.529858 30144 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.602407 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:23.541646 29980 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.636986 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.592876 30030 raft_consensus.cc:2804] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:23.590826 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:23.564060 30278 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.503237 30258 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 23.20, Last appended by leader: 20, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.695353 30273 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:23.695791 30273 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:23.696154 30273 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:23.696648 29980 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:23.697237 30252 log.cc:927] Time spent T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.523s	user 0.008s	sys 0.007s
I20260709 12:13:23.560318 30115 consensus_queue.cc:237] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:23.676668 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 60066.5us
W20260709 12:13:23.678274 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 83754.8us
I20260709 12:13:23.593034 30272 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.601250 30276 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:23.580905 30107 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.584349 30256 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:23.684451 30226 raft_consensus.cc:3055] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:23.657985 30180 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:13:23.687821 30270 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 12:13:23.692662 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 101927us
I20260709 12:13:23.717506 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:23.681123 30271 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.718880 30271 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.708835 30107 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.685019 30255 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:13:23.725406 30107 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:23.708503 30272 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:23.727836 30177 consensus_meta.cc:287] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 12:13:23.729035 30272 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.729585 30104 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:23.730192 29754 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.721972 30271 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.730676 29754 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.731580 30159 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:23.733747 29754 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.725477 29686 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.738945 30254 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:23.747509 30241 consensus_meta.cc:287] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.658s	user 0.012s	sys 0.001s
I20260709 12:13:23.748020 30241 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.749629 30240 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:23.750073 30241 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:23.714759 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 181885us
I20260709 12:13:23.754094 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:23.705616 30276 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:23.709149 30256 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:23.757759 30285 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:23.756137 22270 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.705752 30182 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.763556 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:23.713991 30226 raft_consensus.cc:740] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:23.728295 30177 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.777384 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:23.756064 30066 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:23.704962 30278 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.779261 29686 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.780462 30144 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:23.728662 30037 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.782794 30037 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.783535 22857 raft_consensus.cc:2393] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 24: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:23.776516 30271 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 12:13:23.780021 30226 consensus_queue.cc:260] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.784631 30226 raft_consensus.cc:3060] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:23.786820 30276 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.792526 22863 raft_consensus.cc:2410] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:13:23.755766 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:23.790922 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:23.795743 22270 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:23.796306 22088 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:23.789336 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 113645us
I20260709 12:13:23.797678 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:23.800891 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 45216.3us
I20260709 12:13:23.799953 29980 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:23.803169 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:23.788576 30182 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:23.793377 30271 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:23.759647 30272 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:13:23.799726 30275 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:23.819469 30209 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.841594 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:23.842222 22270 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:23.843039 30209 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:23.843688 30209 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:23.844103 30209 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.846441 22237 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:23.847635 30226 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:23.847700 22237 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:23.760180 30280 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:13:23.812733 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:23.801100 30254 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:23.825954 30290 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:23.806316 30037 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:23.857679 30290 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:23.825263 30176 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:23.858095 30290 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:23.858381 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:23.858991 22857 raft_consensus.cc:3055] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:13:23.859282 22857 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:23.830072 30148 raft_consensus.cc:3055] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:23.831807 30278 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:23.863077 22270 raft_consensus.cc:2468] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 24.
I20260709 12:13:23.863406 30070 raft_consensus.cc:993] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:13:23.857821 22860 raft_consensus.cc:1275] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:23.833913 30177 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:23.864207 30286 raft_consensus.cc:1081] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:13:23.849586 30256 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.860699 30226 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:23.835762 22017 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 250) took 29336 ms (client timeout 15000 ms). Trace:
I20260709 12:13:23.836187 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:23.851487 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:23.867426 22237 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:23.837549 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:13:23.840898 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.867983 22269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:13:23.868501 22831 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:23.780038 29686 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.853300 30126 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:23.854208 30274 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:23.885686 30274 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:23.885962 30180 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:23.886145 30274 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:23.865325 30256 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:23.885864 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.870528 30226 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:23.891167 29754 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:23.892110 30215 consensus_queue.cc:1059] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:23.893349 30115 raft_consensus.cc:2804] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:23.894157 29864 consensus_queue.cc:1048] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:23.894639 30182 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.894990 30115 raft_consensus.cc:697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 24 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:23.895258 30182 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.896113 30176 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.896018 30115 consensus_queue.cc:237] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.897858 30182 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.860288 22857 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.900949 22857 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:13:23.836840 22018 catalog_manager.cc:5697] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 12 to 13, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 13 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:23.850072 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 147478us
I20260709 12:13:23.868654 22269 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.902469 22269 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:23.903014 22018 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 17 to 18, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 18 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.849536 22830 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:23.896720 30176 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:23.905457 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 56008.6us
I20260709 12:13:23.906864 30176 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.907063 30154 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:23.907619 30180 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:23.904721 22018 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 21 to 22, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 22 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:23.909050 22018 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 15 to 16, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 16 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:23.910392 22018 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.899031 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.913326 22860 raft_consensus.cc:2410] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 24 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:13:23.899075 29686 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:23.899400 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.861814 30148 raft_consensus.cc:740] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:23.914506 30276 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:23.915311 30148 consensus_queue.cc:260] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:23.915990 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:23.884995 30293 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:23.911936 22018 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 15 to 20, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 20 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.906929 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:23.917547 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 47388.5us
I20260709 12:13:23.916886 29686 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:23.925128 22269 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:23.930938 22018 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 18 to 19, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 19 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.921751 22857 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:13:23.935549 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.936401 22189 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:13:23.942315 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:23.945253 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.916391 30148 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:23.949867 22237 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:23.953271 22117 raft_consensus.cc:1275] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:13:23.957335 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:23.958081 22116 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:23.960479 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:23.961305 22195 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:23.963189 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:23.963961 22189 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:23.916456 30209 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:23.929184 30177 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:23.992918 22265 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:23.990530 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:13:23.997344 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47570.5us
I20260709 12:13:23.989812 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:23.966496 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.002907 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:24.004868 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:23.998554 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 56375.2us
I20260709 12:13:23.993968 22018 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 15 to 16, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 16 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:24.006199 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:23.999816 30226 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:13:24.008262 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:23.986795 22269 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:23.948231 30293 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.933485 30246 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:24.014520 22266 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:23.966255 30126 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.016634 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.015523 22861 raft_consensus.cc:2393] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:23.987016 30273 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.018791 30293 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.014789 30177 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.013634 22264 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:24.025643 30104 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:24.025599 30226 raft_consensus.cc:697] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:24.026465 30290 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:24.000043 30288 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:13:24.027988 30241 consensus_queue.cc:1048] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:23.943717 30070 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.085s
I20260709 12:13:24.029117 22236 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:23.995235 30144 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.062s
W20260709 12:13:24.089658 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 60655.7us
I20260709 12:13:24.090762 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:24.024344 22195 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:24.034360 22018 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 15 to 17, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:23.933921 29686 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:24.103703 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65238.1us
I20260709 12:13:23.946882 30272 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.042502 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.043608 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.107815 22118 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:23.966410 30182 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.967680 30176 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.079876 30271 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.054293 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.117309 22018 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 14 to 15, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.058565 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.066855 30285 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.070341 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.070794 30028 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.070919 30126 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:23.865734 22017 rpcz_store.cc:269] 0709 12:12:54.895918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.897638 (+  1720us) service_pool.cc:224] Handling call
0709 12:13:23.835646 (+28938008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:18.683803 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:18.684605 (+   802us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:18.684679 (+    74us) write_op.cc:435] Acquired schema lock
0709 12:13:18.684719 (+    40us) tablet.cc:662] Decoding operations
0709 12:13:18.714267 (+ 29548us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:18.714370 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:18.714395 (+    25us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:13:18.715959 (+  1564us) tablet.cc:701] Row locks acquired
0709 12:13:18.716027 (+    68us) write_op.cc:260] PREPARE: finished
0709 12:13:18.716211 (+   184us) write_op.cc:270] Start()
0709 12:13:18.716372 (+   161us) write_op.cc:276] Timestamp: P: 1783599198716139 usec, L: 0
0709 12:13:18.716395 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:13:18.828528 (+112133us) log.cc:844] Serialized 7538 byte log entry
0709 12:13:19.024447 (+195919us) op_driver.cc:464] REPLICATION: finished
0709 12:13:19.112473 (+ 88026us) write_op.cc:301] APPLY: starting
0709 12:13:19.112592 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:19.482877 (+370285us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:19.483050 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:20.092492 (+609442us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:20.092930 (+   438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:13:20.092977 (+    47us) write_op.cc:312] APPLY: finished
0709 12:13:20.093523 (+   546us) log.cc:844] Serialized 172 byte log entry
0709 12:13:20.326026 (+232503us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:20.333319 (+  7293us) write_op.cc:454] Released schema lock
0709 12:13:20.395692 (+ 62373us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:20.450825 (+ 55133us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:20.450858 (+    33us) write_op.cc:454] Released schema lock
0709 12:13:21.394035 (+943177us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
Metrics: {"mutex_wait_us":2046818,"reported_tablets":40,"spinlock_wait_cycles":18176,"child_traces":[["op",{"apply.queue_time_us":87703,"apply.run_cpu_time_us":147690,"apply.run_wall_time_us":1338321,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83585,"num_ops":19,"prepare.queue_time_us":249523,"prepare.run_cpu_time_us":15647,"prepare.run_wall_time_us":197117,"raft.queue_time_us":18082,"raft.run_cpu_time_us":11412,"raft.run_wall_time_us":64963,"replication_time_us":307864,"spinlock_wait_cycles":63787392,"thread_start_us":487404,"threads_started":5,"wal-append.queue_time_us":370424,"wal-append.run_cpu_time_us":12423,"wal-append.run_wall_time_us":3152442}]]}
I20260709 12:13:24.079931 22266 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:24.083542 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.012845 30209 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:13:24.094727 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:24.043880 30030 raft_consensus.cc:697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:24.107210 22120 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:24.052448 22116 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:24.150614 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:24.151369 22116 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:24.118736 22272 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:13:24.069411 30240 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.122628 30176 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.080173 30104 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.123011 30180 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.130802 30293 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:24.131151 30162 consensus_meta.cc:287] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 12:13:24.130851 30290 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:24.043238 30274 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:24.132740 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.175719 22123 raft_consensus.cc:1240] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 12:13:24.176213 22267 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 9.
I20260709 12:13:24.135164 30149 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:24.136940 30271 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.140146 22863 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:24.124404 30272 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.124543 30182 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:24.143232 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:24.185473 22118 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:13:24.119961 22018 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.147312 22122 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:13:24.153848 22119 raft_consensus.cc:2393] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:24.162221 22116 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
I20260709 12:13:24.107569 29686 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:24.106452 30137 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:24.109097 30140 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:24.169373 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 170225us
I20260709 12:13:24.145886 30286 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:24.149081 30107 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.178789 30162 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:24.133471 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:24.205951 22858 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:24.179787 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:24.163276 29980 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.166508 30104 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:24.201144 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:24.170167 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 163058us
W20260709 12:13:24.194809 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 303089us
I20260709 12:13:24.194535 30286 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:24.193989 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:24.166747 30240 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.206419 22858 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:24.290012 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.165129 30028 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:24.303140 22120 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:24.193223 30186 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.148468 30285 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.207238 30241 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:24.208415 22018 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 9 to 11, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 11 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.331288 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:24.334820 22118 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 12.
I20260709 12:13:24.345072 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.345950 22118 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
W20260709 12:13:24.335582 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 141661us
I20260709 12:13:24.284027 30163 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.181488 30226 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:24.317221 30162 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.349344 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:24.353906 22018 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 14 to 15, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 15 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:24.359907 22018 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.339295 30177 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:24.284008 30107 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.361693 22269 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:24.358835 22163 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:24.362869 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.363143 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.333159 22858 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:24.333057 29980 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.365423 22197 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:13:24.362787 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.368528 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.369048 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.366359 22195 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:13:24.369138 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:24.371407 22197 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:24.365650 22018 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:24.371990 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.372292 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:24.351325 30282 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:24.378123 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.382006 22193 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:13:24.385089 22865 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 24 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:13:24.388099 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:24.379640 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.376279 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.396229 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.395676 22122 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:24.361604 30163 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:24.378589 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 283972us
I20260709 12:13:24.373427 30273 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.352295 30186 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:24.457146 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.289291 30030 consensus_queue.cc:237] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.335289 30283 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:13:24.474037 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:24.375646 30296 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:13:24.475921 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 126668us
I20260709 12:13:24.397505 30161 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:24.486620 30126 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:24.397720 30286 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:24.367837 30162 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.488021 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:24.488502 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 100521us
I20260709 12:13:24.492089 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:24.487936 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.502863 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:24.506217 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:24.511861 22120 raft_consensus.cc:2468] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
I20260709 12:13:24.380694 30302 consensus_queue.cc:1059] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.119s
I20260709 12:13:24.517442 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:24.561764 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44388.2us
W20260709 12:13:24.484311 30305 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:13:24.517103 30201 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:24.566773 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 63991.9us
I20260709 12:13:24.569355 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:24.571714 22120 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:13:24.572088 22120 pending_rounds.cc:85] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 10
I20260709 12:13:24.572348 22120 pending_rounds.cc:107] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:13:24.572593 22120 raft_consensus.cc:2889] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:24.517560 30176 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.517019 30180 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.515374 30273 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.522416 30303 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:24.515131 30137 consensus_queue.cc:1048] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 12:13:24.554243 30271 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.654883 22118 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 12:13:24.655426 22117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.008s	sys 0.016s
I20260709 12:13:24.517221 30320 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
W20260709 12:13:24.601651 30298 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
W20260709 12:13:24.673110 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 110429us
I20260709 12:13:24.611763 30290 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.566380 30272 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:24.650170 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 81434.5us
W20260709 12:13:24.681658 30299 log.cc:927] Time spent T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.193s	user 0.003s	sys 0.000s
I20260709 12:13:24.694199 29980 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:24.674743 30318 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.159s	user 0.000s	sys 0.003s
I20260709 12:13:24.657503 30319 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:24.695577 30240 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:24.695963 30319 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.696583 30319 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:24.681519 30286 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:24.710212 30315 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:13:24.715996 30149 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.532s	user 0.004s	sys 0.005s
I20260709 12:13:24.666569 30163 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.677553 30176 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:24.722198 30176 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.682013 30285 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.722657 30176 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:24.593041 30201 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.693791 30334 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.724743 30201 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.724677 30334 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.688069 30326 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.726145 30326 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.727021 30334 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.613998 30322 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:24.717303 30186 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.717931 30162 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.728238 30326 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.614353 30273 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.730772 30273 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:24.731271 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 415075us
I20260709 12:13:24.735031 30310 consensus_queue.cc:1048] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:24.738778 30182 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:24.741489 30300 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.676s	user 0.002s	sys 0.004s
W20260709 12:13:24.742733 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.692648 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:24.743646 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51136.4us
I20260709 12:13:24.744349 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:24.744833 30258 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:24.746368 30258 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:24.746181 30278 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:24.746789 30258 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:24.747004 30278 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.747430 30278 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:24.749265 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:24.689388 30306 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.218s	user 0.004s	sys 0.000s
I20260709 12:13:24.753346 30149 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:24.753831 30149 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.754161 30149 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:24.755728 29686 consensus_meta.cc:287] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 12:13:24.756198 29686 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:24.722448 22121 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:13:24.758011 22191 raft_consensus.cc:2368] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:24.758526 29686 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:24.759210 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.760807 30104 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.719237 30028 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:24.778550 22272 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:24.720498 30329 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:24.720831 30323 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:24.784483 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.785218 22264 raft_consensus.cc:1240] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:24.744422 22864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56938 (request call id 1283) took 1274 ms. Trace:
I20260709 12:13:24.762030 22830 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:24.788746 22830 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:24.763368 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:24.764156 30291 raft_consensus.cc:3055] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:24.804612 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:24.692795 30290 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:24.718197 30148 consensus_meta.cc:287] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.002s
I20260709 12:13:24.778913 22263 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:24.812239 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:24.779579 22270 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:13:24.779498 30137 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.781322 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.840708 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.840968 30257 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:24.841524 22271 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:13:24.842669 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.843806 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.844508 22271 raft_consensus.cc:2410] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:13:24.781724 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.845557 30282 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:24.845553 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.846645 22189 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 23 index: 20. Preceding OpId from leader: term: 24 index: 21. (index mismatch)
I20260709 12:13:24.847018 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:24.847620 30316 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:13:24.847712 22267 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:24.848333 30290 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.849238 22195 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 12:13:24.849475 30312 log.cc:927] Time spent T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.779s	user 0.003s	sys 0.002s
I20260709 12:13:24.850180 30137 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.785732 22864 rpcz_store.cc:276] 0709 12:13:23.470597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.470827 (+   230us) service_pool.cc:224] Handling call
0709 12:13:23.471171 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:23.471408 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:23.484332 (+ 12924us) log.cc:844] Serialized 14 byte log entry
0709 12:13:23.838537 (+354205us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b18001d9200. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd5522 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:13:24.478275 (+639738us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b18001d9200. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcced96a4bc 00007fcceacb848b 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a
0709 12:13:24.744079 (+265804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.744129 (+    50us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:24.744172 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.744256 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.744365 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":265478,"prepare.queue_time_us":21945,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":270095,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":26618368,"thread_start_us":29975,"threads_started":1,"wal-append.queue_time_us":42870,"wal-append.run_cpu_time_us":1471,"wal-append.run_wall_time_us":1032728}
I20260709 12:13:24.808214 30279 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:24.810149 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.810604 22196 raft_consensus.cc:1275] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:24.778542 30274 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 29 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:24.814731 22197 raft_consensus.cc:1240] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:24.768942 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 84759.3us
I20260709 12:13:24.861186 22193 raft_consensus.cc:2393] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:24.779881 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.821724 30104 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:24.806627 30154 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:24.823957 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.757962 30258 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:24.825296 30115 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:24.872881 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.826505 22192 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:24.828882 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:24.829375 30176 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.831223 30148 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.832877 30320 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.883050 22088 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:24.883504 30320 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.884210 30066 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:24.790055 30028 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:24.839296 30317 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
I20260709 12:13:24.848564 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.851867 30319 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.781263 29980 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.072s
I20260709 12:13:24.804612 30309 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.016s
W20260709 12:13:24.680364 22117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.008s	sys 0.024s
I20260709 12:13:24.816241 22123 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:24.855933 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:24.859102 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.861068 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.861780 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:24.805287 30291 raft_consensus.cc:740] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:24.862860 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.897352 22114 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:24.865327 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:24.852670 30159 raft_consensus.cc:3055] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:24.866261 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.902021 22121 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 15.
I20260709 12:13:24.903234 22858 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:24.864415 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.904410 22190 raft_consensus.cc:2410] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 23 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:13:24.866719 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:24.904603 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.867792 22263 raft_consensus.cc:2393] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 9: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:24.900452 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.905848 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.906490 22115 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:24.899665 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:24.907543 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.871963 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.874029 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:24.868376 30154 raft_consensus.cc:697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:24.860373 29686 raft_consensus.cc:493] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.881053 22857 raft_consensus.cc:1240] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: [15.15-15.15]
I20260709 12:13:24.905404 22117 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:13:24.881541 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:24.910043 22861 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:24.910149 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:24.911396 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:24.882650 30148 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:24.913931 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.914618 22272 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
W20260709 12:13:24.914736 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 53075.7us
I20260709 12:13:24.915462 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.915480 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:24.887234 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:24.897055 30104 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.863853 30240 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.891238 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:24.893857 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:24.936800 22192 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:24.898286 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.825017 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:24.897081 30177 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:24.918455 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.938040 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.918555 30271 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:24.860906 30279 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:24.918867 30066 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:24.893450 30028 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.946285 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.919516 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.919739 29686 raft_consensus.cc:515] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:24.925549 30320 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:24.926470 30258 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:24.912627 30159 raft_consensus.cc:740] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:24.927591 30291 consensus_queue.cc:260] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:24.928717 29980 consensus_queue.cc:1243] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 24.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:13:24.930491 22861 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:24.917312 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:24.916249 22272 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
W20260709 12:13:24.936712 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45594.9us
I20260709 12:13:24.918067 22268 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:24.938055 22123 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:24.939036 22866 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:24.938040 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.941481 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.942701 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.918761 30154 consensus_queue.cc:237] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:24.945307 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:24.947276 22115 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:24.940152 30329 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:24.951385 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.974928 22114 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 8.
I20260709 12:13:24.943553 30279 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:24.989182 22266 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
W20260709 12:13:24.967643 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.971374 22263 raft_consensus.cc:2393] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 23: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:24.972445 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:24.949939 30066 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:24.974646 22267 raft_consensus.cc:2410] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:13:24.954568 22162 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:24.973793 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:24.993651 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 76447.8us
I20260709 12:13:24.948630 30272 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:24.951752 30320 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.022035 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:24.999663 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:25.019351 22268 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:24.940860 30240 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.024957 22162 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:25.048339 22162 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:24.944048 30177 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.050051 22863 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 1288) took 1223 ms. Trace:
I20260709 12:13:25.050467 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.050535 22863 rpcz_store.cc:276] 0709 12:13:23.826721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.826889 (+   168us) service_pool.cc:224] Handling call
0709 12:13:25.049820 (+1222931us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540071f054. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:25.049971 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378562432}
I20260709 12:13:25.051362 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.053056 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.055761 22123 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:25.055982 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.056870 22195 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:25.058890 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.059124 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.059706 22194 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 24.
I20260709 12:13:25.060802 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.061836 22192 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 25: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:25.062511 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.063246 22195 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:25.065606 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.066377 22190 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 24.
I20260709 12:13:25.067412 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.028396 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:24.985850 30258 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.953510 30327 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:25.069795 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:24.994633 30126 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:13:24.940694 30104 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.023178 30226 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:25.078931 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 45467us
I20260709 12:13:25.087440 22271 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:13:25.079478 22191 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:25.071882 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:25.023089 30215 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:25.026114 30332 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:25.096698 22195 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:13:25.081840 22268 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:25.083314 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.099051 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:25.032151 30301 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:25.099427 22267 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 12:13:25.084041 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.103350 22267 pending_rounds.cc:85] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 8
I20260709 12:13:25.103986 22267 pending_rounds.cc:107] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 12:13:25.104212 22267 raft_consensus.cc:2889] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:25.027526 29980 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:13:25.080922 30303 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:25.096350 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:25.079854 30274 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:13:25.027350 30271 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:13:25.054772 30161 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:13:25.027977 30272 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.031214 30320 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.098397 30332 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:25.118065 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:25.083127 30180 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:25.097806 30215 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.121136 22118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44368 (request call id 2990) took 1075 ms. Trace:
I20260709 12:13:25.122447 22264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4519) took 1035 ms. Trace:
I20260709 12:13:25.103303 30301 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:25.136521 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.103610 30335 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:25.139787 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:25.082396 30258 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.139729 22264 rpcz_store.cc:276] 0709 12:13:24.086765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.087102 (+   337us) service_pool.cc:224] Handling call
0709 12:13:24.087406 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.790304 (+702898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.122133 (+331829us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b540026bbd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:25.122366 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604357376}
I20260709 12:13:25.139196 22118 rpcz_store.cc:276] 0709 12:13:24.045755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.346703 (+300948us) service_pool.cc:224] Handling call
0709 12:13:24.362283 (+ 15580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.679850 (+317567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.120707 (+440857us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54002ad5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:25.121046 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582725376}
I20260709 12:13:25.113935 22191 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
W20260709 12:13:25.151894 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 123588us
I20260709 12:13:25.114475 30274 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.085007 30327 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.159188 22087 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:25.137447 30329 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:25.179875 22862 raft_consensus.cc:1240] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 24 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:13:25.173070 22163 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:25.138036 30137 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.187723 30137 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.109656 30066 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.188231 30137 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.191320 30321 consensus_queue.cc:1059] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:25.192098 30321 consensus_queue.cc:1243] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 24.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:13:25.190305 30137 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.149058 30215 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:25.185900 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 286288us
I20260709 12:13:25.193717 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.141058 30332 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:25.152331 30335 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.152643 30301 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:25.160602 30153 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:25.159813 30115 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.161090 30274 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:13:25.139720 30296 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:13:25.149255 30182 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:25.208245 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:25.178306 30329 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.176754 30326 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:25.175308 30319 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.166793 30273 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:13:25.200179 30148 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:25.192970 30030 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:25.204826 30335 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:25.258792 22858 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:25.263002 22858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56938 (request call id 1293) took 1258 ms. Trace:
I20260709 12:13:25.251703 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:25.208863 30153 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:25.265647 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 57470.1us
I20260709 12:13:25.266004 30153 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.266134 30240 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.181605 30180 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:13:25.263896 22858 rpcz_store.cc:276] 0709 12:13:24.004188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.088615 (+ 84427us) service_pool.cc:224] Handling call
0709 12:13:24.902809 (+814194us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b580063f5d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd1e0aa 00007fccedda0447 00007fcceddb8fe7 00007fcceddba7de 00007fcceddc627c 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c
0709 12:13:25.262914 (+360105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889759488}
I20260709 12:13:25.248908 30309 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.036s
I20260709 12:13:25.230224 30272 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:25.249294 30329 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.229943 30028 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.233016 30182 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:25.235155 30226 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:13:25.268193 30343 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:25.280566 30343 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:25.281002 30343 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:25.203967 30282 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:13:25.234649 30115 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.292374 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:25.278724 30336 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:13:25.278210 30339 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:13:25.309688 22236 leader_election.cc:400] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
W20260709 12:13:25.278461 30278 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.000s
W20260709 12:13:25.297322 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.295778 30240 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:13:25.317040 30258 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:25.317955 30345 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:13:25.320425 30320 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.271359 30104 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.310176 22236 leader_election.cc:403] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:13:25.312961 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4511) took 1312 ms. Trace:
I20260709 12:13:25.337248 22265 rpcz_store.cc:276] 0709 12:13:24.000804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.001078 (+   274us) service_pool.cc:224] Handling call
0709 12:13:24.018844 (+ 17766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.109014 (+ 90170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.109057 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.109102 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:13:24.109128 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.312676 (+1203548us) spinlock_profiling.cc:243] Waited 89.9 ms on lock 0x7b540026ded4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:25.312730 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.312894 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206838016}
I20260709 12:13:25.278179 30182 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:25.277824 30177 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:25.276889 30326 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:25.306646 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:25.272913 30327 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:25.277411 29980 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:25.490449 30104 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:25.499950 30162 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:25.500861 30162 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.501605 29980 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.502090 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:25.502449 30355 log.cc:927] Time spent T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.119s	user 0.000s	sys 0.002s
I20260709 12:13:25.502979 30162 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:25.335968 30278 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.504033 29980 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:25.504338 30115 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:25.504865 30350 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.193s	user 0.000s	sys 0.009s
I20260709 12:13:25.505498 30278 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.313818 30303 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 12:13:25.506765 30303 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:25.507464 30303 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:25.496745 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 189144us
I20260709 12:13:25.306500 30226 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:25.489750 30326 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:25.500065 30149 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.011s
I20260709 12:13:25.505739 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.496094 22116 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 21: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
W20260709 12:13:25.386813 30341 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:13:25.508137 30335 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.513478 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:25.514434 22198 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:25.547139 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.500123 30137 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.549742 22119 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 22. Current term is 23. Ops: [22.10-22.10]
I20260709 12:13:25.550998 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:25.553735 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:25.554594 22116 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:25.564651 22116 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:25.573702 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:25.574667 22265 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:25.582969 22236 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:25.586024 22119 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:25.586117 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44368 (request call id 2993) took 1539 ms. Trace:
I20260709 12:13:25.586555 22122 rpcz_store.cc:276] 0709 12:13:24.046414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.194526 (+148112us) service_pool.cc:224] Handling call
0709 12:13:25.585961 (+1391435us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b5400311fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:25.586066 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142839680}
I20260709 12:13:25.531934 29980 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:25.508409 30303 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.590204 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:25.590787 22831 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:25.565734 30282 consensus_queue.cc:1243] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:13:25.593168 22119 raft_consensus.cc:3055] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:25.616328 22119 raft_consensus.cc:740] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:25.617295 22119 consensus_queue.cc:260] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.618450 22119 raft_consensus.cc:3060] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:25.566645 30177 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:25.610884 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:25.533537 30149 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.585162 30180 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:25.565943 30162 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:25.530983 30104 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 12:13:25.588358 30344 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:25.588886 30148 raft_consensus.cc:2804] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:25.661587 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:25.593446 30037 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:13:25.661517 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 92973.6us
I20260709 12:13:25.588886 30028 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 12:13:25.664594 22088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.702s (SENT) [suppressed 17 similar messages]
I20260709 12:13:25.618604 30278 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:25.666354 30303 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:25.663844 30286 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:25.689518 22119 raft_consensus.cc:1275] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 12:13:25.707413 22119 pending_rounds.cc:85] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 16
I20260709 12:13:25.707688 22119 pending_rounds.cc:107] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 12:13:25.707942 22119 raft_consensus.cc:2889] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:25.663650 30319 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:25.665591 30320 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:25.663452 30162 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.566896 30137 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.611080 29980 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.696254 30344 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:25.718832 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:25.703938 30177 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:25.707275 30286 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.725379 30153 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.717135 30104 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:25.714284 30266 consensus_queue.cc:1048] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.015s
W20260709 12:13:25.729156 30367 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:13:25.729758 30177 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.731344 30293 raft_consensus.cc:3055] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:13:25.733634 30357 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:13:25.734490 30365 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:13:25.702598 30037 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.741120 30286 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:25.750514 30324 log.cc:927] Time spent T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.175s	user 0.003s	sys 0.010s
I20260709 12:13:25.751338 29980 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:25.714147 30364 consensus_queue.cc:1059] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:13:25.726178 30344 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:25.754617 30162 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:25.740399 30104 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:25.757253 30337 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.671s	user 0.004s	sys 0.010s
I20260709 12:13:25.757113 30335 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:25.713452 30320 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:25.717459 30319 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.723740 30327 consensus_queue.cc:1059] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:13:25.819097 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:25.743503 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:25.819936 22192 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:25.770350 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.772601 22120 raft_consensus.cc:1240] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:25.752815 30149 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.777521 22119 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:13:25.777691 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 526515us
W20260709 12:13:25.827747 30332 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.003s
I20260709 12:13:25.828269 30332 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.830588 30332 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:25.832413 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.833086 22195 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 29: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:25.833236 22196 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:13:25.833714 30153 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:25.835779 30226 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:25.835989 30176 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:25.819310 30343 consensus_meta.cc:287] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.002s
I20260709 12:13:25.816177 30320 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:25.837131 30343 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:25.837738 30215 consensus_meta.cc:287] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.000s
I20260709 12:13:25.838129 30215 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.839475 30343 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.804653 30104 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:25.840296 30215 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:25.804034 30301 consensus_meta.cc:287] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.001s
I20260709 12:13:25.841522 30301 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.843582 30301 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:25.844884 30137 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.808632 30070 consensus_queue.cc:1048] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
W20260709 12:13:25.771340 30279 consensus_meta.cc:287] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.742s	user 0.013s	sys 0.000s
W20260709 12:13:25.787278 30356 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:13:25.741380 30329 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.859802 30319 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.861109 30329 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:25.809789 30276 consensus_queue.cc:1059] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:13:25.795264 30344 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.862385 30276 raft_consensus.cc:3055] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:25.862872 30276 raft_consensus.cc:740] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:25.863716 30344 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:25.763820 30293 raft_consensus.cc:740] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:25.864841 30293 consensus_queue.cc:260] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.865880 30293 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:25.866334 22270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3462) took 1090 ms. Trace:
I20260709 12:13:25.866763 22270 rpcz_store.cc:276] 0709 12:13:24.775962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.776111 (+   149us) service_pool.cc:224] Handling call
0709 12:13:24.779350 (+  3239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:24.816561 (+ 37211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.866147 (+1049586us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b540026b6d0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:25.866278 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6625664}
I20260709 12:13:25.866606 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:25.774887 30258 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:25.869195 30258 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.870117 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:25.806492 30360 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:25.871309 30258 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:25.871076 30360 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.807175 30037 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:25.769273 30373 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:25.872310 30373 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:25.872736 30373 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:25.873262 30037 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.873457 30360 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:25.873778 30037 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.874328 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:25.875031 22119 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:25.875907 30037 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:25.849711 22123 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:25.850975 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:25.877355 22191 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:25.877701 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:25.805392 30266 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 28.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:13:25.857553 30279 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.813877 22114 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:25.871449 22237 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:25.879448 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 214870us
W20260709 12:13:25.885043 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.888588 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:25.889539 22119 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:25.884037 22237 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:25.895180 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:25.895563 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:25.896008 22115 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:25.899030 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:25.903246 30377 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:25.880681 30226 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.906334 22162 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:25.907294 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:25.864046 30276 consensus_queue.cc:260] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.836500 30286 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.882148 30327 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:25.880455 30137 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:25.932331 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:25.894138 30149 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:25.899730 30370 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:25.928375 30329 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.931633 30215 raft_consensus.cc:2804] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:25.933610 30376 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:25.911070 30226 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:25.970016 22115 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:25.950615 30327 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:25.928596 30360 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:13:25.951453 30137 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:25.971266 30274 consensus_meta.cc:287] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.723s	user 0.013s	sys 0.000s
I20260709 12:13:25.963838 30149 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:13:25.967264 30182 consensus_meta.cc:287] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.582s	user 0.013s	sys 0.000s
I20260709 12:13:25.956956 30370 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:25.971478 30376 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:25.979398 30104 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:25.990236 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 112615us
I20260709 12:13:26.004383 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:25.990460 22269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45844 (request call id 4518) took 1932 ms (client timeout 2543 ms). Trace:
I20260709 12:13:25.985811 22162 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:25.970151 30215 raft_consensus.cc:697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:25.957688 30329 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:26.016968 22269 rpcz_store.cc:269] 0709 12:13:24.058114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.058282 (+   168us) service_pool.cc:224] Handling call
0709 12:13:25.990245 (+1931963us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400160dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:25.990392 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552186112}
I20260709 12:13:26.025435 22197 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:13:26.026389 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:26.026686 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:26.027207 22190 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:26.027421 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:26.028071 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:25.981442 30364 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:25.991683 30271 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:26.031459 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 369977us
I20260709 12:13:26.041136 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:26.034188 22163 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:26.041908 22192 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:26.046097 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:26.042362 29864 consensus_queue.cc:1059] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:13:26.049824 30303 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:26.050537 29864 raft_consensus.cc:3055] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:26.050928 29864 raft_consensus.cc:740] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:26.051153 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:26.052174 30290 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:26.051816 29864 consensus_queue.cc:260] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.031200 30332 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:26.067677 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.040239 30256 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.015280 30274 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.086364 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:26.022018 30182 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.054369 30344 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:13:26.045251 30364 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:26.044993 30271 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.112237 22189 raft_consensus.cc:2368] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10.
I20260709 12:13:26.057510 30363 raft_consensus.cc:2804] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:26.067198 30286 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:26.081578 22190 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 25.
I20260709 12:13:26.111683 30274 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:26.086548 30256 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:26.054147 30177 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:26.109957 22087 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:26.160288 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 113455us
I20260709 12:13:26.169546 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:26.176188 22123 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:13:26.177138 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:13:26.178020 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 68131.5us
I20260709 12:13:26.178893 30177 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.110246 30372 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:26.052750 30149 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:26.075783 30349 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:26.190649 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:26.106392 30370 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:26.162204 30279 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:26.120119 29864 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:26.203353 30387 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:13:26.205255 30388 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 12:13:26.206406 30382 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:13:26.206715 30364 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:26.179736 30363 raft_consensus.cc:697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:26.207991 30363 consensus_queue.cc:237] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.183828 30177 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:26.180122 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:26.217079 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:26.217769 22114 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:26.163939 30323 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.189886 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:26.236764 22190 raft_consensus.cc:3060] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:26.238478 22123 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:13:26.191349 22192 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:26.081701 30148 raft_consensus.cc:697] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:26.108457 30153 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.077s
W20260709 12:13:26.201840 30361 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:13:26.105189 30215 consensus_queue.cc:237] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.235828 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:26.182978 29980 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:26.252123 22190 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:26.253743 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:26.254501 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:26.285878 22121 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:26.262405 22192 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:26.241493 30372 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:26.291888 22114 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:26.274534 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:26.073949 30327 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:26.211350 30286 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 12:13:26.190073 30373 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:26.248292 30323 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:26.271795 30104 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:26.241525 30279 consensus_queue.cc:1059] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:13:26.290067 30278 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:26.123453 30376 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:26.295032 29980 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:26.307346 30258 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:13:26.354020 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 176956us
I20260709 12:13:26.356289 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:26.357275 22088 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:26.325620 30137 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:26.308239 30372 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:26.359794 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:26.330302 30278 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:26.355737 30258 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:26.371754 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 73718.5us
W20260709 12:13:26.465723 30396 log.cc:927] Time spent T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.159s	user 0.002s	sys 0.000s
I20260709 12:13:26.414330 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:26.385500 30256 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:26.386554 29980 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.384608 30107 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:26.434382 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:26.472699 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:26.440922 30395 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:13:26.370983 30278 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:26.438350 30137 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:26.381630 30385 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:26.370798 30272 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:26.360972 30273 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:26.380959 30386 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:26.414479 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:26.373894 30258 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:26.413771 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.414973 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:26.414140 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:26.552320 30293 consensus_meta.cc:287] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.003s
I20260709 12:13:26.478262 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:26.402581 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:26.560870 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 158368us
I20260709 12:13:26.562111 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:26.481973 30372 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.563613 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:26.564316 22267 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:26.541217 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58296.3us
I20260709 12:13:26.541918 22268 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:26.548513 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:26.549525 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:26.358222 30148 consensus_queue.cc:237] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.558497 22122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1908) took 1538 ms. Trace:
I20260709 12:13:26.568845 22122 rpcz_store.cc:276] 0709 12:13:25.019647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.587509 (+567862us) service_pool.cc:224] Handling call
0709 12:13:25.611464 (+ 23955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:25.751846 (+140382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.751878 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:25.751920 (+    42us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:25.751951 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.558321 (+806370us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54003124d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:26.558355 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.558453 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322324224}
I20260709 12:13:26.569921 22088 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:26.565989 22264 raft_consensus.cc:2410] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:13:26.566644 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:26.404091 30271 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:26.554859 30373 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:26.578318 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:26.581137 22088 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:26.572093 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:26.616089 22191 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:26.648643 22272 raft_consensus.cc:3055] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:26.649194 22272 raft_consensus.cc:740] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:26.564666 30273 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:26.650022 22272 consensus_queue.cc:260] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.651132 22272 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:26.651790 30271 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:26.653718 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:26.654448 22122 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 12.
I20260709 12:13:26.554647 30137 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:26.571923 30272 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:26.692852 30154 consensus_queue.cc:1059] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 28.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.031s
I20260709 12:13:26.680316 30373 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:26.731516 30373 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.655328 30403 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:26.733558 30403 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:26.734041 30403 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:26.688997 30162 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:26.680437 30409 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:26.753427 30137 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:26.732436 22272 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:13:26.758661 22272 pending_rounds.cc:85] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 10
I20260709 12:13:26.758960 22272 pending_rounds.cc:107] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:13:26.759286 22272 raft_consensus.cc:2889] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:26.703095 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:26.705090 30412 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 12:13:26.705765 30402 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
W20260709 12:13:26.707170 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.559397 30386 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:26.690303 30323 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:26.810611 22118 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:26.716204 30271 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:26.828404 22265 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:26.830968 30399 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.831564 30149 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.832410 30149 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.838205 30149 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:26.838650 22189 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3515) took 1778 ms (client timeout 1551 ms). Trace:
W20260709 12:13:26.843320 22189 rpcz_store.cc:269] 0709 12:13:25.058700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.064114 (+  5414us) service_pool.cc:224] Handling call
0709 12:13:26.836525 (+1772411us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400235fd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:26.836731 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2318937344}
I20260709 12:13:26.796413 30409 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:26.831535 30399 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:26.856801 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 289639us
I20260709 12:13:26.842013 30290 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:13:26.869750 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 288688us
I20260709 12:13:26.850572 30149 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:26.871829 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
W20260709 12:13:26.860795 30332 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.001s
I20260709 12:13:26.839954 30271 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.872291 30176 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:13:26.884419 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:26.877805 29980 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:26.877422 30332 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:26.868746 30290 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.890105 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:26.921448 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:26.888981 30273 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:26.890584 29980 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.926011 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:26.890692 30409 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:26.891178 30320 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.052s	user 0.015s	sys 0.000s
I20260709 12:13:26.929471 30414 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:26.877192 30149 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.931663 30176 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:26.925621 30332 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:26.919307 30159 consensus_queue.cc:260] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.938436 22120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1911) took 1776 ms. Trace:
I20260709 12:13:26.974339 22120 rpcz_store.cc:276] 0709 12:13:25.162412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.664975 (+502563us) service_pool.cc:224] Handling call
0709 12:13:25.665860 (+   885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:25.821093 (+155233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.938195 (+1117102us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540031d654. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:26.938377 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244911872}
I20260709 12:13:26.927989 29980 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:26.942975 30376 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:26.943005 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:26.985273 22272 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:26.985150 30376 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:26.944959 30407 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:26.945338 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:26.986397 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:26.986534 30407 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:26.987027 22272 raft_consensus.cc:3060] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:13:26.987511 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:26.945775 30283 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.948200 30386 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:26.948429 22268 raft_consensus.cc:1275] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:13:26.989886 22268 pending_rounds.cc:85] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 11
I20260709 12:13:26.950059 30037 raft_consensus.cc:3055] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:26.950737 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:26.991706 22270 raft_consensus.cc:3060] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:26.951926 30291 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:26.952121 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:26.996862 22264 raft_consensus.cc:3060] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:26.952915 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:26.955853 30177 consensus_meta.cc:287] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.002s
I20260709 12:13:26.987699 30376 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:26.946296 22267 raft_consensus.cc:1240] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:26.990151 22268 pending_rounds.cc:107] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:13:27.007942 22272 raft_consensus.cc:2468] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 10.
I20260709 12:13:27.008404 22268 raft_consensus.cc:2889] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:27.014074 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 87923.7us
I20260709 12:13:27.015313 22088 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:27.012552 22270 raft_consensus.cc:2468] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:27.016942 30386 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:27.020284 30148 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:27.020990 30148 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.021466 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:27.022620 30423 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:26.991468 30037 raft_consensus.cc:740] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:26.998292 30283 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.025327 30148 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:27.026163 30283 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:26.991962 30407 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:27.034332 30290 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.035571 30271 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.035835 30258 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.037604 30290 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.038129 30290 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.041249 30176 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:27.043937 30283 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.044466 30283 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:27.042475 30162 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:27.042125 30258 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:27.047200 30283 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.035748 22264 raft_consensus.cc:2468] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:27.042460 30290 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:27.049590 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.050212 30149 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:27.052569 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:27.055963 22264 raft_consensus.cc:1240] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:27.064502 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:27.065366 22198 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:27.065521 22120 raft_consensus.cc:1240] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:26.956609 30320 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:27.067416 30162 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:13:27.075387 30162 raft_consensus.cc:2764] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 12:13:27.076427 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.077389 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.077994 22270 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:27.077839 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:27.080932 22268 raft_consensus.cc:2368] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10.
I20260709 12:13:27.083298 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.084679 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:27.086545 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.087648 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:27.088016 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.088133 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.088389 22269 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:27.086112 22270 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:27.018245 30328 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:27.091253 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:27.102056 22863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.102775 22863 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 12.
I20260709 12:13:27.104378 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.104935 22861 raft_consensus.cc:2468] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:27.106244 22266 raft_consensus.cc:2393] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 20: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:27.112071 30319 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.077123 30407 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:27.114790 22088 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:27.112751 30319 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.115757 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.081930 30162 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:27.116297 22198 raft_consensus.cc:2468] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:27.117847 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.121928 30386 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:27.123911 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.125602 30319 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:27.126230 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.127928 30408 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:27.128069 30286 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.128486 30408 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.128871 30286 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.120427 22830 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:27.019127 30177 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.215101 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.136036 22120 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 29 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 28. Current term is 29. Ops: []
W20260709 12:13:27.442157 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 327405us
I20260709 12:13:27.227393 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.443063 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.448904 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.447190 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.455876 22120 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:27.262501 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:27.472645 22198 raft_consensus.cc:2410] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
W20260709 12:13:27.469280 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.474179 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.480047 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.215626 30162 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:27.131870 30286 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.482640 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:27.482883 30286 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.483548 30286 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.484257 30162 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.481972 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.485384 22865 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:27.485572 29686 leader_election.cc:290] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:27.486474 30310 raft_consensus.cc:3055] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:27.486589 22865 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:27.258123 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:27.266983 30429 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 12:13:27.267814 30413 log.cc:927] Time spent T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:13:27.483878 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:27.265470 30375 log.cc:927] Time spent T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.431s	user 0.006s	sys 0.000s
W20260709 12:13:27.344789 30428 log.cc:927] Time spent T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 12:13:27.117043 30278 consensus_meta.cc:287] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.000s
I20260709 12:13:27.114377 30321 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:27.504927 22267 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:27.487380 30344 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:27.234124 30372 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:27.132593 30280 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.133213 30279 raft_consensus.cc:2804] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:13:27.471125 30316 log.cc:927] Time spent T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:13:27.506839 22864 raft_consensus.cc:2393] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 16: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:27.107026 30328 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:27.227619 30386 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:27.117588 29980 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:27.512989 22865 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:13:27.133158 30407 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.272595 30326 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.456002 30320 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:27.523880 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.487044 30310 raft_consensus.cc:740] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:27.235720 30403 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:27.552307 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.537814 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.410772 30409 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.558384 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.548110 30408 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.536579 30278 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:27.572227 30407 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:27.572363 30328 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.573585 30286 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.556838 30279 raft_consensus.cc:697] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 18 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:27.545578 30372 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.547681 30280 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.543586 30321 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.544332 30344 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.552619 30326 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:27.586748 30403 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.587988 30373 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:27.589489 30332 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
I20260709 12:13:27.590571 30332 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:27.593364 30344 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:27.593997 30397 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 1.420s	user 0.007s	sys 0.008s
I20260709 12:13:27.595316 30329 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:27.561005 30409 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.602849 30399 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:27.593549 30393 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 1.425s	user 0.007s	sys 0.005s
I20260709 12:13:27.603323 30409 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.493374 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.646653 22116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1909) took 2626 ms. Trace:
I20260709 12:13:27.504839 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:27.649253 22119 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:27.649894 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.650786 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.651698 22267 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 15.
I20260709 12:13:27.652196 22272 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 21: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:27.653431 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.653788 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.654434 22271 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:27.656309 22267 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:13:27.529839 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.660102 22829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.037s	sys 0.087s
W20260709 12:13:27.660679 22829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.037s	sys 0.087s
W20260709 12:13:27.661949 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.646653 22120 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 25.
I20260709 12:13:27.665956 22122 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:27.669620 22859 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:13:27.647596 22116 rpcz_store.cc:276] 0709 12:13:25.019981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.590593 (+570612us) service_pool.cc:224] Handling call
0709 12:13:25.590897 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:25.627093 (+ 36196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.627128 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:25.627602 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:13:25.710629 (+ 83027us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:25.721312 (+ 10683us) log.cc:844] Serialized 14 byte log entry
0709 12:13:25.721956 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.722054 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.264548 (+1542494us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:27.645306 (+380758us) raft_consensus.cc:1685] finished
0709 12:13:27.645620 (+   314us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.646228 (+   608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38271,"prepare.queue_time_us":10560,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":24208,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":16598,"spinlock_wait_cycles":100375936,"thread_start_us":76660,"threads_started":2,"wal-append.queue_time_us":142907}
I20260709 12:13:27.671250 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.672333 22859 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:27.675814 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 3492) took 1174 ms. Trace:
I20260709 12:13:27.677922 22264 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:27.682358 22865 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:27.685663 30226 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:27.676492 22266 rpcz_store.cc:276] 0709 12:13:26.501170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.542525 (+ 41355us) service_pool.cc:224] Handling call
0709 12:13:27.675129 (+1132604us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b540026c0d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:27.675606 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242432896}
I20260709 12:13:27.573800 30182 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.752010 22860 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:27.753451 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.754523 22265 raft_consensus.cc:2410] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 12:13:27.758000 22116 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:27.760740 22123 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 22. Current term is 23. Ops: [22.10-22.10]
I20260709 12:13:27.761298 22114 raft_consensus.cc:1240] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:27.781461 30030 raft_consensus.cc:3055] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:27.782213 30030 raft_consensus.cc:740] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:27.579018 30310 consensus_queue.cc:260] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.783751 30310 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:27.784430 22263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3468) took 3006 ms. Trace:
I20260709 12:13:27.784955 22263 rpcz_store.cc:276] 0709 12:13:24.777694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.995211 (+217517us) service_pool.cc:224] Handling call
0709 12:13:25.990400 (+995189us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:25.992079 (+  1679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.992111 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:25.992906 (+   795us) log.cc:844] Serialized 52 byte log entry
0709 12:13:26.101188 (+108282us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:26.552070 (+450882us) log.cc:844] Serialized 14 byte log entry
0709 12:13:26.552312 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.552386 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.592734 (+1040348us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
0709 12:13:27.659086 (+ 66352us) raft_consensus.cc:1685] finished
0709 12:13:27.659251 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.783994 (+124743us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b5400160dd0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:27.784199 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1091,"prepare.queue_time_us":72162,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":14506,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":19983,"spinlock_wait_cycles":2253072000,"thread_start_us":439604,"threads_started":2,"wal-append.queue_time_us":148196}
I20260709 12:13:27.786736 30326 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.789551 30279 consensus_queue.cc:237] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.793576 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.793398 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:27.794973 30280 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.795861 22269 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 22: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:27.798513 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:27.799609 22123 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:27.814517 30177 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:27.805454 22864 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:27.830297 30321 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:27.849861 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.851806 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.854341 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.855755 22120 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 18: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:27.784128 30030 consensus_queue.cc:260] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.10, Last appended by leader: 10, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:27.863133 30291 consensus_meta.cc:287] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.855s	user 0.026s	sys 0.002s
I20260709 12:13:27.863744 30030 raft_consensus.cc:3060] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:27.867542 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:27.830832 30278 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:27.871390 30276 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:27.883466 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:27.888895 30439 log.cc:927] Time spent T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:13:27.860091 22118 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:27.893822 30159 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:27.894373 30177 raft_consensus.cc:476] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 12:13:27.894840 30372 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:27.899170 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:27.900353 22857 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:27.828591 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.902712 30037 consensus_queue.cc:260] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:27.904203 30037 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:27.917616 29980 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:27.924552 22264 raft_consensus.cc:1240] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:27.926473 22270 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:13:27.927616 22271 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:27.928247 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:13:27.929255 22271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45860 (request call id 3489) took 1514 ms (client timeout 1783 ms). Trace:
I20260709 12:13:27.929641 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.947381 22121 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 17: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:27.951166 22194 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:27.951809 22117 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 12:13:27.952864 22194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3517) took 2888 ms (client timeout 2103 ms). Trace:
W20260709 12:13:27.953310 22194 rpcz_store.cc:269] 0709 12:13:25.064848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.065013 (+   165us) service_pool.cc:224] Handling call
0709 12:13:27.952529 (+2887516us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b540020dd54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:27.952711 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6559411968}
I20260709 12:13:27.954602 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:27.955031 22264 raft_consensus.cc:1240] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 22. Current term is 23. Ops: [22.10-22.10]
I20260709 12:13:27.955380 22114 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:27.955683 30291 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.956388 30291 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:27.955274 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.960870 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.962172 22163 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:27.963486 30283 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:27.929787 22271 rpcz_store.cc:269] 0709 12:13:26.414603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.414733 (+   130us) service_pool.cc:224] Handling call
0709 12:13:27.928995 (+1514262us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400056254. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:27.929173 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2541130112}
I20260709 12:13:27.949638 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.964365 30363 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.948397 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:27.971483 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.928682 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.972538 29864 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:27.976320 22272 raft_consensus.cc:1240] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:27.971091 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:27.988957 22119 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:27.989920 22116 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:27.991088 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.993418 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.994819 22120 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:27.999138 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:27.964329 30283 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.005499 22118 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:28.007560 29980 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.008440 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:28.008351 29980 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.011873 29980 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:28.013885 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 52009.2us
I20260709 12:13:28.016203 22123 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
I20260709 12:13:28.017475 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:28.018205 22121 raft_consensus.cc:2410] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:13:28.018303 22123 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
W20260709 12:13:27.972175 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 87426.4us
I20260709 12:13:28.001982 22122 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
W20260709 12:13:28.028270 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.984088 30363 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.004374 30291 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:28.040812 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:28.059875 22121 raft_consensus.cc:2393] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:28.061174 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:28.066824 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:28.068886 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.075044 30215 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.076028 30215 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.125088 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:28.135747 22194 raft_consensus.cc:1275] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:28.072386 22830 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:28.172524 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.173691 22118 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 23.
I20260709 12:13:28.046554 30283 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:28.180804 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.182825 30107 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:28.183048 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.183466 30107 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.185146 22114 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
W20260709 12:13:28.189829 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.198969 30107 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:28.198647 30278 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:28.199965 30278 consensus_queue.cc:1243] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:28.201495 22862 raft_consensus.cc:2410] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:13:28.201225 22122 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:28.200958 29864 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.223572 29864 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.236047 22862 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 1111) took 1112 ms. Trace:
I20260709 12:13:28.236645 22862 rpcz_store.cc:276] 0709 12:13:27.123423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.123601 (+   178us) service_pool.cc:224] Handling call
0709 12:13:28.235692 (+1112091us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540019f5d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:28.235946 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2475191040}
I20260709 12:13:28.237133 30302 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:28.242326 22829 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.201170 30283 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.239460 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:28.249346 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 177163us
I20260709 12:13:28.241751 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:28.200716 30278 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:28.254737 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:28.259720 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:28.259795 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:28.263818 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:28.238595 30291 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.248401 30107 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.271026 22118 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:28.271164 22114 raft_consensus.cc:1275] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:13:28.258782 30037 raft_consensus.cc:2804] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:28.255918 30278 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:28.253181 29864 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:28.275261 22119 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
I20260709 12:13:28.273343 22120 raft_consensus.cc:2468] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:28.278796 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:28.279690 30340 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.280894 30274 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:28.285153 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 98470.1us
I20260709 12:13:28.285006 30283 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:28.284997 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.286206 30030 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:28.285089 30328 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:28.300760 30278 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.301429 30328 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.265084 30302 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.302681 30278 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:28.303906 30328 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:28.294646 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:28.295555 30275 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 12:13:28.295720 30363 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:28.290197 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:28.304615 30291 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.311124 22122 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:13:28.300254 30137 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:13:28.321219 30162 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:28.322144 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:28.324059 30107 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:28.325331 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 201749us
I20260709 12:13:28.298671 30030 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:28.296789 30037 raft_consensus.cc:697] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:28.317709 22119 raft_consensus.cc:1240] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:28.332089 22118 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 LEADER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 12:13:28.304631 30302 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:28.337788 22122 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:13:28.320838 22114 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:28.338802 22116 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:28.334463 22830 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:28.340374 22114 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:28.335995 30030 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:28.307765 30340 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.343076 22123 raft_consensus.cc:1275] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:28.336730 22162 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:28.337225 22193 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
I20260709 12:13:28.348199 22117 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:13:28.329487 30274 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.353991 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:28.345640 30215 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:28.354110 22115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38186 (request call id 1919) took 2366 ms. Trace:
I20260709 12:13:28.337141 30162 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.353443 30291 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:28.360121 30360 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.371078 30302 raft_consensus.cc:2804] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:13:28.360054 30279 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:13:28.358932 22115 rpcz_store.cc:276] 0709 12:13:25.987757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.002356 (+ 14599us) service_pool.cc:224] Handling call
0709 12:13:26.002782 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:26.003256 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:26.020959 (+ 17703us) log.cc:844] Serialized 14 byte log entry
0709 12:13:26.825937 (+804978us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b18003cfbe0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd5522 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:13:27.798464 (+972527us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b18003cfbe0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fcced95c20b 00007fcced961d23 00007fcced96223a 00007fcceddcca2a
0709 12:13:28.034722 (+236258us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:28.268581 (+233859us) log.cc:844] Serialized 26 byte log entry
0709 12:13:28.277668 (+  9087us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:28.277717 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:28.292609 (+ 14892us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:28.353638 (+ 61029us) raft_consensus.cc:1685] finished
0709 12:13:28.353667 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:28.353867 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8299,"prepare.queue_time_us":17027,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":3155,"raft.queue_time_us":26015,"raft.run_cpu_time_us":525,"raft.run_wall_time_us":169394,"spinlock_wait_cycles":24105088,"thread_start_us":174513,"threads_started":1,"wal-append.queue_time_us":2249478}
I20260709 12:13:28.373088 22119 raft_consensus.cc:1275] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:28.371819 30279 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.378660 30274 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:28.373428 30159 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:28.370807 30360 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.385242 22191 raft_consensus.cc:1240] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:28.384490 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:28.376678 30279 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:28.393668 22192 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:28.384758 30302 raft_consensus.cc:697] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:28.391014 30283 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:28.387960 30107 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:28.382613 30276 consensus_queue.cc:1059] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.018s
I20260709 12:13:28.409655 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:28.413815 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:28.419795 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:28.381703 30037 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.423851 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:28.405357 30291 consensus_queue.cc:1059] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:13:28.429769 30215 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:28.433342 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:28.433758 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:28.444622 22272 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 23: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:28.453243 30443 log.cc:927] Time spent T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:13:28.454795 22831 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:28.472760 30340 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:28.473665 30340 consensus_queue.cc:1059] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260709 12:13:28.475641 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 67603.7us
I20260709 12:13:28.483697 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:28.491007 30445 log.cc:927] Time spent T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.124s	user 0.003s	sys 0.000s
I20260709 12:13:28.450784 30302 consensus_queue.cc:237] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.520378 29980 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:28.529111 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:28.528393 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:28.545456 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 142082us
I20260709 12:13:28.530930 30275 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.531102 30159 consensus_queue.cc:1059] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:13:28.570637 30454 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:28.571597 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.507745 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:13:28.550725 30372 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.531595 29980 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.563127 30274 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:28.588631 30107 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:13:28.616097 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.604192 30328 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:28.607486 30275 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:28.634153 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 122839us
I20260709 12:13:28.599879 30372 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.630782 30328 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.644378 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:28.645253 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.645529 22862 raft_consensus.cc:2410] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:13:28.645344 22859 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 18 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:28.648746 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:28.649853 22859 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:28.651988 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:28.655886 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:28.630262 30107 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.639520 30276 raft_consensus.cc:3055] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:13:28.658260 30446 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.238s	user 0.000s	sys 0.005s
I20260709 12:13:28.658160 30328 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:28.678248 30275 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:28.680910 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:28.681687 22272 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:28.673693 30276 raft_consensus.cc:740] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:28.686748 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:28.687021 30276 consensus_queue.cc:260] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 24.21, Last appended by leader: 21, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.688398 30276 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:28.689301 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:28.690011 22268 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:28.692760 22270 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:28.693405 30447 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:28.693665 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:28.693982 30447 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:28.694484 22271 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 15.
I20260709 12:13:28.695080 30447 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.676811 30360 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:28.701345 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 263427us
I20260709 12:13:28.700749 30457 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:28.703127 30457 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.696377 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:28.705518 30457 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:28.712201 22272 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:28.706102 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:28.696527 30447 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:28.705508 30278 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:28.733908 30137 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:28.741528 22830 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:28.736635 30278 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:28.745713 30278 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:28.757730 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51776.5us
I20260709 12:13:28.770685 30107 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:28.774587 30278 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.785506 29980 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:28.777065 30328 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.786206 29980 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:28.786469 22192 raft_consensus.cc:606] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:28.786862 22192 raft_consensus.cc:614] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:28.786806 29980 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.788843 30162 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:28.791538 30328 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:28.791813 30372 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:28.794430 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 56903.2us
I20260709 12:13:28.734685 30215 raft_consensus.cc:3055] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:28.796720 30215 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:28.797894 30215 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.799394 30215 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:28.799572 30360 consensus_queue.cc:1059] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:28.800972 30159 consensus_queue.cc:1048] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:13:28.801201 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 58570.1us
I20260709 12:13:28.802268 30037 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:28.802909 30037 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.802796 30159 consensus_queue.cc:1059] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:28.803438 30037 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:28.804060 30360 raft_consensus.cc:3055] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:28.804471 30360 raft_consensus.cc:740] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:28.803457 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:28.805111 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 62755.1us
I20260709 12:13:28.805502 30360 consensus_queue.cc:260] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.795812 30310 raft_consensus.cc:3055] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:28.806495 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:28.806964 30360 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:28.807210 29864 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:28.807507 30291 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:28.807812 30453 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.807974 30291 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.805976 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:28.808430 30453 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.808861 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:28.810420 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:28.810828 30453 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:28.811353 30159 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:28.811833 30159 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.806552 30310 raft_consensus.cc:740] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:28.812887 30447 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:28.813041 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 72669.4us
I20260709 12:13:28.813565 30310 consensus_queue.cc:260] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.808435 30291 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:28.814752 30310 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:28.807535 30454 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.817345 30454 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.817378 30278 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:28.819675 30454 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:28.819514 30457 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:13:28.820437 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.821871 30278 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:28.732667 30279 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:28.824898 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 63609.3us
I20260709 12:13:28.829383 30278 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:28.802351 30448 raft_consensus.cc:3055] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:28.831979 30448 raft_consensus.cc:740] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:28.833441 30448 consensus_queue.cc:260] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.834028 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:28.834873 30448 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:28.826792 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:28.836653 30291 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.837172 22265 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:13:28.825454 30137 consensus_queue.cc:1059] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:13:28.811658 30453 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:28.812407 30159 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:28.837426 30278 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:28.842317 30328 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:28.843384 30363 consensus_queue.cc:1059] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:13:28.826413 22018 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 156) took 24177 ms (client timeout 15000 ms). Trace:
I20260709 12:13:28.854271 30468 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:28.854882 22862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44679affd4554006a2cb59b10b589a27"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:13:28.871470 22862 raft_consensus.cc:606] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Received request to transfer leadership to TS ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:28.871918 22862 raft_consensus.cc:614] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:28.855671 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:28.856834 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:28.857782 30467 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.859839 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:28.862656 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 334353us
I20260709 12:13:28.864151 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:28.880066 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:28.892459 22121 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:28.903225 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:28.905915 22193 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 16.
I20260709 12:13:28.907909 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:28.879835 30360 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:13:28.906549 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:28.913934 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:28.915530 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 55973.3us
I20260709 12:13:28.923425 22117 raft_consensus.cc:3055] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:28.917238 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:28.916987 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 81420.8us
I20260709 12:13:28.914207 22830 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:28.914799 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:28.891585 30447 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:28.924448 22860 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:28.923844 22117 raft_consensus.cc:740] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:28.931906 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.940864 22861 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:13:28.939198 22831 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:28.924501 30030 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.005s
I20260709 12:13:28.869434 30278 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.934883 22191 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:28.953154 22119 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:28.956228 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:28.960837 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:28.961421 30137 raft_consensus.cc:3055] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:28.961843 30137 raft_consensus.cc:740] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:28.962159 22198 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:13:28.962829 30137 consensus_queue.cc:260] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.964291 30137 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:28.933043 29980 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:28.928438 30454 consensus_queue.cc:1048] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
W20260709 12:13:28.970917 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.972920 30460 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:28.973165 22088 leader_election.cc:400] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10.
I20260709 12:13:28.973639 22088 leader_election.cc:403] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:28.974507 22860 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:13:28.974677 22198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:13:28.975167 30279 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:28.975451 22198 raft_consensus.cc:606] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:28.975752 29980 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085) with higher term. Message: Invalid argument: T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 9. Current term is 10.
I20260709 12:13:28.907188 30468 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.977133 30475 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:28.977569 30475 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:28.977782 30476 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:13:28.978385 30468 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:28.978531 30475 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.977799 22117 consensus_queue.cc:260] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:28.975858 22198 raft_consensus.cc:614] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:28.980175 30475 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:28.980312 22117 raft_consensus.cc:3060] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:28.867184 22018 rpcz_store.cc:269] 0709 12:13:04.649197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.649852 (+   655us) service_pool.cc:224] Handling call
0709 12:13:28.826021 (+24176169us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:24.920028 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:24.920584 (+   556us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:24.920612 (+    28us) write_op.cc:435] Acquired schema lock
0709 12:13:24.920629 (+    17us) tablet.cc:662] Decoding operations
0709 12:13:24.921915 (+  1286us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:24.921992 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:24.922017 (+    25us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:13:24.923076 (+  1059us) tablet.cc:701] Row locks acquired
0709 12:13:24.923097 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:13:24.923266 (+   169us) write_op.cc:270] Start()
0709 12:13:24.923365 (+    99us) write_op.cc:276] Timestamp: P: 1783599204923209 usec, L: 0
0709 12:13:24.923383 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:13:24.924037 (+   654us) log.cc:844] Serialized 5944 byte log entry
0709 12:13:25.666322 (+742285us) op_driver.cc:464] REPLICATION: finished
0709 12:13:27.267825 (+1601503us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b18003e2ea0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacd53f3 00007fcceacd77c1 00007fcceacd7779 00007fcceacd7709 00007fcceacd76d1 00007fcceacd69cd 0000000000388634 0000000000388479 00007fcceacb883a
0709 12:13:27.267986 (+   161us) write_op.cc:301] APPLY: starting
0709 12:13:27.268072 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:27.869948 (+601876us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:27.870025 (+    77us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:28.013583 (+143558us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:28.014069 (+   486us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:13:28.014117 (+    48us) write_op.cc:312] APPLY: finished
0709 12:13:28.014822 (+   705us) log.cc:844] Serialized 139 byte log entry
0709 12:13:28.270859 (+256037us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:28.369167 (+ 98308us) write_op.cc:454] Released schema lock
0709 12:13:28.376823 (+  7656us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:28.420907 (+ 44084us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:28.423046 (+  2139us) write_op.cc:454] Released schema lock
0709 12:13:28.520681 (+ 97635us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcced95d86e 00007fcced95cbb6 00007fcced95c7d8 00007fcced966221 00007fcced9661d9 00007fcced966169
Metrics: {"mutex_wait_us":1677017,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":159733,"apply.run_cpu_time_us":60735,"apply.run_wall_time_us":1133336,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66857,"num_ops":15,"prepare.queue_time_us":403362,"prepare.run_cpu_time_us":25862,"prepare.run_wall_time_us":297178,"raft.queue_time_us":329650,"raft.run_cpu_time_us":2931,"raft.run_wall_time_us":202883,"replication_time_us":706002,"spinlock_wait_cycles":56717440,"thread_start_us":1191359,"threads_started":5,"wal-append.queue_time_us":712300,"wal-append.run_cpu_time_us":30326,"wal-append.run_wall_time_us":1293712}]]}
I20260709 12:13:28.973587 30460 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.945807 30291 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:28.995937 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 56805us
W20260709 12:13:29.005343 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 91239.5us
I20260709 12:13:29.006464 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:29.008496 30454 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:29.008406 22088 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:29.009021 30454 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.009411 30454 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:29.006801 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:28.990852 22237 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:28.955608 30030 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:29.010958 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 166592us
I20260709 12:13:28.972956 30278 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:29.002609 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:28.910125 30467 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:28.993122 30460 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:29.033883 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 75944.6us
I20260709 12:13:29.041357 30452 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:29.043270 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:29.045614 22192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f"
dest_uuid: "7d3f536360b444b1886777f4776be22c"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:44556
I20260709 12:13:29.046123 30030 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:29.046341 22192 raft_consensus.cc:606] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:29.046833 22192 raft_consensus.cc:614] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:29.047466 30037 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:29.049660 30463 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:29.031049 30162 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:29.033901 22861 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:29.056516 30372 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:29.056952 30372 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:29.057345 30372 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:29.060968 22088 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:29.061946 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 151926us
I20260709 12:13:29.061856 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:28.975962 30275 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:13:29.064966 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:29.010363 29864 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:29.068998 29864 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:29.070115 29864 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:29.071661 29864 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:29.075467 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:13:29.049686 30465 log.cc:927] Time spent T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:13:29.073752 30453 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:29.093528 22861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820"
dest_uuid: "164596fc2efa450581a5b68cad62271f"
mode: GRACEFUL
new_leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:13:29.074818 30474 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:29.097882 22163 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:29.094164 22861 raft_consensus.cc:606] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Received request to transfer leadership to TS cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:29.102324 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:29.083951 30463 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:29.079829 29980 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.114172 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.115564 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:29.116251 22120 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:29.101480 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:29.119740 22123 raft_consensus.cc:1240] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:29.114224 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:29.083807 30279 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:29.117554 30463 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.128875 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.077448 30030 consensus_queue.cc:1048] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:13:29.129721 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.127918 30463 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:29.136534 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:29.107191 30468 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:29.137274 22118 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:29.110251 30310 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.109030 30474 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:29.091662 30340 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:13:29.135684 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:13:29.132918 30274 consensus_meta.cc:287] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.522s	user 0.013s	sys 0.000s
I20260709 12:13:29.125370 30279 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:29.132658 30452 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:29.150322 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:13:29.168010 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 105198us
W20260709 12:13:29.169836 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72061.5us
I20260709 12:13:29.172801 22858 raft_consensus.cc:1240] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:13:29.132603 30479 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:29.151769 30457 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:29.148334 30474 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:29.164021 30279 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:29.191871 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.159512 30274 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:29.197347 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:29.198884 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.150331 30310 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:29.200841 22019 catalog_manager.cc:5697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.203379 22019 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 16 to 20, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 20 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.204972 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.206432 30310 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:29.208271 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.211542 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:29.212535 30469 log.cc:927] Time spent T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:13:29.196404 22117 raft_consensus.cc:1275] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:13:29.163100 30452 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:29.221787 22237 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:29.148072 29980 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:29.228112 22019 catalog_manager.cc:5697] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.158880 30468 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:29.232635 22198 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 18.
W20260709 12:13:29.237073 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 176161us
I20260709 12:13:29.240736 22271 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:29.200326 30107 consensus_queue.cc:1059] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 12:13:29.247736 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 111294us
I20260709 12:13:29.248484 22265 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:29.250216 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:29.250942 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.251144 22271 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 16.
I20260709 12:13:29.249756 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:29.256409 22196 raft_consensus.cc:2368] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:29.258172 22197 raft_consensus.cc:2410] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 20 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:13:29.258106 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:29.259136 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.259817 22191 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:29.217278 30037 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:29.261574 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 69146.9us
I20260709 12:13:29.262310 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:29.225571 30452 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:29.223865 30483 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:29.165447 30478 consensus_queue.cc:1048] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.154s
I20260709 12:13:29.273030 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:29.274434 22265 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:29.279454 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:29.280223 22272 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:29.288553 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:29.289512 22117 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:29.289065 22163 leader_election.cc:336] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Timed out: RequestConsensusVote RPC to 127.20.102.196:42539 timed out after 1.981s (SENT)
I20260709 12:13:29.299469 30037 consensus_queue.cc:1048] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:13:29.302980 30037 consensus_queue.cc:1243] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:13:29.303292 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:29.304085 22119 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 29.
I20260709 12:13:29.299639 30107 raft_consensus.cc:3055] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:13:29.305015 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:29.305925 22270 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:29.309369 30471 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:29.310014 30471 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.310431 30471 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:29.313799 22019 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 14 to 15, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.317374 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:29.318137 29980 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:29.316876 22019 catalog_manager.cc:5697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.274081 30275 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:29.322167 30275 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:29.323438 30275 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:29.325816 22019 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.331760 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:29.332005 30275 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:29.332943 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:29.335229 22271 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:29.340703 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.246842 30279 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:29.272928 30472 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:29.328459 30276 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.000s
I20260709 12:13:29.284902 30278 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:29.349969 22195 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:29.331760 22019 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 18 to 19, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 19 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.356437 22118 raft_consensus.cc:2468] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 13.
I20260709 12:13:29.359908 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:29.367627 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:29.383939 22272 raft_consensus.cc:2393] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 18: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:29.387456 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.388563 22196 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:13:29.344849 30107 raft_consensus.cc:740] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:29.393045 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:29.389204 30215 consensus_meta.cc:287] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.585s	user 0.013s	sys 0.000s
I20260709 12:13:29.379009 30278 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:29.416936 22117 raft_consensus.cc:2468] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:29.316462 30454 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:29.420265 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 138430us
I20260709 12:13:29.423470 22192 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:29.390204 30467 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:29.426582 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:29.418771 30159 consensus_meta.cc:287] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
W20260709 12:13:29.432354 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.433465 22019 catalog_manager.cc:5697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 17, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.444242 22266 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:29.379850 30472 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:29.424117 30278 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:29.430567 30448 consensus_meta.cc:287] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.003s
I20260709 12:13:29.485169 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:29.458089 22019 catalog_manager.cc:5697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.460354 22196 raft_consensus.cc:1240] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:13:29.463500 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:29.464006 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:29.464458 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:29.464921 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:29.495242 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.495448 22866 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 29.
I20260709 12:13:29.465713 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:29.495309 30162 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:29.496562 22857 raft_consensus.cc:2393] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 19: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:13:29.470052 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.477622 22163 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:29.494676 30488 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:29.504019 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:29.509289 30477 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.509943 30477 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:29.511366 30470 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.503s	user 0.006s	sys 0.001s
I20260709 12:13:29.512248 30477 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:29.512933 30480 log.cc:927] Time spent T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:13:29.513231 30491 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.513962 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.515729 30468 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:29.516402 30448 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:29.505959 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.529729 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:29.530393 22019 catalog_manager.cc:5697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.536149 22198 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
W20260709 12:13:29.541076 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 283876us
I20260709 12:13:29.456199 30159 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:29.565387 30279 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:29.565871 30454 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:29.566777 30463 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:29.561622 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 84131.5us
W20260709 12:13:29.557880 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 92530.1us
I20260709 12:13:29.560012 22193 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 29.
I20260709 12:13:29.578243 22196 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 12:13:29.579717 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.581240 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:29.585296 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:29.575585 22019 catalog_manager.cc:5697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.532469 30037 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:29.598220 22163 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:13:29.603585 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.611554 30483 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:29.623418 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 51021.8us
I20260709 12:13:29.626633 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.637408 30483 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:29.641917 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 43749.3us
I20260709 12:13:29.602054 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:29.657420 22198 raft_consensus.cc:1240] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:29.596812 30037 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.529317 30488 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:29.501368 30107 consensus_queue.cc:260] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:29.710290 30107 raft_consensus.cc:3060] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:13:29.665804 30372 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
I20260709 12:13:29.716027 30372 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:29.717583 22122 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:29.719007 30372 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:29.719246 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.666431 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.723224 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:29.624722 30500 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:13:29.667090 30476 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:29.725078 30476 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.725484 30476 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:29.724606 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.726784 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.727392 22198 raft_consensus.cc:2368] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:13:29.728062 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.667373 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:29.729817 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:29.730597 22195 raft_consensus.cc:2368] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:29.731339 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.732336 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:29.728579 22198 raft_consensus.cc:2468] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:29.667033 30474 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:29.732970 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 104908us
I20260709 12:13:29.733574 22264 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:29.735095 30474 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:29.669142 22019 catalog_manager.cc:5697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.736479 22019 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:13:29.738658 30460 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.661s	user 0.013s	sys 0.000s
I20260709 12:13:29.678797 30159 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:29.739257 30460 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:29.742556 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.743273 22198 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:29.743711 22266 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:29.744071 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:29.693507 29980 raft_consensus.cc:2764] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:13:29.746869 22858 raft_consensus.cc:1240] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:13:29.747292 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:29.695683 30472 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:29.696410 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:29.749054 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:29.598974 30468 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.750123 30468 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:29.708827 30037 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:29.667069 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.754091 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.648965 30463 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:29.586277 30493 consensus_queue.cc:1059] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.231s
I20260709 12:13:29.749311 22197 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
W20260709 12:13:29.693990 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 98726.9us
I20260709 12:13:29.744227 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:29.712262 30488 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:29.822587 22191 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
W20260709 12:13:29.805037 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.793642 22264 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:29.782563 22189 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
W20260709 12:13:29.794627 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 297158us
I20260709 12:13:29.827152 22117 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:13:29.756397 30497 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:13:29.600896 30447 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.194s
W20260709 12:13:29.763515 30475 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.720s	user 0.014s	sys 0.000s
I20260709 12:13:29.657989 30479 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.568490 30491 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:29.845474 22115 raft_consensus.cc:1217] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 13.12->[14.13-18.15]   Dedup: 14.13->[16.14-18.15]
I20260709 12:13:29.848475 22115 pending_rounds.cc:85] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting all ops after (but not including) 13
I20260709 12:13:29.857266 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:29.858605 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.852676 22163 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:29.777165 30460 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:29.794255 30478 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.835369 29980 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:29.849761 22115 pending_rounds.cc:107] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:13:29.869642 22115 raft_consensus.cc:2889] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:29.871088 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:29.871876 22196 raft_consensus.cc:2376] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23. Re-sending same reply.
I20260709 12:13:29.877518 29980 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:29.864610 30463 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:13:29.885178 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.886058 22197 raft_consensus.cc:2410] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:13:29.887733 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:13:29.888005 22087 leader_election.cc:336] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.551s (SENT)
I20260709 12:13:29.830519 30468 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:29.897612 22195 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24.
I20260709 12:13:29.898874 22858 raft_consensus.cc:2368] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
W20260709 12:13:29.898802 22236 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.567s (SENT)
I20260709 12:13:29.886709 30478 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:29.898769 22194 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:29.863092 30159 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:29.902629 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.899185 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:29.937620 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.938432 22195 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
W20260709 12:13:29.941872 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46007us
W20260709 12:13:29.949270 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 61283.1us
W20260709 12:13:29.950004 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:29.952380 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:29.952471 22236 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.567s (SENT)
I20260709 12:13:29.953284 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:29.862572 30479 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:29.901432 30477 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:13:29.968935 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 105474us
I20260709 12:13:29.964855 22163 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:29.975673 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:29.976600 22197 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:29.976706 22195 raft_consensus.cc:2368] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:29.978076 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:29.979328 22236 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.574s (SENT)
W20260709 12:13:29.979940 22236 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.574s (SENT)
I20260709 12:13:29.980247 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:29.983397 22196 raft_consensus.cc:1240] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:29.983531 22198 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:13:29.957469 30447 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:29.987123 22194 raft_consensus.cc:1275] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
W20260709 12:13:29.988190 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 503121us
W20260709 12:13:29.992419 22236 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.583s (SENT)
W20260709 12:13:29.993180 22236 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.583s (SENT)
I20260709 12:13:29.993888 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:29.994884 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:29.967232 30477 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.000957 22198 raft_consensus.cc:1240] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 17. Current term is 18. Ops: []
W20260709 12:13:30.008601 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.007301 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.012069 22196 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:30.005393 22265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.004s	sys 0.012s
W20260709 12:13:30.014222 22265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.005s	sys 0.013s
I20260709 12:13:29.961283 30159 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:29.991528 30447 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:30.011711 30492 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:29.995951 29864 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:30.008948 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:30.052388 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 43530.9us
I20260709 12:13:30.053442 22830 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:29.989549 30472 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:30.017431 22236 leader_election.cc:336] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.591s (SENT)
I20260709 12:13:30.020674 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.006212 30477 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:29.986304 30504 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:30.062223 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 76529.2us
I20260709 12:13:30.011267 30468 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:30.041942 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:30.066555 22117 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:30.051481 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:13:30.060340 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.011451 30506 raft_consensus.cc:2804] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:30.004940 30448 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:13:30.013624 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.071331 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:30.071516 22198 raft_consensus.cc:3060] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:30.065586 22830 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:30.035840 30447 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:30.075241 22087 leader_election.cc:336] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.103s (SENT)
I20260709 12:13:30.076321 22087 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:30.078372 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 67800.4us
W20260709 12:13:30.063427 30278 consensus_meta.cc:287] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.562s	user 0.014s	sys 0.000s
W20260709 12:13:30.068934 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 55297.7us
I20260709 12:13:30.051597 29864 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:30.086493 22236 leader_election.cc:336] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.634s (SENT)
I20260709 12:13:30.091658 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.098860 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.095667 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:30.099761 22190 raft_consensus.cc:2376] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21. Re-sending same reply.
I20260709 12:13:30.111452 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.112393 22191 raft_consensus.cc:2376] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18. Re-sending same reply.
I20260709 12:13:30.113564 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.114344 22191 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:13:30.116562 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.118249 22191 raft_consensus.cc:2393] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 19: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:13:30.120402 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 49155.7us
I20260709 12:13:30.130043 22117 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 23.
I20260709 12:13:30.066596 30512 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:30.132959 30115 raft_consensus.cc:2804] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:13:30.098310 30276 raft_consensus.cc:2804] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:30.193171 30276 raft_consensus.cc:697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:30.194537 30276 consensus_queue.cc:237] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.138214 30159 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:30.138950 30467 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:30.196596 29980 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.139832 22196 raft_consensus.cc:2468] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 17.
I20260709 12:13:30.140466 30476 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.199477 30476 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 30 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:30.149792 30475 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:30.089516 30468 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.200548 30475 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:30.201900 30475 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:30.202450 30468 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:30.162541 30310 consensus_queue.cc:1059] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:13:30.205192 30487 raft_consensus.cc:993] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: : Instructing follower cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:13:30.205662 22830 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:30.207363 30495 raft_consensus.cc:1081] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Signalling peer cc9b9c8894084021a0c6ddaf659d222e to start an election
I20260709 12:13:30.208273 30495 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:30.155296 30463 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:30.156687 30107 raft_consensus.cc:3055] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:30.210206 30107 raft_consensus.cc:740] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:30.211197 30107 consensus_queue.cc:260] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:30.211833 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 81664us
I20260709 12:13:30.212570 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:30.212845 30340 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:30.213209 30340 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
W20260709 12:13:30.218840 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 49456.4us
I20260709 12:13:30.162405 22194 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:13:30.166517 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.171417 30478 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.101394 30460 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:30.177560 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 109046us
I20260709 12:13:30.070219 30506 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:30.101841 29864 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:30.258646 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:30.259881 22866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:30.236533 22237 leader_election.cc:400] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:30.261734 22237 leader_election.cc:403] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:13:30.174883 30447 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:30.163331 30512 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:30.246943 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.213986 30340 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.263466 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:30.234607 30483 raft_consensus.cc:2764] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:13:30.268424 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.234568 30107 raft_consensus.cc:3060] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:30.270131 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:30.242872 30504 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.237362 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.102448 30278 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.283867 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:30.258515 30506 raft_consensus.cc:3060] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:30.288808 30471 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.978s	user 0.016s	sys 0.000s
W20260709 12:13:30.287477 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 160307us
I20260709 12:13:30.288759 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:30.258961 30115 raft_consensus.cc:697] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:30.323429 22271 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:13:30.311846 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:30.314116 30487 consensus_queue.cc:1175] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cc9b9c8894084021a0c6ddaf659d222e" responder_term: 15 status { last_received { term: 15 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 15 index: 14 } }
I20260709 12:13:30.284013 22270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820"
dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
 from {username='slave'} at 127.0.0.1:34878
I20260709 12:13:30.327419 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.327826 22270 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.328356 22190 raft_consensus.cc:2410] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 20 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:13:30.275301 30472 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:30.277745 30512 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:30.325277 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.322413 30479 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.351516 22198 raft_consensus.cc:2468] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 23.
I20260709 12:13:30.354489 30483 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:30.355037 30483 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:30.328519 30452 consensus_meta.cc:287] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 1.041s	user 0.015s	sys 0.000s
W20260709 12:13:30.363915 22193 consensus_meta.cc:287] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.005s
I20260709 12:13:30.364341 22193 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:30.366263 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:30.346112 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.309544 30453 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.275125 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:30.361361 22236 leader_election.cc:336] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.634s (SENT)
I20260709 12:13:30.325292 30340 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:30.369077 22271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4581) took 1008 ms. Trace:
I20260709 12:13:30.370977 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:30.370537 22191 raft_consensus.cc:2368] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17.
I20260709 12:13:30.328452 22270 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:30.368551 22198 raft_consensus.cc:2376] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21. Re-sending same reply.
I20260709 12:13:30.357311 30483 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.372282 30115 consensus_queue.cc:237] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:30.377511 30511 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:13:30.377946 30453 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.390637 30278 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:30.311160 30504 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.395800 22271 rpcz_store.cc:276] 0709 12:13:29.361192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.369465 (+  8273us) service_pool.cc:224] Handling call
0709 12:13:29.369793 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:30.324037 (+954244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:30.368591 (+ 44554us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b5400331dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:30.368979 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192329600}
W20260709 12:13:30.405978 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 198966us
W20260709 12:13:30.413843 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52531.8us
I20260709 12:13:30.324956 30471 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.367811 30467 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:30.421802 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.423031 22830 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:30.413458 30509 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:30.434919 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 328106us
I20260709 12:13:30.442117 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.443224 22191 raft_consensus.cc:2376] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24. Re-sending same reply.
W20260709 12:13:30.447427 22236 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Timed out: RequestConsensusVote RPC to 127.20.102.193:39673 timed out after 1.659s (SENT)
I20260709 12:13:30.413028 30505 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:30.449206 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:30.450058 22861 raft_consensus.cc:2368] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21.
I20260709 12:13:30.368680 30452 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.450416 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:30.452454 22117 raft_consensus.cc:2376] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23. Re-sending same reply.
I20260709 12:13:30.452695 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.453464 22123 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
W20260709 12:13:30.457326 22236 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.659s (SENT)
I20260709 12:13:30.458114 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:30.458334 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:30.459056 22114 raft_consensus.cc:2376] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18. Re-sending same reply.
I20260709 12:13:30.434859 29980 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.469213 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.437084 30460 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.471019 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:30.475425 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 168812us
I20260709 12:13:30.476313 22120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:30.478863 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.471652 22123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:30.472463 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.473507 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.482208 22119 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:30.482607 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:30.484145 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.487584 22857 raft_consensus.cc:1240] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:30.431785 30467 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:30.491775 22861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 1120) took 1029 ms. Trace:
I20260709 12:13:30.492142 30467 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.492322 22861 rpcz_store.cc:276] 0709 12:13:29.462710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.464141 (+  1431us) service_pool.cc:224] Handling call
0709 12:13:30.491517 (+1027376us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400431554. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:30.491699 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2185029888}
I20260709 12:13:30.494592 30509 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:30.496661 30476 consensus_queue.cc:1059] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:30.497270 30515 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.497822 30476 raft_consensus.cc:3055] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:30.497936 30515 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:30.499230 22268 raft_consensus.cc:1275] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:13:30.500237 30515 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.500476 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.501121 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.501194 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.501384 22194 raft_consensus.cc:2376] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16. Re-sending same reply.
I20260709 12:13:30.501900 22121 raft_consensus.cc:2468] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:30.504184 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.504726 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.500655 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:30.505635 22114 raft_consensus.cc:2393] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:30.498373 30476 raft_consensus.cc:740] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:30.505930 22271 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:13:30.513326 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 56059.7us
W20260709 12:13:30.526238 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.501992 22116 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:30.459591 30483 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:30.527683 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.527560 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.527806 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.528540 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.529421 22119 raft_consensus.cc:2410] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:13:30.519203 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.530014 22118 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
I20260709 12:13:30.470562 30448 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:30.534106 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:30.536283 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
W20260709 12:13:30.536819 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.538075 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.539054 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.539872 22272 raft_consensus.cc:2410] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:13:30.545260 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.545923 22191 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:30.548483 22119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:30.549340 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.482764 30447 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.543862 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.553081 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:30.553351 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.557262 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.564684 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
W20260709 12:13:30.568149 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.477023 29980 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:30.570241 30520 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:13:30.554229 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:30.571628 22120 raft_consensus.cc:2376] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21. Re-sending same reply.
I20260709 12:13:30.571897 22269 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:30.459476 30505 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:30.584594 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.585210 22191 raft_consensus.cc:2376] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20. Re-sending same reply.
I20260709 12:13:30.573501 22121 raft_consensus.cc:2393] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 17: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:30.586493 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.582335 22271 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:30.572485 22265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4579) took 1218 ms. Trace:
I20260709 12:13:30.593837 22122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.594081 22123 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:30.532112 30475 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:30.608245 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.608757 30475 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.609356 22263 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:30.611023 30475 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:30.613078 30504 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:30.614073 22163 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:30.614645 30453 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:30.615475 30522 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:30.616080 30522 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:30.587546 22265 rpcz_store.cc:276] 0709 12:13:29.333988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.334138 (+   150us) service_pool.cc:224] Handling call
0709 12:13:29.334448 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:29.379605 (+ 45157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:29.379649 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:29.402271 (+ 22622us) log.cc:844] Serialized 26 byte log entry
0709 12:13:30.014635 (+612364us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:30.014675 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:30.014748 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:30.551749 (+537001us) raft_consensus.cc:1685] finished
0709 12:13:30.551769 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:30.551901 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34662,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":10118,"thread_start_us":581568,"threads_started":1,"wal-append.queue_time_us":707212}
I20260709 12:13:30.483906 30460 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:30.623708 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.594470 22122 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 25.
I20260709 12:13:30.600447 22118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:30.601523 22266 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:30.546659 30494 raft_consensus.cc:2804] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:30.601600 22268 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:13:30.601907 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 174510us
I20260709 12:13:30.628057 22268 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:30.619468 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.619239 22119 raft_consensus.cc:3060] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:30.629405 22189 raft_consensus.cc:2393] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 22: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:30.626235 22118 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:30.546754 30518 consensus_queue.cc:1048] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:13:30.629954 22830 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:30.638315 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.637279 22114 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:30.634964 30468 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.640132 30505 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.640358 30468 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:30.640385 30037 consensus_meta.cc:287] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.887s	user 0.013s	sys 0.000s
I20260709 12:13:30.642781 30468 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.642855 30037 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.643671 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.644112 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.584430 30483 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.651686 30494 raft_consensus.cc:697] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:30.652734 30494 consensus_queue.cc:237] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.647064 30522 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.646315 22268 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:30.656618 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.658561 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:30.649034 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.662400 22114 raft_consensus.cc:2393] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 10: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:30.663939 22268 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:30.664599 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3"
I20260709 12:13:30.665591 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:30.669785 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.673076 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.677939 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.678143 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.665395 22121 raft_consensus.cc:2376] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16. Re-sending same reply.
I20260709 12:13:30.691730 22119 raft_consensus.cc:2468] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24.
I20260709 12:13:30.701428 22163 leader_election.cc:400] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21.
I20260709 12:13:30.702055 22163 leader_election.cc:403] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:30.703270 30475 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 21
W20260709 12:13:30.705001 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.711334 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 26 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.660310 29980 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.717257 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea5fe59611e4539abcf87b4fd1a282c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.726001 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:30.731873 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.733177 22192 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:30.739096 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:30.740027 22860 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:30.677651 30453 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:30.716071 22087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.773s (SENT) [suppressed 76 similar messages]
W20260709 12:13:30.760087 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44071.7us
I20260709 12:13:30.747264 22859 raft_consensus.cc:2393] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 19: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:30.750985 22121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 26 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" is_pre_election: true
I20260709 12:13:30.691702 30037 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.764539 22121 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 25.
I20260709 12:13:30.767743 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.717885 22191 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 24.
I20260709 12:13:30.690917 30448 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:30.713685 30276 raft_consensus.cc:2804] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:13:30.781080 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.800436 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.801584 22198 raft_consensus.cc:2368] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:30.808550 22118 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
I20260709 12:13:30.725320 30512 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 12:13:30.825860 20891 tablet_server.cc:179] TabletServer@127.20.102.193:0 shutting down...
I20260709 12:13:30.826404 30512 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 30 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:30.827410 30471 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:30.831277 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:30.832155 22266 raft_consensus.cc:3060] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:30.846498 22266 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:30.672591 30476 consensus_queue.cc:260] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 14, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:30.799021 30497 log.cc:927] Time spent T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:13:30.857486 22865 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 30: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:30.858951 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:30.821007 22192 raft_consensus.cc:2468] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 19.
I20260709 12:13:30.861357 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:30.872128 22859 raft_consensus.cc:2410] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 26 because replica has last-logged OpId of term: 24 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 20.
I20260709 12:13:30.863689 30276 raft_consensus.cc:697] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 23 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:30.881889 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.889014 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:30.823028 30534 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 12:13:30.896179 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:30.789587 30453 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.897557 30476 raft_consensus.cc:3060] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:30.899593 30453 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:30.882309 30479 consensus_queue.cc:1059] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:13:30.877655 30536 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:30.901558 30536 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:30.903952 30536 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.906114 22193 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:30.907039 30460 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.908625 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.911854 22272 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
W20260709 12:13:30.925275 22270 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.000s
W20260709 12:13:30.925731 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.927371 30276 consensus_queue.cc:237] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.930199 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:30.931063 22263 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:30.925921 22270 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:30.877246 30452 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.947808 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.945336 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:30.951891 22193 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:30.952255 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:30.953474 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:30.932276 29864 consensus_meta.cc:287] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.003s
I20260709 12:13:30.893669 30491 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:30.965857 22858 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:30.930405 30215 raft_consensus.cc:3055] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:13:31.005997 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 296094us
W20260709 12:13:31.096171 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.097579 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.099771 22830 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.100477 22270 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:31.102296 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:31.103461 22271 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 24: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:31.105590 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.114861 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:31.120177 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
W20260709 12:13:31.125064 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.125906 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.129441 22830 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:31.133183 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:31.135219 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:31.136379 22271 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
W20260709 12:13:31.140326 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.154917 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:31.160763 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:31.161559 22193 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:13:31.185577 22266 raft_consensus.cc:2393] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 23: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:31.192130 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.019758 30215 raft_consensus.cc:740] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:31.218509 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.213115 22191 raft_consensus.cc:1217] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Deduplicated request from leader. Original: 13.12->[14.13-14.13]   Dedup: 14.13->[]
I20260709 12:13:31.224691 22859 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:31.226842 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 99992.8us
I20260709 12:13:31.231159 22191 raft_consensus.cc:1240] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 17. Current term is 18. Ops: [14.13-14.13]
I20260709 12:13:31.144193 30278 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.160938 30512 raft_consensus.cc:2804] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:31.126040 30478 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:31.020151 29864 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:31.214087 30526 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:31.254371 30310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.065s	sys 0.118s
I20260709 12:13:31.286561 22196 raft_consensus.cc:2368] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21.
I20260709 12:13:31.104910 30448 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:31.314599 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.323176 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:31.192806 22271 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:13:31.337642 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:31.338558 22191 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:31.305290 30310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.065s	sys 0.119s
I20260709 12:13:31.274231 30526 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:31.344674 22269 consensus_meta.cc:287] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.772s	user 0.013s	sys 0.000s
I20260709 12:13:31.366447 22269 raft_consensus.cc:2468] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
I20260709 12:13:31.273259 30512 raft_consensus.cc:697] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:31.367345 22264 raft_consensus.cc:1240] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:31.374233 22268 consensus_meta.cc:287] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.003s
I20260709 12:13:31.400610 22268 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 15. (term mismatch)
I20260709 12:13:31.403157 22268 pending_rounds.cc:85] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 14
I20260709 12:13:31.403486 22268 pending_rounds.cc:107] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 24.15
I20260709 12:13:31.403827 22268 raft_consensus.cc:2889] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:31.332365 30506 consensus_meta.cc:287] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 1.008s	user 0.013s	sys 0.002s
I20260709 12:13:31.259724 30278 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:31.421274 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:13:31.423074 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 44577.9us
I20260709 12:13:31.431434 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:31.432163 22193 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:31.433459 22865 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 30: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:31.438351 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:31.260008 30478 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:31.445449 22862 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:31.378681 30526 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:31.452962 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 173686us
I20260709 12:13:31.376384 30491 consensus_queue.cc:1059] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:13:31.465229 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:31.465497 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.466596 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.467038 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.467347 22189 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 23: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:31.468328 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.469187 22189 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:31.470860 22197 raft_consensus.cc:1240] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
W20260709 12:13:31.471381 30107 consensus_meta.cc:287] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 1.169s	user 0.012s	sys 0.000s
I20260709 12:13:31.468371 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.472482 30107 consensus_queue.cc:1059] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:31.473682 30107 consensus_queue.cc:1059] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:13:31.477228 30340 consensus_meta.cc:287] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 1.072s	user 0.013s	sys 0.000s
I20260709 12:13:31.479983 22269 raft_consensus.cc:1275] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:13:31.482972 22269 pending_rounds.cc:85] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 14
I20260709 12:13:31.483019 30278 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:31.483356 22269 pending_rounds.cc:107] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:13:31.481371 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 3170) took 1213 ms. Trace:
I20260709 12:13:31.483650 30278 raft_consensus.cc:3055] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:31.484073 30278 raft_consensus.cc:740] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:31.484001 22196 rpcz_store.cc:276] 0709 12:13:30.267938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.268111 (+   173us) service_pool.cc:224] Handling call
0709 12:13:31.481171 (+1213060us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002369d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:31.481283 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302849792}
I20260709 12:13:31.434034 30506 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:31.485525 30512 consensus_queue.cc:237] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:31.487818 30506 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:31.490358 22862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:31.481968 22264 raft_consensus.cc:1275] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:13:31.491295 22264 pending_rounds.cc:85] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 10
I20260709 12:13:31.482399 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:31.345503 30215 consensus_queue.cc:260] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:31.494851 22193 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:31.495398 22264 pending_rounds.cc:107] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:13:31.498021 22264 raft_consensus.cc:2889] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:31.483619 22269 raft_consensus.cc:2889] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:31.498802 30491 consensus_queue.cc:1243] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:31.499543 30491 raft_consensus.cc:3055] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:31.499326 30278 consensus_queue.cc:260] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:31.499940 30491 raft_consensus.cc:740] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:31.500916 30278 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:31.501219 30491 consensus_queue.cc:260] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:31.502655 30491 raft_consensus.cc:3060] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:31.503176 22864 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
W20260709 12:13:31.512727 22263 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.001s
W20260709 12:13:31.519333 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.488520 30506 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:31.523192 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.465627 30539 log.cc:927] Time spent T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:13:31.526084 22191 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:31.525969 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.564616 22193 raft_consensus.cc:2368] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23.
I20260709 12:13:31.527225 22859 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
W20260709 12:13:31.535461 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.524552 30476 consensus_meta.cc:287] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.000s
I20260709 12:13:31.544643 30478 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:31.559600 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:31.567149 22198 raft_consensus.cc:2410] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
W20260709 12:13:31.566617 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 310931us
I20260709 12:13:31.579414 22263 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:31.580735 22272 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:31.586489 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 115649us
W20260709 12:13:31.554780 30475 consensus_meta.cc:287] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.851s	user 0.012s	sys 0.001s
I20260709 12:13:31.597718 30478 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.598670 30478 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:31.601083 30551 consensus_queue.cc:1048] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:31.604079 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:31.604988 22193 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:31.567930 30477 consensus_meta.cc:287] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 1.497s	user 0.013s	sys 0.004s
I20260709 12:13:31.607848 30538 consensus_queue.cc:1048] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:31.614876 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.618350 22191 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 24: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:13:31.615701 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.612633 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:31.611615 30558 raft_consensus.cc:3055] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:31.620114 30475 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539) with higher term. Message: Invalid argument: T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21.
I20260709 12:13:31.645187 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.645885 22193 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:31.646145 22191 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
W20260709 12:13:31.637392 22860 consensus_meta.cc:287] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.857s	user 0.012s	sys 0.002s
I20260709 12:13:31.576363 30506 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:31.654996 22860 raft_consensus.cc:2468] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:31.655405 22267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45844 (request call id 4599) took 1008 ms. Trace:
I20260709 12:13:31.616230 30477 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:31.659189 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.658741 22857 raft_consensus.cc:1240] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: [17.15-19.16]
I20260709 12:13:31.639496 30558 raft_consensus.cc:740] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:31.648710 29864 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:31.667518 30564 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.668282 30564 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:31.670246 30562 consensus_queue.cc:1059] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:31.671211 30564 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:31.671840 30564 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:31.667237 30558 consensus_queue.cc:260] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:31.673291 30558 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:31.671622 30562 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:31.658749 22267 rpcz_store.cc:276] 0709 12:13:30.647424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.647674 (+   250us) service_pool.cc:224] Handling call
0709 12:13:30.650762 (+  3088us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:30.651206 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:30.651235 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:30.651754 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:13:30.733202 (+ 81448us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:30.733260 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:30.733356 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:31.655141 (+921785us) raft_consensus.cc:1685] finished
0709 12:13:31.655178 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:31.655332 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1580,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":158,"thread_start_us":80991,"threads_started":1,"wal-append.queue_time_us":452585}
I20260709 12:13:31.665807 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:31.680110 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.680393 22195 raft_consensus.cc:2393] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 17: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:31.682896 22191 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 12:13:31.683131 22087 leader_election.cc:336] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.500s (SENT)
I20260709 12:13:31.679114 22193 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
W20260709 12:13:31.686457 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.683532 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:31.695048 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.696424 22864 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56966 (request call id 1202) took 1430 ms (client timeout 1622 ms). Trace:
W20260709 12:13:31.711151 22864 rpcz_store.cc:269] 0709 12:13:30.265679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.265988 (+   309us) service_pool.cc:224] Handling call
0709 12:13:31.696160 (+1430172us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400800a54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:31.696340 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2678329728}
I20260709 12:13:31.777272 22193 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:31.777545 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:31.688074 30478 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:31.823765 30553 log.cc:927] Time spent T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:13:31.672528 30564 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:31.831573 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:31.841341 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.845127 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 257617us
W20260709 12:13:31.843359 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 216081us
I20260709 12:13:31.866360 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.829088 30559 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.874317 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 3193) took 1032 ms. Trace:
I20260709 12:13:31.878741 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.874965 22198 rpcz_store.cc:276] 0709 12:13:30.841691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.841835 (+   144us) service_pool.cc:224] Handling call
0709 12:13:31.873983 (+1032148us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b5400026554. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:31.874183 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556211968}
I20260709 12:13:31.889288 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:31.890110 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 112629us
I20260709 12:13:31.890192 22191 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 25.
W20260709 12:13:31.902370 22164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.019s	sys 0.042s
W20260709 12:13:31.902755 22164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.019s	sys 0.042s
W20260709 12:13:31.903707 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.885761 30560 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:31.906097 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.892277 30566 raft_consensus.cc:3055] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:31.908892 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:31.907820 30566 raft_consensus.cc:740] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:31.909924 30564 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:31.910665 30564 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:31.911228 30564 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:31.910943 30566 consensus_queue.cc:260] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:31.873909 30559 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:31.919003 22163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.003s	sys 0.013s
I20260709 12:13:31.920437 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:31.927618 22163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.003s	sys 0.013s
W20260709 12:13:31.929240 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 246117us
W20260709 12:13:32.116108 22190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 3187) took 1480 ms (client timeout 1651 ms). Trace:
I20260709 12:13:32.190502 30572 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:32.093148 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 191346us
W20260709 12:13:32.301322 22190 rpcz_store.cc:269] 0709 12:13:30.636013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.636271 (+   258us) service_pool.cc:224] Handling call
0709 12:13:32.115855 (+1479584us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540011a654. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:32.116032 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2628119808}
I20260709 12:13:31.943688 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.305112 22197 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 30: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:31.933465 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.307374 22196 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:32.307587 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:31.928448 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:32.311522 22191 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 164596fc2efa450581a5b68cad62271f in current term 30: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:32.312373 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.312899 22190 raft_consensus.cc:2376] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22. Re-sending same reply.
W20260709 12:13:32.303078 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:32.315107 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:32.315723 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.913470 30560 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:31.966262 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:32.316970 22830 leader_election.cc:336] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:31.965354 30559 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:31.967306 30552 log.cc:927] Time spent T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.474s	user 0.003s	sys 0.012s
I20260709 12:13:32.310642 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.318840 30560 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:32.313310 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:32.156913 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.950022 30535 log.cc:927] Time spent T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.152s	user 0.012s	sys 0.009s
I20260709 12:13:31.913849 30506 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:31.970072 30521 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.968990 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3536) took 1093 ms. Trace:
W20260709 12:13:32.075788 22195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 3162) took 2117 ms (client timeout 2174 ms). Trace:
I20260709 12:13:32.308440 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:32.338016 22196 raft_consensus.cc:2376] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19. Re-sending same reply.
W20260709 12:13:32.317245 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.913374 30475 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.344378 22237 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:32.317778 22087 leader_election.cc:336] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.537s (SENT)
I20260709 12:13:32.315294 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.319753 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.345780 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:32.320166 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:32.337412 22192 rpcz_store.cc:276] 0709 12:13:30.875886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.880968 (+  5082us) service_pool.cc:224] Handling call
0709 12:13:30.889681 (+  8713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:30.913370 (+ 23689us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:13:30.950350 (+ 36980us) log.cc:844] Serialized 14 byte log entry
0709 12:13:31.517938 (+567588us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:31.518003 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:13:31.518055 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.968617 (+450562us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b54000fc3d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:31.968670 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:31.968873 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37310,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":192922,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"spinlock_wait_cycles":53443840,"thread_start_us":339637,"threads_started":2,"wal-append.queue_time_us":433536}
W20260709 12:13:32.332183 30558 consensus_meta.cc:287] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: Time spent flushing consensus metadata: real 0.658s	user 0.013s	sys 0.001s
I20260709 12:13:31.920897 30477 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:31.949458 30561 log.cc:927] Time spent T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:13:32.331233 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:32.341035 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.349903 22197 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 24: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:13:32.350265 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.351418 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:32.338135 30526 consensus_meta.cc:287] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: Time spent flushing consensus metadata: real 0.819s	user 0.012s	sys 0.002s
I20260709 12:13:32.257666 30487 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:32.345945 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:32.060029 30557 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.348084 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:32.190645 29864 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.352097 22270 raft_consensus.cc:3060] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:32.337563 22195 rpcz_store.cc:269] 0709 12:13:29.958645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.977827 (+ 19182us) service_pool.cc:224] Handling call
0709 12:13:32.075498 (+2097671us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b540020dd54. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:32.075699 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3912941312}
I20260709 12:13:32.072386 30570 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:32.357450 22193 raft_consensus.cc:2468] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:31.966161 30483 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:32.358657 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:32.336613 30569 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.360601 22263 raft_consensus.cc:3060] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:32.351647 22830 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.361866 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.365718 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:31.947225 30278 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.403s
W20260709 12:13:32.354267 30491 consensus_meta.cc:287] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.851s	user 0.015s	sys 0.001s
I20260709 12:13:32.371670 22269 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
I20260709 12:13:32.372462 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:32.371502 22830 leader_election.cc:336] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:32.372514 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:32.376252 22830 leader_election.cc:336] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:32.373399 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.374856 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:32.379459 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 61706.4us
I20260709 12:13:32.301816 30572 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.382831 22270 raft_consensus.cc:2468] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:32.383852 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.377274 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.355261 30509 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.386554 22192 raft_consensus.cc:2393] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:32.087630 30573 consensus_queue.cc:1048] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.281s
I20260709 12:13:32.391335 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:32.377252 22830 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.388513 22263 raft_consensus.cc:2468] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 21.
W20260709 12:13:32.392966 22830 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.359630 30340 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:32.365942 30506 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:32.358269 30568 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:32.371645 30477 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:32.394088 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.341146 30521 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.373188 30571 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.349545 30475 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.399899 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.400393 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.372648 30558 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:31.912495 30564 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.413096 30558 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.415153 30572 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:32.375590 30574 raft_consensus.cc:2804] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:32.405288 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:32.402089 22830 leader_election.cc:336] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:32.423188 22830 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:32.422163 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 75043.7us
I20260709 12:13:32.410156 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.412030 22193 raft_consensus.cc:2393] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:32.402117 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.372717 29864 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.370728 30487 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.363495 30526 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.424937 22197 raft_consensus.cc:2468] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:32.427567 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:32.429209 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:32.430236 22830 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:32.421999 30574 raft_consensus.cc:697] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:32.371861 30557 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.431213 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:32.437199 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.437039 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:32.415632 30558 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:32.435993 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.442474 22195 raft_consensus.cc:2368] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23.
I20260709 12:13:32.444249 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:32.447731 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 67342.3us
I20260709 12:13:32.449357 22858 raft_consensus.cc:2368] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for earlier term 25. Current term is 26.
I20260709 12:13:32.445117 22197 raft_consensus.cc:2376] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18. Re-sending same reply.
I20260709 12:13:32.374961 30569 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.406224 30477 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.395401 30509 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.435518 30340 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:32.452339 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.440665 30452 raft_consensus.cc:2804] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:32.438297 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.434150 30495 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:32.438666 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:32.458348 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.460462 22190 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 23: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:32.465019 22193 raft_consensus.cc:2410] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 24 because replica has last-logged OpId of term: 22 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:13:32.403713 30568 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.471997 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:32.473613 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.408170 30571 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.476022 22192 raft_consensus.cc:2393] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 24: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:32.480710 22087 leader_election.cc:336] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.671s (SENT)
W20260709 12:13:32.483821 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45238.2us
I20260709 12:13:32.459671 30340 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.481896 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.495483 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.487162 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:32.488510 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:32.461109 30573 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:32.499297 22191 raft_consensus.cc:2393] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 18: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:32.499903 22193 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:32.486732 30581 raft_consensus.cc:2764] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:13:32.502108 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:32.501436 30574 consensus_queue.cc:237] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.502772 30573 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:32.497431 30278 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.503530 30521 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:32.534368 30521 raft_consensus.cc:493] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:32.503074 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.535457 22195 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 16.
I20260709 12:13:32.536594 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.537566 22195 raft_consensus.cc:2410] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 26 because replica has last-logged OpId of term: 24 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 20.
I20260709 12:13:32.503502 30564 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:32.496232 30340 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:32.521277 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:32.493430 30582 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:32.554322 30582 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:32.555605 30582 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:32.524041 22087 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.730s (SENT)
I20260709 12:13:32.557646 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:32.557737 30577 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:13:32.558740 30564 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:32.560171 30580 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.561000 30526 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 26 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:32.560846 30580 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:32.561664 22087 leader_election.cc:336] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.760s (SENT)
I20260709 12:13:32.561910 22194 raft_consensus.cc:1275] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:32.562251 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:32.527334 30571 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:32.563097 30475 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:32.563378 22194 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:13:32.563665 30580 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:32.520423 30573 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:32.564308 30573 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:32.528486 30278 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.564733 29864 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:32.565354 30569 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:32.529918 30568 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:32.532025 22265 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:13:32.558065 30487 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:32.566812 30278 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:32.523212 30107 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:32.535053 30521 raft_consensus.cc:515] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.570176 30521 leader_election.cc:290] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:32.520721 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:32.572301 22087 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.841s (SENT)
I20260709 12:13:32.576900 22194 raft_consensus.cc:1275] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:13:32.589221 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 68549.9us
I20260709 12:13:32.519351 30452 raft_consensus.cc:697] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:32.535080 30477 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:32.600414 22087 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.857s (SENT)
I20260709 12:13:32.601419 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:32.601729 22087 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:32.589530 30107 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:32.589704 30564 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:32.609541 22194 raft_consensus.cc:1275] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:13:32.614590 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 94073.1us
W20260709 12:13:32.617252 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 75921.1us
W20260709 12:13:32.617457 22087 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 2.096s (SENT)
I20260709 12:13:32.621397 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:32.622159 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:32.622957 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:32.626372 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:32.605728 30487 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.614892 30566 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:32.615073 30278 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:32.636349 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 26 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:32.636945 22198 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:32.643345 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:32.646663 22163 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:32.623777 30572 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:32.653214 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 760786us
I20260709 12:13:32.649645 30569 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:32.658686 30589 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:32.660883 30521 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:32.631754 30107 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:32.653985 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:32.635246 30564 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:32.642163 30522 raft_consensus.cc:2764] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:13:32.641196 30278 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:32.682371 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:32.682675 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:32.648017 30582 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:32.684674 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:32.650619 30534 consensus_queue.cc:1048] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 12:13:32.676506 30570 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.698416 30570 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.641587 30487 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.662089 30506 consensus_queue.cc:1059] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:13:32.704146 22198 raft_consensus.cc:2468] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 26.
I20260709 12:13:32.685251 22236 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:32.685899 30278 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:32.721657 30547 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.014s	sys 0.035s
I20260709 12:13:32.720395 30564 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:32.722069 30547 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.259s	user 0.014s	sys 0.036s
I20260709 12:13:32.686570 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:32.688923 30107 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:32.689901 30569 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:32.618513 30452 consensus_queue.cc:237] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:32.725606 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:32.727135 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.727033 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:32.714700 30548 log.cc:927] Time spent T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.248s	user 0.002s	sys 0.010s
W20260709 12:13:32.709147 30549 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 1.223s	user 0.015s	sys 0.000s
W20260709 12:13:32.732609 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.732791 30562 raft_consensus.cc:2804] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:32.739666 30107 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:32.730576 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 96159.9us
I20260709 12:13:32.744230 30589 consensus_queue.cc:1048] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:32.744408 22830 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:32.745719 30589 raft_consensus.cc:2804] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:32.746274 30589 raft_consensus.cc:697] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 26 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:32.717247 29864 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:32.747124 30589 consensus_queue.cc:237] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 24.21, Last appended by leader: 21, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.750391 29864 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:32.745770 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.733317 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:32.710886 30506 raft_consensus.cc:3055] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:13:32.766708 22830 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.717125 30582 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:32.700735 30570 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:32.769062 22236 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:32.770442 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.809763 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:32.811456 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:32.819375 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.726653 30572 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 12:13:32.722383 30564 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.768046 30506 raft_consensus.cc:740] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:32.830188 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.807632 30562 raft_consensus.cc:697] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:32.812598 30569 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:32.816800 30483 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:32.827713 30559 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:32.825769 30558 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:32.817044 30570 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 12:13:32.862977 30581 raft_consensus.cc:2804] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:13:32.872666 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:32.875277 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 55193.2us
I20260709 12:13:32.817111 30491 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:13:32.879449 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:32.882984 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 114030us
I20260709 12:13:32.865788 30597 raft_consensus.cc:2804] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:32.876613 30483 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:32.882572 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 134486us
I20260709 12:13:32.893319 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:32.896224 30447 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:32.896754 30447 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.877915 30558 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:32.897456 30483 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:32.917610 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.877502 30340 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.897204 30581 raft_consensus.cc:697] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:32.919039 30569 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.921029 30506 consensus_queue.cc:260] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.925081 30572 raft_consensus.cc:3060] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:32.925951 30570 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.933226 30610 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:13:32.943598 30570 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.902894 30582 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.933925 30585 consensus_queue.cc:1048] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:13:32.945802 30570 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:32.913137 30558 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:32.946758 30506 raft_consensus.cc:3060] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:32.929352 30562 consensus_queue.cc:237] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.910841 22163 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:32.952370 22858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56950 (request call id 1130) took 1629 ms (client timeout 2166 ms). Trace:
I20260709 12:13:32.899252 30597 raft_consensus.cc:697] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:32.958413 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:32.932756 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:32.953007 22858 rpcz_store.cc:269] 0709 12:13:31.322618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.322768 (+   150us) service_pool.cc:224] Handling call
0709 12:13:32.952091 (+1629323us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540030f054. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:32.952289 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2587624320}
W20260709 12:13:32.959965 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 49295.2us
I20260709 12:13:32.903035 30447 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:32.959225 22861 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:32.961061 22163 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:32.959438 22865 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 16.
I20260709 12:13:32.978329 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:32.975217 30522 raft_consensus.cc:2804] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:32.979247 30597 consensus_queue.cc:237] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.980010 30522 raft_consensus.cc:697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:32.928702 30509 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:32.932286 30526 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:32.981374 30522 consensus_queue.cc:237] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.981606 30526 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:32.984009 30526 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:32.924504 30278 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:32.986788 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:32.988447 22270 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:32.932801 30487 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:32.989275 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 109923us
I20260709 12:13:32.990417 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:32.990449 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:32.957214 30564 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:32.979943 30606 raft_consensus.cc:2804] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:32.991441 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:32.992437 30570 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:32.992689 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f
I20260709 12:13:33.017124 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:32.994398 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:32.995370 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:32.986795 22236 connection.cc:256] RPC call timeout handler was delayed by -2.4149386790002154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
I20260709 12:13:32.995822 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.017119 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:33.019181 22236 connection.cc:256] RPC call timeout handler was delayed by -2.3546386790001179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 12:13:33.025899 22236 connection.cc:256] RPC call timeout handler was delayed by -2.3456386790001034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 12:13:33.026450 22236 leader_election.cc:336] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.505s (SENT)
I20260709 12:13:33.027319 22087 leader_election.cc:400] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23.
W20260709 12:13:33.027324 22236 leader_election.cc:336] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.609s (SENT)
W20260709 12:13:33.028993 22236 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.665s (SENT)
W20260709 12:13:33.029711 22236 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.668s (SENT)
I20260709 12:13:33.026283 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:32.968312 29864 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.040588 22192 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 25.
I20260709 12:13:33.042361 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54878b51479940bebc76fc9d84de64cb" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:33.042846 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:33.045646 22087 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:33.045749 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 145315us
W20260709 12:13:33.047574 22236 leader_election.cc:336] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.720s (SENT)
I20260709 12:13:33.048424 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:33.049597 29864 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:33.036550 30564 raft_consensus.cc:2804] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:33.030197 30573 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.037478 30606 raft_consensus.cc:697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:33.052073 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.066589 22858 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 12:13:33.084686 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:33.092401 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 44872.6us
W20260709 12:13:33.105921 22236 leader_election.cc:336] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.730s (SENT)
I20260709 12:13:33.051069 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:33.106276 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:33.072849 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:33.106992 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 55971.6us
I20260709 12:13:33.075611 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.051651 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:33.131825 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:33.132441 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 80867.7us
I20260709 12:13:33.084079 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:33.141553 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:33.142168 22194 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:33.143950 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.151886 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:33.154335 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 70405.7us
I20260709 12:13:33.175952 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.177369 22860 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:33.132602 30475 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:33.185187 30475 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:33.137458 30483 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.185636 30475 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:33.188030 30483 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:33.188935 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 83039.2us
W20260709 12:13:33.189698 22236 leader_election.cc:336] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.750s (SENT)
I20260709 12:13:33.190120 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:33.191093 30562 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:13:33.191385 22236 leader_election.cc:336] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Timed out: RequestConsensusVote RPC to 127.20.102.194:36735 timed out after 1.761s (SENT)
I20260709 12:13:33.191900 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:33.192713 30562 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:33.192981 30509 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:33.175870 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 45109.8us
I20260709 12:13:33.080083 30570 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:33.071024 30606 consensus_queue.cc:237] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.198940 30612 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:33.066538 30564 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:33.078193 30559 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:33.086568 30572 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:33.172546 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:33.058387 30278 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:33.070072 30557 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:33.069586 30573 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:33.066352 30340 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:33.140851 30107 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:33.197032 22237 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:33.176585 30491 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:33.237820 22237 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:33.237865 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:33.282295 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 44599.8us
W20260709 12:13:33.283082 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.207769 30564 raft_consensus.cc:3060] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:33.284369 30278 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:33.293695 30573 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:33.296545 22194 raft_consensus.cc:2468] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 23.
W20260709 12:13:33.300680 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 83295.2us
W20260709 12:13:33.347937 22236 connection.cc:256] RPC call timeout handler was delayed by -2.2466386790001707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
I20260709 12:13:33.219193 30483 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:13:33.349459 22236 connection.cc:256] RPC call timeout handler was delayed by -2.1903204430000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 12:13:33.349877 22236 connection.cc:256] RPC call timeout handler was delayed by -2.147638679000238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
W20260709 12:13:33.297315 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 128746us
W20260709 12:13:33.350224 22236 connection.cc:256] RPC call timeout handler was delayed by -2.1395386790002249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
W20260709 12:13:33.350811 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:33.351295 22236 connection.cc:256] RPC call timeout handler was delayed by -2.0135949660000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 12:13:33.351552 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 52088us
W20260709 12:13:33.351760 22236 connection.cc:256] RPC call timeout handler was delayed by -2.0018949660000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 12:13:33.352461 22236 connection.cc:256] RPC call timeout handler was delayed by -1.9594985999999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 12:13:33.352842 22236 connection.cc:256] RPC call timeout handler was delayed by -1.9189985999998953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260709 12:13:33.238231 30491 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.373710 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:33.374691 22267 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 23.
I20260709 12:13:33.052323 30581 consensus_queue.cc:237] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.332324 30572 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:33.214159 30612 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.148s
I20260709 12:13:33.331442 30278 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.398706 30278 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:33.361334 30566 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 12:13:33.405844 30570 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:33.329937 30573 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.406970 30573 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:33.356123 30483 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.415766 30483 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:33.221235 30558 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.421860 30558 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:33.422521 22270 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:33.364164 30491 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:33.356746 30107 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.429241 30107 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:33.431356 30107 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:33.350932 30559 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.431656 30447 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.432053 30559 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:33.434010 30559 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:33.436066 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6833615380000992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 12:13:33.436512 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6667200770000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:13:33.436851 22236 connection.cc:256] RPC call timeout handler was delayed by -1.6173875330000556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 12:13:33.437809 22236 connection.cc:256] RPC call timeout handler was delayed by -1.4963780120001502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 12:13:33.438253 22236 connection.cc:256] RPC call timeout handler was delayed by -1.173839917000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260709 12:13:33.438632 22236 connection.cc:256] RPC call timeout handler was delayed by -1.0641615380002349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.275s for a response
I20260709 12:13:33.439121 30562 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.439608 30509 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.440254 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:33.475800 22860 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
W20260709 12:13:33.442991 30607 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.429s	user 0.006s	sys 0.006s
W20260709 12:13:33.459149 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:33.479785 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 305566us
I20260709 12:13:33.481038 22237 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:33.485762 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:33.491981 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.502557 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:33.504225 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.506678 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.508499 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.516249 30506 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:33.517561 30506 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:33.518729 30506 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.484114 30509 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.527453 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.529242 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.531647 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:33.535964 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.536729 22189 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:33.538743 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:33.548638 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:33.538789 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.502542 30107 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:13:33.583719 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 50565.3us
I20260709 12:13:33.510082 30559 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 12:13:33.598270 22858 raft_consensus.cc:2393] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 21: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:33.590763 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:33.484378 30562 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:33.624243 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.627712 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:33.628355 22189 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:33.626243 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:33.592542 30107 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:33.627163 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.637482 22190 raft_consensus.cc:1275] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:33.635068 30630 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:33.640223 30630 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.640576 30630 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:33.642375 30475 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:33.646126 22198 raft_consensus.cc:1240] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Rejecting Update request from peer 164596fc2efa450581a5b68cad62271f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:33.619678 30447 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:33.627974 30628 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.661785 30562 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:33.662492 30562 consensus_queue.cc:1059] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:33.635043 30107 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:33.671613 22189 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 26.
I20260709 12:13:33.673455 30581 raft_consensus.cc:3055] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:33.673631 30630 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.675642 30581 raft_consensus.cc:740] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:33.684437 30581 consensus_queue.cc:260] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.687085 30491 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.674821 30628 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:33.690860 30628 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:33.671028 30564 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:33.693360 30564 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:33.695217 30215 raft_consensus.cc:3060] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:33.711297 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:33.712001 22237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.711664 30483 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.713016 30475 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Requested vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:33.672329 30509 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:33.808882 30278 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:33.830231 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 296541us
I20260709 12:13:33.855527 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:33.855844 22162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.827893 22087 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:33.857599 22162 leader_election.cc:336] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:33.862124 22088 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:33.858363 22162 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:33.822897 30612 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.805843 30573 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:33.834075 30491 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:33.878643 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:33.872015 30572 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:33.874050 30632 log.cc:927] Time spent T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:13:33.873176 30559 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:33.886461 22268 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:33.887164 22162 leader_election.cc:336] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:33.875931 30612 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.888836 22197 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 23.
I20260709 12:13:33.895283 22163 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:33.896153 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:33.877617 30506 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:33.904446 22270 raft_consensus.cc:1240] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:33.905272 30580 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:13:33.905879 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.907784 30612 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:33.909269 30573 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:33.910745 22858 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:13:33.911315 30483 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:33.911743 30636 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:13:33.896435 30478 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:33.911927 22266 raft_consensus.cc:1240] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:33.912478 30593 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:33.914036 30630 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:33.919178 22271 raft_consensus.cc:1240] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:33.891438 30477 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:33.901436 22162 consensus_peers.cc:597] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.929917 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3580) took 1793 ms. Trace:
I20260709 12:13:33.890000 30475 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:33.938766 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:33.950286 22197 rpcz_store.cc:276] 0709 12:13:32.136924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.451813 (+314889us) service_pool.cc:224] Handling call
0709 12:13:33.929723 (+1477910us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000fbed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:33.929848 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3254473600}
I20260709 12:13:33.953224 22270 raft_consensus.cc:3060] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:33.890489 30559 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:33.900640 30340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.010s
W20260709 12:13:33.939740 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 456768us
W20260709 12:13:33.962263 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 320841us
W20260709 12:13:33.950163 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 48790.4us
W20260709 12:13:33.947326 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 313725us
I20260709 12:13:33.939334 30590 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
W20260709 12:13:33.964720 22162 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:33.965279 22831 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:33.951839 30477 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:33.963985 22830 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:33.968344 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:33.967253 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:33.971711 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:33.960469 30340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.001s	sys 0.010s
I20260709 12:13:33.981575 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:33.983512 22162 leader_election.cc:336] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:33.983408 22194 raft_consensus.cc:1275] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 24 index: 21. Preceding OpId from leader: term: 26 index: 22. (index mismatch)
I20260709 12:13:33.987417 22272 raft_consensus.cc:1275] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:13:33.988701 22270 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:33.986328 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:33.991364 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:33.996687 22265 raft_consensus.cc:1275] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:13:33.997746 22162 leader_election.cc:336] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:33.998243 22162 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:33.998334 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:34.006384 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:33.976619 30453 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:34.007324 22861 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:34.010259 22858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:34.007179 30278 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:34.011876 30614 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.012490 30614 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.013576 30543 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:34.014549 30591 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:34.014861 30614 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:34.015014 30591 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.015401 30591 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.017968 30530 raft_consensus.cc:2804] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:34.018563 30530 raft_consensus.cc:697] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 23 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:34.019526 30530 consensus_queue.cc:237] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:34.022395 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:33.956290 30483 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:13:34.025066 22861 raft_consensus.cc:2468] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:13:34.026744 30107 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:33.988368 30521 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:33.979194 30590 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:34.029417 30477 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:34.030238 30566 consensus_queue.cc:1048] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:34.044689 30581 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.010305 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:34.035852 22860 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 12:13:34.059034 22864 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:34.033002 22162 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.033947 30580 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:34.038771 30557 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:13:34.045673 30566 consensus_queue.cc:1243] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 22.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:13:34.046774 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:34.047281 22164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.051415 22237 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:34.004403 30573 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:13:34.061079 22162 leader_election.cc:336] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.064613 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.076581 22162 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.079639 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:13:34.080341 22860 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:34.030733 30559 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.053942 30107 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:34.055073 30590 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:34.094894 22236 leader_election.cc:304] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:34.087868 22162 leader_election.cc:336] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:34.102133 22162 leader_election.cc:336] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.102535 22162 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.079293 22864 raft_consensus.cc:2468] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:34.104254 22237 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:34.079668 30569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.006s	sys 0.035s
I20260709 12:13:34.104279 22860 raft_consensus.cc:2468] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:13:34.079278 30573 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:34.114862 30573 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:34.110576 22237 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:34.081287 30644 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:34.097146 30562 raft_consensus.cc:2804] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:34.121503 30557 consensus_queue.cc:1059] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:34.107893 30477 consensus_queue.cc:1059] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
W20260709 12:13:34.109155 30569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.006s	sys 0.035s
I20260709 12:13:34.124420 30558 raft_consensus.cc:2804] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:34.124606 30478 consensus_queue.cc:1059] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:34.126125 30448 consensus_queue.cc:1048] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:34.129357 30107 raft_consensus.cc:2749] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:34.129161 30573 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.132632 30582 raft_consensus.cc:2804] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:34.097424 30215 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:34.149644 30606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.012s	sys 0.015s
I20260709 12:13:34.124433 22163 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:34.068056 30630 consensus_queue.cc:1059] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:13:34.142489 30562 raft_consensus.cc:697] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:34.156381 30558 raft_consensus.cc:697] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:34.163051 30582 raft_consensus.cc:697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:34.166055 30597 raft_consensus.cc:3055] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:13:34.161482 30606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.013s	sys 0.016s
W20260709 12:13:34.169649 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 67549.1us
W20260709 12:13:34.178208 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 173241us
I20260709 12:13:34.173983 22163 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:34.181493 22162 leader_election.cc:336] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.182073 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:34.183697 22162 consensus_peers.cc:597] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.228718 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45086.2us
W20260709 12:13:34.230223 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 48320.4us
W20260709 12:13:34.230957 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 57073.2us
I20260709 12:13:34.232089 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:34.231189 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 47463.2us
I20260709 12:13:34.235292 22864 raft_consensus.cc:1240] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:34.230122 22162 consensus_peers.cc:597] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.241806 22162 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.243505 22162 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.181221 30586 raft_consensus.cc:2804] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:34.178920 30628 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:34.179176 30597 raft_consensus.cc:740] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:34.254817 22162 consensus_peers.cc:597] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.181077 30515 consensus_queue.cc:1048] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 12:13:34.240381 30478 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:34.270072 22162 leader_election.cc:336] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.270577 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:34.276659 22162 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.252379 30448 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:34.253718 30593 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:34.227636 30602 consensus_queue.cc:1048] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
W20260709 12:13:34.277685 22162 consensus_peers.cc:597] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.292080 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 197266us
I20260709 12:13:34.292248 30557 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:34.254644 30543 consensus_queue.cc:1048] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.029s
I20260709 12:13:34.241812 30645 consensus_queue.cc:1059] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:13:34.299150 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:34.300150 22162 consensus_peers.cc:597] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.308404 22162 consensus_peers.cc:597] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.309721 22162 consensus_peers.cc:597] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.313444 22162 leader_election.cc:336] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.314007 22162 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.306996 30506 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:34.377871 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 78788.5us
I20260709 12:13:34.364601 30593 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:34.378964 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.363399 30107 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:34.276306 30558 consensus_queue.cc:237] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:34.418090 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 181568us
I20260709 12:13:34.396953 30630 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.447786 22267 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:34.315650 30562 consensus_queue.cc:237] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:34.370054 30506 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.368136 30597 consensus_queue.cc:260] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.446661 30630 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:34.455776 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 76926.6us
I20260709 12:13:34.457481 30630 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:34.458442 22162 consensus_peers.cc:597] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.458957 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 103780us
W20260709 12:13:34.459656 22162 consensus_peers.cc:597] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.460305 22162 leader_election.cc:336] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.426895 30612 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:34.461555 30661 log.cc:927] Time spent T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:13:34.461561 30037 raft_consensus.cc:3055] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:34.474956 30037 raft_consensus.cc:740] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:34.475831 30037 consensus_queue.cc:260] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:34.461946 30653 log.cc:927] Time spent T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 12:13:34.462533 30477 raft_consensus.cc:3055] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:34.477957 30477 raft_consensus.cc:740] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:34.478785 30591 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.479063 30477 consensus_queue.cc:260] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.463068 30483 raft_consensus.cc:3055] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:34.481316 30483 raft_consensus.cc:740] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:34.482170 30483 consensus_queue.cc:260] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:34.463670 30651 log.cc:927] Time spent T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 12:13:34.464069 30612 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.486379 30612 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:34.467964 30652 log.cc:927] Time spent T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:13:34.488667 30037 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:34.492868 30477 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.494552 30580 raft_consensus.cc:3055] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:34.495298 30580 raft_consensus.cc:740] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:34.367944 30582 consensus_queue.cc:237] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:34.460744 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.497687 30478 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:34.452682 30648 log.cc:927] Time spent T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:13:34.439527 30573 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:34.498884 22162 leader_election.cc:336] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.425768 30663 raft_consensus.cc:2764] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:13:34.499485 30483 raft_consensus.cc:3060] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:34.499308 22162 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.501752 30478 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:34.503132 22162 leader_election.cc:336] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.506556 30612 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.517272 30612 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:34.519683 30612 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:34.520356 22162 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.521425 30591 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:34.509783 30107 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:34.521531 30515 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:34.458487 22236 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:34.496672 30580 consensus_queue.cc:260] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:34.544080 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:34.541783 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 83356.1us
I20260709 12:13:34.546643 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.553987 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:34.554802 22265 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:34.565531 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.471110 30506 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:34.543521 30107 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:34.562711 30581 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:34.570631 22236 leader_election.cc:304] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:34.593490 22832 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.596660 30518 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.597275 30518 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.599053 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:34.622169 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 202775us
I20260709 12:13:34.569151 30515 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 12:13:34.635953 22271 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:34.562954 30612 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.589418 30483 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.570905 30580 raft_consensus.cc:3060] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:34.628921 30663 raft_consensus.cc:2749] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:34.622412 30506 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.637226 30509 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:34.660058 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 61087.9us
I20260709 12:13:34.661274 22236 leader_election.cc:400] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:34.661702 22236 leader_election.cc:403] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:13:34.646693 30612 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.675518 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.650504 30483 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.678746 30107 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:34.681198 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 446975us
I20260709 12:13:34.657073 30506 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:34.685055 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 163425us
W20260709 12:13:34.687525 22162 leader_election.cc:336] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.688064 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:34.692175 22162 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:34.693243 22162 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.693746 22162 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.696950 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:34.679369 30509 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735) with higher term. Message: Invalid argument: T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19.
I20260709 12:13:34.699627 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:34.720885 22162 leader_election.cc:336] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:34.722013 22162 leader_election.cc:336] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.722539 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.683032 30586 raft_consensus.cc:697] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:34.700610 30581 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:13:34.685011 30107 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:34.705534 30647 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:34.705837 30448 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:34.774735 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 75193.7us
I20260709 12:13:34.789526 22236 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:34.835848 22088 leader_election.cc:336] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.622s (SENT)
W20260709 12:13:34.773135 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 51153.7us
I20260709 12:13:34.838837 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.833197 22010 maintenance_manager.cc:419] P 724c00f1bc7e49c9835e5c0e664b7356: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033373
I20260709 12:13:34.735319 30278 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:34.845158 30278 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.845628 30278 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:34.843518 22088 leader_election.cc:336] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.630s (SENT)
I20260709 12:13:34.836112 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:34.844182 22269 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:34.850643 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:34.774669 30666 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:34.773500 30591 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:34.849397 30630 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:34.857445 30669 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:13:34.858397 30670 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:13:34.874972 30668 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:13:34.837620 30518 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:34.881896 30506 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:34.883306 30612 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:34.781533 30475 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:13:34.884057 30667 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:13:34.886062 30107 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:34.852634 22162 leader_election.cc:336] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:34.929859 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 77304.8us
W20260709 12:13:34.930797 22162 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:34.932067 22162 leader_election.cc:336] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.893213 22265 raft_consensus.cc:2468] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 24.
W20260709 12:13:34.904496 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 115061us
I20260709 12:13:34.935282 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:34.906867 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:34.937975 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.939216 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.939945 22270 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:34.907716 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.903162 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:34.835461 30559 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:34.943885 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.876518 30586 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.946168 22163 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:34.947861 22830 leader_election.cc:336] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.948618 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:34.920222 30581 raft_consensus.cc:2749] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:34.956532 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 113047us
W20260709 12:13:34.957630 22088 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.524s (SENT)
I20260709 12:13:34.958053 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:34.952564 22830 leader_election.cc:336] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.966554 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.967407 22269 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 24: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:34.968245 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.918490 30606 consensus_queue.cc:1059] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:13:34.929373 30475 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:34.972684 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.954824 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:34.949582 30518 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:34.973984 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.951455 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:34.959116 22088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.913968 30630 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:34.953423 22162 leader_election.cc:336] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.942548 30612 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:34.956498 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.969741 30475 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:34.975430 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.975366 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.001322 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.998603 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.031131 22266 raft_consensus.cc:2410] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:13:34.997463 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.031754 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
W20260709 12:13:34.975934 22830 leader_election.cc:336] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.996423 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:35.033133 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57238.6us
I20260709 12:13:34.990727 30581 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
W20260709 12:13:35.034899 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.037022 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.959292 30602 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:35.038643 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:35.039321 22270 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:35.035974 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:35.038527 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:35.046864 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.050033 22088 leader_election.cc:336] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.821s (SENT)
I20260709 12:13:35.050566 22088 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:34.961323 30591 raft_consensus.cc:2804] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:35.054205 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.056555 22268 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:35.060752 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 107351us
W20260709 12:13:35.061892 22162 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.062453 22162 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:35.064636 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:34.989763 30606 raft_consensus.cc:3055] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:35.071367 22265 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:35.069141 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:35.022161 30614 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:34.990829 30453 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:35.071638 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.999221 30483 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:35.014751 30686 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.950968 30559 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:34.975939 30518 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.074275 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.073235 22268 raft_consensus.cc:2393] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:35.065748 30515 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:35.099886 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:35.070529 30606 raft_consensus.cc:740] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:35.094753 22270 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 26.
I20260709 12:13:35.096652 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.069977 30612 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:35.105299 22270 raft_consensus.cc:1240] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:35.086401 30673 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:35.093829 30681 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.104s	user 0.004s	sys 0.000s
I20260709 12:13:35.124505 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.125922 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:35.052238 30581 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:35.094117 30518 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:35.141832 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.130288 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.089270 30453 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:35.153941 22268 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:35.093773 30686 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:35.156849 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.159761 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.160848 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.167273 30630 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:35.171743 30453 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:35.172381 30678 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
W20260709 12:13:35.185590 30677 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.323s	user 0.003s	sys 0.000s
I20260709 12:13:35.191538 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.159657 30278 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:35.207850 22270 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 26: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:35.214244 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.201212 22266 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 12:13:35.202948 22271 raft_consensus.cc:2393] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 24: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:35.215416 22267 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
W20260709 12:13:35.197374 30675 log.cc:927] Time spent T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.324s	user 0.000s	sys 0.002s
I20260709 12:13:35.228742 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.241626 22270 raft_consensus.cc:2410] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:13:35.196223 30597 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:35.250439 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 188585us
I20260709 12:13:35.245097 22864 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:13:35.251493 22162 leader_election.cc:336] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.199411 30686 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:35.252933 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:35.257655 22162 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.258301 22162 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:35.277562 22162 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.278290 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:35.283638 22162 leader_election.cc:336] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.284299 22162 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:35.284440 22830 leader_election.cc:336] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:35.287240 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 201091us
I20260709 12:13:35.285306 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:35.296177 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.292397 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 215876us
I20260709 12:13:35.160444 30606 consensus_queue.cc:260] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:35.304035 22088 leader_election.cc:336] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Timed out: RequestConsensusVote RPC to 127.20.102.195:38085 timed out after 1.635s (SENT)
I20260709 12:13:35.254859 30278 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:35.306568 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.268567 30215 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:35.309934 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.287330 30521 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:35.291145 30580 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:35.318548 22162 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.323256 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.329182 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:35.329583 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:35.331333 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.333729 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.334491 22198 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:35.337671 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.338438 22195 raft_consensus.cc:2468] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 23.
I20260709 12:13:35.340013 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.341630 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.342387 30689 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:35.342839 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.345742 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.346264 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.346659 30689 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:35.351086 30506 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:35.353560 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.354751 22190 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 24: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:13:35.353730 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50610.3us
I20260709 12:13:35.360980 22189 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:35.361706 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.327082 30591 raft_consensus.cc:697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 24 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:35.377944 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:35.378863 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 109299us
I20260709 12:13:35.379374 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:35.380326 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.312960 30656 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:35.388998 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:35.377503 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:35.393716 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.394685 22190 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 26: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:35.312857 30687 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:13:35.403643 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.397172 30614 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:35.351867 30686 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:35.404788 22189 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17.
I20260709 12:13:35.406813 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.405921 22264 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:35.401525 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:35.405251 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 43661.5us
W20260709 12:13:35.408233 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.419545 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.420210 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.352130 30691 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:35.308218 30573 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:13:35.364032 30278 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.433156 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.438014 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:35.369634 30606 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:35.440191 22264 raft_consensus.cc:1240] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:35.395920 30483 raft_consensus.cc:2764] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:13:35.391254 30559 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:35.440076 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:35.438370 22190 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:35.406201 30689 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:35.406159 30614 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.434082 22088 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.446852 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.450870 22190 raft_consensus.cc:2410] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:13:35.455061 30614 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:35.441031 30557 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.458751 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.459133 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:35.446995 30684 log.cc:927] Time spent T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:13:35.444540 30215 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:35.449446 30686 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:35.456367 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 68955us
I20260709 12:13:35.469998 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.468240 30506 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:35.484184 22088 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.443030 30278 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:35.472970 30483 raft_consensus.cc:3060] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:35.467496 30557 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:35.490517 30689 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:35.517616 30278 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:35.495079 30506 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:35.462280 30591 consensus_queue.cc:237] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:35.493268 30630 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:13:35.476992 30215 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:35.502439 30581 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:35.562721 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 76483.7us
W20260709 12:13:35.567510 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 179825us
I20260709 12:13:35.569059 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:35.572180 22194 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:35.570180 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:35.574662 22162 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:35.581249 22162 consensus_peers.cc:597] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.584486 22088 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.604425 22087 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:35.595139 22088 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.613911 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:35.614576 22161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.582121 30708 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:35.615767 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.597200 30630 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:35.618167 30689 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:35.622571 30686 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:35.638748 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 76773.8us
W20260709 12:13:35.648797 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.651046 22194 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
I20260709 12:13:35.655043 30586 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:35.655853 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.655694 30586 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:35.624436 30708 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:35.657099 22197 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:13:35.658059 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.658514 30708 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:35.658619 22197 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24.
I20260709 12:13:35.659744 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:35.639856 30689 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.661280 30689 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:35.629393 30714 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:35.665159 30586 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:35.664324 22197 raft_consensus.cc:2410] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:13:35.665584 30483 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:35.668745 30557 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:35.669086 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.670261 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:35.670792 22197 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:35.675395 30685 log.cc:927] Time spent T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.482s	user 0.001s	sys 0.001s
I20260709 12:13:35.629640 30506 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:35.641048 30630 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:35.709833 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:35.723201 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:35.710095 30667 log.cc:927] Time spent T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:13:35.727886 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:35.705297 30710 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.728950 30509 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:35.732898 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 117205us
I20260709 12:13:35.736600 22190 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24.
I20260709 12:13:35.739781 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.730245 30107 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:13:35.733855 30518 consensus_meta.cc:287] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.010s
I20260709 12:13:35.744251 22861 raft_consensus.cc:1275] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:13:35.743232 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:35.746335 22162 leader_election.cc:336] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:35.743484 30628 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.010s	sys 0.019s
I20260709 12:13:35.749248 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:35.762329 22162 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 137 similar messages]
W20260709 12:13:35.763744 22162 consensus_peers.cc:597] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.765287 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.766396 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.738657 30710 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:35.766927 22189 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:35.767768 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.768409 22189 raft_consensus.cc:2393] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 23: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:35.769070 30710 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:35.769917 30614 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:35.772919 22191 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:35.752359 30518 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:35.774521 22198 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:35.760536 30215 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:35.782562 30693 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:35.783221 30719 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:35.783667 30597 consensus_meta.cc:287] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: Time spent flushing consensus metadata: real 0.527s	user 0.016s	sys 0.000s
I20260709 12:13:35.784430 22196 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 26.
I20260709 12:13:35.760632 30573 consensus_queue.cc:1048] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 12:13:35.785543 22190 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 18.
I20260709 12:13:35.746928 30107 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.786541 30107 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:35.786705 30645 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.772523 30614 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:35.780534 22197 raft_consensus.cc:2410] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e for term 26 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 14.
I20260709 12:13:35.808578 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.809010 22191 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:35.787482 30645 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:35.787972 30518 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:35.812477 30719 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:13:35.818609 30645 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:35.826761 22860 consensus_queue.cc:237] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:35.831889 22236 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:35.837769 30710 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:35.839463 22163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.811353 22088 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:35.811622 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:35.845503 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:35.755471 30628 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.011s	sys 0.019s
I20260709 12:13:35.848454 30614 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:35.848616 30710 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:35.841743 30689 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:35.854400 22189 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:35.855266 22236 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:35.855715 30719 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:35.856228 30278 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:13:35.856904 30674 log.cc:927] Time spent T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.995s	user 0.001s	sys 0.007s
I20260709 12:13:35.864758 22189 raft_consensus.cc:1275] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 12:13:35.758891 22009 maintenance_manager.cc:643] P 724c00f1bc7e49c9835e5c0e664b7356: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.913s	user 0.045s	sys 0.008s Metrics: {"bytes_written":6577,"delete_count":0,"lbm_write_time_us":1214,"lbm_writes_lt_1ms":6,"reinsert_count":0,"update_count":272}
I20260709 12:13:35.870072 22189 pending_rounds.cc:85] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 15
I20260709 12:13:35.870466 22189 pending_rounds.cc:107] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 12:13:35.870791 22189 raft_consensus.cc:2889] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:35.874917 22189 raft_consensus.cc:1240] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:35.876145 22010 maintenance_manager.cc:419] P 724c00f1bc7e49c9835e5c0e664b7356: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.338181
I20260709 12:13:35.877336 22189 raft_consensus.cc:1275] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:13:35.869861 30644 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:35.882270 30278 raft_consensus.cc:697] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:35.897876 22263 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:35.887499 30506 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.901633 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:35.900569 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:35.878232 30573 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:13:35.885790 30509 consensus_queue.cc:1048] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:13:35.912575 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:35.914633 30506 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:35.922600 30506 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:35.891587 30581 consensus_queue.cc:1048] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
W20260709 12:13:35.917284 22162 consensus_peers.cc:597] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.917680 30689 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:35.884825 30582 consensus_queue.cc:1059] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:13:35.933506 30582 raft_consensus.cc:3055] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:35.933934 30582 raft_consensus.cc:740] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:35.934804 30582 consensus_queue.cc:260] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:35.935670 30475 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:35.936049 30582 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:35.918426 30278 consensus_queue.cc:237] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:35.940940 30689 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.941546 30689 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:35.943931 30689 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:35.931056 22162 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:35.951434 22162 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:35.955165 22162 consensus_peers.cc:597] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.956959 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:35.955730 22162 leader_election.cc:336] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.995460 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:35.977905 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:35.998188 22162 leader_election.cc:336] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.998569 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:36.000577 22236 leader_election.cc:336] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.997391 30714 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:36.001307 22236 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:36.007468 22830 leader_election.cc:336] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.012547 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:36.013609 22265 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:36.005637 22162 leader_election.cc:336] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.008211 22088 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:36.001819 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:36.017217 22861 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 30.
I20260709 12:13:35.956310 30689 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:35.997977 30720 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.006855 30686 raft_consensus.cc:3060] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:36.023307 22162 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.007248 30714 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.993582 30630 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:13:36.022300 30614 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.015870 30573 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:36.037285 30720 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:36.057336 30720 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:36.061211 30710 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:36.062196 30107 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.043736 30714 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:36.027222 30689 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:36.070657 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:36.071481 22195 raft_consensus.cc:2376] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 17. Re-sending same reply.
I20260709 12:13:36.072433 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:36.038757 30719 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:36.087683 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:36.090730 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:36.091890 22195 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 23.
I20260709 12:13:36.072140 30689 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:36.103322 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:36.103925 30730 log.cc:927] Time spent T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:13:36.104898 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:36.105597 22195 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:36.106499 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:36.107036 22195 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:36.079967 30614 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:36.109812 30593 raft_consensus.cc:493] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:36.110401 30593 raft_consensus.cc:515] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:36.111177 30614 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:36.112498 30593 leader_election.cc:290] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:36.114820 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:36.118482 22087 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:36.120301 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 112180us
I20260709 12:13:36.122809 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:36.124883 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:36.127835 22195 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 21.
I20260709 12:13:36.132014 22265 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
I20260709 12:13:36.133451 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:36.134112 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:36.136240 22087 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:36.121333 30340 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:36.141781 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:36.142812 22195 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:36.144147 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.135036 30719 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:36.129248 30614 raft_consensus.cc:3060] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:36.151649 30714 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.144528 30340 raft_consensus.cc:493] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.182163 30340 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:36.153342 22266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45860 (request call id 3563) took 1140 ms. Trace:
I20260709 12:13:36.184994 22266 rpcz_store.cc:276] 0709 12:13:35.013221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.048808 (+ 35587us) service_pool.cc:224] Handling call
0709 12:13:35.049173 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:35.216599 (+167426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.152999 (+936400us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540029c7d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:36.153264 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348986112}
I20260709 12:13:36.187618 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:36.194001 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:36.194965 22196 raft_consensus.cc:2393] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 26: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:36.195917 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:36.200321 22196 raft_consensus.cc:2410] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:13:36.154992 30612 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:36.188633 22192 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 30.
I20260709 12:13:36.156641 30733 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:36.137858 30710 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.161659 22088 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
W20260709 12:13:36.212004 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 50429.7us
I20260709 12:13:36.213716 30710 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:36.214382 30710 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:36.215415 30710 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.161953 30107 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:36.162326 30719 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
W20260709 12:13:36.164943 22831 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.217664 30719 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.165454 22197 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:36.137991 30689 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.173882 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:36.226227 22194 raft_consensus.cc:2410] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
W20260709 12:13:36.176420 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.176602 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:36.227818 22190 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 30.
I20260709 12:13:36.228554 22193 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
W20260709 12:13:36.178054 22236 leader_election.cc:336] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.230685 22236 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:36.231794 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.233683 30714 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:36.230101 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:36.235724 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57715.7us
I20260709 12:13:36.239255 30107 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:36.240258 30713 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:36.240811 30713 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.241209 30713 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:36.235095 30628 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:36.242707 30628 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:36.248539 22236 leader_election.cc:336] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.250185 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:36.252904 22236 consensus_peers.cc:597] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:36.270861 22236 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.210496 30733 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:36.224615 22192 pending_rounds.cc:85] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 9
I20260709 12:13:36.274742 22192 pending_rounds.cc:107] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 22.10
I20260709 12:13:36.275051 22192 raft_consensus.cc:2889] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:36.209288 30612 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:36.262239 22194 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:13:36.281055 30733 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.268198 30107 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:36.209905 22196 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:36.272068 22236 leader_election.cc:336] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.207337 22195 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 20.
W20260709 12:13:36.269666 30731 log.cc:927] Time spent T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
I20260709 12:13:36.294258 22194 raft_consensus.cc:1275] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:13:36.295681 22194 pending_rounds.cc:85] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 14
I20260709 12:13:36.296000 22194 pending_rounds.cc:107] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:13:36.296370 22194 raft_consensus.cc:2889] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:36.276937 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:36.299621 22196 raft_consensus.cc:1275] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:36.304484 22087 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:36.292650 22236 consensus_peers.cc:597] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.311352 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:36.313444 22194 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:36.306806 22195 raft_consensus.cc:1275] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:36.322387 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:36.368813 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:36.290264 30107 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.372375 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:36.383616 22271 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:36.325162 30666 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.369120 30506 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:36.324247 30483 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.393172 22190 raft_consensus.cc:1240] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:13:36.373381 30475 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:36.392618 30689 raft_consensus.cc:3060] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:36.372195 30630 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:13:36.394507 30582 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:36.395272 30506 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:36.441260 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46254.8us
I20260709 12:13:36.382392 30107 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.390628 30278 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:13:36.412057 30475 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:36.453823 22194 raft_consensus.cc:2468] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 25.
W20260709 12:13:36.445786 22236 consensus_peers.cc:597] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.403007 30562 consensus_queue.cc:1048] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
W20260709 12:13:36.459710 22236 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.415802 30656 consensus_queue.cc:1048] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 12:13:36.396036 30666 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:36.407168 30483 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:36.469254 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:36.445109 30506 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:36.444201 30704 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.428823 30340 raft_consensus.cc:515] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:36.452229 30582 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:36.475980 30686 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:36.444741 30558 consensus_queue.cc:1048] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:13:36.411459 30612 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:36.509159 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 182421us
W20260709 12:13:36.530565 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 83967.1us
I20260709 12:13:36.512089 30559 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:13:36.498796 30704 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.544018 30734 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:36.544977 30734 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.545576 30734 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:36.547935 30689 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:36.549377 30728 log.cc:927] Time spent T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
W20260709 12:13:36.552626 30740 log.cc:927] Time spent T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:13:36.554121 30738 log.cc:927] Time spent T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:13:36.538188 30562 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:36.570503 30340 leader_election.cc:290] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:36.573107 30666 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:36.573138 30673 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:36.575536 30673 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:36.555399 30737 log.cc:927] Time spent T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:13:36.610070 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:36.624020 30562 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:36.636240 30562 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:36.636754 30107 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:36.628679 30573 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:36.639245 30483 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:36.639822 30573 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:36.640689 30673 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:36.621090 30733 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 30 FOLLOWER]: Leader pre-election won for term 31
W20260709 12:13:36.640796 30739 log.cc:927] Time spent T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:13:36.542363 30582 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.645047 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:36.646989 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 191296us
W20260709 12:13:36.648284 22236 leader_election.cc:336] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:36.652141 22236 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.655262 30614 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:36.654781 22236 leader_election.cc:336] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:36.657116 22236 consensus_peers.cc:597] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.647138 30475 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:36.658329 22236 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.658823 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:36.660640 30483 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:36.661300 30483 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.663924 30483 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:36.666312 30107 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:36.668615 22236 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.669308 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:36.674306 30107 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:36.675935 22236 consensus_peers.cc:597] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:36.676329 22193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55836 (request call id 3202) took 1298 ms (client timeout 1689 ms). Trace:
W20260709 12:13:36.676623 22236 consensus_peers.cc:597] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:36.676935 22193 rpcz_store.cc:269] 0709 12:13:35.377761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.401087 (+ 23326us) service_pool.cc:224] Handling call
0709 12:13:36.676108 (+1275021us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54002a03d4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:36.676256 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556003584}
I20260709 12:13:36.643036 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:36.686734 22196 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:36.677364 22236 leader_election.cc:336] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.645843 30733 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.689463 30733 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:13:36.689567 22236 leader_election.cc:336] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.690104 30573 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:36.690651 22236 leader_election.cc:336] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:36.693678 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.694885 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:36.701756 22236 leader_election.cc:336] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.702910 22236 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:36.710812 30581 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:36.711087 22236 consensus_peers.cc:597] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:36.712007 22236 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.712443 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:36.713270 30581 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:13:36.713677 22236 leader_election.cc:336] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.714007 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:36.714202 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:36.715708 30581 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:36.715996 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:36.719828 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:36.720181 22236 leader_election.cc:336] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:36.721284 22236 consensus_peers.cc:597] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.721398 22088 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:36.723080 22088 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:36.639250 30562 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:36.721911 22236 leader_election.cc:336] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.729032 22236 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:36.674285 30704 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:36.737392 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:36.739126 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 416847us
I20260709 12:13:36.735785 22196 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 24.
I20260709 12:13:36.742213 30628 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:36.742377 30704 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:36.744567 22236 consensus_peers.cc:597] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:36.745834 22236 consensus_peers.cc:597] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:36.746819 22236 leader_election.cc:336] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.751753 22192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 3213) took 1365 ms. Trace:
I20260709 12:13:36.751914 22087 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:36.752209 22192 rpcz_store.cc:276] 0709 12:13:35.386546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.224000 (+837454us) service_pool.cc:224] Handling call
0709 12:13:36.224382 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:36.286572 (+ 62190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:36.286620 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:36.287350 (+   730us) log.cc:844] Serialized 52 byte log entry
0709 12:13:36.642934 (+355584us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:13:36.642977 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.643047 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:36.751519 (+108472us) raft_consensus.cc:1685] finished
0709 12:13:36.751537 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.751684 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1692,"raft.queue_time_us":3772,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":14020,"thread_start_us":270867,"threads_started":1,"wal-append.queue_time_us":440590}
I20260709 12:13:36.754885 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:36.726572 30710 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:36.759351 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:36.709386 30713 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:36.725128 30573 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:36.729665 30614 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:36.764482 22265 raft_consensus.cc:3055] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:36.767524 22265 raft_consensus.cc:740] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:36.775630 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:36.768448 22265 consensus_queue.cc:260] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.828361 22265 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:36.843668 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:36.845872 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 63155.1us
I20260709 12:13:36.846799 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:36.885478 30713 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 31 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:36.889101 30734 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.826346 30710 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.845410 30754 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:13:36.902307 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 55625.6us
W20260709 12:13:36.906286 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 130763us
I20260709 12:13:36.900811 30506 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.913714 30483 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:36.913599 30754 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.774569 30573 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:36.915896 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:36.908324 30710 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:36.962522 22265 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
W20260709 12:13:36.966192 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 58878.5us
I20260709 12:13:36.968528 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:36.966212 22265 pending_rounds.cc:85] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 12
I20260709 12:13:36.985105 22265 pending_rounds.cc:107] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:13:36.985817 22265 raft_consensus.cc:2889] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:36.958423 30704 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:37.020429 30704 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.022743 30704 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:36.988538 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:37.023530 22194 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:13:37.023841 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:37.025066 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.026477 22194 raft_consensus.cc:1275] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:37.023519 22267 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:37.028184 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:36.985569 30614 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:13:37.000936 30278 raft_consensus.cc:493] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:37.029342 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.029774 30278 raft_consensus.cc:515] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.030496 22189 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:37.032217 30278 leader_election.cc:290] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:37.034991 30762 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
W20260709 12:13:37.037048 30741 log.cc:927] Time spent T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.480s	user 0.013s	sys 0.003s
I20260709 12:13:37.039645 22198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3617) took 1704 ms. Trace:
I20260709 12:13:37.040030 22197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3623) took 1693 ms. Trace:
I20260709 12:13:37.040406 22197 rpcz_store.cc:276] 0709 12:13:35.347074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.834827 (+487753us) service_pool.cc:224] Handling call
0709 12:13:36.165179 (+330352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:36.223177 (+ 57998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.039853 (+816676us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b540011ba50. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:37.039975 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758928128}
I20260709 12:13:37.041635 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:37.042901 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:37.043381 22197 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:37.045452 30734 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.040046 22198 rpcz_store.cc:276] 0709 12:13:35.335624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.335755 (+   131us) service_pool.cc:224] Handling call
0709 12:13:35.336116 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.775030 (+438914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.039389 (+1264359us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400236ed4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:37.039579 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007795584}
I20260709 12:13:37.048105 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:37.048617 22198 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:37.002903 30688 log.cc:927] Time spent T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 1.695s	user 0.017s	sys 0.023s
I20260709 12:13:37.005189 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.049019 22830 leader_election.cc:304] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:37.049634 30037 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:37.050400 30037 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.010645 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86b841ece254f9bbfd1bd07c08f7004" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:37.010149 30754 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:37.014997 22191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55838 (request call id 3611) took 1686 ms (client timeout 1751 ms). Trace:
I20260709 12:13:37.049692 22266 raft_consensus.cc:2468] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:13:37.014576 30506 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.055336 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:37.059607 22235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.075430 22197 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:37.076494 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:37.077241 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:36.971726 30573 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:37.087165 30037 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.078860 22197 raft_consensus.cc:3060] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:37.057543 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.078177 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:37.072160 22191 rpcz_store.cc:269] 0709 12:13:35.328109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.328258 (+   149us) service_pool.cc:224] Handling call
0709 12:13:37.014805 (+1686547us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b5400109ad4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:37.014932 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906769280}
I20260709 12:13:36.958762 30752 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:37.102018 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f168c463b75448c945cd40fd0ad742f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:37.079867 30530 raft_consensus.cc:2804] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:37.116099 22198 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 19.
I20260709 12:13:37.119575 22191 raft_consensus.cc:1240] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:13:37.120664 22198 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:13:37.066712 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:37.122733 22198 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:13:37.105756 30752 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.133841 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:37.136623 22193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37260 (request call id 2143) took 1031 ms. Trace:
I20260709 12:13:37.137429 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f06d3e4d31493d8aa24b2983f369fe" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:37.142414 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:37.143663 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 77092.1us
I20260709 12:13:37.148361 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 26 index: 22 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:37.154623 30752 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:37.157020 30720 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:37.157845 30720 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.163626 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:37.164909 30720 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:37.140709 30686 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:37.182626 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:37.077461 30734 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 12:13:37.148377 30673 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:37.151505 30530 raft_consensus.cc:697] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 24 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:37.192984 22197 raft_consensus.cc:2468] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 31.
I20260709 12:13:37.151238 30714 consensus_queue.cc:1059] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 12:13:37.197556 30733 consensus_meta.cc:287] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.000s
I20260709 12:13:37.198282 30733 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.201920 22195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 3221) took 1167 ms. Trace:
I20260709 12:13:37.196513 30714 consensus_queue.cc:1243] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:13:37.204944 30714 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:37.202339 22195 rpcz_store.cc:276] 0709 12:13:36.034119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.379210 (+345091us) service_pool.cc:224] Handling call
0709 12:13:36.379645 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:36.498897 (+119252us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:36.674759 (+175862us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b1800114460. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fccf17ba3c7 00007fcceddcc9a7 00007fcceddd55e5 00007fcceddd5568
0709 12:13:36.957234 (+282475us) log.cc:844] Serialized 14 byte log entry
0709 12:13:37.083202 (+125968us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:37.083693 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:13:37.083927 (+   234us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:37.085298 (+  1371us) log.cc:844] Serialized 14 byte log entry
0709 12:13:37.085784 (+   486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.106221 (+ 20437us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b1800114460. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceaca32a6 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419
0709 12:13:37.106802 (+   581us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400026554. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc2e01 00007fcceddc183e 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:37.106849 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:37.201607 (+ 94758us) raft_consensus.cc:1685] finished
0709 12:13:37.201634 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.201837 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":253535,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":1733,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":8425,"spinlock_wait_cycles":315761792,"thread_start_us":393670,"threads_started":2,"wal-append.queue_time_us":237723}
W20260709 12:13:37.208319 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 72722.9us
I20260709 12:13:37.213464 30733 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 31 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:37.215102 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
W20260709 12:13:37.215909 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 160423us
I20260709 12:13:37.217094 22857 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 31: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:37.205459 30714 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.220104 22163 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:37.198204 30530 consensus_queue.cc:237] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.239008 22163 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:37.239094 30695 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:37.245215 30673 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:37.246253 30483 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:37.247051 30483 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.225200 30628 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:13:37.263154 22087 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:37.277697 22087 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:37.266759 22089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:37.258953 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 187626us
W20260709 12:13:37.250101 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 65022.1us
I20260709 12:13:37.243140 30752 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:37.266901 30559 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:37.268862 30714 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.274921 30734 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:37.315459 30734 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.318082 30734 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.292277 30720 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:37.319118 30720 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:37.320430 30720 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.325539 30695 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:37.309387 30772 log.cc:927] Time spent T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:13:37.309839 30751 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.296411 30752 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.289593 30614 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:37.333031 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:37.334239 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:37.335041 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:37.335350 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:37.335911 22190 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:37.336262 22197 raft_consensus.cc:2393] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 31: Already voted for candidate 164596fc2efa450581a5b68cad62271f in this term.
I20260709 12:13:37.295071 30758 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:37.337625 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:37.339551 22198 raft_consensus.cc:2393] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 24: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:37.343127 22236 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.008s	sys 0.019s
W20260709 12:13:37.343542 22236 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.008s	sys 0.019s
W20260709 12:13:37.343864 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 558260us
I20260709 12:13:37.346567 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.347303 22196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55838 (request call id 3646) took 1168 ms. Trace:
I20260709 12:13:37.347848 22196 rpcz_store.cc:276] 0709 12:13:36.179106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.005203 (+826097us) service_pool.cc:224] Handling call
0709 12:13:37.005629 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:37.005930 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:37.005963 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:37.011231 (+  5268us) log.cc:844] Serialized 26 byte log entry
0709 12:13:37.215468 (+204237us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:37.215512 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.215587 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:37.347078 (+131491us) raft_consensus.cc:1685] finished
0709 12:13:37.347102 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.347240 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":200217,"threads_started":1,"wal-append.queue_time_us":239553}
I20260709 12:13:37.349175 22192 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 26.
I20260709 12:13:37.347301 22269 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 20.
I20260709 12:13:37.354621 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:37.357542 22087 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:37.298259 30710 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:13:37.297739 30630 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:13:37.365201 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:37.368239 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:37.326805 30483 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.384809 30457 consensus_queue.cc:1048] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:37.353117 30758 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.386682 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:37.386855 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:37.387656 30758 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.388324 30757 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:37.388967 30757 raft_consensus.cc:493] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:37.389485 30757 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:37.390635 22830 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c; no voters: 
I20260709 12:13:37.391487 30457 raft_consensus.cc:2804] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:37.392007 30457 raft_consensus.cc:697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 31 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:37.337823 30751 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.376344 30752 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:37.378037 30709 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:37.352289 30614 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:37.326357 30695 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.417944 30614 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.418810 30695 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.331220 30559 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.421065 30630 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:37.402637 30457 consensus_queue.cc:237] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.404456 30612 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:37.407088 22162 leader_election.cc:336] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:37.422590 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 65162.6us
I20260709 12:13:37.424522 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:37.423846 30687 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.426707 30687 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.427774 30751 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.430516 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.413847 30710 raft_consensus.cc:3055] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:37.439782 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.440672 22269 raft_consensus.cc:2410] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:13:37.445056 22163 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:37.434269 22087 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:37.450040 22163 leader_election.cc:304] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:37.469946 22236 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:37.443538 30710 raft_consensus.cc:740] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:37.469168 30614 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:37.468719 30714 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:37.491865 30784 raft_consensus.cc:2749] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:37.484150 30704 raft_consensus.cc:2804] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:37.473961 30687 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.502708 30614 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:37.509635 30559 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:37.492962 22236 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:37.536989 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 87030.4us
I20260709 12:13:37.538228 22163 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:37.539649 30695 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:37.541169 22163 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:37.541994 30695 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:37.542197 30559 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:37.544286 22163 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:37.544754 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 51964.1us
I20260709 12:13:37.507767 30714 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.545964 22236 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:37.547688 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:37.547940 30714 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:37.549315 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:37.549252 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:37.558239 30573 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:37.552512 30559 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.587558 30573 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.588217 30573 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:37.543152 30666 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:37.544068 30704 raft_consensus.cc:697] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 25 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:37.550401 30647 raft_consensus.cc:2749] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:37.596213 30704 consensus_queue.cc:237] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.554221 30695 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:37.585381 30614 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.586680 30733 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:37.586969 30787 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:13:37.553313 30558 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:37.625125 30695 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.613642 30733 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.633867 30695 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.636442 30695 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.652997 30733 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.630764 30612 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:37.658982 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 111329us
I20260709 12:13:37.667428 22265 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:13:37.667922 22265 pending_rounds.cc:85] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 9
I20260709 12:13:37.668180 22265 pending_rounds.cc:107] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:13:37.668452 22265 raft_consensus.cc:2889] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:37.669363 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:37.643947 30714 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.670719 22264 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 12:13:37.672664 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.678179 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.679391 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.680226 22263 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 22: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:37.680274 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.681838 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:37.687513 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.689010 22266 raft_consensus.cc:2393] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 26: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:37.686081 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.690785 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.691636 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.699329 30757 raft_consensus.cc:515] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.667026 30612 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.701781 30612 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:37.703209 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:37.678905 30714 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.705854 30573 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.707067 30714 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.707497 30757 leader_election.cc:290] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:37.708185 30573 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:37.711159 30559 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:37.714241 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:37.721308 22267 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 19: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:37.722443 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.730690 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2e5184fad402e8f3b26ea46e3c996" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:37.731762 22268 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:37.734318 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:37.739070 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 200936us
I20260709 12:13:37.743613 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:37.746443 22236 consensus_peers.cc:597] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.747459 22236 leader_election.cc:336] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:37.749042 22236 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:37.749764 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:37.751994 30752 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:37.754590 30733 consensus_queue.cc:1059] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:37.743397 30714 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:13:37.758965 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.760222 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.765247 22268 raft_consensus.cc:2468] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 21.
I20260709 12:13:37.137111 22193 rpcz_store.cc:276] 0709 12:13:36.105326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.693364 (+588038us) service_pool.cc:224] Handling call
0709 12:13:36.693667 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:36.693924 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 22
0709 12:13:36.762892 (+ 68968us) log.cc:844] Serialized 14 byte log entry
0709 12:13:37.136145 (+373253us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.136320 (+   175us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:13:37.136366 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.136431 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.136563 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":75315,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":2796,"thread_start_us":434643,"threads_started":2}
I20260709 12:13:37.767993 22831 leader_election.cc:304] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:13:37.762471 22194 raft_consensus.cc:2955] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 4 to 15, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:37.770783 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.776243 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:37.777515 22088 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:37.781204 30559 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:37.788506 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:37.793040 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:37.795789 22266 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:37.774364 30602 raft_consensus.cc:2804] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:37.811720 22189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55836 (request call id 3212) took 2425 ms. Trace:
I20260709 12:13:37.800004 30612 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:37.812175 22189 rpcz_store.cc:276] 0709 12:13:35.386292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.879494 (+493202us) service_pool.cc:224] Handling call
0709 12:13:37.030309 (+1150815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.030890 (+   581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.811490 (+780600us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400109ad0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc18ad 00007fccf2d86419 00007fccec2fdbd4 00007fccec2fdb62 00007fccec2fda91 00007fccec2fda0c 00007fccec2fccc2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:13:37.811651 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2645997952}
W20260709 12:13:37.814317 30771 log.cc:927] Time spent T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.569s	user 0.001s	sys 0.002s
I20260709 12:13:37.815747 22268 raft_consensus.cc:1275] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:13:37.785939 30714 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:37.820051 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:37.823357 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:37.799041 30614 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:37.749922 30713 raft_consensus.cc:2955] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 4 to 15, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:37.830001 30630 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:37.833184 30764 log.cc:927] Time spent T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.628s	user 0.004s	sys 0.001s
I20260709 12:13:37.820760 30602 raft_consensus.cc:697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Becoming Leader. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Running, Role: LEADER
I20260709 12:13:37.844940 22266 raft_consensus.cc:3060] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:13:37.856149 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:37.852567 30602 consensus_queue.cc:237] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:37.851414 30506 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:37.871728 22266 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:37.873512 30664 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:37.863351 30630 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:37.882781 30710 consensus_queue.cc:260] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.885623 30710 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:37.888278 30614 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:37.894429 30686 raft_consensus.cc:3055] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:37.894917 30686 raft_consensus.cc:740] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:37.895794 30686 consensus_queue.cc:260] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:37.899448 30686 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:37.904556 30714 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:37.929667 22857 raft_consensus.cc:1240] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Rejecting Update request from peer 7d3f536360b444b1886777f4776be22c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:37.984107 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:37.994899 22015 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.999972 22015 catalog_manager.cc:5697] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 20, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 20 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:38.008517 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 584224us
W20260709 12:13:38.010821 22162 leader_election.cc:336] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:38.011610 22162 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:38.016062 22015 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 25 to 28. New cstate: current_term: 28 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:13:38.021677 22236 leader_election.cc:336] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:38.029381 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:38.048121 22830 leader_election.cc:336] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:38.050889 22830 leader_election.cc:336] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:38.051479 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:38.058252 30811 log.cc:927] Time spent T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.118s	user 0.003s	sys 0.000s
I20260709 12:13:38.062033 30478 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.063315 30478 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.065456 22015 catalog_manager.cc:5697] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:38.066551 30628 consensus_queue.cc:1048] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:13:38.068058 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.069170 30695 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:38.070210 30695 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.073141 22191 raft_consensus.cc:1275] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:38.064114 30477 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 12:13:38.078967 30477 consensus_queue.cc:1243] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer 164596fc2efa450581a5b68cad62271f log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:13:38.081380 30656 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:38.092259 30666 consensus_queue.cc:1059] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:38.093060 30478 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:38.097880 30475 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:38.084106 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 60636.9us
W20260709 12:13:38.100474 22236 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:38.101130 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:38.101599 30710 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.102519 30710 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.105707 30582 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:38.114121 30614 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.114810 30614 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.118551 30780 raft_consensus.cc:3055] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:38.119048 30780 raft_consensus.cc:740] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:38.120285 30751 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.101181 30709 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:38.123075 30751 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.107364 30695 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:38.162719 30734 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.163739 30734 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.120565 30780 consensus_queue.cc:260] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:38.179507 30478 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.180843 30478 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.183050 30780 raft_consensus.cc:3060] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:38.184273 30478 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:38.202631 30710 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:38.209687 30754 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.210425 30754 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.216365 30751 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:38.221817 30614 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:38.222930 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 122591us
W20260709 12:13:38.224449 22236 leader_election.cc:336] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:38.225358 22236 leader_election.cc:336] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:38.226148 22236 consensus_peers.cc:597] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:38.226397 30734 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:38.226795 22236 leader_election.cc:336] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:38.227255 22236 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:38.229068 20891 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 22148)
I20260709 12:13:38.212605 30754 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:38.145411 22015 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:38.233690 30713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45124 (request call id 5) took 2588 ms. Trace:
I20260709 12:13:38.235452 22015 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 19 to 25. New cstate: current_term: 25 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:38.238466 22015 catalog_manager.cc:5697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 14 to 17, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.249737 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.252835 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.255362 22189 raft_consensus.cc:1240] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:38.285820 30798 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:38.299641 22193 raft_consensus.cc:1240] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:13:38.301066 22189 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:38.291018 30734 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.302595 30734 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:38.303598 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 76869.9us
I20260709 12:13:38.299635 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:38.313114 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 262362us
I20260709 12:13:38.234498 30713 rpcz_store.cc:276] 0709 12:13:35.645200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.645810 (+   610us) service_pool.cc:224] Handling call
0709 12:13:35.825357 (+179547us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b1800089ee0. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddfd73d 00007fcceddc8f3f 00007fcceddc86b3 00007fcceddc09fa 00007fccf2d884c9 00007fccec304c54 00007fccec304be2 00007fccec304b11 00007fccec304a8c 00007fccec303d42
0709 12:13:35.830987 (+  5630us) log.cc:844] Serialized 508 byte log entry
0709 12:13:36.667386 (+836399us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b5400840e20. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fccedd3b142 00007fccedd1beaa 00007fccedd22d53 00007fccedd22cd9 00007fccedd22c69 00007fccedd22c31 00007fccedd21dfd 0000000000388634 0000000000388479 00007fcceacd5475
0709 12:13:38.233377 (+1565991us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1540,"raft.run_cpu_time_us":5209,"raft.run_wall_time_us":826593,"spinlock_wait_cycles":154483328,"thread_start_us":49880,"threads_started":1,"wal-append.queue_time_us":99319,"wal-append.run_cpu_time_us":1921,"wal-append.run_wall_time_us":1016058}
I20260709 12:13:38.316386 30798 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:38.317293 30798 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.318847 22007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7f1b154b48c54be6b421b01ed436bf21 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 15)
I20260709 12:13:38.326020 22189 raft_consensus.cc:1275] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 31 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
I20260709 12:13:38.326892 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.330331 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.346905 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.347951 22264 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 26.
I20260709 12:13:38.349684 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.307503 22009 maintenance_manager.cc:643] P 724c00f1bc7e49c9835e5c0e664b7356: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 2.312s	user 0.130s	sys 0.022s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":28352,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":27208,"dirs.run_cpu_time_us":1287,"dirs.run_wall_time_us":3119,"lbm_read_time_us":52230,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":23,"lbm_write_time_us":1957,"lbm_writes_lt_1ms":12,"peak_mem_usage":308217,"reinsert_count":0,"thread_start_us":147168,"threads_started":2,"update_count":301,"wal-append.queue_time_us":115859}
I20260709 12:13:38.353003 22197 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 23.
I20260709 12:13:38.355808 22010 maintenance_manager.cc:419] P 724c00f1bc7e49c9835e5c0e664b7356: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 12:13:38.357066 30614 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.357666 22009 maintenance_manager.cc:643] P 724c00f1bc7e49c9835e5c0e664b7356: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 12:13:38.357714 30614 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.362478 30628 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:38.363394 30614 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:38.363250 30628 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.369606 30628 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:38.377791 30754 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:38.375010 30798 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:38.391237 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.395383 22265 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:13:38.378755 30754 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:38.399782 30734 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:38.412873 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:38.414966 30530 consensus_queue.cc:1048] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:13:38.427042 22265 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:38.427259 30754 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:38.434473 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:38.445044 22019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 277) took 35710 ms (client timeout 15000 ms). Trace:
I20260709 12:13:38.445537 30713 consensus_queue.cc:1048] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:13:38.449301 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:38.453088 30734 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.453991 30734 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:38.454778 30614 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.455534 30614 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.458199 22194 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:13:38.459008 30614 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:38.462988 30628 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:38.463711 30628 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.464202 30628 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:38.465739 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.359020 22015 catalog_manager.cc:5697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 14 to 19, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 19 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:38.481655 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.476161 30614 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.487291 22265 raft_consensus.cc:3055] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:38.487746 22265 raft_consensus.cc:740] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:38.487615 30614 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:38.488811 22265 consensus_queue.cc:260] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.489991 30448 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.490142 22265 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:38.490978 30448 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.497728 22194 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:38.507156 22265 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:13:38.507251 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:38.507726 22267 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:38.508420 22265 pending_rounds.cc:85] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 11
I20260709 12:13:38.510840 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.511576 22194 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:38.505282 30614 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:38.521766 30448 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:38.523684 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.526021 22189 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:38.525352 22015 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 12 to 21. New cstate: current_term: 21 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.538646 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:38.445765 22019 rpcz_store.cc:269] 0709 12:13:02.703562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.703784 (+   222us) service_pool.cc:224] Handling call
0709 12:13:38.410463 (+35706679us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:30.084213 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:30.141388 (+ 57175us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:30.141440 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:13:30.141459 (+    19us) tablet.cc:662] Decoding operations
0709 12:13:30.142679 (+  1220us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:30.142788 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:30.142815 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:13:30.143939 (+  1124us) tablet.cc:701] Row locks acquired
0709 12:13:30.143989 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:13:30.144159 (+   170us) write_op.cc:270] Start()
0709 12:13:30.144328 (+   169us) write_op.cc:276] Timestamp: P: 1783599210144089 usec, L: 0
0709 12:13:30.144354 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:13:30.176366 (+ 32012us) log.cc:844] Serialized 5228 byte log entry
0709 12:13:31.463192 (+1286826us) op_driver.cc:464] REPLICATION: finished
0709 12:13:32.415493 (+952301us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b4400022b4c. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceabfbc85 00007fcceabfc6a2 00007fcced96e1db 00007fcced969aaf 00007fcceacb80ac 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd4c02 00007fccf17f8ef0
0709 12:13:32.767429 (+351936us) write_op.cc:301] APPLY: starting
0709 12:13:32.807971 (+ 40542us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:33.083838 (+275867us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:33.083863 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:33.667087 (+583224us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:33.667364 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:13:33.667408 (+    44us) write_op.cc:312] APPLY: finished
0709 12:13:33.667733 (+   325us) log.cc:844] Serialized 121 byte log entry
0709 12:13:34.059190 (+391457us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:34.079392 (+ 20202us) write_op.cc:454] Released schema lock
0709 12:13:34.081631 (+  2239us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:34.114432 (+ 32801us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:34.116537 (+  2105us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1029639,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1230556,"apply.run_cpu_time_us":59229,"apply.run_wall_time_us":1369072,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58493,"num_ops":13,"prepare.queue_time_us":276061,"prepare.run_cpu_time_us":85228,"prepare.run_wall_time_us":521052,"raft.queue_time_us":807580,"raft.run_cpu_time_us":50991,"raft.run_wall_time_us":1261583,"replication_time_us":1318657,"spinlock_wait_cycles":80827776,"thread_start_us":2498791,"threads_started":5,"wal-append.queue_time_us":956489,"wal-append.run_cpu_time_us":21909,"wal-append.run_wall_time_us":3675230}]]}
I20260709 12:13:38.528092 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.539719 22015 catalog_manager.cc:5697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:38.529062 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.529175 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.529762 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.530210 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791f1d0e9076481dad104e8c3b503af8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.530596 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.532280 30602 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:38.511166 22265 pending_rounds.cc:107] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:13:38.546195 22265 raft_consensus.cc:2889] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:38.551690 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:38.552600 30614 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.557890 30614 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:38.558890 22194 raft_consensus.cc:1275] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:38.559394 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:38.559778 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:38.560056 22198 raft_consensus.cc:2376] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22. Re-sending same reply.
I20260709 12:13:38.556972 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.561864 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:38.555877 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 70014.6us
I20260709 12:13:38.568260 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.569409 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.574440 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.569777 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.560058 30614 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:38.581084 22196 raft_consensus.cc:2393] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 19: Already voted for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in this term.
I20260709 12:13:38.573832 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.574501 22190 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:38.574857 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.556758 30628 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.552984 30734 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:38.597426 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:38.598799 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:38.604876 22087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.624089 22266 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 22.
I20260709 12:13:38.650406 22190 raft_consensus.cc:1275] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 12:13:38.651221 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 53875us
I20260709 12:13:38.668051 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:38.675592 22163 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:38.677492 22236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.685611 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.687042 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.688171 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:38.699893 22189 raft_consensus.cc:1275] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Refusing update from remote peer 164596fc2efa450581a5b68cad62271f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:38.695428 30734 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:38.703769 30774 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:38.704030 30734 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.704360 30774 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:38.713297 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 45494.7us
I20260709 12:13:38.721262 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:38.722179 22271 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:38.711241 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 81562.9us
I20260709 12:13:38.745869 30757 consensus_queue.cc:1048] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.011s
I20260709 12:13:38.704741 30774 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:38.710804 30628 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:38.762996 22271 raft_consensus.cc:2468] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 27.
I20260709 12:13:38.704576 30734 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.766870 22163 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:38.779996 22087 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:38.787034 30734 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:38.778247 30628 raft_consensus.cc:2804] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:38.789337 30107 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.790114 30107 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.709244 22015 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 14 to 15, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.809967 22015 catalog_manager.cc:5697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:38.813134 30829 log.cc:927] Time spent T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.003s
I20260709 12:13:38.805228 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:38.788498 30828 log.cc:927] Time spent T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: Append to log took a long time: real 0.117s	user 0.005s	sys 0.000s
I20260709 12:13:38.831828 30628 raft_consensus.cc:697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 27 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
W20260709 12:13:38.903782 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 121633us
W20260709 12:13:38.903228 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 141446us
I20260709 12:13:38.864107 30107 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:38.921257 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:38.921411 30107 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:38.922684 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:38.883543 30799 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:38.924563 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 166733us
I20260709 12:13:38.862608 30614 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:38.880594 30784 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:38.922706 30107 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:38.922900 30798 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:13:38.951498 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 192016us
I20260709 12:13:38.966143 30784 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:38.812628 22015 catalog_manager.cc:5697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 19 to 20, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 20 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:38.971951 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:38.970007 30798 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
W20260709 12:13:38.978940 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 56371us
I20260709 12:13:38.980085 22236 leader_election.cc:304] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:38.987362 30614 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:38.991358 30734 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:38.992954 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 52765.7us
I20260709 12:13:38.995791 30734 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:38.996101 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.009843 30734 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:38.923058 30628 consensus_queue.cc:237] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:38.947278 30799 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:38.968691 30784 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:39.032191 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 57453.3us
I20260709 12:13:39.006943 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d4cdb3f6584a3d98a8736d0f93ddaf" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:38.968266 22015 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:39.052637 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.021327 30107 raft_consensus.cc:2749] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:39.064073 30798 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.087517 30774 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.084232 30799 consensus_queue.cc:1048] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
W20260709 12:13:39.129395 22237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 272257us
W20260709 12:13:39.151528 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 169931us
I20260709 12:13:39.154089 30614 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.162709 30798 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:39.179622 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:39.172523 30734 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:39.195523 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 124636us
I20260709 12:13:39.192096 30734 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:39.229894 20891 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 22148)
I20260709 12:13:39.180207 30614 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:39.155910 22015 catalog_manager.cc:5697] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.213390 30842 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.228394 30734 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:39.238835 30836 log.cc:927] Time spent T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:13:39.274919 30834 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:39.275676 30834 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:39.276674 30834 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:39.280022 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 105806us
I20260709 12:13:39.283224 30754 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:39.283860 30107 consensus_queue.cc:1048] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:13:39.293572 30839 log.cc:927] Time spent T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.132s	user 0.000s	sys 0.003s
I20260709 12:13:39.297791 30774 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:39.300186 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 304238us
I20260709 12:13:39.264074 30842 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.306804 30842 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:39.313947 30614 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:39.315670 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:39.302438 22015 catalog_manager.cc:5697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:39.321025 30614 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.321622 30614 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.329666 30614 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:39.330757 22015 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:39.333299 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:39.347859 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 65182.8us
I20260709 12:13:39.350174 22163 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.351259 30448 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:39.352066 30842 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.352617 30842 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:39.350509 22236 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:39.358544 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:39.346947 30614 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:39.346902 30477 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.361059 30477 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.363090 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:39.363649 30477 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:39.365607 30846 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:39.366632 30835 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:39.367194 30846 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:39.367635 30846 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.367977 30846 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:39.370308 22015 catalog_manager.cc:5697] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:39.373203 22162 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.373713 22162 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:39.374965 30784 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:39.378428 22162 consensus_peers.cc:597] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:39.379236 22162 leader_election.cc:336] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.372622 22015 catalog_manager.cc:5697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 22, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 22 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:39.381762 30842 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:39.382310 30614 raft_consensus.cc:493] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:39.382913 30614 raft_consensus.cc:515] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:39.379613 22162 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:39.385501 30614 leader_election.cc:290] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:39.402841 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 46518.3us
I20260709 12:13:39.405588 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 27 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:39.407998 30734 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.413636 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:39.420070 30734 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:39.430521 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:39.431813 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 81398.9us
I20260709 12:13:39.409085 30784 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:39.439924 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.442802 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.433904 30107 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:39.382905 22015 catalog_manager.cc:5697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:39.449857 22015 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 22 to 23, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 23 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:39.454905 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:39.456144 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 91829.2us
W20260709 12:13:39.459440 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 80230.7us
I20260709 12:13:39.461735 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.451993 22015 catalog_manager.cc:5697] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:39.465932 22087 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:39.470878 22162 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.472105 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:39.472872 22087 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.474262 30733 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:39.475215 30844 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:39.476042 30855 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:13:39.461156 30842 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:13:39.487618 30846 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.489707 30614 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:39.493450 22015 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:39.495659 22015 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 16 to 17, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.462337 30734 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:39.497737 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 89018.3us
I20260709 12:13:39.505406 30844 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.506196 30798 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:39.506062 30844 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:39.506906 30798 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.509125 30477 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:39.510754 22162 leader_election.cc:336] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.511216 22162 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:39.511933 30477 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:39.512807 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:39.514201 22162 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.514961 30798 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:39.508594 30844 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:39.516642 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 43909.7us
I20260709 12:13:39.517557 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.520969 22015 catalog_manager.cc:5697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:39.522730 22087 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.518497 30848 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:39.520336 30846 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:39.524940 30834 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:39.525643 30834 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.527846 30834 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:39.524672 22236 leader_election.cc:336] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.529385 30855 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:39.530515 30855 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:39.528894 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:39.533612 30834 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:13:39.537055 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:39.515237 22162 leader_election.cc:336] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.543556 22162 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:39.553004 30844 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.553731 30844 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.556246 30844 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:39.570075 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 54850.5us
I20260709 12:13:39.570662 30448 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:39.571405 22162 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:39.573390 22162 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:39.585211 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:39.571367 30844 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.599143 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:39.599730 30844 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.606050 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:39.619007 30844 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:39.622651 22830 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:39.624431 30784 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.626570 30784 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.631048 30851 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.631688 30851 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.635116 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.636328 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:39.637423 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:39.641675 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:39.643599 22190 raft_consensus.cc:2393] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 25: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:39.644841 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:39.646148 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.646934 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:39.648038 22265 raft_consensus.cc:2393] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 27: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:39.650599 22268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:39.644955 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.653654 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44711cbd4d234e36807a94726a691570" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.661103 30846 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.661752 30846 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.664047 30846 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:39.671926 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:39.671078 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 27 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.680246 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:39.681603 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:39.682178 22270 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:39.682951 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:39.659937 30784 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:39.695075 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:39.698575 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.699047 22191 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:39.696894 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:39.699828 22195 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:39.697791 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:39.700568 22265 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:39.705153 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.685635 30844 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:39.719111 22191 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 23.
I20260709 12:13:39.720995 30844 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.722146 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.723445 30844 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:39.723450 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.724736 22191 raft_consensus.cc:2393] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 23: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:39.727012 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.731788 22195 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 24.
I20260709 12:13:39.735181 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.739158 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.740747 22087 leader_election.cc:304] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:39.709038 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:39.705163 22236 consensus_peers.cc:597] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:39.749332 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.751255 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.750209 22190 raft_consensus.cc:2468] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 24.
W20260709 12:13:39.749617 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 45251.5us
I20260709 12:13:39.710690 30846 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:39.759116 22236 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.766000 22191 raft_consensus.cc:1240] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:13:39.759748 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:39.768469 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 59521.1us
I20260709 12:13:39.768644 22087 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:39.770386 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.753471 30855 raft_consensus.cc:3060] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:39.750479 30848 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:39.781014 22236 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.781580 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:39.782964 22236 leader_election.cc:336] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.792759 22088 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:39.805882 30854 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:39.794312 30734 raft_consensus.cc:3060] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:39.852643 22162 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.855621 22162 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:39.787633 30754 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:39.790412 30842 raft_consensus.cc:2749] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:39.859992 30842 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:39.861729 30850 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:39.862322 30842 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:39.862958 30842 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:39.857319 22236 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:39.864768 30862 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:13:39.865823 30842 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:39.867511 22162 leader_election.cc:336] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.868010 22162 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:39.810822 30477 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.874342 30477 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:39.793622 30846 raft_consensus.cc:493] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.877336 30846 raft_consensus.cc:515] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:39.853741 30851 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:39.807873 30614 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:39.890007 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 121230us
I20260709 12:13:39.979229 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:39.936630 30733 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:39.983408 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:39.985327 22087 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:39.950601 30477 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:39.955837 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:39.904387 30861 log.cc:927] Time spent T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 12:13:39.972613 22265 raft_consensus.cc:2410] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:13:39.989351 22270 raft_consensus.cc:2410] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:13:39.990796 22087 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:40.005188 22087 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.023952 22191 raft_consensus.cc:1240] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Rejecting Update request from peer cc9b9c8894084021a0c6ddaf659d222e for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:40.027550 22263 raft_consensus.cc:1275] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:39.978562 30614 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.027760 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.987883 30780 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:40.046365 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 246989us
I20260709 12:13:40.061126 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:39.988658 30834 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:40.043064 22162 leader_election.cc:336] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:40.002492 30835 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:40.065148 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:39.995121 30848 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:40.007170 30845 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:40.029325 30799 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:40.007027 30873 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:40.040614 30614 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.034021 30107 consensus_queue.cc:1059] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 12:13:40.101781 30844 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:40.103711 30845 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.007091 30733 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:40.154487 30733 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:40.122262 30873 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:40.142120 30846 leader_election.cc:290] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:40.146472 30844 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:40.148672 30845 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:40.170948 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 128898us
W20260709 12:13:40.127828 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 65713.7us
I20260709 12:13:40.172194 30784 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:40.172859 30843 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:40.173360 30844 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:40.177328 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 190350us
W20260709 12:13:40.180956 22162 consensus_peers.cc:597] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.196411 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 133925us
W20260709 12:13:40.224164 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 177708us
I20260709 12:13:40.223286 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.225747 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:40.226451 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 201571us
I20260709 12:13:40.227864 22265 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:40.226378 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9726d3fa41c64b6184468cabcb37dd5a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.227841 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:40.230396 20891 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 22148)
W20260709 12:13:40.224066 22162 consensus_peers.cc:597] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:40.184979 30784 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.161785 30873 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.254082 30855 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:40.225294 30107 consensus_queue.cc:1059] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:13:40.249014 30854 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:40.262768 30854 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.276423 30107 raft_consensus.cc:3055] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:40.280872 30107 raft_consensus.cc:740] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:40.282855 30886 raft_consensus.cc:2804] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:40.283571 30840 raft_consensus.cc:3055] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:40.283614 30886 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.284183 30840 raft_consensus.cc:740] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:40.284444 30886 raft_consensus.cc:3060] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:40.283279 30107 consensus_queue.cc:260] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.294764 30107 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:40.304744 22864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:40.305223 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:40.305557 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:40.307502 30734 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:40.299288 30848 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:40.313267 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.274853 30845 consensus_queue.cc:1048] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.034s
W20260709 12:13:40.317641 22162 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:40.326757 22162 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:40.334764 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.309454 30888 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:40.308068 30894 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:40.312685 30854 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:40.319515 30628 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:13:40.367192 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 60097.8us
I20260709 12:13:40.343362 30843 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:40.361255 30628 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.377032 30628 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:40.320232 30848 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:40.382006 30848 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:40.359992 30894 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:40.388600 30894 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:40.358296 30840 consensus_queue.cc:260] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:40.414973 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 46625us
W20260709 12:13:40.430091 30863 log.cc:927] Time spent T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:13:40.352041 30888 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:40.434648 30888 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:40.435727 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.437920 30840 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.414963 30784 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:40.469583 22162 consensus_peers.cc:597] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.477183 22162 consensus_peers.cc:597] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:40.477846 22162 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:40.482813 22087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 65494us
I20260709 12:13:40.504729 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.512372 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.519587 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:40.523907 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.526409 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.530079 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:40.532756 22162 leader_election.cc:336] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:40.533370 22236 leader_election.cc:336] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:40.534332 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:40.535343 30851 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:40.540390 30734 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:40.541375 30734 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.533453 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:40.549562 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.553681 30780 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:40.554005 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:40.563922 30846 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:40.565860 22088 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.526182 30903 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:40.578604 30846 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:40.550202 30734 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:40.588097 22236 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:40.592700 30614 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.596416 30614 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:40.591934 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:40.598735 22162 consensus_peers.cc:597] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.605769 22162 leader_election.cc:336] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:40.607425 22162 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:40.601383 30873 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.617578 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.611150 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.606819 30851 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:40.623231 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:40.623805 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:40.619501 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 49076.6us
I20260709 12:13:40.622738 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:40.626487 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863b392474d94720808349fe27669b5b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:40.626456 30899 raft_consensus.cc:2749] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:40.632138 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:40.617554 30784 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:40.619511 30855 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:40.606173 30886 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.655594 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:40.656116 30886 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:40.620791 30873 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.659592 30873 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:40.660936 30873 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.664718 30855 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:40.666061 30910 log.cc:927] Time spent T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:13:40.691039 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:40.674556 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
W20260709 12:13:40.673655 22236 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:40.689901 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:40.692516 22196 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.692517 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:40.692919 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.700986 22238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.701689 30107 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:40.705482 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:40.704722 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:40.697798 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.708024 22830 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.708920 22830 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.709566 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.711272 22830 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:40.702911 22087 leader_election.cc:304] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:40.712190 30848 raft_consensus.cc:2749] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:40.714748 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:40.694368 30873 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.715622 30848 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:40.718345 22087 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:40.721451 30873 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:40.725054 22087 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.725529 22196 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 24.
W20260709 12:13:40.725790 22830 leader_election.cc:336] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:40.739277 22830 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:40.734652 30879 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:40.742944 30848 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:40.743932 30855 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:40.745354 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:40.748944 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.750766 30851 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:40.755769 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.775377 22270 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.756505 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.776343 22087 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.777261 30734 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:40.779067 30734 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:40.777597 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.780315 30848 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:40.771915 30895 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:40.781780 22087 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:40.784183 30855 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:40.785142 30855 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:40.786561 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.786347 30855 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.786820 30880 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.787763 30879 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:40.787547 30880 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.788365 30879 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:40.790005 30880 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:40.790617 30879 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:40.791265 30879 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:40.793768 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:40.795022 22236 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 196 similar messages]
I20260709 12:13:40.795141 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.801077 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.804251 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:40.804976 22194 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
I20260709 12:13:40.806095 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063e8815c77400bb77029ed9db742c1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:40.807956 30848 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:40.804353 22236 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:40.814983 22270 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 24.
W20260709 12:13:40.817641 22162 consensus_peers.cc:597] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.841842 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.842753 22830 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:40.854197 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:40.857088 30851 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:40.857522 30851 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.858191 30851 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.857409 22087 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.864984 22190 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
W20260709 12:13:40.865154 22162 consensus_peers.cc:597] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:40.868846 22196 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:40.870007 30879 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:40.886821 30734 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:40.886283 30879 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
W20260709 12:13:40.908360 22162 consensus_peers.cc:597] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:40.914285 30734 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.925293 30734 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:40.930308 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:40.934043 22194 raft_consensus.cc:2393] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in current term 23: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
W20260709 12:13:40.947922 22162 consensus_peers.cc:597] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.966811 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.968677 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:40.981056 30734 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:40.984725 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:40.986002 22272 raft_consensus.cc:2410] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 12:13:40.989583 22088 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:40.989746 22272 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260709 12:13:40.990280 22272 pending_rounds.cc:85] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 14
I20260709 12:13:40.990552 22272 pending_rounds.cc:107] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 12:13:40.990819 22272 raft_consensus.cc:2889] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:40.993794 30886 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:41.004108 30734 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:13:41.052866 30879 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.058876 30879 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:41.065392 30886 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:41.069497 30879 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:41.076673 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:41.052076 30851 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:41.090193 22272 raft_consensus.cc:1240] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Rejecting Update request from peer ea51e825f0ab4ea2bb6c4d0e29709ca3 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:41.090868 30851 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:41.097800 22272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:41.099100 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:41.100118 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:41.101622 30873 consensus_queue.cc:1059] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:41.102039 30846 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:41.102415 30873 consensus_queue.cc:1243] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:13:41.102910 30873 raft_consensus.cc:3055] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:41.103232 30873 raft_consensus.cc:740] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:41.104120 30873 consensus_queue.cc:260] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:41.105929 30873 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:41.529073 30844 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.529141 30734 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.530143 30734 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:41.529910 30844 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:41.531906 30734 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:41.533460 30844 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:41.536342 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:41.617048 22194 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:41.623939 22198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:41.633679 30930 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.634366 30930 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:41.636619 30930 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:41.670004 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:41.671360 22266 raft_consensus.cc:2410] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 12:13:41.675927 30933 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:41.680213 30933 consensus_queue.cc:1243] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer 7d3f536360b444b1886777f4776be22c log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:13:41.683140 30933 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:41.683780 22162 consensus_peers.cc:597] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:41.683720 30933 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:41.686184 22162 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:41.694073 22195 pending_rounds.cc:85] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Aborting all ops after (but not including) 11
I20260709 12:13:41.694622 22195 pending_rounds.cc:107] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:13:41.694974 22195 raft_consensus.cc:2889] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:41.706357 30933 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:41.714757 22163 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:41.715649 30931 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:41.717305 30935 raft_consensus.cc:493] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.736157 30935 raft_consensus.cc:515] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:13:41.744325 20891 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 22148)
I20260709 12:13:41.746037 30935 leader_election.cc:290] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:41.754942 22197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:41.781116 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:41.792577 30844 raft_consensus.cc:493] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.793466 30844 raft_consensus.cc:515] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:41.797511 30934 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.798149 30934 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:41.800459 30934 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:41.812877 30844 leader_election.cc:290] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:41.814116 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:41.827831 30844 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.828649 30844 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:41.835177 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:41.836555 22196 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 23.
I20260709 12:13:41.839736 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0832297a8d44da9dba2792bf6c4c35" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:41.839906 22857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:41.841307 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44679affd4554006a2cb59b10b589a27" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:41.843014 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:41.844465 22266 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:13:41.846192 22270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.040s	sys 0.098s
W20260709 12:13:41.846529 22270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.040s	sys 0.098s
I20260709 12:13:41.852000 22088 leader_election.cc:304] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:41.854573 30879 raft_consensus.cc:2749] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:41.855926 22088 leader_election.cc:304] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:41.857069 30879 raft_consensus.cc:2749] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:41.861398 30844 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:41.864419 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:41.880059 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ce44fb81b642f9ad6b0f0d68e82820" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:41.881296 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1baa23cb6635453b9a9cd5ec7e452f6a" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:41.882613 30844 raft_consensus.cc:493] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.883433 30844 raft_consensus.cc:515] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:41.886590 30844 leader_election.cc:290] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:41.888329 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 27 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:41.889127 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f422c5da2840e0b466894312ebcd44" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 27 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:41.891448 22236 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:41.891839 22087 leader_election.cc:304] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:41.892228 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:41.892966 30899 raft_consensus.cc:2749] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:41.891917 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:41.919559 30851 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:41.958231 22014 catalog_manager.cc:5697] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.968446 30844 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:13:41.974362 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:41.975159 30851 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:41.975541 30851 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.975860 30851 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:41.978799 22088 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:41.980293 30873 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:41.983780 22088 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:41.984623 30851 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:41.985391 30899 raft_consensus.cc:2749] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:41.986057 22014 catalog_manager.cc:5697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 16 to 18, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 18 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:41.987449 22088 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:41.987787 22014 catalog_manager.cc:5697] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.995350 30844 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:42.004256 30851 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:42.009994 22196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:42.010612 22196 raft_consensus.cc:3060] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:42.009876 22014 catalog_manager.cc:5697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 14 to 19, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 19 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:42.011781 22014 catalog_manager.cc:5697] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 20. New cstate: current_term: 20 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:42.005594 30899 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.013052 30899 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:42.013249 22014 catalog_manager.cc:5697] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.015228 30899 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:42.017731 22015 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 278) took 18739 ms (client timeout 15000 ms). Trace:
I20260709 12:13:42.014991 22014 catalog_manager.cc:5697] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:42.008122 30846 raft_consensus.cc:493] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.031059 22014 catalog_manager.cc:5697] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:42.031992 30846 raft_consensus.cc:515] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:42.034258 30846 leader_election.cc:290] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:42.024065 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:42.033674 22014 catalog_manager.cc:5697] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 14 to 21, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 21 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.037446 22014 catalog_manager.cc:5697] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.042851 22014 catalog_manager.cc:5697] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 28 to 31. New cstate: current_term: 31 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:13:42.045523 22162 consensus_peers.cc:597] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:42.056329 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:42.053745 22014 catalog_manager.cc:5697] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.058590 22014 catalog_manager.cc:5697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 12 to 19, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 19 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:42.060382 22014 catalog_manager.cc:5697] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 13 to 17, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 17 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.061998 22014 catalog_manager.cc:5697] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:42.063959 22014 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 18, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 18 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
W20260709 12:13:42.029685 22015 rpcz_store.cc:269] 0709 12:13:23.278083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.337723 (+ 59640us) service_pool.cc:224] Handling call
0709 12:13:42.017621 (+18679898us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:40.104881 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:40.149792 (+ 44911us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:40.149867 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:13:40.149896 (+    29us) tablet.cc:662] Decoding operations
0709 12:13:40.204054 (+ 54158us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:40.223909 (+ 19855us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:40.226640 (+  2731us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:13:40.439353 (+212713us) tablet.cc:701] Row locks acquired
0709 12:13:40.439416 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:13:40.439648 (+   232us) write_op.cc:270] Start()
0709 12:13:40.439838 (+   190us) write_op.cc:276] Timestamp: P: 1783599220439574 usec, L: 0
0709 12:13:40.439864 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:13:40.586533 (+146669us) log.cc:844] Serialized 9885 byte log entry
0709 12:13:40.829564 (+243031us) op_driver.cc:464] REPLICATION: finished
0709 12:13:40.943668 (+114104us) write_op.cc:301] APPLY: starting
0709 12:13:40.950242 (+  6574us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:40.999580 (+ 49338us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:40.999724 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:41.125211 (+125487us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:41.125893 (+   682us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 12:13:41.125957 (+    64us) write_op.cc:312] APPLY: finished
0709 12:13:41.126694 (+   737us) log.cc:844] Serialized 220 byte log entry
0709 12:13:41.128534 (+  1840us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:41.128909 (+   375us) write_op.cc:454] Released schema lock
0709 12:13:41.129027 (+   118us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:41.152252 (+ 23225us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:41.152309 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":211997,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":77809,"apply.run_cpu_time_us":33172,"apply.run_wall_time_us":204591,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108677,"cfile_init":1,"lbm_read_time_us":2049,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"num_ops":25,"prepare.queue_time_us":385030,"prepare.run_cpu_time_us":41489,"prepare.run_wall_time_us":682969,"raft.queue_time_us":97052,"raft.run_cpu_time_us":18351,"raft.run_wall_time_us":41595,"replication_time_us":389511,"thread_start_us":365052,"threads_started":4,"wal-append.queue_time_us":129810}]]}
I20260709 12:13:42.050664 22196 raft_consensus.cc:2468] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24.
I20260709 12:13:42.071528 22014 catalog_manager.cc:5697] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 23 to 27. New cstate: current_term: 27 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:42.139154 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:42.154807 22014 catalog_manager.cc:5697] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 18 to 23, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 23 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:42.157222 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180ca53d6ccc4c27a39b8000ee3b67ff" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
W20260709 12:13:42.158775 22236 consensus_peers.cc:597] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:42.158294 22014 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:42.159554 22236 consensus_peers.cc:597] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:42.159896 30879 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:42.161083 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:42.161726 22014 catalog_manager.cc:5697] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 20, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 20 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.166144 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:42.165771 22014 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:42.172680 22088 leader_election.cc:304] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
W20260709 12:13:42.165788 22236 consensus_peers.cc:597] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:42.176327 22236 consensus_peers.cc:597] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:42.177084 22236 consensus_peers.cc:597] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:42.177735 22236 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:42.179204 22236 consensus_peers.cc:597] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:42.170359 22014 catalog_manager.cc:5697] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 17, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 17 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:42.203842 22014 catalog_manager.cc:5697] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:42.205912 22014 catalog_manager.cc:5697] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.207571 22014 catalog_manager.cc:5697] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:42.219341 22014 catalog_manager.cc:5697] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 22 to 23, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 23 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:42.271008 22014 catalog_manager.cc:5697] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:42.416517 22014 catalog_manager.cc:5697] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 23, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 23 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.418474 22014 catalog_manager.cc:5697] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.422785 22014 catalog_manager.cc:5697] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index 4 to 15, term changed from 17 to 22, VOTER cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) evicted. New cstate: current_term: 22 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.426136 22014 catalog_manager.cc:5697] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 23 to 26, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 26 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.427713 22014 catalog_manager.cc:5697] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 21 to 24, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 24 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.429183 22014 catalog_manager.cc:5697] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 20, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 20 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:42.430416 22014 catalog_manager.cc:5697] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 23 to 24, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 24 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:42.431547 22014 catalog_manager.cc:5697] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:42.432749 22014 catalog_manager.cc:5697] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 15 to 19, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 19 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:13:42.546810 22088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42539, user_credentials={real_user=slave}} blocked reactor thread for 374213us
I20260709 12:13:42.573712 30784 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:42.574333 30784 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:42.577750 30784 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:42.581795 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:42.582679 22265 raft_consensus.cc:2393] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 24: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
W20260709 12:13:42.602385 22293 debug-util.cc:398] Leaking SignalData structure 0x7b080032e180 after lost signal to thread 20894
W20260709 12:13:42.603909 22293 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6fc0 after lost signal to thread 22055
W20260709 12:13:42.604579 22293 debug-util.cc:398] Leaking SignalData structure 0x7b0800327ac0 after lost signal to thread 22147
W20260709 12:13:42.604890 22293 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6ca0 after lost signal to thread 22148
W20260709 12:13:42.606384 22293 debug-util.cc:398] Leaking SignalData structure 0x7b0800383180 after lost signal to thread 22222
W20260709 12:13:42.606673 22293 debug-util.cc:398] Leaking SignalData structure 0x7b0800383340 after lost signal to thread 22223
I20260709 12:13:42.604669 30851 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:42.614354 30899 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.614297 30851 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:42.615132 30899 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:42.612202 30873 raft_consensus.cc:2749] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:42.618270 30899 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:42.619369 30873 raft_consensus.cc:493] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.621385 30953 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.622941 30899 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.612941 30879 raft_consensus.cc:493] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.626298 30879 raft_consensus.cc:515] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:42.626142 30953 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:42.625407 30873 raft_consensus.cc:515] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:42.630965 30899 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:42.633172 30873 leader_election.cc:290] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:42.628736 30879 leader_election.cc:290] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:42.628821 22293 debug-util.cc:398] Leaking SignalData structure 0x7b080003bfe0 after lost signal to thread 22296
W20260709 12:13:42.653589 22293 debug-util.cc:398] Leaking SignalData structure 0x7b080031bf20 after lost signal to thread 22297
W20260709 12:13:42.655498 22293 debug-util.cc:398] Leaking SignalData structure 0x7b0800368a40 after lost signal to thread 22890
W20260709 12:13:42.656006 22293 debug-util.cc:398] Leaking SignalData structure 0x7b080039db00 after lost signal to thread 22891
I20260709 12:13:42.638221 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:42.636960 30734 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.658393 30734 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:42.660483 30734 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:42.634564 30899 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:42.630391 30953 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:42.636914 30851 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:42.671674 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:42.673321 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:42.674945 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 32 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:42.695765 22236 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:42.717096 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:42.717475 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:42.721706 22830 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:42.720662 30879 raft_consensus.cc:493] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:42.725029 30879 raft_consensus.cc:515] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:42.729913 30879 leader_election.cc:290] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:42.731515 22088 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:42.734623 22162 consensus_peers.cc:597] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:42.720674 30851 raft_consensus.cc:2804] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:42.736184 30844 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:13:42.738332 30851 raft_consensus.cc:697] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:42.739313 30851 consensus_queue.cc:237] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:42.740625 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f94aa1b7ea46adad8a5d877b78cef9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:42.744901 20891 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 22148)
I20260709 12:13:42.749536 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bae45452334273a1c277a0a512021f" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:42.749540 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6c5fdc849b4d1b8df5ffb293137964" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 32 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:42.751653 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:42.752489 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:42.753883 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:42.736554 22162 consensus_peers.cc:597] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:42.757256 22162 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:42.757992 30873 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.758705 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8c98b2e5e2428790f3422299acaffb" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:42.758565 30873 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:42.759541 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:42.760926 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5facb1c9654266b70a6d04d1e002f2" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:42.761181 30873 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:42.763581 30873 raft_consensus.cc:493] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.764384 30873 raft_consensus.cc:515] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:42.766813 30873 leader_election.cc:290] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:42.757719 22162 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:42.770179 30903 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:42.771222 22088 leader_election.cc:304] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:42.772696 30873 raft_consensus.cc:2749] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:42.774727 22088 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:42.775954 30846 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:42.776902 30846 raft_consensus.cc:493] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:42.777637 30846 raft_consensus.cc:515] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:42.779466 30903 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:42.789661 30846 leader_election.cc:290] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:42.793998 22236 leader_election.cc:336] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:42.796483 22088 leader_election.cc:304] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:42.798870 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:42.800637 30873 raft_consensus.cc:2749] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:42.802284 22088 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:42.803236 30873 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:42.804965 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:42.805824 30873 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:42.807427 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:42.808218 22267 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 24.
I20260709 12:13:42.809698 22088 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:42.810648 30873 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:42.812044 22088 leader_election.cc:304] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:42.812928 30873 raft_consensus.cc:2749] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:42.813452 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:42.817562 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:42.818356 30873 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:42.818858 30873 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.819317 30873 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:42.820370 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:42.829380 30873 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:42.830796 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:42.830943 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:42.831720 22267 raft_consensus.cc:2468] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 22.
I20260709 12:13:42.831784 22192 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 24.
I20260709 12:13:42.832650 30873 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:42.833422 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4182733145491a94be746238e892f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:42.833909 22236 consensus_peers.cc:597] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:42.835717 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:42.836426 22190 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:42.837700 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:42.838367 22267 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:42.836411 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f1b154b48c54be6b421b01ed436bf21" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:42.846182 22267 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 25.
W20260709 12:13:42.846884 22236 leader_election.cc:336] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:42.847406 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:42.847431 22190 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea51e825f0ab4ea2bb6c4d0e29709ca3 in term 25.
I20260709 12:13:42.848197 30851 raft_consensus.cc:2749] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:42.849337 22088 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 
I20260709 12:13:42.851526 22087 leader_election.cc:304] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:42.852435 30886 raft_consensus.cc:2749] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:42.853106 22087 leader_election.cc:304] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:42.853506 30886 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:42.853693 22162 consensus_peers.cc:597] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:42.854079 30886 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 LEADER]: Becoming Leader. State: Replica: ea51e825f0ab4ea2bb6c4d0e29709ca3, State: Running, Role: LEADER
I20260709 12:13:42.854000 30879 raft_consensus.cc:2749] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:42.855459 30886 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:43.001870 22020 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:43.009423 22020 catalog_manager.cc:5697] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 18 to 19, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 19 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:43.014317 22020 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 19 to 20, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 20 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.019130 22014 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45132 (request call id 279) took 3537 ms. Trace:
I20260709 12:13:43.024531 22020 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 17 to 18, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 18 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:43.038115 22020 catalog_manager.cc:5697] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:43.041755 22020 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 reported cstate change: term changed from 14 to 16, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 16 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:43.046069 22162 consensus_peers.cc:597] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:43.021108 22014 rpcz_store.cc:276] 0709 12:13:39.481330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.481686 (+   356us) service_pool.cc:224] Handling call
0709 12:13:43.019004 (+3537318us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:42.465428 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:42.466128 (+   700us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:42.466186 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:13:42.466208 (+    22us) tablet.cc:662] Decoding operations
0709 12:13:42.469020 (+  2812us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:42.469113 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:42.469145 (+    32us) tablet.cc:685] Acquiring locks for 36 operations
0709 12:13:42.473217 (+  4072us) tablet.cc:701] Row locks acquired
0709 12:13:42.473237 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:13:42.473452 (+   215us) write_op.cc:270] Start()
0709 12:13:42.473608 (+   156us) write_op.cc:276] Timestamp: P: 1783599222473384 usec, L: 0
0709 12:13:42.473627 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:13:42.475001 (+  1374us) log.cc:844] Serialized 14146 byte log entry
0709 12:13:42.606294 (+131293us) spinlock_profiling.cc:243] Waited 893 us on lock 0x7b180038de80. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccf3b9dab1 00007fccf3baa281 00007fcceacb7e07 00007fccf3b129a9 00007fcceacd469b 00007fcceacd293f 00007fcceacd2455 00007fccedd3f190 00007fccedd38ae7 00007fccedd37dd9 00007fccedd42930
0709 12:13:42.667570 (+ 61276us) op_driver.cc:464] REPLICATION: finished
0709 12:13:42.757540 (+ 89970us) write_op.cc:301] APPLY: starting
0709 12:13:42.757629 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:42.848246 (+ 90617us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:42.848285 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:42.904554 (+ 56269us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:42.905180 (+   626us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=72,key_file_lookups=72,delta_file_lookups=0,mrs_lookups=0
0709 12:13:42.905242 (+    62us) write_op.cc:312] APPLY: finished
0709 12:13:42.906027 (+   785us) log.cc:844] Serialized 308 byte log entry
0709 12:13:42.910875 (+  4848us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.911293 (+   418us) write_op.cc:454] Released schema lock
0709 12:13:42.911393 (+   100us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:42.911988 (+   595us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.912030 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":58044,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":89688,"apply.run_cpu_time_us":45854,"apply.run_wall_time_us":154404,"cfile_cache_hit":146,"cfile_cache_hit_bytes":154679,"num_ops":36,"prepare.queue_time_us":15321,"prepare.run_cpu_time_us":15018,"prepare.run_wall_time_us":25203,"raft.queue_time_us":175215,"raft.run_cpu_time_us":15140,"raft.run_wall_time_us":70494,"replication_time_us":193661,"spinlock_wait_cycles":2053376,"thread_start_us":155057,"threads_started":4,"wal-append.queue_time_us":10384}]]}
I20260709 12:13:43.244856 22190 raft_consensus.cc:1275] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 12:13:43.250115 22236 consensus_peers.cc:597] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:43.257197 30954 consensus_queue.cc:1048] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:13:43.267534 30873 raft_consensus.cc:493] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.269111 30873 raft_consensus.cc:515] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:43.274250 22020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 251) took 25628 ms (client timeout 15000 ms). Trace:
I20260709 12:13:43.277190 30873 leader_election.cc:290] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:43.267493 22018 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:43.279422 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:43.280014 22236 consensus_peers.cc:597] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.286609 22162 consensus_peers.cc:597] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:43.286015 22018 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.290302 22018 catalog_manager.cc:5697] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:43.295622 22258 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f1b154b48c54be6b421b01ed436bf21 with delete_type TABLET_DATA_TOMBSTONED (TS cc9b9c8894084021a0c6ddaf659d222e not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:48540
I20260709 12:13:43.302501 22018 catalog_manager.cc:5697] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:43.303705 30873 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:43.304570 30873 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:43.307747 30873 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:43.274701 22020 rpcz_store.cc:269] 0709 12:13:17.646361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.646703 (+   342us) service_pool.cc:224] Handling call
0709 12:13:43.274175 (+25627472us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:43.061738 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:43.062457 (+   719us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:43.062499 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:13:43.062523 (+    24us) tablet.cc:662] Decoding operations
0709 12:13:43.063491 (+   968us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:43.063576 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:43.063619 (+    43us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:13:43.064268 (+   649us) tablet.cc:701] Row locks acquired
0709 12:13:43.064292 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:13:43.064472 (+   180us) write_op.cc:270] Start()
0709 12:13:43.064611 (+   139us) write_op.cc:276] Timestamp: P: 1783599223064411 usec, L: 0
0709 12:13:43.064637 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:13:43.065537 (+   900us) log.cc:844] Serialized 2480 byte log entry
0709 12:13:43.068485 (+  2948us) op_driver.cc:464] REPLICATION: finished
0709 12:13:43.068857 (+   372us) write_op.cc:301] APPLY: starting
0709 12:13:43.068991 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:43.072369 (+  3378us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:43.072478 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:43.076065 (+  3587us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:43.076268 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:13:43.076315 (+    47us) write_op.cc:312] APPLY: finished
0709 12:13:43.089786 (+ 13471us) log.cc:844] Serialized 65 byte log entry
0709 12:13:43.090840 (+  1054us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.090995 (+   155us) write_op.cc:454] Released schema lock
0709 12:13:43.091057 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:43.163971 (+ 72914us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.164007 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12291,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":116,"apply.run_cpu_time_us":8731,"apply.run_wall_time_us":95017,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25092,"num_ops":6,"prepare.queue_time_us":7670,"prepare.run_cpu_time_us":4180,"prepare.run_wall_time_us":7318,"replication_time_us":3690,"thread_start_us":14069,"threads_started":1}]]}
I20260709 12:13:43.311223 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575c887e89834da7b6e222b41a19b692" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:43.312456 22018 catalog_manager.cc:5697] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 19 to 23, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 23 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.314476 22018 catalog_manager.cc:5697] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:43.314901 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:43.316605 22018 catalog_manager.cc:5697] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 16 to 19, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 19 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:13:43.331779 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:43.327826 22018 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 22 to 23, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 23 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.337023 22087 leader_election.cc:304] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:43.337011 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:43.338045 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:43.338145 30873 raft_consensus.cc:2749] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:43.338218 22830 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:43.339254 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:43.335255 22018 catalog_manager.cc:5697] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 15 to 18, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 18 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.345678 30972 tablet_replica.cc:333] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:13:43.346043 22267 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:13:43.345326 22087 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:43.355755 22830 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:43.359335 22190 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Refusing update from remote peer ea51e825f0ab4ea2bb6c4d0e29709ca3: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:13:43.355136 30846 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:43.359369 30960 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:43.360641 30960 consensus_queue.cc:1243] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Peer cc9b9c8894084021a0c6ddaf659d222e log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:13:43.361289 30846 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:43.362643 30972 raft_consensus.cc:2243] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.365118 30972 raft_consensus.cc:2272] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.368839 22265 raft_consensus.cc:1217] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Deduplicated request from leader. Original: 19.10->[20.11-25.13]   Dedup: 20.11->[23.12-25.13]
I20260709 12:13:43.368256 22018 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 11 to 12, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 12 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.369314 22265 pending_rounds.cc:85] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Aborting all ops after (but not including) 11
I20260709 12:13:43.369555 22265 pending_rounds.cc:107] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:13:43.369764 22265 raft_consensus.cc:2889] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:43.370184 22018 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 16 to 18, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 18 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.390573 30972 ts_tablet_manager.cc:1916] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:13:43.426113 22052 debug-util.cc:398] Leaking SignalData structure 0x7b0800294760 after lost signal to thread 20894
W20260709 12:13:43.427392 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080034b7c0 after lost signal to thread 22055
W20260709 12:13:43.428066 22052 debug-util.cc:398] Leaking SignalData structure 0x7b0800348a80 after lost signal to thread 22147
W20260709 12:13:43.428364 22052 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5b00 after lost signal to thread 22148
W20260709 12:13:43.429519 22052 debug-util.cc:398] Leaking SignalData structure 0x7b08003c28c0 after lost signal to thread 22222
W20260709 12:13:43.429826 22052 debug-util.cc:398] Leaking SignalData structure 0x7b0800350da0 after lost signal to thread 22223
W20260709 12:13:43.431030 22052 debug-util.cc:398] Leaking SignalData structure 0x7b0800330ca0 after lost signal to thread 22296
W20260709 12:13:43.431347 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080026f5e0 after lost signal to thread 22297
W20260709 12:13:43.432657 22052 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb180 after lost signal to thread 22890
W20260709 12:13:43.432987 22052 debug-util.cc:398] Leaking SignalData structure 0x7b080034e500 after lost signal to thread 22891
I20260709 12:13:43.439951 30972 ts_tablet_manager.cc:1929] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.14
I20260709 12:13:43.451263 30972 log.cc:1199] T 7f1b154b48c54be6b421b01ed436bf21 P cc9b9c8894084021a0c6ddaf659d222e: Deleting WAL directory at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/wals/7f1b154b48c54be6b421b01ed436bf21
I20260709 12:13:43.454470 22007 catalog_manager.cc:5028] TS cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): tablet 7f1b154b48c54be6b421b01ed436bf21 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
W20260709 12:13:43.476688 22162 consensus_peers.cc:597] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:43.493433 22014 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 19, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 19 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:43.495730 22014 catalog_manager.cc:5697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 19 to 21, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 21 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:43.506055 22014 catalog_manager.cc:5697] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:43.513520 22014 catalog_manager.cc:5697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 19, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 19 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
W20260709 12:13:43.515508 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:43.515885 30873 raft_consensus.cc:493] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.521486 30873 raft_consensus.cc:515] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:43.526036 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:43.529548 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fac2244705d40569bd4a6e8161fb5e9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:43.531654 22087 leader_election.cc:304] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, 7d3f536360b444b1886777f4776be22c
I20260709 12:13:43.532711 30960 raft_consensus.cc:2749] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:43.526079 30873 leader_election.cc:290] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:13:43.548360 22236 consensus_peers.cc:597] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.560990 22162 consensus_peers.cc:597] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:43.564994 22014 catalog_manager.cc:5697] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 23 to 24, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 24 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:43.566768 22014 catalog_manager.cc:5697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 20 to 24, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 24 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:43.568315 22014 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
W20260709 12:13:43.569536 22830 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:43.589814 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:43.605824 22014 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 25 to 26, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 26 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:43.629108 22258 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f1b154b48c54be6b421b01ed436bf21 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 15)) from {username='slave'} at 127.0.0.1:48540
I20260709 12:13:43.630810 22007 catalog_manager.cc:5028] TS cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): tablet 7f1b154b48c54be6b421b01ed436bf21 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
W20260709 12:13:43.631378 22018 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 245) took 14571 ms (client timeout 15000 ms). Trace:
W20260709 12:13:43.631842 22018 rpcz_store.cc:269] 0709 12:13:29.059999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.064243 (+  4244us) service_pool.cc:224] Handling call
0709 12:13:43.631282 (+14567039us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:43.384928 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:43.385937 (+  1009us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:43.386005 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:13:43.386032 (+    27us) tablet.cc:662] Decoding operations
0709 12:13:43.388025 (+  1993us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:43.388119 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:43.388177 (+    58us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:13:43.390124 (+  1947us) tablet.cc:701] Row locks acquired
0709 12:13:43.390146 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:13:43.390342 (+   196us) write_op.cc:270] Start()
0709 12:13:43.390483 (+   141us) write_op.cc:276] Timestamp: P: 1783599223390283 usec, L: 0
0709 12:13:43.390520 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:13:43.391684 (+  1164us) log.cc:844] Serialized 4410 byte log entry
0709 12:13:43.394170 (+  2486us) op_driver.cc:464] REPLICATION: finished
0709 12:13:43.395928 (+  1758us) write_op.cc:301] APPLY: starting
0709 12:13:43.396039 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:43.402679 (+  6640us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:43.402813 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:43.433506 (+ 30693us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:43.433773 (+   267us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 12:13:43.433831 (+    58us) write_op.cc:312] APPLY: finished
0709 12:13:43.434187 (+   356us) log.cc:844] Serialized 105 byte log entry
0709 12:13:43.441388 (+  7201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.441574 (+   186us) write_op.cc:454] Released schema lock
0709 12:13:43.441657 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:43.455663 (+ 14006us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.455710 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":51,"spinlock_wait_cycles":28416,"child_traces":[["op",{"apply.queue_time_us":1516,"apply.run_cpu_time_us":15605,"apply.run_wall_time_us":46171,"cfile_cache_hit":44,"cfile_cache_hit_bytes":46002,"num_ops":11,"prepare.queue_time_us":4253,"prepare.run_cpu_time_us":6039,"prepare.run_wall_time_us":7140,"replication_time_us":3507}]]}
I20260709 12:13:43.698781 22017 catalog_manager.cc:5697] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:43.723093 22017 catalog_manager.cc:5697] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 18 to 19, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 19 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.733429 22017 catalog_manager.cc:5697] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 12 to 13, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to 164596fc2efa450581a5b68cad62271f (127.20.102.196). New cstate: current_term: 13 leader_uuid: "164596fc2efa450581a5b68cad62271f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:43.741796 22016 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 157) took 21240 ms (client timeout 15000 ms). Trace:
I20260709 12:13:43.743461 22017 catalog_manager.cc:5697] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f reported cstate change: term changed from 15 to 17, leader changed from 164596fc2efa450581a5b68cad62271f (127.20.102.196) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 17 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:13:43.745610 20891 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 22148)
W20260709 12:13:43.750339 22162 consensus_peers.cc:597] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:43.754576 22830 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:43.747758 22016 rpcz_store.cc:269] 0709 12:13:22.501300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.501591 (+   291us) service_pool.cc:224] Handling call
0709 12:13:43.741679 (+21240088us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1095933,"reported_tablets":25}
W20260709 12:13:43.766868 22162 consensus_peers.cc:597] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:43.780330 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:43.784336 22016 catalog_manager.cc:5697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 19 to 25, leader changed from cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195) to ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193). New cstate: current_term: 25 leader_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:43.801471 22016 catalog_manager.cc:5697] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 21 to 24, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 24 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } }
I20260709 12:13:43.876143 30846 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.876967 30846 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:43.881490 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:43.884020 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10864c994f49ed830c4951cfadea5e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:43.885785 30846 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:43.886195 22087 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:43.887265 30846 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:43.897835 30846 raft_consensus.cc:493] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.898610 30846 raft_consensus.cc:515] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:43.902729 22017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50266 (request call id 158) took 5414 ms. Trace:
I20260709 12:13:43.902594 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:43.905510 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f853d79ab4bdf9a4bbdf1c2aea79e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:43.908465 22088 leader_election.cc:304] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:43.909746 30873 raft_consensus.cc:2749] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:43.910828 30846 leader_election.cc:290] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:43.910321 22017 rpcz_store.cc:276] 0709 12:13:38.488483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.489091 (+   608us) service_pool.cc:224] Handling call
0709 12:13:43.902632 (+5413541us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:43.786080 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:43.786612 (+   532us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:43.786652 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:13:43.786671 (+    19us) tablet.cc:662] Decoding operations
0709 12:13:43.787167 (+   496us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:43.787204 (+    37us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:43.787220 (+    16us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:13:43.787501 (+   281us) tablet.cc:701] Row locks acquired
0709 12:13:43.787513 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:13:43.787626 (+   113us) write_op.cc:270] Start()
0709 12:13:43.787706 (+    80us) write_op.cc:276] Timestamp: P: 1783599223787589 usec, L: 0
0709 12:13:43.787719 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 12:13:43.788225 (+   506us) log.cc:844] Serialized 1698 byte log entry
0709 12:13:43.790405 (+  2180us) op_driver.cc:464] REPLICATION: finished
0709 12:13:43.790873 (+   468us) write_op.cc:301] APPLY: starting
0709 12:13:43.790958 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:43.793305 (+  2347us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:43.793411 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:43.803361 (+  9950us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:43.803617 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:13:43.803675 (+    58us) write_op.cc:312] APPLY: finished
0709 12:13:43.803987 (+   312us) log.cc:844] Serialized 49 byte log entry
0709 12:13:43.805052 (+  1065us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.805206 (+   154us) write_op.cc:454] Released schema lock
0709 12:13:43.805263 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:43.805725 (+   462us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.805763 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81044,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":276,"apply.run_cpu_time_us":7539,"apply.run_wall_time_us":14760,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16728,"num_ops":4,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":2438,"prepare.run_wall_time_us":2437,"replication_time_us":2580}]]}
I20260709 12:13:43.974241 30846 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:13:43.975035 30846 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:43.977723 30846 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:43.980634 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:43.987831 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3753b5634bb143e1ab2c70fbe2900044" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:43.989464 22088 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:43.990381 30873 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:44.012346 30873 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:13:44.013229 30873 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:44.017791 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:44.019644 30873 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:44.021232 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6f694768d144aa85616d8c7b2453f0" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:44.022902 22088 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:44.023891 30846 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:44.079474 30960 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.080040 30960 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:44.083961 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:44.087190 30960 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:44.094967 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2900731305497ebb6cfec2d7557d25" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:44.097621 22087 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:44.098973 30960 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:44.141975 22162 consensus_peers.cc:597] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:44.164141 30960 raft_consensus.cc:493] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.165040 30960 raft_consensus.cc:515] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:44.167821 30960 leader_election.cc:290] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:44.169720 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:44.177111 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911e3b1b2f64b93b2ad9740ea9810bc" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:44.179142 22087 leader_election.cc:304] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:44.180423 30886 raft_consensus.cc:2749] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:44.209762 22258 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f1b154b48c54be6b421b01ed436bf21 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 15)) from {username='slave'} at 127.0.0.1:48540
W20260709 12:13:44.212734 22021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45140 (request call id 244) took 36313 ms (client timeout 15000 ms). Trace:
W20260709 12:13:44.221374 22021 rpcz_store.cc:269] 0709 12:13:07.899541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.899768 (+   227us) service_pool.cc:224] Handling call
0709 12:13:07.975187 (+ 75419us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:08.133548 (+158361us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b5400280690. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9e640 00007fccf3b75846 00007fccf3c7f90e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:44.212486 (+36078938us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52355,"reported_tablets":50,"spinlock_wait_cycles":82542720}
I20260709 12:13:44.223021 30886 raft_consensus.cc:493] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:44.223840 30886 raft_consensus.cc:515] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:44.226616 30886 leader_election.cc:290] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:44.228842 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:44.233042 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a858eff9ef460fa5e0587bb1ea61f9" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:44.238370 22088 leader_election.cc:304] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:44.242086 30886 raft_consensus.cc:2749] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:44.278447 22007 catalog_manager.cc:5028] TS cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): tablet 7f1b154b48c54be6b421b01ed436bf21 (table test-workload [id=ad4588232900411b98860e921e1369e2]) successfully deleted
I20260709 12:13:44.334813 30886 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.335484 30886 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:44.337940 30886 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:44.339147 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:44.341075 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:44.345732 22087 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:44.346742 30886 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:44.383083 22019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45126 (request call id 252) took 5768 ms. Trace:
W20260709 12:13:44.383940 22236 consensus_peers.cc:597] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:44.383631 22019 rpcz_store.cc:276] 0709 12:13:38.615144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.616912 (+  1768us) service_pool.cc:224] Handling call
0709 12:13:38.745982 (+129070us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b54001b0dd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2c090 00007fcceddcaf3a 00007fccf3b80e9c 00007fccf3c7f04e 00007fccf21402a4 00007fccf2140232 00007fccf2140161 00007fccf21400dc 00007fccf213f392 00007fccec0fd48c 00007fccec0fc8c6
0709 12:13:44.383019 (+5637037us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66205,"reported_tablets":50,"spinlock_wait_cycles":103251840}
I20260709 12:13:44.407981 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:13:44.409271 22162 consensus_peers.cc:597] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:44.412992 20891 tablet_replica.cc:333] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.414882 20891 raft_consensus.cc:2243] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.415692 20891 raft_consensus.cc:2272] T 4c6c5fdc849b4d1b8df5ffb293137964 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.421669 20891 tablet_replica.cc:333] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.428996 20891 raft_consensus.cc:2243] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.434335 20891 raft_consensus.cc:2272] T 863b392474d94720808349fe27669b5b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.442440 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:44.454337 20891 tablet_replica.cc:333] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.456034 20891 raft_consensus.cc:2243] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.464924 20891 raft_consensus.cc:2272] T ca8c98b2e5e2428790f3422299acaffb P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.472079 20891 tablet_replica.cc:333] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.479283 20891 raft_consensus.cc:2243] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.481379 20891 raft_consensus.cc:2272] T 5063e8815c77400bb77029ed9db742c1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.491369 22162 consensus_peers.cc:597] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:44.502939 20891 tablet_replica.cc:333] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.504501 20891 raft_consensus.cc:2243] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.508165 20891 pending_rounds.cc:70] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Trying to abort 1 pending ops.
I20260709 12:13:44.508541 20891 pending_rounds.cc:77] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting op as it isn't in flight: id { term: 22 index: 12 } timestamp: 7305622343034515456 op_type: NO_OP noop_request { }
I20260709 12:13:44.514362 20891 raft_consensus.cc:2889] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:44.515170 20891 raft_consensus.cc:2272] T 9726d3fa41c64b6184468cabcb37dd5a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.532512 20891 tablet_replica.cc:333] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.547642 20891 raft_consensus.cc:2243] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.548806 20891 raft_consensus.cc:2272] T 575c887e89834da7b6e222b41a19b692 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.552803 20891 tablet_replica.cc:333] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.564615 20891 raft_consensus.cc:2243] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.569851 20891 raft_consensus.cc:2272] T 6a694c1edf6f4d74a37990fe7e53a6af P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.580049 20891 tablet_replica.cc:333] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.581324 20891 raft_consensus.cc:2243] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.582172 20891 raft_consensus.cc:2272] T 83a858eff9ef460fa5e0587bb1ea61f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.592528 20891 tablet_replica.cc:333] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.594065 30960 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.610636 30960 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:44.613193 30960 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:44.613754 20891 raft_consensus.cc:2243] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.616182 20891 raft_consensus.cc:2272] T a8f422c5da2840e0b466894312ebcd44 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.617367 22236 consensus_peers.cc:597] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:44.619179 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:44.622661 20891 tablet_replica.cc:333] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.628825 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9255592b74304240a5fa1df814fbb726" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:44.643774 20891 raft_consensus.cc:2243] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.648083 20891 raft_consensus.cc:2272] T 37a6582c89c24e6e838bf8ce6d550b23 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.651994 20891 tablet_replica.cc:333] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
W20260709 12:13:44.656451 22069 auto_rebalancer.cc:629] Failed to schedule move for tablet a1f011a3d3cd4ee8ba13b1e9bfd25e6a: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:44.657404 30969 raft_consensus.cc:493] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.659102 30969 raft_consensus.cc:515] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:44.661429 30969 leader_election.cc:290] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:44.664877 22087 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:44.659040 20891 raft_consensus.cc:2243] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.666347 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:44.666656 20891 raft_consensus.cc:2272] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.667259 30960 raft_consensus.cc:2706] T 9255592b74304240a5fa1df814fbb726 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 10 FOLLOWER]: Received pre-election callback for term 11 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 12:13:44.668730 30969 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.668891 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a461ebb30e94378a21b03f9c6c7a018" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:44.669513 30969 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:44.675980 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:44.676229 20891 tablet_replica.cc:333] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.671309 22087 leader_election.cc:304] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:44.683845 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4074b27f51549b4bf3fae4c6e734506" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:44.685832 30886 raft_consensus.cc:2749] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:44.687817 30969 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:44.693559 20891 raft_consensus.cc:2243] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.694509 20891 pending_rounds.cc:70] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Trying to abort 1 pending ops.
I20260709 12:13:44.694847 20891 pending_rounds.cc:77] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting op as it isn't in flight: id { term: 19 index: 14 } timestamp: 7305622322913538048 op_type: NO_OP noop_request { }
I20260709 12:13:44.695250 20891 raft_consensus.cc:2889] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:44.695636 20891 raft_consensus.cc:2272] T 2f0832297a8d44da9dba2792bf6c4c35 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.699060 20891 tablet_replica.cc:333] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.703043 22087 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:44.710320 22192 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:13:44.717934 30969 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:44.719386 30960 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.720014 30960 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:44.722036 20891 raft_consensus.cc:2243] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.724292 20891 pending_rounds.cc:70] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Trying to abort 3 pending ops.
I20260709 12:13:44.725391 20891 pending_rounds.cc:77] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting op as it isn't in flight: id { term: 18 index: 15 } timestamp: 7305622355502596096 op_type: NO_OP noop_request { }
I20260709 12:13:44.726305 20891 raft_consensus.cc:2889] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:44.726729 20891 pending_rounds.cc:77] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting op as it isn't in flight: id { term: 16 index: 14 } timestamp: 7305622327739305984 op_type: NO_OP noop_request { }
I20260709 12:13:44.722465 30960 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:44.726408 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:44.728502 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011db458534b4bc8876e63453a07b86b" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:44.729079 30886 raft_consensus.cc:493] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.729629 30886 raft_consensus.cc:515] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:44.732000 30886 leader_election.cc:290] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:44.732336 22088 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:44.733095 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:44.727051 20891 raft_consensus.cc:2889] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:44.734215 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:44.734403 20891 pending_rounds.cc:77] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting op as it isn't in flight: id { term: 14 index: 13 } timestamp: 7305622302412963840 op_type: NO_OP noop_request { }
I20260709 12:13:44.735487 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3d186560a74d7e8c4d29066e4e3567" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:44.735124 20891 raft_consensus.cc:2889] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:44.739127 20891 raft_consensus.cc:2272] T 44711cbd4d234e36807a94726a691570 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.744488 22267 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:44.745050 22088 leader_election.cc:304] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:44.737437 30960 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:44.749330 22163 consensus_peers.cc:597] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1fb787db87147b3be49bef974365af1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.750723 30949 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:44.754420 20891 tablet_replica.cc:333] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.756086 30960 raft_consensus.cc:2749] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:13:44.762166 22162 consensus_peers.cc:597] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.764370 20891 raft_consensus.cc:2243] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.765292 20891 raft_consensus.cc:2272] T 9911e3b1b2f64b93b2ad9740ea9810bc P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.772933 20891 tablet_replica.cc:333] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.773821 20891 raft_consensus.cc:2243] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.774807 20891 raft_consensus.cc:2272] T a466ed4a4d8b45e6bc22f4def613313a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.778157 20891 tablet_replica.cc:333] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.783681 20891 raft_consensus.cc:2243] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.785264 20891 raft_consensus.cc:2272] T 180ca53d6ccc4c27a39b8000ee3b67ff P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.790699 20891 tablet_replica.cc:333] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
W20260709 12:13:44.792709 22236 consensus_peers.cc:597] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:44.794652 22236 consensus_peers.cc:597] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:44.800453 20891 raft_consensus.cc:2243] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.802140 20891 raft_consensus.cc:2272] T 6d0c08f3aeaa409eae4bd1665895337e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.803243 22236 consensus_peers.cc:597] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:44.803983 30960 raft_consensus.cc:493] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.804637 30960 raft_consensus.cc:515] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:44.805480 20891 tablet_replica.cc:333] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.806421 20891 raft_consensus.cc:2243] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.807224 30960 leader_election.cc:290] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:44.809132 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:44.812556 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d43361a72435b8868d1f3cdb436a3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:44.812654 30949 raft_consensus.cc:2955] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:13:44.814640 22088 leader_election.cc:304] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:13:44.815927 30960 raft_consensus.cc:2749] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:44.815078 22267 raft_consensus.cc:2955] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
W20260709 12:13:44.826845 22236 consensus_peers.cc:597] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:44.828369 20891 raft_consensus.cc:2272] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:44.828949 22162 consensus_peers.cc:597] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:44.837357 20891 tablet_replica.cc:333] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.838603 20891 raft_consensus.cc:2243] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.839509 20891 raft_consensus.cc:2272] T 8b5facb1c9654266b70a6d04d1e002f2 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.842823 20891 tablet_replica.cc:333] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.842531 22190 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:13:44.843950 20891 raft_consensus.cc:2243] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.844623 20891 raft_consensus.cc:2272] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.847985 20891 tablet_replica.cc:333] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.848997 20891 raft_consensus.cc:2243] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.850353 20891 raft_consensus.cc:2272] T 68d3fd71ae0648daa990f506abe35c85 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.853711 20891 tablet_replica.cc:333] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.857272 20891 raft_consensus.cc:2243] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.858011 20891 raft_consensus.cc:2272] T 3753b5634bb143e1ab2c70fbe2900044 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.861411 20891 tablet_replica.cc:333] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.862763 20891 raft_consensus.cc:2243] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.863740 20891 raft_consensus.cc:2272] T b4bae45452334273a1c277a0a512021f P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.867398 20891 tablet_replica.cc:333] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.868503 20891 raft_consensus.cc:2243] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.869861 20891 pending_rounds.cc:70] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Trying to abort 1 pending ops.
I20260709 12:13:44.868899 22018 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c reported cstate change: config changed from index -1 to 14, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 21 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.873313 20891 pending_rounds.cc:77] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting op as it isn't in flight: id { term: 16 index: 15 } timestamp: 7305622374051086336 op_type: NO_OP noop_request { }
I20260709 12:13:44.873919 20891 raft_consensus.cc:2889] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:44.874415 20891 raft_consensus.cc:2272] T 97ce44fb81b642f9ad6b0f0d68e82820 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.878091 20891 tablet_replica.cc:333] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
W20260709 12:13:44.881099 22162 consensus_peers.cc:597] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.882419 22265 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:44.883872 20891 raft_consensus.cc:2243] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:44.885617 22163 consensus_peers.cc:597] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c -> Peer 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539): Couldn't send request to peer 164596fc2efa450581a5b68cad62271f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37a6582c89c24e6e838bf8ce6d550b23. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.887872 20891 raft_consensus.cc:2272] T fc3d186560a74d7e8c4d29066e4e3567 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.890956 30885 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:44.892236 20891 tablet_replica.cc:333] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.893405 20891 raft_consensus.cc:2243] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:44.918787 20891 raft_consensus.cc:2272] T d97f4392fa434ad9bf2e7d3e78bfdf4c P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.936887 20891 tablet_replica.cc:333] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.938125 20891 raft_consensus.cc:2243] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.939054 20891 raft_consensus.cc:2272] T c4074b27f51549b4bf3fae4c6e734506 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.975822 20891 tablet_replica.cc:333] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:44.976662 20891 raft_consensus.cc:2243] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.169188 20891 raft_consensus.cc:2272] T 44679affd4554006a2cb59b10b589a27 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.178792 20891 tablet_replica.cc:333] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.179803 20891 raft_consensus.cc:2243] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.180526 20891 raft_consensus.cc:2272] T 8d6f694768d144aa85616d8c7b2453f0 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.183760 20891 tablet_replica.cc:333] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.184719 20891 raft_consensus.cc:2243] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.218019 30960 raft_consensus.cc:493] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 164596fc2efa450581a5b68cad62271f)
I20260709 12:13:45.218964 30960 raft_consensus.cc:515] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:45.186389 20891 raft_consensus.cc:2272] T 907dafb5bddd48fdbc0a660020256df1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.295799 20891 tablet_replica.cc:333] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.296494 20891 raft_consensus.cc:2243] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.297556 20891 raft_consensus.cc:2272] T 43c89655d0564df0b63993d88160eb8e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.298350 30960 leader_election.cc:290] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:13:45.304275 20891 tablet_replica.cc:333] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.305223 20891 raft_consensus.cc:2243] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.306043 20891 raft_consensus.cc:2272] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.311007 20891 tablet_replica.cc:333] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.329589 20891 raft_consensus.cc:2243] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.330513 20891 raft_consensus.cc:2272] T 60967fd8cf404b7bb1b9f9c03875f4f3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.334535 20891 tablet_replica.cc:333] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.335273 20891 raft_consensus.cc:2243] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.335912 20891 pending_rounds.cc:70] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Trying to abort 2 pending ops.
I20260709 12:13:45.336143 20891 pending_rounds.cc:77] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting op as it isn't in flight: id { term: 22 index: 14 } timestamp: 7305622357896794112 op_type: NO_OP noop_request { }
I20260709 12:13:45.336519 20891 raft_consensus.cc:2889] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:45.336845 20891 pending_rounds.cc:77] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting op as it isn't in flight: id { term: 20 index: 13 } timestamp: 7305622322024210432 op_type: NO_OP noop_request { }
I20260709 12:13:45.337196 20891 raft_consensus.cc:2889] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:45.337527 20891 raft_consensus.cc:2272] T 7f1b154b48c54be6b421b01ed436bf21 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.340525 20891 tablet_replica.cc:333] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.342348 20891 raft_consensus.cc:2243] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.343348 20891 raft_consensus.cc:2272] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.346149 20891 tablet_replica.cc:333] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.347342 20891 raft_consensus.cc:2243] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.349964 20891 raft_consensus.cc:2272] T 6109e5c745bb4d53948d7f39ab4cf4ec P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.355194 20891 tablet_replica.cc:333] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.356076 20891 raft_consensus.cc:2243] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.357328 20891 raft_consensus.cc:2272] T 497837e9d32f4d9c809e44f8fabb9d03 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.360512 20891 tablet_replica.cc:333] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.363811 20891 raft_consensus.cc:2243] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.364388 30960 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.364971 30960 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:45.367229 30960 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:45.369437 20891 pending_rounds.cc:70] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Trying to abort 1 pending ops.
I20260709 12:13:45.369797 20891 pending_rounds.cc:77] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7305622331935109120 op_type: NO_OP noop_request { }
I20260709 12:13:45.370159 20891 raft_consensus.cc:2889] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:45.370555 20891 raft_consensus.cc:2272] T c1fb787db87147b3be49bef974365af1 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.373673 20891 tablet_replica.cc:333] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.374562 20891 raft_consensus.cc:2243] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.375231 20891 raft_consensus.cc:2272] T ed4182733145491a94be746238e892f9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.378204 20891 tablet_replica.cc:333] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.379093 20891 raft_consensus.cc:2243] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.379791 20891 raft_consensus.cc:2272] T 0a461ebb30e94378a21b03f9c6c7a018 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.382709 20891 tablet_replica.cc:333] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.383517 20891 raft_consensus.cc:2243] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.384143 20891 raft_consensus.cc:2272] T 1baa23cb6635453b9a9cd5ec7e452f6a P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.387213 20891 tablet_replica.cc:333] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.388049 20891 raft_consensus.cc:2243] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.389003 20891 raft_consensus.cc:2272] T 5c953802abd84140ba6c6a85dcdbf124 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.393344 20891 tablet_replica.cc:333] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.394120 20891 raft_consensus.cc:2243] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.394788 20891 raft_consensus.cc:2272] T 8ec86d794d1447b58c35b6fb35b481f8 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.397607 20891 tablet_replica.cc:333] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.398384 20891 raft_consensus.cc:2243] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.398906 20891 raft_consensus.cc:2272] T 7fac2244705d40569bd4a6e8161fb5e9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.401824 20891 tablet_replica.cc:333] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.402544 20891 raft_consensus.cc:2243] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.403116 20891 raft_consensus.cc:2272] T 1f10864c994f49ed830c4951cfadea5e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.406319 20891 tablet_replica.cc:333] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.407038 20891 raft_consensus.cc:2243] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.407922 20891 raft_consensus.cc:2272] T 6d2d43361a72435b8868d1f3cdb436a3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.413165 20891 tablet_replica.cc:333] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.413950 20891 raft_consensus.cc:2243] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.414561 20891 raft_consensus.cc:2272] T 011db458534b4bc8876e63453a07b86b P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.417511 20891 tablet_replica.cc:333] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.418212 20891 raft_consensus.cc:2243] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.419034 20891 raft_consensus.cc:2272] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.422166 20891 tablet_replica.cc:333] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.422931 20891 raft_consensus.cc:2243] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.423632 20891 raft_consensus.cc:2272] T ff2900731305497ebb6cfec2d7557d25 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.426608 20891 tablet_replica.cc:333] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3: stopping tablet replica
I20260709 12:13:45.427222 20891 raft_consensus.cc:2243] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:45.435946 20891 raft_consensus.cc:2272] T f0f94aa1b7ea46adad8a5d877b78cef9 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.461946 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:45.464974 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:45.465920 31002 ts_tablet_manager.cc:933] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:45.479604 31003 ts_tablet_manager.cc:933] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f: Initiating tablet copy from peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:45.487115 22265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.005s	sys 0.013s
W20260709 12:13:45.488023 22265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.005s	sys 0.013s
I20260709 12:13:45.493209 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dccbaccd2369440b957f9e2e49c0b59e" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:45.496591 22086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:45.505694 22236 consensus_peers.cc:597] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:45.517154 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 84927.2us
I20260709 12:13:45.539582 22087 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:45.549165 22087 raft_consensus.cc:2686] T dccbaccd2369440b957f9e2e49c0b59e P ea51e825f0ab4ea2bb6c4d0e29709ca3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:13:45.557538 31003 tablet_copy_client.cc:323] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
I20260709 12:13:45.549993 31002 tablet_copy_client.cc:323] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.102.194:36735
I20260709 12:13:45.571069 22270 raft_consensus.cc:2955] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
W20260709 12:13:45.579185 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 66388.8us
W20260709 12:13:45.580274 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 77286.7us
I20260709 12:13:45.559362 30949 raft_consensus.cc:2955] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:13:45.590377 22861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3728a188c254ff78ba0aff2361f13e3" candidate_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:13:45.594427 22088 leader_election.cc:304] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea51e825f0ab4ea2bb6c4d0e29709ca3; no voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e
W20260709 12:13:45.595413 22088 raft_consensus.cc:2686] T f3728a188c254ff78ba0aff2361f13e3 P ea51e825f0ab4ea2bb6c4d0e29709ca3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:13:45.601619 22208 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet c1fb787db87147b3be49bef974365af1 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:13:45.601951 22207 tablet_copy_service.cc:140] P 7d3f536360b444b1886777f4776be22c: Received BeginTabletCopySession request for tablet 37a6582c89c24e6e838bf8ce6d550b23 from peer 164596fc2efa450581a5b68cad62271f ({username='slave'} at 127.0.0.1:37260)
I20260709 12:13:45.602685 22208 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet c1fb787db87147b3be49bef974365af1 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-c1fb787db87147b3be49bef974365af1
I20260709 12:13:45.603577 22207 tablet_copy_service.cc:161] P 7d3f536360b444b1886777f4776be22c: Beginning new tablet copy session on tablet 37a6582c89c24e6e838bf8ce6d550b23 from peer 164596fc2efa450581a5b68cad62271f at {username='slave'} at 127.0.0.1:37260: session id = 164596fc2efa450581a5b68cad62271f-37a6582c89c24e6e838bf8ce6d550b23
W20260709 12:13:45.621948 22162 consensus_peers.cc:597] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:45.623940 22162 consensus_peers.cc:597] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:45.625674 22019 catalog_manager.cc:5697] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index -1 to 14, NON_VOTER 164596fc2efa450581a5b68cad62271f (127.20.102.196) added. New cstate: current_term: 22 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } } }
I20260709 12:13:45.637135 22208 tablet_copy_source_session.cc:215] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:13:45.647207 22830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 61883.4us
W20260709 12:13:45.652650 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 67197.3us
I20260709 12:13:45.662757 22207 tablet_copy_source_session.cc:215] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:45.681229 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1fb787db87147b3be49bef974365af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:45.686383 31002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a6582c89c24e6e838bf8ce6d550b23. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:45.689226 22069 auto_rebalancer.cc:629] Failed to schedule move for tablet 8ec86d794d1447b58c35b6fb35b481f8: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:45.704445 31003 tablet_copy_client.cc:806] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:45.705344 31003 tablet_copy_client.cc:670] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
W20260709 12:13:45.710736 22236 consensus_peers.cc:597] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:45.763049 22830 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:45.764094 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:45.765879 31002 tablet_copy_client.cc:806] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:45.766557 31002 tablet_copy_client.cc:670] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:45.769361 31011 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:45.770013 31011 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:45.774155 31003 tablet_copy_client.cc:538] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:13:45.778421 22236 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:45.779644 31011 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:45.781082 31002 tablet_copy_client.cc:538] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:45.781810 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:45.783573 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:45.784853 31011 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:45.804467 31003 tablet_bootstrap.cc:492] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
I20260709 12:13:45.806653 31002 tablet_bootstrap.cc:492] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f: Bootstrap starting.
W20260709 12:13:45.818459 22162 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 318 similar messages]
W20260709 12:13:45.821851 22162 consensus_peers.cc:597] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:45.828450 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:45.864893 31011 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:45.865828 31011 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:45.880451 30993 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:45.881095 30993 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:45.884419 30993 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:45.889672 31011 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:45.893379 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:45.896644 30993 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:45.897320 30993 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:45.900488 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:45.901711 30993 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:45.896308 31011 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:13:45.908669 22236 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:45.911298 31000 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:45.912317 31000 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:45.911222 31011 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:45.934597 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:45.938187 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:45.942874 31011 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:45.944941 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:45.947100 31011 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:45.964674 22236 consensus_peers.cc:597] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:45.965363 22236 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:45.965718 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:45.963285 31011 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:45.968897 31011 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:45.973742 30957 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:45.979815 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:45.987818 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:45.988734 22192 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 24.
W20260709 12:13:46.003749 22162 leader_election.cc:336] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:46.004624 22162 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:46.002404 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.008131 30957 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:46.008600 30957 raft_consensus.cc:493] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.009014 30957 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:46.022739 22236 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:46.023713 30983 raft_consensus.cc:2749] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:46.026357 30949 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.038466 31011 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.038365 30949 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:45.967464 31000 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.042309 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:46.043732 22270 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 25.
W20260709 12:13:46.042924 22830 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:46.045367 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.040676 30949 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.046814 30949 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:46.047284 30949 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.047739 30949 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:46.049360 22830 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:46.056840 31000 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.057808 31000 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.058646 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:46.060850 22162 consensus_peers.cc:597] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:46.069473 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:46.036446 30957 raft_consensus.cc:515] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.075083 30957 leader_election.cc:290] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.076792 31000 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:46.089867 22162 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:46.091820 31011 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:46.091995 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 69297.4us
W20260709 12:13:46.095058 22236 leader_election.cc:336] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:46.116320 30983 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.117241 30983 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.121836 30949 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.125946 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:46.126622 22269 raft_consensus.cc:3060] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:46.131479 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:46.131700 30983 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.135282 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:46.136823 22236 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:46.138950 22236 leader_election.cc:336] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:46.139603 22270 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:46.141350 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.142675 30983 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:46.146270 30957 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.147500 30957 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.149901 30957 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.150621 30983 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.151225 30983 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:46.157419 22269 raft_consensus.cc:2468] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 26.
I20260709 12:13:46.161338 22163 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.161964 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a694c1edf6f4d74a37990fe7e53a6af" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:46.161811 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907dafb5bddd48fdbc0a660020256df1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:46.162868 22190 raft_consensus.cc:3060] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:46.160424 30949 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.164397 31011 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.167711 31011 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.170301 31011 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.165010 31000 raft_consensus.cc:2804] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:46.172411 31011 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.173211 31000 raft_consensus.cc:697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 26 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:46.173504 31011 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.174268 31000 consensus_queue.cc:237] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.165693 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:46.176802 22190 raft_consensus.cc:2468] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 25.
I20260709 12:13:46.178145 22189 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:46.175814 31011 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.183529 30999 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
W20260709 12:13:46.184413 22162 leader_election.cc:336] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:46.184899 30999 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.187147 30999 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.189359 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:13:46.192878 22236 leader_election.cc:336] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:46.193715 22236 leader_election.cc:336] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:46.194415 22236 leader_election.cc:336] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:46.185200 22162 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:46.195587 30999 raft_consensus.cc:2749] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:46.197116 22162 consensus_peers.cc:597] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:46.202656 22236 leader_election.cc:304] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:46.203827 30957 raft_consensus.cc:2804] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:46.204375 30957 raft_consensus.cc:697] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 25 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:46.205111 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:46.205300 30957 consensus_queue.cc:237] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:46.208700 22162 connection.cc:769] client connection to 127.20.102.193:39673 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:13:46.209344 22162 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:13:46.209679 30993 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:46.213976 30993 raft_consensus.cc:493] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.214485 30993 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:46.243714 31001 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.244431 31001 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.246827 31001 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.256759 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:46.257550 22269 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 26.
I20260709 12:13:46.260430 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.235464 30949 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.269899 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:46.270750 22192 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:46.277125 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:46.264225 31001 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:46.282271 31001 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.282693 30983 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.294425 22018 catalog_manager.cc:5697] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 25 to 26, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 26 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.282734 31001 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:46.312175 31003 tablet_bootstrap.cc:492] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:46.290372 30949 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.326444 30999 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.327060 30999 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.327503 30949 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.330821 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:46.372367 22019 catalog_manager.cc:5697] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 24 to 25, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 25 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.381253 31003 tablet_bootstrap.cc:492] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:13:46.382328 31003 ts_tablet_manager.cc:1403] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.578s	user 0.049s	sys 0.015s
I20260709 12:13:46.385406 30993 raft_consensus.cc:515] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.387826 30993 leader_election.cc:290] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.385449 30999 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:46.392648 22887 debug-util.cc:398] Leaking SignalData structure 0x7b08003e81a0 after lost signal to thread 20894
W20260709 12:13:46.395728 22887 debug-util.cc:398] Leaking SignalData structure 0x7b080031c9a0 after lost signal to thread 22055
W20260709 12:13:46.397416 22887 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2640 after lost signal to thread 22222
W20260709 12:13:46.399322 22887 debug-util.cc:398] Leaking SignalData structure 0x7b080034f980 after lost signal to thread 22296
W20260709 12:13:46.401186 22887 debug-util.cc:398] Leaking SignalData structure 0x7b080029ab80 after lost signal to thread 22890
I20260709 12:13:46.408686 31025 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.409642 31025 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.414698 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:46.416340 31025 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.417297 31025 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.417919 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:46.418783 22269 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 24.
I20260709 12:13:46.417858 31025 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.421552 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.432276 31025 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.432569 31023 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:46.440104 31023 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.440800 31023 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:46.394244 30957 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.388939 30995 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.406062 30999 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.453625 31028 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.454309 31028 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.454221 31003 raft_consensus.cc:359] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:13:46.455483 31003 raft_consensus.cc:740] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
I20260709 12:13:46.458556 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:46.459182 22269 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:46.450320 30995 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.448980 30957 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.470427 30957 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.464457 30995 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.456224 31003 consensus_queue.cc:260] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:13:46.484331 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0c08f3aeaa409eae4bd1665895337e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:46.485270 22269 raft_consensus.cc:3060] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:46.475606 31002 tablet_bootstrap.cc:492] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:13:46.494947 22162 leader_election.cc:336] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.495529 22162 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:46.496867 31026 raft_consensus.cc:2749] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:46.461525 30983 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:13:46.500993 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:46.503602 31001 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.491883 22163 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
W20260709 12:13:46.496582 22162 consensus_peers.cc:597] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:46.521580 22162 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.480728 31028 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.496543 31003 ts_tablet_manager.cc:1434] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.000s
I20260709 12:13:46.452106 30999 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.538144 31023 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.554507 22269 raft_consensus.cc:2468] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 20.
W20260709 12:13:46.557236 22162 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.557598 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c89655d0564df0b63993d88160eb8e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:46.558218 22271 raft_consensus.cc:3060] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:46.558316 22162 leader_election.cc:336] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.558787 22162 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:46.563817 22162 leader_election.cc:336] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.566329 31024 raft_consensus.cc:2749] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:46.563947 31002 tablet_bootstrap.cc:492] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f: Bootstrap complete.
I20260709 12:13:46.570390 31020 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:46.570609 31002 ts_tablet_manager.cc:1403] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f: Time spent bootstrapping tablet: real 0.764s	user 0.022s	sys 0.044s
I20260709 12:13:46.570942 31020 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.571388 31020 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:46.572028 30999 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.572690 22271 raft_consensus.cc:2468] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 25.
I20260709 12:13:46.573470 31001 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.574455 31002 raft_consensus.cc:359] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:13:46.576125 31002 raft_consensus.cc:740] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 164596fc2efa450581a5b68cad62271f, State: Initialized, Role: LEARNER
W20260709 12:13:46.578109 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:46.551863 31023 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.564386 22162 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:46.563525 22163 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.590188 22269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:46.590993 22269 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:46.588758 22163 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.596524 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f727fa1b2e45f2a0c5ab11ecf61a9e" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:46.597160 22270 raft_consensus.cc:3060] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:46.576992 31002 consensus_queue.cc:260] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: NON_VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: true } }
I20260709 12:13:46.590950 30949 raft_consensus.cc:2749] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:46.592427 31023 raft_consensus.cc:2804] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:46.604270 22207 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-c1fb787db87147b3be49bef974365af1 received from {username='slave'} at 127.0.0.1:37260
I20260709 12:13:46.596184 31001 raft_consensus.cc:2804] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:46.611899 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.631438 22270 raft_consensus.cc:2468] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 27.
I20260709 12:13:46.625082 31001 raft_consensus.cc:697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 25 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:46.626269 30949 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:46.625476 22207 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-c1fb787db87147b3be49bef974365af1 on tablet c1fb787db87147b3be49bef974365af1 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:13:46.625051 31023 raft_consensus.cc:697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:46.638175 31001 consensus_queue.cc:237] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.642645 22163 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.646373 31027 raft_consensus.cc:2804] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:46.646947 31027 raft_consensus.cc:697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 27 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:46.647894 31027 consensus_queue.cc:237] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.634306 30949 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.651540 30949 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:46.655303 22270 raft_consensus.cc:1275] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:46.657167 30999 consensus_queue.cc:1048] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:46.658444 22861 raft_consensus.cc:1217] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
I20260709 12:13:46.675753 31020 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.688138 31023 consensus_queue.cc:237] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.699055 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a466ed4a4d8b45e6bc22f4def613313a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:46.699914 22191 raft_consensus.cc:3060] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:46.700423 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:46.701341 22190 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
I20260709 12:13:46.702590 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:46.703212 22190 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 19.
W20260709 12:13:46.707700 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 86459.1us
I20260709 12:13:46.717191 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:46.718340 31032 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:46.719264 31032 raft_consensus.cc:493] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.719779 31032 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:46.723696 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:46.724694 30957 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:46.733103 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
W20260709 12:13:46.734273 22162 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:46.740752 22162 consensus_peers.cc:597] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:46.743634 22162 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.742853 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:46.744588 22162 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.748220 31002 ts_tablet_manager.cc:1434] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f: Time spent starting tablet: real 0.177s	user 0.013s	sys 0.009s
W20260709 12:13:46.753021 22162 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:46.754277 22162 leader_election.cc:336] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:46.755153 22162 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.762845 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.766384 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.742159 30949 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.781935 22191 raft_consensus.cc:2468] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:46.765874 31011 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:46.772624 30995 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:46.788434 22861 raft_consensus.cc:1217] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 LEARNER]: Deduplicated request from leader. Original: 22.13->[22.14-22.14]   Dedup: 22.14->[]
I20260709 12:13:46.792207 22207 tablet_copy_service.cc:342] P 7d3f536360b444b1886777f4776be22c: Request end of tablet copy session 164596fc2efa450581a5b68cad62271f-37a6582c89c24e6e838bf8ce6d550b23 received from {username='slave'} at 127.0.0.1:37260
I20260709 12:13:46.792824 22207 tablet_copy_service.cc:434] P 7d3f536360b444b1886777f4776be22c: ending tablet copy session 164596fc2efa450581a5b68cad62271f-37a6582c89c24e6e838bf8ce6d550b23 on tablet 37a6582c89c24e6e838bf8ce6d550b23 with peer 164596fc2efa450581a5b68cad62271f
I20260709 12:13:46.794658 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497837e9d32f4d9c809e44f8fabb9d03" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:46.792608 30949 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.795442 22270 raft_consensus.cc:3060] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:46.796527 31020 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:46.799119 30995 raft_consensus.cc:493] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.799650 30995 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:46.805692 22236 consensus_peers.cc:597] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:46.806402 22236 leader_election.cc:336] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.809978 31032 raft_consensus.cc:515] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.811497 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d3fd71ae0648daa990f506abe35c85" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:46.812208 22271 raft_consensus.cc:3060] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:46.826023 22271 raft_consensus.cc:2468] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
I20260709 12:13:46.826550 22270 raft_consensus.cc:2468] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 19.
W20260709 12:13:46.807094 22236 leader_election.cc:336] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:46.829278 22236 leader_election.cc:336] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:46.830502 22236 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.829250 22163 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.831002 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:46.834517 31019 raft_consensus.cc:2804] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:46.835122 31019 raft_consensus.cc:697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:46.837327 31011 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:46.795322 31031 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:46.838604 31031 raft_consensus.cc:493] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.839018 31031 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:46.841035 31019 consensus_queue.cc:237] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:46.842506 22236 consensus_peers.cc:597] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:46.846381 22236 leader_election.cc:336] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.857136 22163 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.858112 31020 raft_consensus.cc:2804] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:46.858639 31020 raft_consensus.cc:697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:46.859519 31020 consensus_queue.cc:237] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:46.868986 22830 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:46.871670 22236 leader_election.cc:304] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:46.872107 22830 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:46.872864 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:46.812309 31032 leader_election.cc:290] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.881500 22189 raft_consensus.cc:1275] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:46.883863 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f011a3d3cd4ee8ba13b1e9bfd25e6a" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:46.884539 22191 raft_consensus.cc:3060] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:46.880896 30993 raft_consensus.cc:2804] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:46.892263 30993 raft_consensus.cc:697] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:46.893324 30993 consensus_queue.cc:237] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.899423 31031 raft_consensus.cc:515] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.900108 22021 catalog_manager.cc:5697] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 24 to 25, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 25 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.902998 31031 leader_election.cc:290] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.902135 22021 catalog_manager.cc:5697] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 19 to 20, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 20 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:46.909212 22162 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.907101 22191 raft_consensus.cc:2468] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:46.904878 31028 consensus_queue.cc:1048] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
W20260709 12:13:46.918239 22162 consensus_peers.cc:597] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:46.918931 22162 leader_election.cc:336] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.909327 22021 catalog_manager.cc:5697] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 26 to 27, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 27 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.922029 22236 leader_election.cc:304] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:46.923128 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97f4392fa434ad9bf2e7d3e78bfdf4c" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:46.924044 22191 raft_consensus.cc:3060] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:46.935314 31031 raft_consensus.cc:2804] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:46.938030 31031 raft_consensus.cc:697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:46.938990 31031 consensus_queue.cc:237] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.939360 30995 raft_consensus.cc:515] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.949973 22191 raft_consensus.cc:2468] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:46.951625 22236 leader_election.cc:304] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:46.952461 30993 raft_consensus.cc:2804] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:46.953105 30993 raft_consensus.cc:697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:46.954097 30993 consensus_queue.cc:237] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.961799 30995 leader_election.cc:290] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.961083 22018 catalog_manager.cc:5697] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 20 to 21, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 21 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.965106 30995 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:46.965727 30995 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:46.968060 30995 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:46.971679 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:46.971757 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6109e5c745bb4d53948d7f39ab4cf4ec" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:46.972642 22192 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:13:46.972695 22190 raft_consensus.cc:3060] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:46.987859 22236 leader_election.cc:336] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:46.989518 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:47.007910 22190 raft_consensus.cc:2468] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 20.
I20260709 12:13:46.969684 30995 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:47.001470 31020 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:47.013356 22236 leader_election.cc:304] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:47.020987 31001 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:47.023384 31001 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:47.025652 31001 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:47.029002 30994 raft_consensus.cc:2804] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:47.029621 30994 raft_consensus.cc:697] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:47.030525 30994 consensus_queue.cc:237] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:47.034106 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:47.020216 30995 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:47.037983 22270 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 26.
I20260709 12:13:47.039108 30995 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:47.010190 31032 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:47.021879 31020 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:47.049245 31032 raft_consensus.cc:493] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:47.054150 31032 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:47.077677 22236 leader_election.cc:336] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:47.078652 22236 leader_election.cc:336] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:47.079295 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:47.080055 22192 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 26.
I20260709 12:13:47.095530 22163 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:47.096551 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:13:47.097214 22265 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 17.
I20260709 12:13:47.097304 30949 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:47.097886 30949 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:47.098312 30949 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:47.102754 31001 raft_consensus.cc:1064] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
I20260709 12:13:47.102840 31020 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:47.105031 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:13:47.107034 30999 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:13:47.105706 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:47.107435 30999 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:47.107810 30999 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:47.113652 22162 consensus_peers.cc:597] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:47.112957 22018 catalog_manager.cc:5697] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 18 to 19, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 19 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:47.114354 22162 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:47.117594 22236 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:47.121030 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:47.123641 31001 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:47.128823 22018 catalog_manager.cc:5697] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 18 to 19, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 19 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.151746 22269 raft_consensus.cc:1275] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:47.172396 31019 consensus_queue.cc:1048] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:47.175836 31032 raft_consensus.cc:515] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:47.178037 31032 leader_election.cc:290] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:13:47.198567 22265 raft_consensus.cc:1275] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:47.151055 31029 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:47.202358 22270 raft_consensus.cc:1275] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:47.202194 31027 consensus_queue.cc:1048] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:47.202384 31029 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting leader election (detected failure of leader ea51e825f0ab4ea2bb6c4d0e29709ca3)
I20260709 12:13:47.204577 31029 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:47.205926 22162 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:47.179379 30999 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:47.210661 30999 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:47.221078 31019 consensus_queue.cc:1048] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:13:47.223529 22162 consensus_peers.cc:597] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:47.224102 22162 consensus_peers.cc:597] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:47.224193 30949 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:47.226732 22270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c953802abd84140ba6c6a85dcdbf124" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:47.226661 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60967fd8cf404b7bb1b9f9c03875f4f3" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:47.227375 22270 raft_consensus.cc:3060] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:47.227438 22189 raft_consensus.cc:3060] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:47.235687 22189 raft_consensus.cc:2468] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
W20260709 12:13:47.240450 22162 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:47.250146 30983 raft_consensus.cc:1064] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: attempting to promote NON_VOTER 164596fc2efa450581a5b68cad62271f to VOTER
W20260709 12:13:47.253412 22236 leader_election.cc:336] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:47.254004 22236 consensus_peers.cc:597] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:47.216354 22021 catalog_manager.cc:5697] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 19 to 20, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 20 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.258420 22270 raft_consensus.cc:2468] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3f536360b444b1886777f4776be22c in term 18.
I20260709 12:13:47.257885 22021 catalog_manager.cc:5697] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 19 to 20, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 20 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.259873 22163 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:47.254833 22236 leader_election.cc:304] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:47.247510 31029 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:47.265480 31032 raft_consensus.cc:2804] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:47.266016 31032 raft_consensus.cc:697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:47.266867 31032 consensus_queue.cc:237] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:47.259964 22021 catalog_manager.cc:5697] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 19 to 20, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 20 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.274294 31027 raft_consensus.cc:2804] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:47.274847 30983 consensus_queue.cc:237] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:47.291323 22270 raft_consensus.cc:1275] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:13:47.293244 31025 consensus_queue.cc:1048] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:47.282562 31027 raft_consensus.cc:697] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Becoming Leader. State: Replica: 7d3f536360b444b1886777f4776be22c, State: Running, Role: LEADER
I20260709 12:13:47.297526 31027 consensus_queue.cc:237] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:13:47.313118 20891 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22144)
W20260709 12:13:47.314967 22162 consensus_peers.cc:597] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:47.358122 22163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:38085, user_credentials={real_user=slave}} blocked reactor thread for 45131.7us
I20260709 12:13:47.383183 22269 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:47.393711 22189 raft_consensus.cc:1275] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:47.398839 22865 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:47.381834 30949 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:13:47.407349 22271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "7d3f536360b444b1886777f4776be22c" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e"
I20260709 12:13:47.411876 22271 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d3f536360b444b1886777f4776be22c in current term 27: Already voted for candidate cc9b9c8894084021a0c6ddaf659d222e in this term.
I20260709 12:13:47.421027 31020 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:13:47.425437 31055 log.cc:927] Time spent T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:13:47.428020 22162 consensus_peers.cc:597] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:47.432471 22270 raft_consensus.cc:1275] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:47.433185 31025 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:47.440258 31029 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:47.448880 22162 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:47.449723 22236 consensus_peers.cc:597] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:47.452673 31001 consensus_queue.cc:1048] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:13:47.459676 22236 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:47.460481 22236 consensus_peers.cc:597] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:47.461143 22236 consensus_peers.cc:597] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:47.449671 22162 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d3f536360b444b1886777f4776be22c; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:13:47.470656 22162 consensus_peers.cc:597] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:47.471410 22162 consensus_peers.cc:597] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:47.473054 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:47.475237 22189 raft_consensus.cc:2393] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9b9c8894084021a0c6ddaf659d222e in current term 27: Already voted for candidate 7d3f536360b444b1886777f4776be22c in this term.
I20260709 12:13:47.491504 31001 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:47.415114 31032 consensus_queue.cc:1048] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
W20260709 12:13:47.512548 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:47.521886 22236 consensus_peers.cc:597] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:47.522375 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 59579.3us
I20260709 12:13:47.535162 22021 catalog_manager.cc:5697] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c reported cstate change: term changed from 17 to 18, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to 7d3f536360b444b1886777f4776be22c (127.20.102.194). New cstate: current_term: 18 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.539917 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:47.552937 22189 raft_consensus.cc:1275] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:13:47.550848 30993 raft_consensus.cc:2749] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:47.557103 22265 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:47.561165 22861 raft_consensus.cc:1275] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 LEARNER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:47.562953 22189 raft_consensus.cc:1275] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:47.565497 30999 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:47.617970 31057 consensus_queue.cc:1048] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:47.629359 30993 consensus_queue.cc:1048] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:13:47.631045 30993 consensus_queue.cc:1048] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:47.633710 31024 raft_consensus.cc:2955] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:13:47.649221 22162 consensus_peers.cc:597] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:47.650672 22162 consensus_peers.cc:597] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:47.652760 22269 raft_consensus.cc:2955] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:47.657310 22018 catalog_manager.cc:5697] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 21 to 22, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 22 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.661509 22189 raft_consensus.cc:1275] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:13:47.656147 22236 consensus_peers.cc:597] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:47.673712 22236 consensus_peers.cc:597] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:47.685153 22162 consensus_peers.cc:597] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:47.720424 22162 consensus_peers.cc:597] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:47.720743 31032 consensus_queue.cc:1048] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:13:47.734069 22236 consensus_peers.cc:597] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:47.737253 22270 raft_consensus.cc:1275] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:13:47.739110 31057 consensus_queue.cc:1048] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:47.751827 30999 raft_consensus.cc:2955] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:47.772713 22861 raft_consensus.cc:2955] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:13:47.778661 22236 consensus_peers.cc:597] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:47.777737 22865 raft_consensus.cc:2955] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:13:47.794209 22236 consensus_peers.cc:597] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:47.800483 22236 consensus_peers.cc:597] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:47.815052 22021 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 14 to 15, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:47.836760 22270 raft_consensus.cc:2955] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:47.855427 22189 raft_consensus.cc:1275] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:47.869251 31032 consensus_queue.cc:1048] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:13:47.872725 22162 consensus_peers.cc:597] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:47.893652 22019 catalog_manager.cc:5697] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: config changed from index 14 to 15, 164596fc2efa450581a5b68cad62271f (127.20.102.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:13:47.905689 22236 consensus_peers.cc:597] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:48.008997 22191 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:13:48.017091 22861 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:48.018718 31000 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:48.020519 22269 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Refusing update from remote peer 7d3f536360b444b1886777f4776be22c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:48.022424 31000 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:48.037806 31000 raft_consensus.cc:2955] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:48.041317 22865 raft_consensus.cc:2955] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:48.049537 22269 raft_consensus.cc:2955] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
I20260709 12:13:48.074106 22006 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1fb787db87147b3be49bef974365af1 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:48.107066 22019 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f reported cstate change: config changed from index 15 to 16, VOTER ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) evicted. New cstate: current_term: 21 leader_uuid: "7d3f536360b444b1886777f4776be22c" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } } }
W20260709 12:13:48.116101 22162 consensus_peers.cc:597] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:48.120596 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:48.128988 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:48.162019 22006 catalog_manager.cc:4755] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c1fb787db87147b3be49bef974365af1: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:48.204707 22162 consensus_peers.cc:597] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:48.317176 20891 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22144)
W20260709 12:13:48.528052 22830 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:48.542220 22236 consensus_peers.cc:597] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:48.550917 22830 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:48.620002 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:48.622663 22830 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:48.581869 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 47725.9us
W20260709 12:13:48.625993 22236 consensus_peers.cc:597] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:48.721257 22162 consensus_peers.cc:597] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:48.768340 22162 consensus_peers.cc:597] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:48.769011 22162 consensus_peers.cc:597] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:48.964846 22236 consensus_peers.cc:597] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:48.985693 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:49.012511 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:49.024101 22830 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:13:49.118240 31031 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.119271 31031 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:49.139740 31031 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:49.140877 22236 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:49.145542 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c" is_pre_election: true
I20260709 12:13:49.146639 22191 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 27.
I20260709 12:13:49.156550 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:49.159821 31031 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:49.160367 31031 raft_consensus.cc:493] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.162745 31031 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:49.194509 22830 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:49.233541 22162 consensus_peers.cc:597] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:49.247184 22162 consensus_peers.cc:597] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:13:49.259876 31031 raft_consensus.cc:515] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:49.275841 31031 leader_election.cc:290] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 election: Requested vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:13:49.290383 22236 consensus_peers.cc:597] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:49.297451 22162 consensus_peers.cc:597] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:49.302424 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:13:49.305231 22195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec86d794d1447b58c35b6fb35b481f8" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "7d3f536360b444b1886777f4776be22c"
I20260709 12:13:49.306023 22195 raft_consensus.cc:3060] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:49.318174 20891 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 22144)
W20260709 12:13:49.315673 22236 leader_election.cc:336] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:13:49.383882 22195 raft_consensus.cc:2468] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 28.
W20260709 12:13:49.386379 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:13:49.416399 22236 leader_election.cc:304] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e; no voters: ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:13:49.417793 31031 raft_consensus.cc:2804] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:49.418359 31031 raft_consensus.cc:697] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 28 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:13:49.420516 31031 consensus_queue.cc:237] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:13:49.511650 22021 catalog_manager.cc:5697] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 26 to 28, leader changed from ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 28 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:49.526782 22162 consensus_peers.cc:597] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:49.579523 22162 consensus_peers.cc:597] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:49.584115 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:49.608659 22006 catalog_manager.cc:4755] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c1fb787db87147b3be49bef974365af1: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:49.637714 22162 consensus_peers.cc:597] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:49.673827 22236 consensus_peers.cc:597] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:49.750211 22236 consensus_peers.cc:597] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:49.787760 22162 consensus_peers.cc:597] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:49.789701 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:49.863677 22236 consensus_peers.cc:597] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:49.888610 22236 consensus_peers.cc:597] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:49.987306 22162 consensus_peers.cc:597] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:49.988881 22236 consensus_peers.cc:597] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:49.992090 22236 consensus_peers.cc:597] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:49.992660 22236 consensus_peers.cc:597] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:49.993273 22162 consensus_peers.cc:597] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:50.016820 22236 consensus_peers.cc:597] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:50.027956 22195 raft_consensus.cc:1275] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:50.029667 31031 consensus_queue.cc:1048] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:50.065762 22236 consensus_peers.cc:597] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:50.075520 22162 consensus_peers.cc:597] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:50.112607 22236 consensus_peers.cc:597] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:50.180084 22236 consensus_peers.cc:597] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:50.312463 22162 consensus_peers.cc:597] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:50.318939 20891 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 22144)
W20260709 12:13:50.361939 22162 consensus_peers.cc:597] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:50.395368 22236 consensus_peers.cc:597] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:50.408648 22162 consensus_peers.cc:597] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:50.457952 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:50.606284 22236 consensus_peers.cc:597] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:50.644340 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:50.706892 22162 consensus_peers.cc:597] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:50.777313 22006 catalog_manager.cc:4755] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c1fb787db87147b3be49bef974365af1: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:50.819981 22236 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111) [suppressed 496 similar messages]
W20260709 12:13:50.840704 22162 consensus_peers.cc:597] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:50.956835 22830 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.033654 22830 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.035854 22830 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.084632 22162 consensus_peers.cc:597] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.085516 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.098747 22236 consensus_peers.cc:597] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:51.107015 22162 consensus_peers.cc:597] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.194061 22162 consensus_peers.cc:597] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:51.238754 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.319538 20891 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 22144)
W20260709 12:13:51.373116 22236 consensus_peers.cc:597] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:51.456267 22236 consensus_peers.cc:597] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:51.467837 22236 consensus_peers.cc:597] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:51.674563 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.772395 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.777493 22830 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.817590 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.845327 22830 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.848906 22162 consensus_peers.cc:597] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.863994 22162 consensus_peers.cc:597] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:51.984954 22162 consensus_peers.cc:597] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:51.997010 22162 consensus_peers.cc:597] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.067242 22162 consensus_peers.cc:597] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.081107 22236 consensus_peers.cc:597] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:52.254341 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:52.266392 22162 consensus_peers.cc:597] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.311597 22236 consensus_peers.cc:597] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.313772 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:52.320109 20891 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 22144)
W20260709 12:13:52.323915 22162 consensus_peers.cc:597] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.327273 22236 consensus_peers.cc:597] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.361548 22236 consensus_peers.cc:597] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:52.390625 22162 consensus_peers.cc:597] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.411309 22236 consensus_peers.cc:597] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.418853 22236 consensus_peers.cc:597] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.530305 22236 consensus_peers.cc:597] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.582566 22236 consensus_peers.cc:597] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:52.592455 22236 consensus_peers.cc:597] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:52.614862 22236 consensus_peers.cc:597] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:52.635324 22162 consensus_peers.cc:597] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:52.637406 22236 consensus_peers.cc:597] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:52.660447 22162 consensus_peers.cc:597] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:52.783113 22162 consensus_peers.cc:597] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.872351 22162 consensus_peers.cc:597] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:52.949002 22006 catalog_manager.cc:4755] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c1fb787db87147b3be49bef974365af1: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:52.985041 22236 consensus_peers.cc:597] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:53.082639 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.091552 22162 consensus_peers.cc:597] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:53.164103 22830 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.180721 22162 consensus_peers.cc:597] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.257295 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.320680 20891 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 22144)
W20260709 12:13:53.345216 22162 consensus_peers.cc:597] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.374282 22830 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.401835 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.578096 22162 consensus_peers.cc:597] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.606647 22162 consensus_peers.cc:597] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.698796 22162 consensus_peers.cc:597] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:53.718094 22830 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.819478 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.166754 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.234915 22830 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.290860 22236 consensus_peers.cc:597] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:54.297564 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.321317 20891 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 22144)
W20260709 12:13:54.336041 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.381110 22162 consensus_peers.cc:597] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:54.405680 22162 consensus_peers.cc:597] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:54.411341 22236 consensus_peers.cc:597] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:54.421993 22162 consensus_peers.cc:597] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.451751 22162 consensus_peers.cc:597] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.532164 22830 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.610291 22236 consensus_peers.cc:597] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:54.707139 22162 consensus_peers.cc:597] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:54.707670 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.708739 22236 consensus_peers.cc:597] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:54.810446 22236 consensus_peers.cc:597] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:54.820251 22162 consensus_peers.cc:597] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:54.847335 22162 consensus_peers.cc:597] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:54.958788 22162 consensus_peers.cc:597] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:55.011070 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:55.102746 22162 consensus_peers.cc:597] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:55.103389 22162 consensus_peers.cc:597] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:55.149210 22236 consensus_peers.cc:597] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:55.241869 22236 consensus_peers.cc:597] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:55.322072 20891 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 22144)
W20260709 12:13:55.402375 22162 consensus_peers.cc:597] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:55.404155 22236 consensus_peers.cc:597] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:55.474952 22162 consensus_peers.cc:597] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:55.506402 22236 consensus_peers.cc:597] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:55.516893 22236 consensus_peers.cc:597] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:55.539088 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:55.568192 22236 consensus_peers.cc:597] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:55.587364 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:55.596802 22236 consensus_peers.cc:597] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:55.630077 22236 consensus_peers.cc:597] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:55.633508 22236 consensus_peers.cc:597] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:55.788444 22236 consensus_peers.cc:597] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:55.799315 22162 consensus_peers.cc:597] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:55.822876 22830 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111) [suppressed 462 similar messages]
W20260709 12:13:55.903728 22236 consensus_peers.cc:597] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:55.937142 22830 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:55.961016 22162 consensus_peers.cc:597] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:55.988926 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:56.080854 22162 consensus_peers.cc:597] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:56.095290 22830 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:56.132604 22830 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:56.316886 22162 consensus_peers.cc:597] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:56.322564 20891 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 22144)
W20260709 12:13:56.338989 22162 consensus_peers.cc:597] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:56.343995 22236 consensus_peers.cc:597] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:56.357430 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:56.415881 22162 consensus_peers.cc:597] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:56.577572 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:36735, user_credentials={real_user=slave}} blocked reactor thread for 77093.4us
W20260709 12:13:56.582367 22236 consensus_peers.cc:597] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:56.619192 22162 consensus_peers.cc:597] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:56.682664 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:56.715090 22162 consensus_peers.cc:597] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:56.745648 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:56.942914 22162 consensus_peers.cc:597] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:56.963908 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:57.019169 22830 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:57.053984 22830 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:57.057265 22236 consensus_peers.cc:597] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:57.114410 22006 catalog_manager.cc:4755] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c1fb787db87147b3be49bef974365af1: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:13:57.188831 22236 consensus_peers.cc:597] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:57.191584 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:57.268006 22236 consensus_peers.cc:597] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:57.297766 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:57.307096 22162 consensus_peers.cc:597] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:57.315732 22162 consensus_peers.cc:597] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:57.307760 22236 consensus_peers.cc:597] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:57.323115 20891 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 22144)
W20260709 12:13:57.391374 22162 consensus_peers.cc:597] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:57.573421 22162 consensus_peers.cc:597] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:57.592352 22162 consensus_peers.cc:597] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:57.624984 22162 consensus_peers.cc:597] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:57.686491 22236 consensus_peers.cc:597] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:57.728113 22236 consensus_peers.cc:597] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:57.859871 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:57.949577 22236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 59924.3us
W20260709 12:13:58.048431 22162 consensus_peers.cc:597] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:58.116243 22162 consensus_peers.cc:597] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:58.131531 22236 consensus_peers.cc:597] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:58.136430 22236 consensus_peers.cc:597] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:58.138319 22162 consensus_peers.cc:597] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:58.148973 22236 consensus_peers.cc:597] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:58.155648 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:58.172758 22162 consensus_peers.cc:597] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:58.188573 22236 consensus_peers.cc:597] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:58.339895 22162 consensus_peers.cc:597] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:58.351557 22236 consensus_peers.cc:597] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:58.357043 22236 consensus_peers.cc:597] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:58.404460 22236 consensus_peers.cc:597] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:58.487826 22236 consensus_peers.cc:597] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:58.631538 22236 consensus_peers.cc:597] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:58.658248 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 69664.1us
W20260709 12:13:58.665568 22830 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:58.754480 22162 consensus_peers.cc:597] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:58.755295 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:58.813902 22830 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:58.825857 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:58.826567 22830 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:58.882452 22162 consensus_peers.cc:597] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:58.912998 22236 consensus_peers.cc:597] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:58.913777 22162 consensus_peers.cc:597] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:58.982225 22162 consensus_peers.cc:597] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:58.991355 20891 tablet_server.cc:196] TabletServer@127.20.102.193:0 shutdown complete.
W20260709 12:13:59.140067 22162 consensus_peers.cc:597] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:59.221006 22162 consensus_peers.cc:597] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:59.238890 22162 consensus_peers.cc:597] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:13:59.260071 20891 tablet_server.cc:179] TabletServer@127.20.102.194:0 shutting down...
W20260709 12:13:59.262544 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:59.278077 22830 consensus_peers.cc:597] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.299235 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:59.306485 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.308909 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.321931 22236 consensus_peers.cc:597] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:59.328747 22830 consensus_peers.cc:597] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.331693 22236 consensus_peers.cc:597] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.332472 22236 consensus_peers.cc:597] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.337841 22830 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:59.345952 22236 consensus_peers.cc:597] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.346905 22236 consensus_peers.cc:597] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.347570 22236 consensus_peers.cc:597] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.350102 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.359071 22830 consensus_peers.cc:597] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.374836 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.436522 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:13:59.439199 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:59.440495 20891 tablet_replica.cc:333] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.441756 20891 raft_consensus.cc:2243] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.442999 20891 raft_consensus.cc:2272] T 6a694c1edf6f4d74a37990fe7e53a6af P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.448170 20891 tablet_replica.cc:333] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.450616 20891 raft_consensus.cc:2243] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.451474 20891 raft_consensus.cc:2272] T 863b392474d94720808349fe27669b5b P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.460594 20891 tablet_replica.cc:333] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.461915 20891 raft_consensus.cc:2243] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.462716 20891 raft_consensus.cc:2272] T 575c887e89834da7b6e222b41a19b692 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:59.457669 22236 consensus_peers.cc:597] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.466223 20891 tablet_replica.cc:333] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.467140 20891 raft_consensus.cc:2243] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.468016 20891 raft_consensus.cc:2272] T 4c6c5fdc849b4d1b8df5ffb293137964 P 7d3f536360b444b1886777f4776be22c [term 31 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:59.471369 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.480581 22236 consensus_peers.cc:597] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.483117 20891 tablet_replica.cc:333] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.484238 20891 raft_consensus.cc:2243] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.485077 20891 raft_consensus.cc:2272] T a8f422c5da2840e0b466894312ebcd44 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.487833 20891 tablet_replica.cc:333] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
W20260709 12:13:59.488360 22830 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:13:59.488790 20891 raft_consensus.cc:2243] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.494424 20891 raft_consensus.cc:2272] T 69f06d3e4d31493d8aa24b2983f369fe P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.497081 20891 tablet_replica.cc:333] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.497946 20891 raft_consensus.cc:2243] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.499133 20891 raft_consensus.cc:2272] T 9726d3fa41c64b6184468cabcb37dd5a P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:59.490052 22236 consensus_peers.cc:597] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.493306 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.501699 22830 consensus_peers.cc:597] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.502288 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.503829 20891 tablet_replica.cc:333] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.504522 20891 raft_consensus.cc:2243] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.505626 20891 raft_consensus.cc:2272] T 5063e8815c77400bb77029ed9db742c1 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.507993 20891 tablet_replica.cc:333] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.508682 20891 raft_consensus.cc:2243] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.509670 20891 raft_consensus.cc:2272] T f0f94aa1b7ea46adad8a5d877b78cef9 P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.512686 20891 tablet_replica.cc:333] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.514319 20891 raft_consensus.cc:2243] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.515686 20891 raft_consensus.cc:2272] T 907dafb5bddd48fdbc0a660020256df1 P 7d3f536360b444b1886777f4776be22c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.518767 20891 tablet_replica.cc:333] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.519675 20891 raft_consensus.cc:2243] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.521114 20891 raft_consensus.cc:2272] T 43c89655d0564df0b63993d88160eb8e P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.524926 20891 tablet_replica.cc:333] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.525736 20891 raft_consensus.cc:2243] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.527128 20891 raft_consensus.cc:2272] T 68d3fd71ae0648daa990f506abe35c85 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.532634 20891 tablet_replica.cc:333] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.533699 20891 raft_consensus.cc:2243] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.534446 20891 raft_consensus.cc:2272] T d97f4392fa434ad9bf2e7d3e78bfdf4c P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.540092 20891 tablet_replica.cc:333] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.541034 20891 raft_consensus.cc:2243] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.541738 20891 raft_consensus.cc:2272] T 9911e3b1b2f64b93b2ad9740ea9810bc P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.560940 20891 tablet_replica.cc:333] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.561909 20891 raft_consensus.cc:2243] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.562680 20891 raft_consensus.cc:2272] T a466ed4a4d8b45e6bc22f4def613313a P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.567595 20891 tablet_replica.cc:333] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.568403 20891 raft_consensus.cc:2243] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.569096 20891 raft_consensus.cc:2272] T 180ca53d6ccc4c27a39b8000ee3b67ff P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.571621 20891 tablet_replica.cc:333] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.572415 20891 raft_consensus.cc:2243] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.573586 20891 raft_consensus.cc:2272] T 6d0c08f3aeaa409eae4bd1665895337e P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.576551 20891 tablet_replica.cc:333] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.577353 20891 raft_consensus.cc:2243] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.577922 20891 raft_consensus.cc:2272] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:59.579762 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.580662 20891 tablet_replica.cc:333] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.581492 20891 raft_consensus.cc:2243] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.582094 20891 raft_consensus.cc:2272] T 44711cbd4d234e36807a94726a691570 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.584698 20891 tablet_replica.cc:333] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.585659 20891 raft_consensus.cc:2243] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.586872 20891 raft_consensus.cc:2272] T 9255592b74304240a5fa1df814fbb726 P 7d3f536360b444b1886777f4776be22c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.591739 20891 tablet_replica.cc:333] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.592585 20891 raft_consensus.cc:2243] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.594426 20891 raft_consensus.cc:2272] T 37a6582c89c24e6e838bf8ce6d550b23 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.597525 20891 tablet_replica.cc:333] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.598377 20891 raft_consensus.cc:2243] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.599303 20891 raft_consensus.cc:2272] T 2f0832297a8d44da9dba2792bf6c4c35 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:59.599874 22236 consensus_peers.cc:597] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:59.602334 20891 tablet_replica.cc:333] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.603193 20891 raft_consensus.cc:2243] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.604453 20891 raft_consensus.cc:2272] T 55006a12f7594727bebe695d1ffbe74f P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.607582 20891 tablet_replica.cc:333] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.608470 20891 raft_consensus.cc:2243] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.609179 20891 raft_consensus.cc:2272] T b4bae45452334273a1c277a0a512021f P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.612376 20891 tablet_replica.cc:333] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.613175 20891 raft_consensus.cc:2243] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.614317 20891 raft_consensus.cc:2272] T 3753b5634bb143e1ab2c70fbe2900044 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.617125 20891 tablet_replica.cc:333] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.617898 20891 raft_consensus.cc:2243] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.618654 20891 raft_consensus.cc:2272] T 8f168c463b75448c945cd40fd0ad742f P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.621356 20891 tablet_replica.cc:333] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.622084 20891 raft_consensus.cc:2243] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.623154 20891 raft_consensus.cc:2272] T 497837e9d32f4d9c809e44f8fabb9d03 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.626940 20891 tablet_replica.cc:333] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.627740 20891 raft_consensus.cc:2243] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.629010 20891 raft_consensus.cc:2272] T c1fb787db87147b3be49bef974365af1 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.631856 20891 tablet_replica.cc:333] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.632704 20891 raft_consensus.cc:2243] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.633965 20891 raft_consensus.cc:2272] T c4074b27f51549b4bf3fae4c6e734506 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.636838 20891 tablet_replica.cc:333] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.637620 20891 raft_consensus.cc:2243] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.638437 20891 raft_consensus.cc:2272] T 44679affd4554006a2cb59b10b589a27 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.641352 20891 tablet_replica.cc:333] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.642216 20891 raft_consensus.cc:2243] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.642817 20891 raft_consensus.cc:2272] T 60967fd8cf404b7bb1b9f9c03875f4f3 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.663551 20891 tablet_replica.cc:333] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.664371 20891 raft_consensus.cc:2243] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.674479 20891 raft_consensus.cc:2272] T 7f1b154b48c54be6b421b01ed436bf21 P 7d3f536360b444b1886777f4776be22c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.677529 20891 tablet_replica.cc:333] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.678401 20891 raft_consensus.cc:2243] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.679651 20891 raft_consensus.cc:2272] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P 7d3f536360b444b1886777f4776be22c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.683431 20891 tablet_replica.cc:333] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.685257 20891 raft_consensus.cc:2243] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.685876 20891 raft_consensus.cc:2272] T 6109e5c745bb4d53948d7f39ab4cf4ec P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.688560 20891 tablet_replica.cc:333] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.689409 20891 raft_consensus.cc:2243] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.690088 20891 raft_consensus.cc:2272] T 0a461ebb30e94378a21b03f9c6c7a018 P 7d3f536360b444b1886777f4776be22c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.692901 20891 tablet_replica.cc:333] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.693634 20891 raft_consensus.cc:2243] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.694211 20891 raft_consensus.cc:2272] T 4dd2e5184fad402e8f3b26ea46e3c996 P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.696906 20891 tablet_replica.cc:333] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.697630 20891 raft_consensus.cc:2243] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.698859 20891 raft_consensus.cc:2272] T 5c953802abd84140ba6c6a85dcdbf124 P 7d3f536360b444b1886777f4776be22c [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:59.699193 22830 consensus_peers.cc:597] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.696635 22236 consensus_peers.cc:597] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:59.701565 20891 tablet_replica.cc:333] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.702386 20891 raft_consensus.cc:2243] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.703070 20891 raft_consensus.cc:2272] T 8ec86d794d1447b58c35b6fb35b481f8 P 7d3f536360b444b1886777f4776be22c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.705842 20891 tablet_replica.cc:333] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.706630 20891 raft_consensus.cc:2243] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.707268 20891 raft_consensus.cc:2272] T ed4182733145491a94be746238e892f9 P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.709841 20891 tablet_replica.cc:333] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.710525 20891 raft_consensus.cc:2243] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.711362 20891 raft_consensus.cc:2272] T 7fac2244705d40569bd4a6e8161fb5e9 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.714119 20891 tablet_replica.cc:333] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.714838 20891 raft_consensus.cc:2243] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.716008 20891 raft_consensus.cc:2272] T 1f10864c994f49ed830c4951cfadea5e P 7d3f536360b444b1886777f4776be22c [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:59.716488 22162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39673, user_credentials={real_user=slave}} blocked reactor thread for 66802.3us
I20260709 12:13:59.718562 20891 tablet_replica.cc:333] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.719347 20891 raft_consensus.cc:2243] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.719890 20891 raft_consensus.cc:2272] T f86b841ece254f9bbfd1bd07c08f7004 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.723606 20891 tablet_replica.cc:333] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.724365 20891 raft_consensus.cc:2243] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.725001 20891 raft_consensus.cc:2272] T 791f1d0e9076481dad104e8c3b503af8 P 7d3f536360b444b1886777f4776be22c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.727985 20891 tablet_replica.cc:333] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.728894 20891 raft_consensus.cc:2243] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.730157 20891 raft_consensus.cc:2272] T ca8c98b2e5e2428790f3422299acaffb P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.732638 20891 tablet_replica.cc:333] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.733412 20891 raft_consensus.cc:2243] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.733989 20891 raft_consensus.cc:2272] T 6d2d43361a72435b8868d1f3cdb436a3 P 7d3f536360b444b1886777f4776be22c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.736626 20891 tablet_replica.cc:333] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.737543 20891 raft_consensus.cc:2243] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.738821 20891 raft_consensus.cc:2272] T dccbaccd2369440b957f9e2e49c0b59e P 7d3f536360b444b1886777f4776be22c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.741837 20891 tablet_replica.cc:333] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.742622 20891 raft_consensus.cc:2243] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.743924 20891 raft_consensus.cc:2272] T ff2900731305497ebb6cfec2d7557d25 P 7d3f536360b444b1886777f4776be22c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.747370 20891 tablet_replica.cc:333] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.748090 20891 raft_consensus.cc:2243] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.748845 20891 raft_consensus.cc:2272] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.751405 20891 tablet_replica.cc:333] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.752046 20891 raft_consensus.cc:2243] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.752755 20891 raft_consensus.cc:2272] T 54878b51479940bebc76fc9d84de64cb P 7d3f536360b444b1886777f4776be22c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.755295 20891 tablet_replica.cc:333] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c: stopping tablet replica
I20260709 12:13:59.756872 20891 raft_consensus.cc:2243] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.757534 20891 raft_consensus.cc:2272] T 5ea5fe59611e4539abcf87b4fd1a282c P 7d3f536360b444b1886777f4776be22c [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:59.761595 22236 consensus_peers.cc:597] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.765132 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.767074 22236 consensus_peers.cc:597] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.786495 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:59.806866 22236 consensus_peers.cc:597] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.807983 22236 consensus_peers.cc:597] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.830386 22830 consensus_peers.cc:597] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.863436 22236 consensus_peers.cc:597] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:59.882289 22236 connection.cc:769] client connection to 127.20.102.194:36735 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:13:59.883772 22236 consensus_peers.cc:597] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.945231 22236 consensus_peers.cc:597] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.945994 22236 consensus_peers.cc:597] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.954953 22236 consensus_peers.cc:597] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:59.971261 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:00.296552 22236 consensus_peers.cc:597] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:00.331506 22236 consensus_peers.cc:597] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:00.416265 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:00.479568 22236 consensus_peers.cc:597] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:00.565218 22236 consensus_peers.cc:597] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:00.639443 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:14:00.666796 31118 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.669044 31118 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:14:00.673729 22236 consensus_peers.cc:597] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:00.677640 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:14:00.678260 31118 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:14:00.681097 31118 raft_consensus.cc:493] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.682377 31118 raft_consensus.cc:515] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:00.684471 31118 leader_election.cc:290] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:00.681720 22236 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:00.685017 22236 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 164596fc2efa450581a5b68cad62271f, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:14:00.688441 22236 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.690097 31118 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:14:00.692946 22236 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
W20260709 12:14:00.693547 22236 leader_election.cc:336] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:00.693931 22236 leader_election.cc:304] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:00.694515 31118 raft_consensus.cc:2749] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:14:00.725263 31118 raft_consensus.cc:493] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.725809 31118 raft_consensus.cc:515] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:00.733223 31130 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.733881 31130 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:00.728063 31118 leader_election.cc:290] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:00.738205 22236 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:00.738886 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:14:00.741119 31130 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:14:00.738914 22236 consensus_peers.cc:597] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:00.744175 22236 leader_election.cc:336] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.744627 22236 leader_election.cc:304] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
W20260709 12:14:00.744849 22830 leader_election.cc:336] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.745301 22830 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:14:00.745484 31126 raft_consensus.cc:2749] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:14:00.746505 31130 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:14:00.751834 31130 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:14:00.752267 22236 consensus_peers.cc:597] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:00.752358 31130 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:00.758708 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a6582c89c24e6e838bf8ce6d550b23" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
I20260709 12:14:00.759338 22267 raft_consensus.cc:2468] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164596fc2efa450581a5b68cad62271f in term 22.
I20260709 12:14:00.760763 31118 raft_consensus.cc:493] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.761400 31118 raft_consensus.cc:515] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:00.762099 31130 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:14:00.764331 31118 leader_election.cc:290] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:00.765610 22830 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:00.766953 22830 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.767383 22830 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:00.769783 31130 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:14:00.771245 22236 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:00.771932 22236 leader_election.cc:336] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.772011 31118 raft_consensus.cc:493] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.772389 22236 leader_election.cc:304] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:00.773144 31126 raft_consensus.cc:2749] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:00.772697 31118 raft_consensus.cc:515] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:00.775480 31118 leader_election.cc:290] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:00.785116 22236 leader_election.cc:336] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:00.785859 22236 leader_election.cc:336] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.786278 22236 leader_election.cc:304] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:00.786988 31126 raft_consensus.cc:2749] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:14:00.791877 22236 consensus_peers.cc:597] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:00.798786 31126 raft_consensus.cc:493] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.799356 31126 raft_consensus.cc:515] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:00.801605 31126 leader_election.cc:290] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:00.812306 22236 leader_election.cc:336] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:00.813144 22236 leader_election.cc:336] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.813500 22236 leader_election.cc:304] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:00.814134 31126 raft_consensus.cc:2749] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:14:00.828049 31126 raft_consensus.cc:493] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.828576 31126 raft_consensus.cc:515] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:00.830926 31126 leader_election.cc:290] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:00.837984 22236 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111) [suppressed 549 similar messages]
W20260709 12:14:00.840992 22236 leader_election.cc:336] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
W20260709 12:14:00.842073 22236 leader_election.cc:336] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:00.845091 22236 leader_election.cc:304] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:00.845752 31126 raft_consensus.cc:2749] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:14:00.873303 31126 raft_consensus.cc:493] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.873893 31126 raft_consensus.cc:515] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:00.875911 31126 leader_election.cc:290] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:14:00.879136 31126 raft_consensus.cc:493] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.881433 31126 raft_consensus.cc:515] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
W20260709 12:14:00.884243 22236 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:00.885103 22236 leader_election.cc:336] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.885725 22236 leader_election.cc:304] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:00.885982 31126 leader_election.cc:290] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:14:00.886543 31118 raft_consensus.cc:2749] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:14:00.895239 22236 leader_election.cc:336] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:00.895833 22236 leader_election.cc:336] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.896148 22236 leader_election.cc:304] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:00.897598 31118 raft_consensus.cc:2749] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:14:00.899122 31130 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.899794 31130 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:00.902148 31130 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:14:00.904155 22267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "164596fc2efa450581a5b68cad62271f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cc9b9c8894084021a0c6ddaf659d222e" is_pre_election: true
W20260709 12:14:00.906330 22830 leader_election.cc:336] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.907078 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:14:00.908123 31130 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:14:00.926044 22236 consensus_peers.cc:597] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:00.932248 31118 raft_consensus.cc:493] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.933112 31118 raft_consensus.cc:515] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:00.935397 31118 leader_election.cc:290] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:14:00.938858 31118 raft_consensus.cc:493] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.939551 31118 raft_consensus.cc:515] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:00.941527 31118 leader_election.cc:290] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:00.944308 22236 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
W20260709 12:14:00.948328 22236 leader_election.cc:336] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:00.948832 22236 leader_election.cc:304] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:00.949790 31118 raft_consensus.cc:2749] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:00.949942 22236 leader_election.cc:336] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:00.950863 22236 leader_election.cc:336] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.951244 22236 leader_election.cc:304] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:00.951963 31118 raft_consensus.cc:2749] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:14:00.981910 31118 raft_consensus.cc:493] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:00.982596 31118 raft_consensus.cc:515] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:00.985018 31118 leader_election.cc:290] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:00.994735 22236 leader_election.cc:336] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:00.995651 22236 leader_election.cc:336] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:00.996050 22236 leader_election.cc:304] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:00.997200 31126 raft_consensus.cc:2749] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:01.000563 31126 raft_consensus.cc:493] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:01.001080 31126 raft_consensus.cc:515] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:01.003046 31126 leader_election.cc:290] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:01.011456 22236 consensus_peers.cc:597] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:01.017223 22236 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:01.017921 22236 leader_election.cc:336] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:01.018323 22236 leader_election.cc:304] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:01.019038 31118 raft_consensus.cc:2749] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:14:01.028805 31118 raft_consensus.cc:493] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:01.029383 31118 raft_consensus.cc:515] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:01.031320 31118 leader_election.cc:290] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:01.038146 22236 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:01.040127 22236 leader_election.cc:336] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:01.040505 22236 leader_election.cc:304] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:01.044167 31118 raft_consensus.cc:2749] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:14:01.047084 31118 raft_consensus.cc:493] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:01.047575 31118 raft_consensus.cc:515] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:01.054026 31118 leader_election.cc:290] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:01.068060 22236 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
W20260709 12:14:01.069128 22236 leader_election.cc:336] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:01.069588 22236 leader_election.cc:304] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:01.070755 31118 raft_consensus.cc:2749] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:14:01.074990 31126 raft_consensus.cc:493] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:01.075567 31126 raft_consensus.cc:515] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:01.077702 31126 leader_election.cc:290] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:14:01.077370 31142 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:01.081072 31142 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:01.084862 31142 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:14:01.086588 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:14:01.087452 22860 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 17.
I20260709 12:14:01.089082 22237 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:14:01.090032 31141 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:14:01.090488 31141 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:01.090904 31141 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:14:01.108515 22830 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:14:01.114761 31142 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:14:01.115448 22236 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:01.115743 31142 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:01.118414 31118 raft_consensus.cc:493] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
W20260709 12:14:01.119002 22236 leader_election.cc:336] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:01.118901 31118 raft_consensus.cc:515] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:01.119429 22236 leader_election.cc:304] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:01.120114 31126 raft_consensus.cc:2749] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:01.121457 22236 leader_election.cc:336] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:01.121906 31118 leader_election.cc:290] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
I20260709 12:14:01.125114 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f" is_pre_election: true
I20260709 12:14:01.125883 22860 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 21.
I20260709 12:14:01.127626 22237 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:14:01.128628 31118 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:14:01.132248 31118 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:01.132866 31118 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:14:01.135793 22236 leader_election.cc:336] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:01.136035 31142 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
W20260709 12:14:01.137072 22236 leader_election.cc:336] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
W20260709 12:14:01.137957 22236 leader_election.cc:336] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:01.138407 22236 leader_election.cc:304] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:01.142725 31142 raft_consensus.cc:2749] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:14:01.112054 31141 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:01.150584 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55006a12f7594727bebe695d1ffbe74f" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:14:01.151460 22860 raft_consensus.cc:3060] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:14:01.156981 31118 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:01.159557 31118 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:14:01.161870 22865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1fb787db87147b3be49bef974365af1" candidate_uuid: "cc9b9c8894084021a0c6ddaf659d222e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "164596fc2efa450581a5b68cad62271f"
I20260709 12:14:01.162715 31141 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Requested vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), 164596fc2efa450581a5b68cad62271f (127.20.102.196:42539)
I20260709 12:14:01.162900 22865 raft_consensus.cc:3060] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:14:01.162254 22860 raft_consensus.cc:2468] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 18.
I20260709 12:14:01.165501 22237 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 
I20260709 12:14:01.166568 31141 raft_consensus.cc:2804] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:14:01.167693 22236 leader_election.cc:336] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:01.167899 31141 raft_consensus.cc:697] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:14:01.169076 31141 consensus_queue.cc:237] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:14:01.171492 22236 leader_election.cc:336] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
W20260709 12:14:01.198227 22236 consensus_peers.cc:597] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:01.199115 22865 raft_consensus.cc:2468] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9b9c8894084021a0c6ddaf659d222e in term 22.
I20260709 12:14:01.200563 22237 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164596fc2efa450581a5b68cad62271f, cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c
I20260709 12:14:01.201975 31141 raft_consensus.cc:2804] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:14:01.202746 31141 raft_consensus.cc:697] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Becoming Leader. State: Replica: cc9b9c8894084021a0c6ddaf659d222e, State: Running, Role: LEADER
I20260709 12:14:01.203759 31141 consensus_queue.cc:237] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:01.203485 22021 catalog_manager.cc:5697] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 17 to 18, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 18 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:01.223404 22830 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:14:01.236294 31118 raft_consensus.cc:493] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:01.237107 31118 raft_consensus.cc:515] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } }
I20260709 12:14:01.243144 31118 leader_election.cc:290] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735)
W20260709 12:14:01.259621 22236 leader_election.cc:336] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:01.260671 22236 leader_election.cc:336] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:01.261181 22236 leader_election.cc:304] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9b9c8894084021a0c6ddaf659d222e; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:01.262045 31118 raft_consensus.cc:2749] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:14:01.284859 22021 catalog_manager.cc:5697] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e reported cstate change: term changed from 21 to 22, leader changed from 7d3f536360b444b1886777f4776be22c (127.20.102.194) to cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195). New cstate: current_term: 22 leader_uuid: "cc9b9c8894084021a0c6ddaf659d222e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:01.332069 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:01.377311 22830 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:01.524706 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:01.600476 22236 consensus_peers.cc:597] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:01.614163 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:01.670889 22830 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:01.689883 22830 consensus_peers.cc:597] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:01.698983 22865 raft_consensus.cc:1275] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:14:01.700577 31118 consensus_queue.cc:1048] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:14:01.748008 22236 consensus_peers.cc:597] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:01.748912 22236 consensus_peers.cc:597] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:01.749488 22236 consensus_peers.cc:597] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:01.765827 22236 consensus_peers.cc:597] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:01.774030 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:01.774773 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:01.780447 22860 raft_consensus.cc:1275] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Refusing update from remote peer cc9b9c8894084021a0c6ddaf659d222e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:14:01.781893 31141 consensus_queue.cc:1048] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:14:01.797740 22236 consensus_peers.cc:597] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:01.818943 22236 consensus_peers.cc:597] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:01.862740 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:01.868683 20891 tablet_server.cc:196] TabletServer@127.20.102.194:0 shutdown complete.
W20260709 12:14:01.873518 22830 consensus_peers.cc:597] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:01.877214 22236 consensus_peers.cc:597] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:01.903565 22236 consensus_peers.cc:597] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:01.930033 22236 consensus_peers.cc:597] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:01.944175 22236 consensus_peers.cc:597] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:01.952240 22236 consensus_peers.cc:597] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:01.990573 20891 tablet_server.cc:179] TabletServer@127.20.102.195:0 shutting down...
W20260709 12:14:01.994691 22830 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:02.005152 22831 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.009065 22830 consensus_peers.cc:597] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:02.009642 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:02.010174 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:02.010898 22831 consensus_peers.cc:597] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.049932 22236 consensus_peers.cc:597] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:02.058107 22831 consensus_peers.cc:597] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.065393 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:02.082645 22831 consensus_peers.cc:597] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.085460 22830 consensus_peers.cc:597] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.087271 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:14:02.088976 22831 consensus_peers.cc:597] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.090034 22236 consensus_peers.cc:597] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.090986 20891 tablet_replica.cc:333] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.091925 20891 raft_consensus.cc:2243] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.093293 20891 raft_consensus.cc:2272] T 575c887e89834da7b6e222b41a19b692 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:02.096356 22831 consensus_peers.cc:597] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:02.097195 20891 tablet_replica.cc:333] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.098299 20891 raft_consensus.cc:2243] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.098992 20891 raft_consensus.cc:2272] T 5063e8815c77400bb77029ed9db742c1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.101996 20891 tablet_replica.cc:333] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.102838 20891 raft_consensus.cc:2243] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.103365 20891 raft_consensus.cc:2272] T 9726d3fa41c64b6184468cabcb37dd5a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.106181 20891 tablet_replica.cc:333] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.106967 20891 raft_consensus.cc:2243] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.108140 20891 raft_consensus.cc:2272] T 6a694c1edf6f4d74a37990fe7e53a6af P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.110927 20891 tablet_replica.cc:333] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.111665 20891 raft_consensus.cc:2243] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.112246 20891 raft_consensus.cc:2272] T ca8c98b2e5e2428790f3422299acaffb P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.115141 20891 tablet_replica.cc:333] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.116075 20891 raft_consensus.cc:2243] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.118052 20891 raft_consensus.cc:2272] T 69f06d3e4d31493d8aa24b2983f369fe P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:02.121519 22831 consensus_peers.cc:597] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:02.121670 20891 tablet_replica.cc:333] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.122845 20891 raft_consensus.cc:2243] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.123719 20891 raft_consensus.cc:2272] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.127072 20891 tablet_replica.cc:333] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.127972 20891 raft_consensus.cc:2243] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:14:02.129628 22830 consensus_peers.cc:597] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.131592 20891 raft_consensus.cc:2272] T d97f4392fa434ad9bf2e7d3e78bfdf4c P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.134737 20891 tablet_replica.cc:333] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.135746 20891 raft_consensus.cc:2243] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:02.135776 22830 consensus_peers.cc:597] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.136415 20891 raft_consensus.cc:2272] T 83a858eff9ef460fa5e0587bb1ea61f9 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.138654 20891 tablet_replica.cc:333] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.139319 20891 raft_consensus.cc:2243] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.140506 20891 raft_consensus.cc:2272] T 9911e3b1b2f64b93b2ad9740ea9810bc P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.142912 20891 tablet_replica.cc:333] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.143592 20891 raft_consensus.cc:2243] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.144558 20891 raft_consensus.cc:2272] T a466ed4a4d8b45e6bc22f4def613313a P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.150579 20891 tablet_replica.cc:333] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.151499 20891 raft_consensus.cc:2243] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.152607 20891 raft_consensus.cc:2272] T 6d0c08f3aeaa409eae4bd1665895337e P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.155149 20891 tablet_replica.cc:333] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.155791 20891 raft_consensus.cc:2243] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.156672 20891 raft_consensus.cc:2272] T a1f011a3d3cd4ee8ba13b1e9bfd25e6a P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.158787 20891 tablet_replica.cc:333] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.159487 20891 raft_consensus.cc:2243] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.160328 20891 raft_consensus.cc:2272] T 8b5facb1c9654266b70a6d04d1e002f2 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.162513 20891 tablet_replica.cc:333] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.163228 20891 raft_consensus.cc:2243] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.163726 20891 raft_consensus.cc:2272] T 68d3fd71ae0648daa990f506abe35c85 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.166061 20891 tablet_replica.cc:333] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.166802 20891 raft_consensus.cc:2243] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.167886 20891 raft_consensus.cc:2272] T 55006a12f7594727bebe695d1ffbe74f P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.171577 20891 tablet_replica.cc:333] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.172327 20891 raft_consensus.cc:2243] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Raft consensus shutting down.
W20260709 12:14:02.172467 22236 consensus_peers.cc:597] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.173564 20891 raft_consensus.cc:2272] T b4bae45452334273a1c277a0a512021f P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.175959 20891 tablet_replica.cc:333] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.176577 20891 raft_consensus.cc:2243] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.177160 20891 raft_consensus.cc:2272] T fc3d186560a74d7e8c4d29066e4e3567 P cc9b9c8894084021a0c6ddaf659d222e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.179416 20891 tablet_replica.cc:333] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.180384 20891 raft_consensus.cc:2243] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.181447 20891 raft_consensus.cc:2272] T 9255592b74304240a5fa1df814fbb726 P cc9b9c8894084021a0c6ddaf659d222e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.184495 20891 tablet_replica.cc:333] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.185511 20891 raft_consensus.cc:2243] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.186923 20891 raft_consensus.cc:2272] T 37a6582c89c24e6e838bf8ce6d550b23 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.191711 20891 tablet_replica.cc:333] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.192610 20891 raft_consensus.cc:2243] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:02.192665 22831 consensus_peers.cc:597] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:02.193550 20891 raft_consensus.cc:2272] T c4074b27f51549b4bf3fae4c6e734506 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.196602 20891 tablet_replica.cc:333] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.197276 20891 raft_consensus.cc:2243] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.198093 20891 raft_consensus.cc:2272] T 8f168c463b75448c945cd40fd0ad742f P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.200328 20891 tablet_replica.cc:333] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.201018 20891 raft_consensus.cc:2243] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.201503 20891 raft_consensus.cc:2272] T 497837e9d32f4d9c809e44f8fabb9d03 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.203738 20891 tablet_replica.cc:333] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.204363 20891 raft_consensus.cc:2243] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.205729 20891 raft_consensus.cc:2272] T c1fb787db87147b3be49bef974365af1 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.208726 20891 tablet_replica.cc:333] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.209371 20891 raft_consensus.cc:2243] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.210602 20891 raft_consensus.cc:2272] T ed4182733145491a94be746238e892f9 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.213618 20891 tablet_replica.cc:333] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.214541 20891 raft_consensus.cc:2243] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.216030 20891 raft_consensus.cc:2272] T 97ce44fb81b642f9ad6b0f0d68e82820 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.219105 20891 tablet_replica.cc:333] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.220060 20891 raft_consensus.cc:2243] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.221243 20891 raft_consensus.cc:2272] T 1baa23cb6635453b9a9cd5ec7e452f6a P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.224342 20891 tablet_replica.cc:333] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.225114 20891 raft_consensus.cc:2243] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.225841 20891 raft_consensus.cc:2272] T 4dd2e5184fad402e8f3b26ea46e3c996 P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.229775 20891 tablet_replica.cc:333] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.230515 20891 raft_consensus.cc:2243] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.231424 20891 raft_consensus.cc:2272] T 5c953802abd84140ba6c6a85dcdbf124 P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.236104 20891 tablet_replica.cc:333] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.236987 20891 raft_consensus.cc:2243] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 28 LEADER]: Raft consensus shutting down.
W20260709 12:14:02.237320 22831 consensus_peers.cc:597] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:02.238255 20891 raft_consensus.cc:2272] T 8ec86d794d1447b58c35b6fb35b481f8 P cc9b9c8894084021a0c6ddaf659d222e [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:02.239934 22830 consensus_peers.cc:597] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.241266 20891 tablet_replica.cc:333] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.242177 20891 raft_consensus.cc:2243] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:02.242617 22830 consensus_peers.cc:597] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.243068 20891 raft_consensus.cc:2272] T 28f727fa1b2e45f2a0c5ab11ecf61a9e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.245944 20891 tablet_replica.cc:333] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.246773 20891 raft_consensus.cc:2243] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.247946 20891 raft_consensus.cc:2272] T 6109e5c745bb4d53948d7f39ab4cf4ec P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:02.250623 22236 consensus_peers.cc:597] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.251036 20891 tablet_replica.cc:333] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.252002 20891 raft_consensus.cc:2243] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.253312 20891 raft_consensus.cc:2272] T 0a461ebb30e94378a21b03f9c6c7a018 P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:02.253803 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.255780 20891 tablet_replica.cc:333] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.256458 20891 raft_consensus.cc:2243] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.257078 20891 raft_consensus.cc:2272] T 1f10864c994f49ed830c4951cfadea5e P cc9b9c8894084021a0c6ddaf659d222e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.259785 20891 tablet_replica.cc:333] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.260571 20891 raft_consensus.cc:2243] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.261157 20891 raft_consensus.cc:2272] T f86b841ece254f9bbfd1bd07c08f7004 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.263844 20891 tablet_replica.cc:333] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.264643 20891 raft_consensus.cc:2243] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.265231 20891 raft_consensus.cc:2272] T 791f1d0e9076481dad104e8c3b503af8 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.267457 20891 tablet_replica.cc:333] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.268038 20891 raft_consensus.cc:2243] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.268750 20891 raft_consensus.cc:2272] T 3753b5634bb143e1ab2c70fbe2900044 P cc9b9c8894084021a0c6ddaf659d222e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.271307 20891 tablet_replica.cc:333] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.271925 20891 raft_consensus.cc:2243] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.272876 20891 raft_consensus.cc:2272] T 011db458534b4bc8876e63453a07b86b P cc9b9c8894084021a0c6ddaf659d222e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.274950 20891 tablet_replica.cc:333] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.275652 20891 raft_consensus.cc:2243] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.276254 20891 raft_consensus.cc:2272] T dccbaccd2369440b957f9e2e49c0b59e P cc9b9c8894084021a0c6ddaf659d222e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.278302 20891 tablet_replica.cc:333] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.278870 20891 raft_consensus.cc:2243] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.279657 20891 raft_consensus.cc:2272] T 8d6f694768d144aa85616d8c7b2453f0 P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.281648 20891 tablet_replica.cc:333] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.282163 20891 raft_consensus.cc:2243] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.282703 20891 raft_consensus.cc:2272] T 907dafb5bddd48fdbc0a660020256df1 P cc9b9c8894084021a0c6ddaf659d222e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.284655 20891 tablet_replica.cc:333] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.285218 20891 raft_consensus.cc:2243] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.285742 20891 raft_consensus.cc:2272] T 43c89655d0564df0b63993d88160eb8e P cc9b9c8894084021a0c6ddaf659d222e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.287612 20891 tablet_replica.cc:333] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.288174 20891 raft_consensus.cc:2243] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.288683 20891 raft_consensus.cc:2272] T f3728a188c254ff78ba0aff2361f13e3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.290764 20891 tablet_replica.cc:333] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.291298 20891 raft_consensus.cc:2243] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.292131 20891 raft_consensus.cc:2272] T 60967fd8cf404b7bb1b9f9c03875f4f3 P cc9b9c8894084021a0c6ddaf659d222e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.294168 20891 tablet_replica.cc:333] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.294723 20891 raft_consensus.cc:2243] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.295835 20891 raft_consensus.cc:2272] T 6d2d43361a72435b8868d1f3cdb436a3 P cc9b9c8894084021a0c6ddaf659d222e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.298197 20891 tablet_replica.cc:333] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.298935 20891 raft_consensus.cc:2243] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.299904 20891 raft_consensus.cc:2272] T f0f94aa1b7ea46adad8a5d877b78cef9 P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.302515 20891 tablet_replica.cc:333] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.303025 20891 raft_consensus.cc:2243] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.303519 20891 raft_consensus.cc:2272] T ff2900731305497ebb6cfec2d7557d25 P cc9b9c8894084021a0c6ddaf659d222e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.305676 20891 tablet_replica.cc:333] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.306337 20891 raft_consensus.cc:2243] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:14:02.307205 20891 raft_consensus.cc:2272] T f5d4cdb3f6584a3d98a8736d0f93ddaf P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.309621 20891 tablet_replica.cc:333] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.310220 20891 raft_consensus.cc:2243] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.310835 20891 raft_consensus.cc:2272] T 54878b51479940bebc76fc9d84de64cb P cc9b9c8894084021a0c6ddaf659d222e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:02.312951 20891 tablet_replica.cc:333] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e: stopping tablet replica
I20260709 12:14:02.313448 20891 raft_consensus.cc:2243] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:02.313925 20891 raft_consensus.cc:2272] T 5ea5fe59611e4539abcf87b4fd1a282c P cc9b9c8894084021a0c6ddaf659d222e [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:02.337371 22830 consensus_peers.cc:597] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:02.357969 22831 consensus_peers.cc:597] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.390514 22830 consensus_peers.cc:597] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:02.420529 22831 consensus_peers.cc:597] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f -> Peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Couldn't send request to peer cc9b9c8894084021a0c6ddaf659d222e. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.195:38085: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.437006 22830 consensus_peers.cc:597] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f -> Peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Couldn't send request to peer 7d3f536360b444b1886777f4776be22c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:02.507668 22830 consensus_peers.cc:597] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:14:02.708310 31120 raft_consensus.cc:493] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7d3f536360b444b1886777f4776be22c)
I20260709 12:14:02.708954 31120 raft_consensus.cc:515] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } attrs { replace: true } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:02.712828 31120 leader_election.cc:290] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:14:02.723790 22830 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
W20260709 12:14:02.724964 22830 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:02.725620 22830 leader_election.cc:304] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:02.726778 31120 raft_consensus.cc:2749] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:14:02.729387 22831 leader_election.cc:336] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Network error: Client connection negotiation failed: client connection to 127.20.102.195:38085: connect: Connection refused (error 111)
W20260709 12:14:02.757071 22830 consensus_peers.cc:597] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:14:03.222540 31120 raft_consensus.cc:493] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:14:03.223198 31120 raft_consensus.cc:515] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:03.225389 31120 leader_election.cc:290] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:14:03.230433 22830 leader_election.cc:336] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
W20260709 12:14:03.231017 22831 leader_election.cc:336] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Network error: Client connection negotiation failed: client connection to 127.20.102.195:38085: connect: Connection refused (error 111)
I20260709 12:14:03.231499 22831 leader_election.cc:304] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:14:03.232266 31120 raft_consensus.cc:2749] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:14:03.313063 31120 raft_consensus.cc:493] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:14:03.313582 31120 raft_consensus.cc:515] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:03.315511 31120 leader_election.cc:290] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:14:03.320197 22831 leader_election.cc:336] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Network error: Client connection negotiation failed: client connection to 127.20.102.195:38085: connect: Connection refused (error 111)
W20260709 12:14:03.322016 22830 leader_election.cc:336] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:03.322589 22830 leader_election.cc:304] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:14:03.323354 31120 raft_consensus.cc:2749] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:14:03.357540 31120 raft_consensus.cc:493] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:14:03.358060 31120 raft_consensus.cc:515] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:03.362708 31120 leader_election.cc:290] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:14:03.364898 22831 leader_election.cc:336] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Network error: Client connection negotiation failed: client connection to 127.20.102.195:38085: connect: Connection refused (error 111)
W20260709 12:14:03.365593 22830 leader_election.cc:336] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:03.366074 22830 leader_election.cc:304] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:03.366847 31120 raft_consensus.cc:2749] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:14:03.399566 22830 consensus_peers.cc:597] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:14:03.403241 20891 tablet_server.cc:196] TabletServer@127.20.102.195:0 shutdown complete.
I20260709 12:14:03.442193 31130 raft_consensus.cc:493] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:14:03.442868 31130 raft_consensus.cc:515] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
W20260709 12:14:03.451784 22831 leader_election.cc:336] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Network error: Client connection negotiation failed: client connection to 127.20.102.195:38085: connect: Connection refused (error 111)
I20260709 12:14:03.451838 31130 leader_election.cc:290] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:14:03.452644 22830 leader_election.cc:336] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:03.453146 22830 leader_election.cc:304] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:14:03.453812 31130 raft_consensus.cc:2749] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:14:03.517357 31130 raft_consensus.cc:493] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:14:03.517992 31130 raft_consensus.cc:515] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7d3f536360b444b1886777f4776be22c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36735 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:03.518697 31120 raft_consensus.cc:493] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:14:03.519279 31120 raft_consensus.cc:515] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:03.520706 31130 leader_election.cc:290] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:14:03.521320 31120 leader_election.cc:290] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:14:03.527791 22831 leader_election.cc:336] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Network error: Client connection negotiation failed: client connection to 127.20.102.195:38085: connect: Connection refused (error 111)
W20260709 12:14:03.528353 22831 leader_election.cc:336] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Network error: Client connection negotiation failed: client connection to 127.20.102.195:38085: connect: Connection refused (error 111)
W20260709 12:14:03.528998 22830 leader_election.cc:336] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7d3f536360b444b1886777f4776be22c (127.20.102.194:36735): Network error: Client connection negotiation failed: client connection to 127.20.102.194:36735: connect: Connection refused (error 111)
I20260709 12:14:03.530405 22830 leader_election.cc:304] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: 7d3f536360b444b1886777f4776be22c, cc9b9c8894084021a0c6ddaf659d222e
I20260709 12:14:03.533560 31120 raft_consensus.cc:2749] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:14:03.534204 22830 leader_election.cc:336] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:03.534734 22830 leader_election.cc:304] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:03.535511 31120 raft_consensus.cc:2749] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:14:03.566295 20891 tablet_server.cc:179] TabletServer@127.20.102.196:0 shutting down...
I20260709 12:14:03.601547 31120 raft_consensus.cc:493] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:14:03.605176 31120 raft_consensus.cc:515] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:03.608332 31120 leader_election.cc:290] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
W20260709 12:14:03.614440 22831 leader_election.cc:336] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Network error: Client connection negotiation failed: client connection to 127.20.102.195:38085: connect: Connection refused (error 111)
W20260709 12:14:03.619520 22830 consensus_peers.cc:597] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:14:03.621120 22830 consensus_peers.cc:597] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f -> Peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Couldn't send request to peer ea51e825f0ab4ea2bb6c4d0e29709ca3. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:14:03.621531 22830 leader_election.cc:336] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:03.621891 22830 leader_election.cc:304] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:03.622507 31120 raft_consensus.cc:2749] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:14:03.641851 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:03.642992 20891 tablet_replica.cc:333] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.643991 20891 raft_consensus.cc:2243] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.644680 20891 raft_consensus.cc:2272] T 37a6582c89c24e6e838bf8ce6d550b23 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.647980 20891 tablet_replica.cc:333] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.648746 20891 raft_consensus.cc:2243] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.649868 20891 raft_consensus.cc:2272] T 7f1b154b48c54be6b421b01ed436bf21 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.652346 20891 tablet_replica.cc:333] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.653031 20891 raft_consensus.cc:2243] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.654203 20891 raft_consensus.cc:2272] T a8f422c5da2840e0b466894312ebcd44 P 164596fc2efa450581a5b68cad62271f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.657230 20891 tablet_replica.cc:333] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.658250 20891 raft_consensus.cc:2243] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.658885 20891 raft_consensus.cc:2272] T 011db458534b4bc8876e63453a07b86b P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.661427 20891 tablet_replica.cc:333] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.662039 20891 raft_consensus.cc:2243] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.663303 20891 raft_consensus.cc:2272] T 7fac2244705d40569bd4a6e8161fb5e9 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.666435 20891 tablet_replica.cc:333] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.667307 20891 raft_consensus.cc:2243] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.668509 20891 raft_consensus.cc:2272] T f86b841ece254f9bbfd1bd07c08f7004 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.672384 20891 tablet_replica.cc:333] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.673516 20891 raft_consensus.cc:2243] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.674326 20891 raft_consensus.cc:2272] T 69f06d3e4d31493d8aa24b2983f369fe P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.677532 20891 tablet_replica.cc:333] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.678174 20891 raft_consensus.cc:2243] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.679272 20891 raft_consensus.cc:2272] T fc3d186560a74d7e8c4d29066e4e3567 P 164596fc2efa450581a5b68cad62271f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.681996 20891 tablet_replica.cc:333] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.682561 31120 raft_consensus.cc:493] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cc9b9c8894084021a0c6ddaf659d222e)
I20260709 12:14:03.683116 31120 raft_consensus.cc:515] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ea51e825f0ab4ea2bb6c4d0e29709ca3" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39673 } } peers { permanent_uuid: "cc9b9c8894084021a0c6ddaf659d222e" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 38085 } } peers { permanent_uuid: "164596fc2efa450581a5b68cad62271f" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42539 } attrs { promote: false } }
I20260709 12:14:03.684096 20891 raft_consensus.cc:2243] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.685189 31120 leader_election.cc:290] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673), cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085)
I20260709 12:14:03.687390 20891 raft_consensus.cc:2272] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.690639 20891 tablet_replica.cc:333] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
W20260709 12:14:03.690941 22831 leader_election.cc:336] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cc9b9c8894084021a0c6ddaf659d222e (127.20.102.195:38085): Network error: Client connection negotiation failed: client connection to 127.20.102.195:38085: connect: Connection refused (error 111)
I20260709 12:14:03.691630 20891 raft_consensus.cc:2243] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 31 LEADER]: Raft consensus shutting down.
W20260709 12:14:03.691769 22830 leader_election.cc:336] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:03.692307 22830 leader_election.cc:304] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164596fc2efa450581a5b68cad62271f; no voters: cc9b9c8894084021a0c6ddaf659d222e, ea51e825f0ab4ea2bb6c4d0e29709ca3
I20260709 12:14:03.692764 20891 raft_consensus.cc:2272] T 4c6c5fdc849b4d1b8df5ffb293137964 P 164596fc2efa450581a5b68cad62271f [term 31 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:03.692955 22830 raft_consensus.cc:2686] T 1baa23cb6635453b9a9cd5ec7e452f6a P 164596fc2efa450581a5b68cad62271f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:03.695359 20891 tablet_replica.cc:333] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.696074 20891 raft_consensus.cc:2243] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.697014 20891 raft_consensus.cc:2272] T 4dd2e5184fad402e8f3b26ea46e3c996 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.699355 20891 tablet_replica.cc:333] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.700031 20891 raft_consensus.cc:2243] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.701035 20891 raft_consensus.cc:2272] T f3728a188c254ff78ba0aff2361f13e3 P 164596fc2efa450581a5b68cad62271f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.703720 20891 tablet_replica.cc:333] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.704515 20891 raft_consensus.cc:2243] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.705758 20891 raft_consensus.cc:2272] T 83a858eff9ef460fa5e0587bb1ea61f9 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.708077 20891 tablet_replica.cc:333] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.708680 20891 raft_consensus.cc:2243] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.709261 20891 raft_consensus.cc:2272] T 8d6f694768d144aa85616d8c7b2453f0 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.711599 20891 tablet_replica.cc:333] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.712177 20891 raft_consensus.cc:2243] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.713160 20891 raft_consensus.cc:2272] T 54878b51479940bebc76fc9d84de64cb P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.715328 20891 tablet_replica.cc:333] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.715912 20891 raft_consensus.cc:2243] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.716827 20891 raft_consensus.cc:2272] T 5ea5fe59611e4539abcf87b4fd1a282c P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.719014 20891 tablet_replica.cc:333] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.719595 20891 raft_consensus.cc:2243] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.720145 20891 raft_consensus.cc:2272] T 97ce44fb81b642f9ad6b0f0d68e82820 P 164596fc2efa450581a5b68cad62271f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.722450 20891 tablet_replica.cc:333] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.723055 20891 raft_consensus.cc:2243] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.723560 20891 raft_consensus.cc:2272] T 55006a12f7594727bebe695d1ffbe74f P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.725708 20891 tablet_replica.cc:333] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.726439 20891 raft_consensus.cc:2243] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.727118 20891 raft_consensus.cc:2272] T c1fb787db87147b3be49bef974365af1 P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.729660 20891 tablet_replica.cc:333] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.730216 20891 raft_consensus.cc:2243] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.731153 20891 raft_consensus.cc:2272] T 8f168c463b75448c945cd40fd0ad742f P 164596fc2efa450581a5b68cad62271f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.733654 20891 tablet_replica.cc:333] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.734228 20891 raft_consensus.cc:2243] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:03.734908 20891 raft_consensus.cc:2272] T f5d4cdb3f6584a3d98a8736d0f93ddaf P 164596fc2efa450581a5b68cad62271f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.737888 20891 tablet_replica.cc:333] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.738740 20891 raft_consensus.cc:2243] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.739815 20891 raft_consensus.cc:2272] T 2f0832297a8d44da9dba2792bf6c4c35 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.742018 20891 tablet_replica.cc:333] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.742605 20891 raft_consensus.cc:2243] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.743489 20891 raft_consensus.cc:2272] T 180ca53d6ccc4c27a39b8000ee3b67ff P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.745900 20891 tablet_replica.cc:333] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.746457 20891 raft_consensus.cc:2243] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.747272 20891 raft_consensus.cc:2272] T 791f1d0e9076481dad104e8c3b503af8 P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.749539 20891 tablet_replica.cc:333] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.750075 20891 raft_consensus.cc:2243] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.750980 20891 raft_consensus.cc:2272] T 8b5facb1c9654266b70a6d04d1e002f2 P 164596fc2efa450581a5b68cad62271f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.753532 20891 tablet_replica.cc:333] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.754074 20891 raft_consensus.cc:2243] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.754941 20891 raft_consensus.cc:2272] T 44679affd4554006a2cb59b10b589a27 P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.757098 20891 tablet_replica.cc:333] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.757614 20891 raft_consensus.cc:2243] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.758493 20891 raft_consensus.cc:2272] T 44711cbd4d234e36807a94726a691570 P 164596fc2efa450581a5b68cad62271f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.760866 20891 tablet_replica.cc:333] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.761588 20891 raft_consensus.cc:2243] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.762605 20891 raft_consensus.cc:2272] T 863b392474d94720808349fe27669b5b P 164596fc2efa450581a5b68cad62271f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:03.764731 20891 tablet_replica.cc:333] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f: stopping tablet replica
I20260709 12:14:03.765281 20891 raft_consensus.cc:2243] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:14:03.766189 20891 raft_consensus.cc:2272] T fe7f853d79ab4bdf9a4bbdf1c2aea79e P 164596fc2efa450581a5b68cad62271f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.254714 20891 tablet_server.cc:196] TabletServer@127.20.102.196:0 shutdown complete.
I20260709 12:14:04.329378 20891 master.cc:562] Master@127.20.102.254:38171 shutting down...
W20260709 12:14:04.396015 22069 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:14:04.396407 22069 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:14:04.396624 22069 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:14:05.331254 22006 catalog_manager.cc:4755] TS ea51e825f0ab4ea2bb6c4d0e29709ca3 (127.20.102.193:39673): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c1fb787db87147b3be49bef974365af1: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39673: connect: Connection refused (error 111)
I20260709 12:14:05.356201 20891 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:05.357028 20891 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.357409 20891 tablet_replica.cc:333] T 00000000000000000000000000000000 P 724c00f1bc7e49c9835e5c0e664b7356: stopping tablet replica
I20260709 12:14:05.648761 20891 master.cc:584] Master@127.20.102.254:38171 shutdown complete.
I20260709 12:14:05.695425 20891 test_util.cc:182] -----------------------------------------------
I20260709 12:14:05.695708 20891 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895025208-20891-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (285229 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:14:05.698881 20891 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.102.254:38261
I20260709 12:14:05.700017 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:05.706489 31162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:05.706439 31163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:05.707046 31165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:05.709720 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:05.714177 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:05.714386 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:05.714583 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599245714566 us; error 0 us; skew 500 ppm
I20260709 12:14:05.715232 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:05.718148 20891 webserver.cc:533] Webserver started at http://127.20.102.254:38241/ using document root <none> and password file <none>
I20260709 12:14:05.718743 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:05.718951 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:05.719267 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:05.720551 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/master-0-root/instance:
uuid: "b4f015f246414c2f972d92b85595c3e2"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-296p"
I20260709 12:14:05.725467 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:14:05.729346 31170 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.730285 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:05.730610 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/master-0-root
uuid: "b4f015f246414c2f972d92b85595c3e2"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-296p"
I20260709 12:14:05.731014 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:05.750301 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:05.751699 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:05.799198 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.254:38261
I20260709 12:14:05.799338 31221 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.254:38261 every 8 connection(s)
I20260709 12:14:05.803877 31222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.814934 31222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2: Bootstrap starting.
I20260709 12:14:05.819613 31222 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.824442 31222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2: No bootstrap required, opened a new log
I20260709 12:14:05.826930 31222 raft_consensus.cc:359] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f015f246414c2f972d92b85595c3e2" member_type: VOTER }
I20260709 12:14:05.827363 31222 raft_consensus.cc:385] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.827653 31222 raft_consensus.cc:740] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4f015f246414c2f972d92b85595c3e2, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.828341 31222 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f015f246414c2f972d92b85595c3e2" member_type: VOTER }
I20260709 12:14:05.828908 31222 raft_consensus.cc:399] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:05.829165 31222 raft_consensus.cc:493] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:05.829511 31222 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.834753 31222 raft_consensus.cc:515] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f015f246414c2f972d92b85595c3e2" member_type: VOTER }
I20260709 12:14:05.835399 31222 leader_election.cc:304] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4f015f246414c2f972d92b85595c3e2; no voters: 
I20260709 12:14:05.836761 31222 leader_election.cc:290] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:05.837297 31225 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.838965 31225 raft_consensus.cc:697] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [term 1 LEADER]: Becoming Leader. State: Replica: b4f015f246414c2f972d92b85595c3e2, State: Running, Role: LEADER
I20260709 12:14:05.839751 31225 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f015f246414c2f972d92b85595c3e2" member_type: VOTER }
I20260709 12:14:05.840318 31222 sys_catalog.cc:565] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:05.844942 31226 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4f015f246414c2f972d92b85595c3e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f015f246414c2f972d92b85595c3e2" member_type: VOTER } }
I20260709 12:14:05.845019 31227 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4f015f246414c2f972d92b85595c3e2. Latest consensus state: current_term: 1 leader_uuid: "b4f015f246414c2f972d92b85595c3e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f015f246414c2f972d92b85595c3e2" member_type: VOTER } }
I20260709 12:14:05.845991 31226 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:05.846256 31227 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:05.853829 31232 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:05.860517 31232 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:05.861685 20891 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:05.870138 31232 catalog_manager.cc:1383] Generated new cluster ID: f25cc6a1f44b49fcb802dfa71d44b241
I20260709 12:14:05.870538 31232 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:05.886439 31232 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:05.887928 31232 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:05.903354 31232 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2: Generated new TSK 0
I20260709 12:14:05.904093 31232 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:05.929253 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:05.935778 31243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:05.936843 31244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:05.939306 31246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:05.942632 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:05.946790 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:05.947021 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:05.947242 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599245947200 us; error 0 us; skew 500 ppm
I20260709 12:14:05.947793 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:05.950380 20891 webserver.cc:533] Webserver started at http://127.20.102.193:36579/ using document root <none> and password file <none>
I20260709 12:14:05.950882 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:05.951076 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:05.951361 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:05.952515 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/instance:
uuid: "0769d57e6db04b2f86703e0ed60f6185"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-296p"
I20260709 12:14:05.957180 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:14:05.960604 31251 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.961520 20891 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:14:05.961845 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-0-root
uuid: "0769d57e6db04b2f86703e0ed60f6185"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-296p"
I20260709 12:14:05.962143 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:05.978592 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:05.979836 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:05.981478 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:05.983860 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:05.984077 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:05.984341 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:05.984524 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:06.031679 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.193:45623
I20260709 12:14:06.031872 31313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.193:45623 every 8 connection(s)
I20260709 12:14:06.037163 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:06.045732 31318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:06.046500 31319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:06.050034 31322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:06.051734 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:06.055135 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:06.055358 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:06.055570 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599246055553 us; error 0 us; skew 500 ppm
I20260709 12:14:06.056206 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:06.059465 20891 webserver.cc:533] Webserver started at http://127.20.102.194:36017/ using document root <none> and password file <none>
I20260709 12:14:06.060165 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:06.060441 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:06.060839 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:06.061964 31314 heartbeater.cc:344] Connected to a master server at 127.20.102.254:38261
I20260709 12:14:06.062414 31314 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:06.062355 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/instance:
uuid: "56add4c904c74a1bba90579b9204e45d"
format_stamp: "Formatted at 2026-07-09 12:14:06 on dist-test-slave-296p"
I20260709 12:14:06.063439 31314 heartbeater.cc:507] Master 127.20.102.254:38261 requested a full tablet report, sending...
I20260709 12:14:06.065933 31187 ts_manager.cc:194] Registered new tserver with Master: 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:06.068341 31187 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46388
I20260709 12:14:06.068429 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:06.072976 31326 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:06.073874 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:06.074225 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-1-root
uuid: "56add4c904c74a1bba90579b9204e45d"
format_stamp: "Formatted at 2026-07-09 12:14:06 on dist-test-slave-296p"
I20260709 12:14:06.074528 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:06.094385 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:06.095820 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:06.097674 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:06.100198 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:06.100438 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:06.100708 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:06.100911 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:14:06.150334 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.194:33861
I20260709 12:14:06.150487 31388 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.194:33861 every 8 connection(s)
I20260709 12:14:06.155941 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:06.163187 31392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:06.164384 31393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:06.168325 20891 server_base.cc:1061] running on GCE node
W20260709 12:14:06.168368 31395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:06.169401 31389 heartbeater.cc:344] Connected to a master server at 127.20.102.254:38261
I20260709 12:14:06.169879 31389 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:06.169948 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:06.170303 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:06.170521 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599246170501 us; error 0 us; skew 500 ppm
I20260709 12:14:06.170975 31389 heartbeater.cc:507] Master 127.20.102.254:38261 requested a full tablet report, sending...
I20260709 12:14:06.171401 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:06.173578 31187 ts_manager.cc:194] Registered new tserver with Master: 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:06.174885 20891 webserver.cc:533] Webserver started at http://127.20.102.195:43545/ using document root <none> and password file <none>
I20260709 12:14:06.175356 31187 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46402
I20260709 12:14:06.175513 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:06.175984 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:06.176295 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:06.177860 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/instance:
uuid: "d5caa720fddf4dd3958f076ff03df8da"
format_stamp: "Formatted at 2026-07-09 12:14:06 on dist-test-slave-296p"
I20260709 12:14:06.182942 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:06.186822 31400 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:06.187736 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:14:06.188108 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-2-root
uuid: "d5caa720fddf4dd3958f076ff03df8da"
format_stamp: "Formatted at 2026-07-09 12:14:06 on dist-test-slave-296p"
I20260709 12:14:06.188444 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:06.211020 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:06.212967 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:06.215437 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:06.219185 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:06.219415 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:06.219616 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:06.219756 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:06.270684 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.195:45203
I20260709 12:14:06.270896 31462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.195:45203 every 8 connection(s)
I20260709 12:14:06.276273 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:06.284479 31466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:06.286001 31467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:06.289080 31469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:06.290238 31463 heartbeater.cc:344] Connected to a master server at 127.20.102.254:38261
I20260709 12:14:06.290805 31463 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:06.291422 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:06.291831 31463 heartbeater.cc:507] Master 127.20.102.254:38261 requested a full tablet report, sending...
I20260709 12:14:06.292470 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:06.292762 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:06.293052 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599246293032 us; error 0 us; skew 500 ppm
I20260709 12:14:06.293952 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:06.294454 31187 ts_manager.cc:194] Registered new tserver with Master: d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:06.296151 31187 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46410
I20260709 12:14:06.297080 20891 webserver.cc:533] Webserver started at http://127.20.102.196:43017/ using document root <none> and password file <none>
I20260709 12:14:06.297840 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:06.298117 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:06.298486 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:06.299882 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-3-root/instance:
uuid: "a209a5d7b61542d885ef601e8bcaa26c"
format_stamp: "Formatted at 2026-07-09 12:14:06 on dist-test-slave-296p"
I20260709 12:14:06.305153 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:14:06.309269 31474 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:06.310202 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:06.310545 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-3-root
uuid: "a209a5d7b61542d885ef601e8bcaa26c"
format_stamp: "Formatted at 2026-07-09 12:14:06 on dist-test-slave-296p"
I20260709 12:14:06.310838 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:06.323750 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:06.325292 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:06.326666 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:06.329599 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:06.329896 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:06.330134 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:06.330271 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:06.381945 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.196:42171
I20260709 12:14:06.382256 31536 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.196:42171 every 8 connection(s)
I20260709 12:14:06.397872 31537 heartbeater.cc:344] Connected to a master server at 127.20.102.254:38261
I20260709 12:14:06.398443 31537 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:06.399369 31537 heartbeater.cc:507] Master 127.20.102.254:38261 requested a full tablet report, sending...
I20260709 12:14:06.401886 31187 ts_manager.cc:194] Registered new tserver with Master: a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:06.402164 20891 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016813647s
I20260709 12:14:06.404171 31187 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46416
I20260709 12:14:06.432669 31187 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46418:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:14:06.695386 31277 tablet_service.cc:1511] Processing CreateTablet for tablet 0191640019a84d1c9ec1470b18a33641 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:14:06.696990 31277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0191640019a84d1c9ec1470b18a33641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.697623 31278 tablet_service.cc:1511] Processing CreateTablet for tablet eb07b495c85d4de88b7c752f4a6f7ee7 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:14:06.699160 31278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb07b495c85d4de88b7c752f4a6f7ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.696372 31279 tablet_service.cc:1511] Processing CreateTablet for tablet 8603c16c544a4d349593068e0a1788fa (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:14:06.701660 31279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8603c16c544a4d349593068e0a1788fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.704890 31276 tablet_service.cc:1511] Processing CreateTablet for tablet 3110254469cd41d2bc5addd8675f1ddd (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:14:06.705364 31275 tablet_service.cc:1511] Processing CreateTablet for tablet 521c6b0664a14a35a1eca5919b44637f (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:14:06.706516 31276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3110254469cd41d2bc5addd8675f1ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.710857 31274 tablet_service.cc:1511] Processing CreateTablet for tablet a957f943814a47b2be47b8491e63b5c0 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:14:06.712335 31274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a957f943814a47b2be47b8491e63b5c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.713213 31275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521c6b0664a14a35a1eca5919b44637f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.714886 31354 tablet_service.cc:1511] Processing CreateTablet for tablet 8603c16c544a4d349593068e0a1788fa (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:14:06.716400 31354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8603c16c544a4d349593068e0a1788fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.718137 31352 tablet_service.cc:1511] Processing CreateTablet for tablet 85ab5b9c556a42dbba099f8a42b496f6 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:14:06.718917 31273 tablet_service.cc:1511] Processing CreateTablet for tablet d3a4e71f02b84b77a615d593e2bd3597 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:14:06.719638 31352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ab5b9c556a42dbba099f8a42b496f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.720316 31273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a4e71f02b84b77a615d593e2bd3597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.721966 31351 tablet_service.cc:1511] Processing CreateTablet for tablet 3110254469cd41d2bc5addd8675f1ddd (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:14:06.723438 31351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3110254469cd41d2bc5addd8675f1ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.725248 31272 tablet_service.cc:1511] Processing CreateTablet for tablet 215d8d9803624fe3b90591e545bf5024 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:14:06.726068 31350 tablet_service.cc:1511] Processing CreateTablet for tablet 521c6b0664a14a35a1eca5919b44637f (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:14:06.726783 31272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 215d8d9803624fe3b90591e545bf5024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.727553 31350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521c6b0664a14a35a1eca5919b44637f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.729992 31349 tablet_service.cc:1511] Processing CreateTablet for tablet dc2fa69725764633ab7d8cc899591b75 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:14:06.732436 31353 tablet_service.cc:1511] Processing CreateTablet for tablet eb07b495c85d4de88b7c752f4a6f7ee7 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:14:06.734879 31271 tablet_service.cc:1511] Processing CreateTablet for tablet 641ff77e975546a1824207bab77c2788 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:14:06.735960 31353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb07b495c85d4de88b7c752f4a6f7ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.736361 31271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 641ff77e975546a1824207bab77c2788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.737234 31349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2fa69725764633ab7d8cc899591b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.741444 31270 tablet_service.cc:1511] Processing CreateTablet for tablet 75927c3304e84b06a5ca9baf08eda6f6 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:14:06.742882 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75927c3304e84b06a5ca9baf08eda6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.755296 31348 tablet_service.cc:1511] Processing CreateTablet for tablet d3a4e71f02b84b77a615d593e2bd3597 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:14:06.755542 31347 tablet_service.cc:1511] Processing CreateTablet for tablet 215d8d9803624fe3b90591e545bf5024 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:14:06.757982 31346 tablet_service.cc:1511] Processing CreateTablet for tablet 2607cd0103e94dec990c36aa6cbf89d0 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:14:06.759096 31348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a4e71f02b84b77a615d593e2bd3597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.759856 31346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2607cd0103e94dec990c36aa6cbf89d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.762009 31347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 215d8d9803624fe3b90591e545bf5024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.766244 31345 tablet_service.cc:1511] Processing CreateTablet for tablet 75927c3304e84b06a5ca9baf08eda6f6 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:14:06.767758 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75927c3304e84b06a5ca9baf08eda6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.769690 31275 tablet_service.cc:1511] Processing CreateTablet for tablet f4d045764fb04dbc819b8f88e9bb085f (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:14:06.771164 31275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d045764fb04dbc819b8f88e9bb085f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.777581 31273 tablet_service.cc:1511] Processing CreateTablet for tablet ad60c538b49e4a5fb4fa276ea5b25314 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:14:06.779213 31273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad60c538b49e4a5fb4fa276ea5b25314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.818445 31502 tablet_service.cc:1511] Processing CreateTablet for tablet 8603c16c544a4d349593068e0a1788fa (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:14:06.820345 31502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8603c16c544a4d349593068e0a1788fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.821069 31497 tablet_service.cc:1511] Processing CreateTablet for tablet dc2fa69725764633ab7d8cc899591b75 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:14:06.822230 31501 tablet_service.cc:1511] Processing CreateTablet for tablet 0191640019a84d1c9ec1470b18a33641 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:14:06.823470 31494 tablet_service.cc:1511] Processing CreateTablet for tablet 2607cd0103e94dec990c36aa6cbf89d0 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:14:06.824410 31493 tablet_service.cc:1511] Processing CreateTablet for tablet f4d045764fb04dbc819b8f88e9bb085f (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:14:06.825810 31498 tablet_service.cc:1511] Processing CreateTablet for tablet a957f943814a47b2be47b8491e63b5c0 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:14:06.825919 31496 tablet_service.cc:1511] Processing CreateTablet for tablet 215d8d9803624fe3b90591e545bf5024 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:14:06.818750 31500 tablet_service.cc:1511] Processing CreateTablet for tablet 85ab5b9c556a42dbba099f8a42b496f6 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:14:06.822103 31495 tablet_service.cc:1511] Processing CreateTablet for tablet 641ff77e975546a1824207bab77c2788 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:14:06.828756 31499 tablet_service.cc:1511] Processing CreateTablet for tablet 521c6b0664a14a35a1eca5919b44637f (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:14:06.830032 31426 tablet_service.cc:1511] Processing CreateTablet for tablet 85ab5b9c556a42dbba099f8a42b496f6 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:14:06.831682 31426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ab5b9c556a42dbba099f8a42b496f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.831512 31428 tablet_service.cc:1511] Processing CreateTablet for tablet eb07b495c85d4de88b7c752f4a6f7ee7 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:14:06.834218 31424 tablet_service.cc:1511] Processing CreateTablet for tablet a957f943814a47b2be47b8491e63b5c0 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:14:06.835197 31427 tablet_service.cc:1511] Processing CreateTablet for tablet 0191640019a84d1c9ec1470b18a33641 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:14:06.836722 31423 tablet_service.cc:1511] Processing CreateTablet for tablet dc2fa69725764633ab7d8cc899591b75 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:14:06.837947 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 641ff77e975546a1824207bab77c2788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.839149 31422 tablet_service.cc:1511] Processing CreateTablet for tablet d3a4e71f02b84b77a615d593e2bd3597 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:14:06.841151 31500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ab5b9c556a42dbba099f8a42b496f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.842655 31421 tablet_service.cc:1511] Processing CreateTablet for tablet 641ff77e975546a1824207bab77c2788 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:14:06.843760 31498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a957f943814a47b2be47b8491e63b5c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.849500 31493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d045764fb04dbc819b8f88e9bb085f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.848297 31419 tablet_service.cc:1511] Processing CreateTablet for tablet 75927c3304e84b06a5ca9baf08eda6f6 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:14:06.834275 31425 tablet_service.cc:1511] Processing CreateTablet for tablet 3110254469cd41d2bc5addd8675f1ddd (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:14:06.846017 31420 tablet_service.cc:1511] Processing CreateTablet for tablet 2607cd0103e94dec990c36aa6cbf89d0 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:14:06.851686 31494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2607cd0103e94dec990c36aa6cbf89d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.852500 31501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0191640019a84d1c9ec1470b18a33641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.853365 31428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb07b495c85d4de88b7c752f4a6f7ee7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:06.855757 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:06.856256 31422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a4e71f02b84b77a615d593e2bd3597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.856809 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 215d8d9803624fe3b90591e545bf5024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.857055 31419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75927c3304e84b06a5ca9baf08eda6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.857715 31424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a957f943814a47b2be47b8491e63b5c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.858469 31421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 641ff77e975546a1824207bab77c2788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.859007 31497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2fa69725764633ab7d8cc899591b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.860860 31427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0191640019a84d1c9ec1470b18a33641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.863026 31423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2fa69725764633ab7d8cc899591b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.864575 31499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521c6b0664a14a35a1eca5919b44637f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.865103 31425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3110254469cd41d2bc5addd8675f1ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.865922 31420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2607cd0103e94dec990c36aa6cbf89d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.869555 31278 tablet_service.cc:1511] Processing CreateTablet for tablet ea3247f0fa74413892d5db3bbb4bb052 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:14:06.870924 31278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea3247f0fa74413892d5db3bbb4bb052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.914305 31274 tablet_service.cc:1511] Processing CreateTablet for tablet fdb3d3e1eb4043a8b0c90c5b76a60ac0 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:14:06.924759 31351 tablet_service.cc:1511] Processing CreateTablet for tablet f4d045764fb04dbc819b8f88e9bb085f (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:14:06.926172 31351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d045764fb04dbc819b8f88e9bb085f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.967062 31279 tablet_service.cc:1511] Processing CreateTablet for tablet 3043ea4e7aac4914af456073b1b6a33c (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:14:06.969700 31277 tablet_service.cc:1511] Processing CreateTablet for tablet 1e16b0bb459e4dcf906ddc86d14187bc (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:14:06.974074 31270 tablet_service.cc:1511] Processing CreateTablet for tablet 95ee9c20206541cf9fdc5d65759ce8e9 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:14:06.979822 31271 tablet_service.cc:1511] Processing CreateTablet for tablet 17f21568498d48caad98d644ce34352a (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:14:06.984946 31345 tablet_service.cc:1511] Processing CreateTablet for tablet ea3247f0fa74413892d5db3bbb4bb052 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:14:06.987340 31275 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada87845b524af0b51a486204b74b96 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:14:06.959971 31274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb3d3e1eb4043a8b0c90c5b76a60ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.997715 31354 tablet_service.cc:1511] Processing CreateTablet for tablet fdb3d3e1eb4043a8b0c90c5b76a60ac0 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:14:07.000639 31351 tablet_service.cc:1511] Processing CreateTablet for tablet 45c3a704808243b09ae619420b9ef16c (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:14:07.002589 31353 tablet_service.cc:1511] Processing CreateTablet for tablet 3043ea4e7aac4914af456073b1b6a33c (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:14:07.004884 31346 tablet_service.cc:1511] Processing CreateTablet for tablet 95ee9c20206541cf9fdc5d65759ce8e9 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:14:07.001144 31354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb3d3e1eb4043a8b0c90c5b76a60ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.016045 31346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ee9c20206541cf9fdc5d65759ce8e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.020745 31493 tablet_service.cc:1511] Processing CreateTablet for tablet ad60c538b49e4a5fb4fa276ea5b25314 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:14:07.021400 31353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3043ea4e7aac4914af456073b1b6a33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.029965 31558 tablet_bootstrap.cc:492] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:07.030356 31557 tablet_bootstrap.cc:492] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:07.041404 31279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3043ea4e7aac4914af456073b1b6a33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.045783 31277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e16b0bb459e4dcf906ddc86d14187bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.049392 31271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f21568498d48caad98d644ce34352a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.053582 31275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada87845b524af0b51a486204b74b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.057104 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ee9c20206541cf9fdc5d65759ce8e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.061309 31347 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb27277c309451f909355cb86a5d907 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:14:07.071557 31314 heartbeater.cc:499] Master 127.20.102.254:38261 was elected leader, sending a full tablet report...
I20260709 12:14:07.073515 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea3247f0fa74413892d5db3bbb4bb052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.076646 31351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c3a704808243b09ae619420b9ef16c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.077875 31347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb27277c309451f909355cb86a5d907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.082769 31354 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada87845b524af0b51a486204b74b96 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:14:07.092142 31354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada87845b524af0b51a486204b74b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.102103 31493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad60c538b49e4a5fb4fa276ea5b25314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.120901 31560 tablet_bootstrap.cc:492] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:07.132119 31352 tablet_service.cc:1511] Processing CreateTablet for tablet a31c0489c4404a649554f01c10277574 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:14:07.155579 31558 tablet_bootstrap.cc:654] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.171339 31348 tablet_service.cc:1511] Processing CreateTablet for tablet 75145062a94b45be996b563319044cd4 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:14:07.172550 31347 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8c6788cec8476ba424246e634c4712 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:14:07.178437 31389 heartbeater.cc:499] Master 127.20.102.254:38261 was elected leader, sending a full tablet report...
I20260709 12:14:07.177806 31559 tablet_bootstrap.cc:492] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:07.181239 31423 tablet_service.cc:1511] Processing CreateTablet for tablet ad60c538b49e4a5fb4fa276ea5b25314 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:14:07.182888 31423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad60c538b49e4a5fb4fa276ea5b25314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.187105 31560 tablet_bootstrap.cc:654] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.187635 31426 tablet_service.cc:1511] Processing CreateTablet for tablet 75145062a94b45be996b563319044cd4 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:14:07.189396 31426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75145062a94b45be996b563319044cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.203495 31352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31c0489c4404a649554f01c10277574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.208873 31419 tablet_service.cc:1511] Processing CreateTablet for tablet 1e16b0bb459e4dcf906ddc86d14187bc (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:14:07.210471 31419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e16b0bb459e4dcf906ddc86d14187bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.212146 31421 tablet_service.cc:1511] Processing CreateTablet for tablet 45c3a704808243b09ae619420b9ef16c (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:14:07.213935 31421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c3a704808243b09ae619420b9ef16c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.215674 31276 tablet_service.cc:1511] Processing CreateTablet for tablet ddfe25b91d214455814522b83bc111d1 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:14:07.219772 31276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfe25b91d214455814522b83bc111d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.220216 31350 tablet_service.cc:1511] Processing CreateTablet for tablet 53171289fe984298815d6d30885bf378 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:14:07.220695 31428 tablet_service.cc:1511] Processing CreateTablet for tablet 3043ea4e7aac4914af456073b1b6a33c (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:14:07.222229 31428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3043ea4e7aac4914af456073b1b6a33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.223845 31557 tablet_bootstrap.cc:654] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.226468 31349 tablet_service.cc:1511] Processing CreateTablet for tablet 6f73b173ebeb4e0092ede2f6573824e8 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:14:07.227556 31500 tablet_service.cc:1511] Processing CreateTablet for tablet fdb3d3e1eb4043a8b0c90c5b76a60ac0 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:14:07.229065 31500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb3d3e1eb4043a8b0c90c5b76a60ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.231235 31272 tablet_service.cc:1511] Processing CreateTablet for tablet 53171289fe984298815d6d30885bf378 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:14:07.228670 31273 tablet_service.cc:1511] Processing CreateTablet for tablet a31c0489c4404a649554f01c10277574 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:14:07.237205 31559 tablet_bootstrap.cc:654] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.241552 31272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53171289fe984298815d6d30885bf378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.244158 31420 tablet_service.cc:1511] Processing CreateTablet for tablet ea3247f0fa74413892d5db3bbb4bb052 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:14:07.245703 31420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea3247f0fa74413892d5db3bbb4bb052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.252359 31494 tablet_service.cc:1511] Processing CreateTablet for tablet 1e16b0bb459e4dcf906ddc86d14187bc (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:14:07.253805 31494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e16b0bb459e4dcf906ddc86d14187bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.237140 31347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8c6788cec8476ba424246e634c4712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.254953 31270 tablet_service.cc:1511] Processing CreateTablet for tablet 6f73b173ebeb4e0092ede2f6573824e8 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:14:07.264101 31278 tablet_service.cc:1511] Processing CreateTablet for tablet d502420b9f304f568a686ba8cdb9ae80 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:14:07.281536 31502 tablet_service.cc:1511] Processing CreateTablet for tablet 75145062a94b45be996b563319044cd4 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:14:07.269179 31273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31c0489c4404a649554f01c10277574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.284008 31422 tablet_service.cc:1511] Processing CreateTablet for tablet 17f21568498d48caad98d644ce34352a (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:14:07.285087 31349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f73b173ebeb4e0092ede2f6573824e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.286051 31271 tablet_service.cc:1511] Processing CreateTablet for tablet 385e15f5c0b14702a8444e0e908bff77 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:14:07.294844 31354 tablet_service.cc:1511] Processing CreateTablet for tablet 385e15f5c0b14702a8444e0e908bff77 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:14:07.270951 31495 tablet_service.cc:1511] Processing CreateTablet for tablet 45c3a704808243b09ae619420b9ef16c (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:14:07.297616 31351 tablet_service.cc:1511] Processing CreateTablet for tablet ebdc9dd0bb6b443791a0ffbe39829943 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:14:07.299289 31463 heartbeater.cc:499] Master 127.20.102.254:38261 was elected leader, sending a full tablet report...
I20260709 12:14:07.321224 31502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75145062a94b45be996b563319044cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.322824 31422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f21568498d48caad98d644ce34352a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.325204 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c3a704808243b09ae619420b9ef16c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.327037 31346 tablet_service.cc:1511] Processing CreateTablet for tablet e88d7f9369fa4e8eaa71b635d908ee34 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:14:07.342250 31560 tablet_bootstrap.cc:492] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:07.343027 31560 ts_tablet_manager.cc:1403] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.223s	user 0.011s	sys 0.009s
I20260709 12:14:07.346299 31560 raft_consensus.cc:359] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:07.362257 31560 raft_consensus.cc:385] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:07.362746 31560 raft_consensus.cc:740] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:07.365477 31279 tablet_service.cc:1511] Processing CreateTablet for tablet fdc78b9bfcf344f389246d2a9db1c5eb (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:14:07.328887 31425 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb27277c309451f909355cb86a5d907 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:14:07.365597 31560 consensus_queue.cc:260] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:07.301024 31353 tablet_service.cc:1511] Processing CreateTablet for tablet 1e602beb4a714f99a8480a347d7add2e (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:14:07.367660 31425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb27277c309451f909355cb86a5d907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.360948 31558 tablet_bootstrap.cc:492] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:07.368747 31558 ts_tablet_manager.cc:1403] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.339s	user 0.009s	sys 0.019s
I20260709 12:14:07.356062 31274 tablet_service.cc:1511] Processing CreateTablet for tablet 02ebece119174df8b0065e09199cb74a (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:14:07.372334 31558 raft_consensus.cc:359] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:07.358223 31557 tablet_bootstrap.cc:492] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:07.374905 31557 ts_tablet_manager.cc:1403] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.345s	user 0.011s	sys 0.009s
I20260709 12:14:07.373387 31275 tablet_service.cc:1511] Processing CreateTablet for tablet ebdc9dd0bb6b443791a0ffbe39829943 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:14:07.356817 31348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75145062a94b45be996b563319044cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.378489 31557 raft_consensus.cc:359] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:07.300875 31498 tablet_service.cc:1511] Processing CreateTablet for tablet 95ee9c20206541cf9fdc5d65759ce8e9 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:14:07.389940 31498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ee9c20206541cf9fdc5d65759ce8e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.387935 31557 raft_consensus.cc:385] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:07.340206 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f73b173ebeb4e0092ede2f6573824e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.388670 31350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53171289fe984298815d6d30885bf378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.396677 31499 tablet_service.cc:1511] Processing CreateTablet for tablet 17f21568498d48caad98d644ce34352a (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:14:07.387806 31558 raft_consensus.cc:385] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:07.403236 31557 raft_consensus.cc:740] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:07.411867 31558 raft_consensus.cc:740] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:07.407353 31537 heartbeater.cc:499] Master 127.20.102.254:38261 was elected leader, sending a full tablet report...
I20260709 12:14:07.463560 31558 consensus_queue.cc:260] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:07.466418 31352 tablet_service.cc:1511] Processing CreateTablet for tablet 02ebece119174df8b0065e09199cb74a (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:14:07.426508 31493 tablet_service.cc:1511] Processing CreateTablet for tablet a31c0489c4404a649554f01c10277574 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:14:07.429564 31499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f21568498d48caad98d644ce34352a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.380658 31277 tablet_service.cc:1511] Processing CreateTablet for tablet feb5c33d2a8a4010b336be5c5c4635cc (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:14:07.414597 31423 tablet_service.cc:1511] Processing CreateTablet for tablet ddfe25b91d214455814522b83bc111d1 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:14:07.477653 31423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfe25b91d214455814522b83bc111d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.477891 31345 tablet_service.cc:1511] Processing CreateTablet for tablet feb5c33d2a8a4010b336be5c5c4635cc (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:14:07.481600 31493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31c0489c4404a649554f01c10277574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.447347 31279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc78b9bfcf344f389246d2a9db1c5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.454269 31351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebdc9dd0bb6b443791a0ffbe39829943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.454768 31419 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada87845b524af0b51a486204b74b96 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:14:07.486439 31419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada87845b524af0b51a486204b74b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.487108 31426 tablet_service.cc:1511] Processing CreateTablet for tablet d502420b9f304f568a686ba8cdb9ae80 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:14:07.488471 31428 tablet_service.cc:1511] Processing CreateTablet for tablet 1e602beb4a714f99a8480a347d7add2e (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:14:07.489913 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb5c33d2a8a4010b336be5c5c4635cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.490906 31354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385e15f5c0b14702a8444e0e908bff77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.491626 31346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88d7f9369fa4e8eaa71b635d908ee34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.492265 31278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d502420b9f304f568a686ba8cdb9ae80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.501168 31352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ebece119174df8b0065e09199cb74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.462736 31559 tablet_bootstrap.cc:492] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:07.502259 31559 ts_tablet_manager.cc:1403] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.325s	user 0.018s	sys 0.014s
I20260709 12:14:07.505345 31559 raft_consensus.cc:359] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:07.506105 31559 raft_consensus.cc:385] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:07.506407 31559 raft_consensus.cc:740] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:07.507426 31559 consensus_queue.cc:260] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:07.488544 31426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d502420b9f304f568a686ba8cdb9ae80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.468034 31496 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb27277c309451f909355cb86a5d907 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:14:07.509369 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb27277c309451f909355cb86a5d907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.509389 31353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e602beb4a714f99a8480a347d7add2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.471136 31427 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8c6788cec8476ba424246e634c4712 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:14:07.513083 31427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8c6788cec8476ba424246e634c4712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.515220 31500 tablet_service.cc:1511] Processing CreateTablet for tablet 6f73b173ebeb4e0092ede2f6573824e8 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:14:07.501242 31274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ebece119174df8b0065e09199cb74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.557251 31277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb5c33d2a8a4010b336be5c5c4635cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.559085 31272 tablet_service.cc:1511] Processing CreateTablet for tablet 77e9e7b1921647a199c915cb27208e60 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:14:07.436606 31497 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8c6788cec8476ba424246e634c4712 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:14:07.422612 31501 tablet_service.cc:1511] Processing CreateTablet for tablet ddfe25b91d214455814522b83bc111d1 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:14:07.502295 31557 consensus_queue.cc:260] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:07.561753 31497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8c6788cec8476ba424246e634c4712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.562574 31501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfe25b91d214455814522b83bc111d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.477684 31424 tablet_service.cc:1511] Processing CreateTablet for tablet 53171289fe984298815d6d30885bf378 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:14:07.534574 31420 tablet_service.cc:1511] Processing CreateTablet for tablet 385e15f5c0b14702a8444e0e908bff77 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:14:07.547482 31421 tablet_service.cc:1511] Processing CreateTablet for tablet fdc78b9bfcf344f389246d2a9db1c5eb (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:14:07.553260 31422 tablet_service.cc:1511] Processing CreateTablet for tablet e88d7f9369fa4e8eaa71b635d908ee34 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:14:07.553638 31565 raft_consensus.cc:493] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.554334 31428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e602beb4a714f99a8480a347d7add2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.578845 31271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385e15f5c0b14702a8444e0e908bff77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.598618 31558 ts_tablet_manager.cc:1434] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.229s	user 0.015s	sys 0.018s
I20260709 12:14:07.590626 31494 tablet_service.cc:1511] Processing CreateTablet for tablet d502420b9f304f568a686ba8cdb9ae80 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:14:07.609961 31498 tablet_service.cc:1511] Processing CreateTablet for tablet ebdc9dd0bb6b443791a0ffbe39829943 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:14:07.619994 31424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53171289fe984298815d6d30885bf378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.577051 31565 raft_consensus.cc:515] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:07.629101 31421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc78b9bfcf344f389246d2a9db1c5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.625916 31557 ts_tablet_manager.cc:1434] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.251s	user 0.021s	sys 0.006s
I20260709 12:14:07.602813 31275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebdc9dd0bb6b443791a0ffbe39829943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.638908 31422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88d7f9369fa4e8eaa71b635d908ee34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.633494 31500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f73b173ebeb4e0092ede2f6573824e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.646416 31565 leader_election.cc:290] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
W20260709 12:14:07.653080 31538 tablet.cc:2406] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:07.662081 31560 ts_tablet_manager.cc:1434] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.319s	user 0.031s	sys 0.037s
I20260709 12:14:07.663244 31560 tablet_bootstrap.cc:492] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:07.664752 31427 tablet_service.cc:1511] Processing CreateTablet for tablet 77e9e7b1921647a199c915cb27208e60 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:14:07.666303 31272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e9e7b1921647a199c915cb27208e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.668099 31566 raft_consensus.cc:493] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.668654 31566 raft_consensus.cc:515] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:07.669363 31558 tablet_bootstrap.cc:492] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:07.671453 31566 leader_election.cc:290] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:07.665184 31270 tablet_service.cc:1511] Processing CreateTablet for tablet b21175df55ee43caab9a53db893f84a5 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:14:07.665691 31425 tablet_service.cc:1511] Processing CreateTablet for tablet 02ebece119174df8b0065e09199cb74a (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:14:07.653828 31420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385e15f5c0b14702a8444e0e908bff77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.655190 31559 ts_tablet_manager.cc:1434] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.153s	user 0.012s	sys 0.013s
I20260709 12:14:07.695829 31569 raft_consensus.cc:493] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.696463 31569 raft_consensus.cc:515] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:07.698225 31559 tablet_bootstrap.cc:492] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:07.699182 31569 leader_election.cc:290] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:07.692632 31498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebdc9dd0bb6b443791a0ffbe39829943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.695273 31557 tablet_bootstrap.cc:492] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:07.667672 31347 tablet_service.cc:1511] Processing CreateTablet for tablet c82bc50bbf494273a5cf986a398a5e4f (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:14:07.742599 31278 tablet_service.cc:1511] Processing CreateTablet for tablet ed36eebaa333457eb2e68c91b95afb39 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:14:07.746299 31495 tablet_service.cc:1511] Processing CreateTablet for tablet fdc78b9bfcf344f389246d2a9db1c5eb (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:14:07.747282 31423 tablet_service.cc:1511] Processing CreateTablet for tablet c82bc50bbf494273a5cf986a398a5e4f (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:14:07.747285 31494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d502420b9f304f568a686ba8cdb9ae80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.752372 31558 tablet_bootstrap.cc:654] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.736616 31425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ebece119174df8b0065e09199cb74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.754818 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b21175df55ee43caab9a53db893f84a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.774690 31348 tablet_service.cc:1511] Processing CreateTablet for tablet 4977dacca462483d9bc0b0929a806d10 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:14:07.797174 31501 tablet_service.cc:1511] Processing CreateTablet for tablet feb5c33d2a8a4010b336be5c5c4635cc (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:14:07.790637 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc78b9bfcf344f389246d2a9db1c5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.813519 31353 tablet_service.cc:1511] Processing CreateTablet for tablet b21175df55ee43caab9a53db893f84a5 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:14:07.754842 31502 tablet_service.cc:1511] Processing CreateTablet for tablet 1e602beb4a714f99a8480a347d7add2e (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:14:07.753296 31276 tablet_service.cc:1511] Processing CreateTablet for tablet 4977dacca462483d9bc0b0929a806d10 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:14:07.837812 31559 tablet_bootstrap.cc:654] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.828830 31347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82bc50bbf494273a5cf986a398a5e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.848898 31278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed36eebaa333457eb2e68c91b95afb39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.849402 31502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e602beb4a714f99a8480a347d7add2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.856379 31272 tablet_service.cc:1511] Processing CreateTablet for tablet 30451bcaa4ca44f992ef5f47be40eda9 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:14:07.848667 31419 tablet_service.cc:1511] Processing CreateTablet for tablet 4977dacca462483d9bc0b0929a806d10 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:14:07.857765 31272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30451bcaa4ca44f992ef5f47be40eda9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.862442 31279 tablet_service.cc:1511] Processing CreateTablet for tablet 8a490d738b8e443a857242c089199946 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:14:07.864679 31279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a490d738b8e443a857242c089199946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.865289 31501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb5c33d2a8a4010b336be5c5c4635cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.845161 31423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82bc50bbf494273a5cf986a398a5e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.868063 31493 tablet_service.cc:1511] Processing CreateTablet for tablet e88d7f9369fa4e8eaa71b635d908ee34 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 12:14:07.868871 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:07.880550 31567 raft_consensus.cc:493] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.881402 31567 raft_consensus.cc:515] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:07.905857 31276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4977dacca462483d9bc0b0929a806d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.910228 31497 tablet_service.cc:1511] Processing CreateTablet for tablet 77e9e7b1921647a199c915cb27208e60 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:14:07.915791 31497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e9e7b1921647a199c915cb27208e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.918820 31346 tablet_service.cc:1511] Processing CreateTablet for tablet 8a490d738b8e443a857242c089199946 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:14:07.922565 31352 tablet_service.cc:1511] Processing CreateTablet for tablet 30451bcaa4ca44f992ef5f47be40eda9 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:14:07.953446 31493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88d7f9369fa4e8eaa71b635d908ee34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.928861 31350 tablet_service.cc:1511] Processing CreateTablet for tablet 1f955719b6b1451eaf77381e2047ffff (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:14:07.929494 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:07.954593 31512 raft_consensus.cc:2468] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 0.
I20260709 12:14:07.932951 31427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e9e7b1921647a199c915cb27208e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.957083 31419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4977dacca462483d9bc0b0929a806d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.932407 31499 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45422 (request call id 16) took 1066 ms. Trace:
I20260709 12:14:07.880635 31496 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45422 (request call id 17) took 1011 ms. Trace:
I20260709 12:14:07.960948 31496 rpcz_store.cc:276] 0709 12:14:06.866665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.399585 (+532920us) service_pool.cc:224] Handling call
0709 12:14:07.508885 (+109300us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.508991 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:07.618776 (+109785us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:07.868156 (+249380us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:07.878366 (+ 10210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:07.963075 31496 tablet_service.cc:1511] Processing CreateTablet for tablet c82bc50bbf494273a5cf986a398a5e4f (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:14:07.964370 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82bc50bbf494273a5cf986a398a5e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.935199 31348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4977dacca462483d9bc0b0929a806d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.966964 31567 leader_election.cc:290] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:07.951154 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927c3304e84b06a5ca9baf08eda6f6" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:07.969213 31364 raft_consensus.cc:2468] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
I20260709 12:14:07.959792 31253 leader_election.cc:304] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:07.970865 31570 raft_consensus.cc:2804] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:07.971266 31570 raft_consensus.cc:493] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.971585 31570 raft_consensus.cc:3060] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:07.973114 31499 rpcz_store.cc:276] 0709 12:14:06.866327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.395561 (+529234us) service_pool.cc:224] Handling call
0709 12:14:07.428979 (+ 33418us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.429096 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:07.654790 (+225694us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:07.931827 (+277037us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:07.932337 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:07.973654 31401 leader_election.cc:304] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:07.974979 31568 raft_consensus.cc:2804] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:07.975435 31568 raft_consensus.cc:493] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.011045 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927c3304e84b06a5ca9baf08eda6f6" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:08.012178 31345 tablet_service.cc:1511] Processing CreateTablet for tablet 521fc30d365d455da547428401e26181 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:14:08.015475 31557 tablet_bootstrap.cc:654] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.032671 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:08.045296 31560 tablet_bootstrap.cc:654] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.044427 31493 tablet_service.cc:1511] Processing CreateTablet for tablet ed36eebaa333457eb2e68c91b95afb39 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:14:08.046983 31493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed36eebaa333457eb2e68c91b95afb39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.049887 31421 tablet_service.cc:1511] Processing CreateTablet for tablet ed36eebaa333457eb2e68c91b95afb39 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:14:08.050200 31272 tablet_service.cc:1511] Processing CreateTablet for tablet 04626a79b549449386652742229e800a (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:14:08.051610 31421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed36eebaa333457eb2e68c91b95afb39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.051695 31272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04626a79b549449386652742229e800a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.064090 31494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45422 (request call id 22) took 1022 ms. Trace:
I20260709 12:14:08.065099 31424 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47470 (request call id 21) took 1054 ms. Trace:
I20260709 12:14:08.065580 31424 rpcz_store.cc:276] 0709 12:14:07.010636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.476808 (+466172us) service_pool.cc:224] Handling call
0709 12:14:07.571337 (+ 94529us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.571493 (+   156us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:07.873875 (+302382us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:07.981013 (+107138us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.065028 (+ 84015us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.067541 31424 tablet_service.cc:1511] Processing CreateTablet for tablet 1f955719b6b1451eaf77381e2047ffff (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:14:08.003492 31352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30451bcaa4ca44f992ef5f47be40eda9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.082932 31570 raft_consensus.cc:515] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:08.085815 31351 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab02fdbdd944bfab62c752b0636f82c (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:14:08.087414 31570 leader_election.cc:290] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:08.005498 31568 raft_consensus.cc:3060] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.089423 31558 tablet_bootstrap.cc:492] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:08.090102 31558 ts_tablet_manager.cc:1403] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.421s	user 0.018s	sys 0.031s
I20260709 12:14:08.077077 31424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f955719b6b1451eaf77381e2047ffff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.095288 31289 raft_consensus.cc:2393] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 1: Already voted for candidate 0769d57e6db04b2f86703e0ed60f6185 in this term.
I20260709 12:14:08.096858 31426 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47470 (request call id 22) took 1060 ms. Trace:
I20260709 12:14:08.102432 31274 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab02fdbdd944bfab62c752b0636f82c (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:14:08.103798 31274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab02fdbdd944bfab62c752b0636f82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.105715 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:08.106348 31512 raft_consensus.cc:3060] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.109779 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
W20260709 12:14:08.112123 31475 leader_election.cc:343] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:08.100684 31351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab02fdbdd944bfab62c752b0636f82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.117388 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927c3304e84b06a5ca9baf08eda6f6" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:08.112637 31475 leader_election.cc:304] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:08.127089 31559 tablet_bootstrap.cc:492] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:08.128023 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927c3304e84b06a5ca9baf08eda6f6" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:08.128343 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:07.975256 31499 tablet_service.cc:1511] Processing CreateTablet for tablet b21175df55ee43caab9a53db893f84a5 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:14:08.129220 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
W20260709 12:14:08.165995 31330 leader_election.cc:343] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:08.157722 31559 ts_tablet_manager.cc:1403] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.460s	user 0.024s	sys 0.003s
I20260709 12:14:08.166301 31512 raft_consensus.cc:2468] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 1.
I20260709 12:14:08.176389 31419 tablet_service.cc:1511] Processing CreateTablet for tablet 04626a79b549449386652742229e800a (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 12:14:08.167995 31475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 56061.9us
I20260709 12:14:08.170406 31425 tablet_service.cc:1511] Processing CreateTablet for tablet 8a490d738b8e443a857242c089199946 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:14:08.139278 31273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55504 (request call id 19) took 1332 ms. Trace:
I20260709 12:14:08.121670 31426 rpcz_store.cc:276] 0709 12:14:07.036213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.485934 (+449721us) service_pool.cc:224] Handling call
0709 12:14:07.488033 (+  2099us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.488135 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:07.813810 (+325675us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.096075 (+282265us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.096737 (+   662us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.176256 31567 raft_consensus.cc:2749] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:08.179549 31499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b21175df55ee43caab9a53db893f84a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.181501 31422 tablet_service.cc:1511] Processing CreateTablet for tablet 521fc30d365d455da547428401e26181 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:14:08.182403 31559 raft_consensus.cc:359] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:08.178582 31346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a490d738b8e443a857242c089199946. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:08.187095 31252 leader_election.cc:343] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:08.187258 31404 leader_election.cc:343] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:08.206107 31558 raft_consensus.cc:359] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:08.208810 31253 leader_election.cc:304] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:08.139575 31568 raft_consensus.cc:515] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:08.064684 31494 rpcz_store.cc:276] 0709 12:14:07.041652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.574303 (+532651us) service_pool.cc:224] Handling call
0709 12:14:07.626722 (+ 52419us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.626836 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:07.935991 (+309155us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.063350 (+127359us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.063997 (+   647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.172065 31420 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47470 (request call id 24) took 1004 ms. Trace:
I20260709 12:14:08.216948 31420 rpcz_store.cc:276] 0709 12:14:07.168065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.533282 (+365217us) service_pool.cc:224] Handling call
0709 12:14:07.620868 (+ 87586us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5800195998. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fcceab5ddb1 00007fcceac9db71 00007fcceac9da22 00007fccf3bb68d9 00007fccf2d10ee0 00007fccf2df6831 00007fccf2dd3ac3 00007fccf2d82400 00007fccec207af4 00007fccec207a82 00007fccec2079b1
0709 12:14:07.621031 (+   163us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.621137 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:07.952694 (+331557us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.171335 (+218641us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.171981 (+   646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29737216}
I20260709 12:14:08.188916 31273 rpcz_store.cc:276] 0709 12:14:06.806880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.190958 (+384078us) service_pool.cc:224] Handling call
0709 12:14:07.247254 (+ 56296us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.247361 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:07.754160 (+506799us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.138542 (+384382us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.139197 (+   655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.142215 31495 tablet_service.cc:1511] Processing CreateTablet for tablet 1f955719b6b1451eaf77381e2047ffff (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:14:08.196707 31426 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab02fdbdd944bfab62c752b0636f82c (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:14:08.220408 31570 raft_consensus.cc:2804] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:08.220891 31560 tablet_bootstrap.cc:492] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:08.221580 31560 ts_tablet_manager.cc:1403] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.559s	user 0.037s	sys 0.016s
I20260709 12:14:08.222084 31419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04626a79b549449386652742229e800a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.225145 31438 raft_consensus.cc:2393] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56add4c904c74a1bba90579b9204e45d in current term 1: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:08.232889 31498 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45422 (request call id 24) took 1063 ms. Trace:
I20260709 12:14:08.233290 31498 rpcz_store.cc:276] 0709 12:14:07.169653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.584229 (+414576us) service_pool.cc:224] Handling call
0709 12:14:07.627346 (+ 43117us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.627483 (+   137us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:08.133352 (+505869us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.232341 (+ 98989us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.232825 (+   484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.234170 31350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f955719b6b1451eaf77381e2047ffff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.234977 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521fc30d365d455da547428401e26181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.235630 31329 leader_election.cc:304] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:08.225528 31494 tablet_service.cc:1511] Processing CreateTablet for tablet 30451bcaa4ca44f992ef5f47be40eda9 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:14:08.239081 31354 tablet_service.cc:1511] Processing CreateTablet for tablet bb35e6f710fb417fba28d448bf7cc140 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:14:08.225903 31252 leader_election.cc:343] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:08.241150 31426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab02fdbdd944bfab62c752b0636f82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.228071 31495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f955719b6b1451eaf77381e2047ffff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.227212 31568 leader_election.cc:290] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:08.226056 31276 tablet_service.cc:1511] Processing CreateTablet for tablet bb35e6f710fb417fba28d448bf7cc140 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:14:08.192570 31559 raft_consensus.cc:385] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.242534 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927c3304e84b06a5ca9baf08eda6f6" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:08.244228 31276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb35e6f710fb417fba28d448bf7cc140. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:08.244462 31404 leader_election.cc:343] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:08.229547 31493 tablet_service.cc:1511] Processing CreateTablet for tablet 04626a79b549449386652742229e800a (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:14:08.240597 31354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb35e6f710fb417fba28d448bf7cc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.228021 31428 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47470 (request call id 23) took 1097 ms. Trace:
I20260709 12:14:08.243021 31559 raft_consensus.cc:740] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.247336 31353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b21175df55ee43caab9a53db893f84a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.247668 31559 consensus_queue.cc:260] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:08.252460 31559 ts_tablet_manager.cc:1434] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.002s
I20260709 12:14:08.245918 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75927c3304e84b06a5ca9baf08eda6f6" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:08.253693 31364 raft_consensus.cc:3060] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.253301 31273 tablet_service.cc:1511] Processing CreateTablet for tablet 7ead5d3f281f4adb8e218fc8979158f2 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:14:08.254351 31349 tablet_service.cc:1511] Processing CreateTablet for tablet 27155e412e29424db98323b0a5e9d620 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:14:08.256153 31349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27155e412e29424db98323b0a5e9d620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.255035 31273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ead5d3f281f4adb8e218fc8979158f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.246831 31428 rpcz_store.cc:276] 0709 12:14:07.131044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.487545 (+356501us) service_pool.cc:224] Handling call
0709 12:14:07.489495 (+  1950us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.498721 (+  9226us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:08.098359 (+599638us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.211059 (+112700us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.227953 (+ 16894us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.262642 31557 tablet_bootstrap.cc:492] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:08.263257 31557 ts_tablet_manager.cc:1403] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.611s	user 0.013s	sys 0.018s
I20260709 12:14:08.242501 31425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a490d738b8e443a857242c089199946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.265682 31559 tablet_bootstrap.cc:492] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:08.266462 31422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521fc30d365d455da547428401e26181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.266796 31424 tablet_service.cc:1511] Processing CreateTablet for tablet 7ead5d3f281f4adb8e218fc8979158f2 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:14:08.268186 31424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ead5d3f281f4adb8e218fc8979158f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.254962 31493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04626a79b549449386652742229e800a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.280807 31494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30451bcaa4ca44f992ef5f47be40eda9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.286767 31498 tablet_service.cc:1511] Processing CreateTablet for tablet bb35e6f710fb417fba28d448bf7cc140 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:14:08.289515 31498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb35e6f710fb417fba28d448bf7cc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.293467 31496 tablet_service.cc:1511] Processing CreateTablet for tablet 521fc30d365d455da547428401e26181 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:14:08.212613 31558 raft_consensus.cc:385] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.341899 31558 raft_consensus.cc:740] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.342909 31558 consensus_queue.cc:260] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:08.245934 31502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45422 (request call id 23) took 1110 ms. Trace:
I20260709 12:14:08.344483 31502 rpcz_store.cc:276] 0709 12:14:07.135520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.577726 (+442206us) service_pool.cc:224] Handling call
0709 12:14:07.848656 (+270930us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.848818 (+   162us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:08.095315 (+246497us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.245353 (+150038us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.245860 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.345708 31567 raft_consensus.cc:493] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.346292 31567 raft_consensus.cc:515] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:08.297537 31501 tablet_service.cc:1511] Processing CreateTablet for tablet 7ead5d3f281f4adb8e218fc8979158f2 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:14:08.351971 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d045764fb04dbc819b8f88e9bb085f" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:08.353206 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d045764fb04dbc819b8f88e9bb085f" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
W20260709 12:14:08.355423 31478 leader_election.cc:343] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:08.356228 31567 leader_election.cc:290] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
W20260709 12:14:08.358085 31475 leader_election.cc:343] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:08.358696 31475 leader_election.cc:304] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:08.304942 31428 tablet_service.cc:1511] Processing CreateTablet for tablet 27155e412e29424db98323b0a5e9d620 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:14:08.306489 31557 raft_consensus.cc:359] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:08.360486 31557 raft_consensus.cc:385] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.360962 31567 raft_consensus.cc:2749] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:08.361241 31557 raft_consensus.cc:740] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.362300 31428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27155e412e29424db98323b0a5e9d620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.307317 31560 raft_consensus.cc:359] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:08.232587 31500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45422 (request call id 21) took 1219 ms. Trace:
I20260709 12:14:08.362861 31500 rpcz_store.cc:276] 0709 12:14:07.013122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.514280 (+501158us) service_pool.cc:224] Handling call
0709 12:14:07.575919 (+ 61639us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.585795 (+  9876us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:08.137288 (+551493us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.231994 (+ 94706us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.232522 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.358722 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521fc30d365d455da547428401e26181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.365044 31560 raft_consensus.cc:385] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.365473 31560 raft_consensus.cc:740] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.366478 31560 consensus_queue.cc:260] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:08.369755 31559 tablet_bootstrap.cc:654] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.309907 31497 tablet_service.cc:1511] Processing CreateTablet for tablet 27155e412e29424db98323b0a5e9d620 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:14:08.311559 31278 tablet_service.cc:1511] Processing CreateTablet for tablet 08e23c1349714ee8b522e1b92accebc2 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:14:08.374980 31278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e23c1349714ee8b522e1b92accebc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.314399 31348 tablet_service.cc:1511] Processing CreateTablet for tablet 08e23c1349714ee8b522e1b92accebc2 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:14:08.325273 31570 raft_consensus.cc:697] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:08.377727 31570 consensus_queue.cc:237] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:08.379366 31364 raft_consensus.cc:2468] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:08.380111 31590 raft_consensus.cc:2749] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:08.327415 31329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 91902.2us
I20260709 12:14:08.381757 31348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e23c1349714ee8b522e1b92accebc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.373277 31501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ead5d3f281f4adb8e218fc8979158f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.389889 31560 ts_tablet_manager.cc:1434] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.168s	user 0.003s	sys 0.005s
I20260709 12:14:08.390817 31424 tablet_service.cc:1511] Processing CreateTablet for tablet 08e23c1349714ee8b522e1b92accebc2 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:14:08.392158 31560 tablet_bootstrap.cc:492] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:08.393167 31497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27155e412e29424db98323b0a5e9d620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.393260 31401 leader_election.cc:304] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:08.394637 31568 raft_consensus.cc:2804] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:08.409456 31424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e23c1349714ee8b522e1b92accebc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.423059 31500 tablet_service.cc:1511] Processing CreateTablet for tablet efbd74b64bc44ffea43757f3bdbfe1c3 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:14:08.427738 31500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbd74b64bc44ffea43757f3bdbfe1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.432184 31568 raft_consensus.cc:697] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:08.435678 31568 consensus_queue.cc:237] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:08.428205 31557 consensus_queue.cc:260] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:08.439831 31557 ts_tablet_manager.cc:1434] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.176s	user 0.009s	sys 0.002s
I20260709 12:14:08.437618 31273 tablet_service.cc:1511] Processing CreateTablet for tablet efbd74b64bc44ffea43757f3bdbfe1c3 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:14:08.440949 31557 tablet_bootstrap.cc:492] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:08.444375 31273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbd74b64bc44ffea43757f3bdbfe1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.451864 31346 tablet_service.cc:1511] Processing CreateTablet for tablet efbd74b64bc44ffea43757f3bdbfe1c3 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:14:08.454699 31346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbd74b64bc44ffea43757f3bdbfe1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.459898 31347 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58214 (request call id 29) took 1013 ms. Trace:
I20260709 12:14:08.473385 31502 tablet_service.cc:1511] Processing CreateTablet for tablet 49cdc6c4a86a4b57b1df61deb0767165 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:14:08.484055 31274 tablet_service.cc:1511] Processing CreateTablet for tablet 49cdc6c4a86a4b57b1df61deb0767165 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:14:08.484050 31351 tablet_service.cc:1511] Processing CreateTablet for tablet 5010c0b5047248748914c1dc813009c8 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:14:08.485733 31351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5010c0b5047248748914c1dc813009c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.485733 31274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49cdc6c4a86a4b57b1df61deb0767165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.487180 31502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49cdc6c4a86a4b57b1df61deb0767165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.493878 31422 tablet_service.cc:1511] Processing CreateTablet for tablet 5010c0b5047248748914c1dc813009c8 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:14:08.493559 31186 catalog_manager.cc:5697] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 1, leader changed from <none> to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 1 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.495303 31422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5010c0b5047248748914c1dc813009c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.460556 31347 rpcz_store.cc:276] 0709 12:14:07.446847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.634727 (+187880us) service_pool.cc:224] Handling call
0709 12:14:07.754024 (+119297us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.758197 (+  4173us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:08.315831 (+557634us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.459225 (+143394us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.459813 (+   588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.501844 31187 catalog_manager.cc:5697] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:08.507879 31496 tablet_service.cc:1511] Processing CreateTablet for tablet 5010c0b5047248748914c1dc813009c8 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:14:08.509296 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5010c0b5047248748914c1dc813009c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.479230 31423 tablet_service.cc:1511] Processing CreateTablet for tablet 49cdc6c4a86a4b57b1df61deb0767165 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:14:08.513564 31423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49cdc6c4a86a4b57b1df61deb0767165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.513801 31276 tablet_service.cc:1511] Processing CreateTablet for tablet d315efa422c24fa4a72ad1fc98375dc9 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:14:08.515142 31276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d315efa422c24fa4a72ad1fc98375dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.525804 31347 tablet_service.cc:1511] Processing CreateTablet for tablet d315efa422c24fa4a72ad1fc98375dc9 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:14:08.526866 31557 tablet_bootstrap.cc:654] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.527238 31347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d315efa422c24fa4a72ad1fc98375dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.536928 31428 tablet_service.cc:1511] Processing CreateTablet for tablet d315efa422c24fa4a72ad1fc98375dc9 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:14:08.538591 31428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d315efa422c24fa4a72ad1fc98375dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.531975 31558 ts_tablet_manager.cc:1434] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.441s	user 0.026s	sys 0.021s
I20260709 12:14:08.552124 31270 tablet_service.cc:1511] Processing CreateTablet for tablet fb12da9e1bf4477cb726be970f4406e7 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:14:08.552336 31497 tablet_service.cc:1511] Processing CreateTablet for tablet fb12da9e1bf4477cb726be970f4406e7 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:14:08.553930 31497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb12da9e1bf4477cb726be970f4406e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.554193 31270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb12da9e1bf4477cb726be970f4406e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.569100 31568 raft_consensus.cc:493] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.572933 31568 raft_consensus.cc:515] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:08.574030 31350 tablet_service.cc:1511] Processing CreateTablet for tablet fb12da9e1bf4477cb726be970f4406e7 (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:14:08.574388 31419 tablet_service.cc:1511] Processing CreateTablet for tablet 050680dae66642369827ee0318291dac (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:14:08.576212 31419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050680dae66642369827ee0318291dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.577576 31568 leader_election.cc:290] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:08.575500 31350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb12da9e1bf4477cb726be970f4406e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.593736 31499 tablet_service.cc:1511] Processing CreateTablet for tablet 050680dae66642369827ee0318291dac (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:14:08.625792 31499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050680dae66642369827ee0318291dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.605082 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2fa69725764633ab7d8cc899591b75" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:08.630044 31558 tablet_bootstrap.cc:492] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
W20260709 12:14:08.630349 31401 leader_election.cc:343] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:08.635406 31560 tablet_bootstrap.cc:654] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.684262 31495 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45422 (request call id 32) took 1020 ms. Trace:
I20260709 12:14:08.685268 31495 rpcz_store.cc:276] 0709 12:14:07.663448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.108762 (+445314us) service_pool.cc:224] Handling call
0709 12:14:08.220617 (+111855us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:08.220736 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:08.503560 (+282824us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.683180 (+179620us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.684107 (+   927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.700322 31557 tablet_bootstrap.cc:492] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:08.705534 31559 tablet_bootstrap.cc:492] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:08.706262 31559 ts_tablet_manager.cc:1403] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.443s	user 0.011s	sys 0.024s
I20260709 12:14:08.707645 31557 ts_tablet_manager.cc:1403] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.267s	user 0.039s	sys 0.027s
I20260709 12:14:08.711621 31559 raft_consensus.cc:359] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:08.716604 31559 raft_consensus.cc:385] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.717025 31559 raft_consensus.cc:740] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.718076 31559 consensus_queue.cc:260] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:08.715550 31557 raft_consensus.cc:359] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:08.719416 31557 raft_consensus.cc:385] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.719772 31557 raft_consensus.cc:740] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.722553 31559 ts_tablet_manager.cc:1434] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 12:14:08.720849 31557 consensus_queue.cc:260] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:08.725788 31559 tablet_bootstrap.cc:492] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:08.726702 31558 tablet_bootstrap.cc:654] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.726116 31557 ts_tablet_manager.cc:1434] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:14:08.728051 31557 tablet_bootstrap.cc:492] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:08.735709 31557 tablet_bootstrap.cc:654] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.737331 31559 tablet_bootstrap.cc:654] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.739494 31560 tablet_bootstrap.cc:492] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:08.740561 31560 ts_tablet_manager.cc:1403] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.349s	user 0.017s	sys 0.020s
I20260709 12:14:08.743781 31560 raft_consensus.cc:359] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:08.795360 31276 tablet_service.cc:1511] Processing CreateTablet for tablet 050680dae66642369827ee0318291dac (DEFAULT_TABLE table=test-workload [id=18f4e896a5e84ac99c777aaad9b7c7de]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:14:08.833253 31558 tablet_bootstrap.cc:492] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:08.835817 31560 raft_consensus.cc:385] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.835664 31570 raft_consensus.cc:493] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.836951 31560 raft_consensus.cc:740] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.837568 31570 raft_consensus.cc:515] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:08.838622 31560 consensus_queue.cc:260] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:08.839600 31557 tablet_bootstrap.cc:492] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:08.843457 31557 ts_tablet_manager.cc:1403] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.116s	user 0.013s	sys 0.005s
I20260709 12:14:08.847285 31276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050680dae66642369827ee0318291dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.864864 31591 raft_consensus.cc:493] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.866091 31591 raft_consensus.cc:515] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:08.872066 31591 leader_election.cc:290] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:08.871961 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3110254469cd41d2bc5addd8675f1ddd" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:08.871976 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3110254469cd41d2bc5addd8675f1ddd" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:08.876019 31330 leader_election.cc:343] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:08.877286 31329 leader_election.cc:343] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:08.877892 31329 leader_election.cc:304] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:08.878916 31591 raft_consensus.cc:2749] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:08.890029 31252 consensus_peers.cc:597] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:08.889927 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:08.893373 31558 ts_tablet_manager.cc:1403] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.310s	user 0.015s	sys 0.002s
I20260709 12:14:08.895298 31560 ts_tablet_manager.cc:1434] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.154s	user 0.006s	sys 0.003s
I20260709 12:14:08.897609 31560 tablet_bootstrap.cc:492] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:08.901279 31570 leader_election.cc:290] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:08.909525 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a4e71f02b84b77a615d593e2bd3597" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:08.914062 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2fa69725764633ab7d8cc899591b75" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:08.917060 31402 leader_election.cc:343] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:08.917968 31402 leader_election.cc:304] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
W20260709 12:14:08.919499 31353 consensus_meta.cc:287] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d: Time spent flushing consensus metadata: real 0.532s	user 0.012s	sys 0.013s
I20260709 12:14:08.920418 31568 raft_consensus.cc:2749] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:08.921068 31353 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:58214 (request call id 31) took 1378 ms. Trace:
I20260709 12:14:08.921775 31558 raft_consensus.cc:359] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:08.922827 31558 raft_consensus.cc:385] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.923142 31558 raft_consensus.cc:740] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.921604 31353 rpcz_store.cc:276] 0709 12:14:07.542599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.796443 (+253844us) service_pool.cc:224] Handling call
0709 12:14:07.866982 (+ 70539us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.867135 (+   153us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:08.328513 (+461378us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.920339 (+591826us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.920989 (+   650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.923993 31558 consensus_queue.cc:260] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:08.945067 31568 consensus_queue.cc:1048] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:08.954200 31557 raft_consensus.cc:359] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:08.955209 31557 raft_consensus.cc:385] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.955523 31557 raft_consensus.cc:740] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.956960 31558 ts_tablet_manager.cc:1434] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.004s
I20260709 12:14:08.958760 31558 tablet_bootstrap.cc:492] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
W20260709 12:14:08.966446 31252 leader_election.cc:343] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:08.969273 31560 tablet_bootstrap.cc:654] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.956534 31557 consensus_queue.cc:260] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:08.989341 31557 ts_tablet_manager.cc:1434] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.145s	user 0.006s	sys 0.005s
I20260709 12:14:08.996023 31570 consensus_queue.cc:1048] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:08.997880 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a4e71f02b84b77a615d593e2bd3597" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:09.001261 31254 leader_election.cc:343] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.001962 31254 leader_election.cc:304] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:09.004832 31559 tablet_bootstrap.cc:492] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:09.004369 31570 raft_consensus.cc:2749] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:09.005684 31559 ts_tablet_manager.cc:1403] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.282s	user 0.004s	sys 0.024s
I20260709 12:14:09.008319 31591 raft_consensus.cc:493] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.008961 31591 raft_consensus.cc:515] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.013064 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a4e71f02b84b77a615d593e2bd3597" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:09.013582 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a4e71f02b84b77a615d593e2bd3597" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:09.014124 31288 raft_consensus.cc:2468] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:09.015519 31558 tablet_bootstrap.cc:654] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.016243 31330 leader_election.cc:304] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:09.017190 31557 tablet_bootstrap.cc:492] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:09.014446 31591 leader_election.cc:290] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
W20260709 12:14:09.018283 31329 leader_election.cc:343] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.022768 31591 raft_consensus.cc:2804] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:09.028215 31591 raft_consensus.cc:493] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.021657 31559 raft_consensus.cc:359] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.029529 31591 raft_consensus.cc:3060] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.036895 31559 raft_consensus.cc:385] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.043835 31591 raft_consensus.cc:515] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.040134 31559 raft_consensus.cc:740] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.047369 31559 consensus_queue.cc:260] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.053015 31570 raft_consensus.cc:493] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.057436 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a4e71f02b84b77a615d593e2bd3597" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:09.058283 31288 raft_consensus.cc:3060] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.056610 31570 raft_consensus.cc:515] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.066795 31591 leader_election.cc:290] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:09.067510 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a4e71f02b84b77a615d593e2bd3597" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:09.071030 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521c6b0664a14a35a1eca5919b44637f" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:09.067157 31570 leader_election.cc:290] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:09.074004 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521c6b0664a14a35a1eca5919b44637f" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:09.074610 31329 leader_election.cc:343] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:09.076012 31252 leader_election.cc:343] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.076400 31560 tablet_bootstrap.cc:492] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:09.077111 31560 ts_tablet_manager.cc:1403] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.180s	user 0.007s	sys 0.029s
I20260709 12:14:09.083576 31557 tablet_bootstrap.cc:654] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.086979 31559 ts_tablet_manager.cc:1434] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.081s	user 0.011s	sys 0.001s
I20260709 12:14:09.090927 31559 tablet_bootstrap.cc:492] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:09.081804 31560 raft_consensus.cc:359] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.095327 31288 raft_consensus.cc:2468] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:09.095629 31560 raft_consensus.cc:385] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.098376 31330 leader_election.cc:304] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:09.099926 31591 raft_consensus.cc:2804] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:09.100469 31591 raft_consensus.cc:697] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:09.101471 31591 consensus_queue.cc:237] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.102075 31620 raft_consensus.cc:493] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:09.104604 31253 leader_election.cc:343] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.096086 31560 raft_consensus.cc:740] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.108820 31560 consensus_queue.cc:260] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.103374 31620 raft_consensus.cc:515] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.113610 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb07b495c85d4de88b7c752f4a6f7ee7" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:09.115097 31620 leader_election.cc:290] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:09.116185 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb07b495c85d4de88b7c752f4a6f7ee7" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
W20260709 12:14:09.118144 31252 leader_election.cc:343] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.119812 31559 tablet_bootstrap.cc:654] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.126087 31560 ts_tablet_manager.cc:1434] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.001s
W20260709 12:14:09.126399 31404 consensus_peers.cc:597] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:09.124308 31254 leader_election.cc:343] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.127503 31254 leader_election.cc:304] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:09.114099 31253 leader_election.cc:304] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:09.130299 31570 raft_consensus.cc:2749] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:09.128351 31620 raft_consensus.cc:2749] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:09.133813 31567 raft_consensus.cc:493] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.134335 31558 tablet_bootstrap.cc:492] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:09.134967 31558 ts_tablet_manager.cc:1403] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.007s
I20260709 12:14:09.134444 31567 raft_consensus.cc:515] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.138175 31567 leader_election.cc:290] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:09.147104 31186 catalog_manager.cc:5697] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.149467 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
W20260709 12:14:09.153612 31475 leader_election.cc:343] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.163513 31558 raft_consensus.cc:359] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.164543 31558 raft_consensus.cc:385] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.164928 31558 raft_consensus.cc:740] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.165248 31560 tablet_bootstrap.cc:492] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:09.167928 31558 consensus_queue.cc:260] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.172180 31558 ts_tablet_manager.cc:1434] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 12:14:09.173494 31558 tablet_bootstrap.cc:492] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:09.177830 31560 tablet_bootstrap.cc:654] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.180548 31558 tablet_bootstrap.cc:654] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.186182 31559 tablet_bootstrap.cc:492] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:09.186578 31559 ts_tablet_manager.cc:1403] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.026s
I20260709 12:14:09.188171 31557 tablet_bootstrap.cc:492] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:09.188959 31557 ts_tablet_manager.cc:1403] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.198s	user 0.014s	sys 0.028s
I20260709 12:14:09.189646 31559 raft_consensus.cc:359] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.190488 31559 raft_consensus.cc:385] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.190698 31559 raft_consensus.cc:740] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.190838 31560 tablet_bootstrap.cc:492] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:09.191424 31560 ts_tablet_manager.cc:1403] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.015s
I20260709 12:14:09.191243 31559 consensus_queue.cc:260] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.192986 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:09.193535 31559 ts_tablet_manager.cc:1434] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:09.193001 31557 raft_consensus.cc:359] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.193948 31438 raft_consensus.cc:2468] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:09.194290 31557 raft_consensus.cc:385] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.194751 31557 raft_consensus.cc:740] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.195164 31559 tablet_bootstrap.cc:492] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:09.195765 31477 leader_election.cc:304] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:09.195812 31557 consensus_queue.cc:260] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.197306 31567 raft_consensus.cc:2804] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:09.197710 31567 raft_consensus.cc:493] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.198083 31567 raft_consensus.cc:3060] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.198796 31557 ts_tablet_manager.cc:1434] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:14:09.200464 31557 tablet_bootstrap.cc:492] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:09.207643 31567 raft_consensus.cc:515] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.209329 31559 tablet_bootstrap.cc:654] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.211030 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:09.211828 31560 raft_consensus.cc:359] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.216230 31558 tablet_bootstrap.cc:492] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:09.216420 31560 raft_consensus.cc:385] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.216846 31558 ts_tablet_manager.cc:1403] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.005s
I20260709 12:14:09.218195 31557 tablet_bootstrap.cc:654] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:09.213304 31475 leader_election.cc:343] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.220687 31558 raft_consensus.cc:359] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.221647 31558 raft_consensus.cc:385] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.221976 31558 raft_consensus.cc:740] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.222787 31567 leader_election.cc:290] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:09.222934 31558 consensus_queue.cc:260] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.223718 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:09.224252 31438 raft_consensus.cc:3060] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.225131 31559 tablet_bootstrap.cc:492] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:09.225747 31559 ts_tablet_manager.cc:1403] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.012s
I20260709 12:14:09.226521 31568 raft_consensus.cc:493] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.227085 31568 raft_consensus.cc:515] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.225831 31560 raft_consensus.cc:740] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.225747 31558 ts_tablet_manager.cc:1434] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:09.229969 31560 consensus_queue.cc:260] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.231881 31620 raft_consensus.cc:493] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.232409 31620 raft_consensus.cc:515] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.233669 31558 tablet_bootstrap.cc:492] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:09.234578 31438 raft_consensus.cc:2468] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:09.234766 31620 leader_election.cc:290] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:09.236294 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2607cd0103e94dec990c36aa6cbf89d0" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:09.237201 31477 leader_election.cc:304] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:09.230902 31568 leader_election.cc:290] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:09.239991 31567 raft_consensus.cc:2804] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:09.238547 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191640019a84d1c9ec1470b18a33641" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:09.241189 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2607cd0103e94dec990c36aa6cbf89d0" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:09.241840 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191640019a84d1c9ec1470b18a33641" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:09.244161 31557 tablet_bootstrap.cc:492] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
W20260709 12:14:09.244153 31253 leader_election.cc:343] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.245239 31557 ts_tablet_manager.cc:1403] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.000s
W20260709 12:14:09.241904 31401 leader_election.cc:343] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.241982 31511 raft_consensus.cc:2468] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
I20260709 12:14:09.239441 31559 raft_consensus.cc:359] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.248710 31559 raft_consensus.cc:385] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.249154 31559 raft_consensus.cc:740] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.250056 31402 leader_election.cc:304] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:09.250583 31559 consensus_queue.cc:260] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.251611 31568 raft_consensus.cc:2804] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:09.252058 31568 raft_consensus.cc:493] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.252561 31568 raft_consensus.cc:3060] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:09.260941 31254 leader_election.cc:343] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.261245 31559 ts_tablet_manager.cc:1434] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.035s	user 0.011s	sys 0.005s
I20260709 12:14:09.261662 31254 leader_election.cc:304] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:09.262806 31620 raft_consensus.cc:2749] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:09.262989 31559 tablet_bootstrap.cc:492] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:09.267467 31558 tablet_bootstrap.cc:654] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.270968 31557 raft_consensus.cc:359] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.272128 31557 raft_consensus.cc:385] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.272521 31557 raft_consensus.cc:740] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.247581 31560 ts_tablet_manager.cc:1434] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.056s	user 0.011s	sys 0.000s
I20260709 12:14:09.273717 31559 tablet_bootstrap.cc:654] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.277742 31568 raft_consensus.cc:515] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.275296 31560 tablet_bootstrap.cc:492] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:09.275714 31567 raft_consensus.cc:697] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:09.281728 31567 consensus_queue.cc:237] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.282150 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2607cd0103e94dec990c36aa6cbf89d0" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:09.283254 31511 raft_consensus.cc:3060] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.276290 31557 consensus_queue.cc:260] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.285400 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2607cd0103e94dec990c36aa6cbf89d0" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:09.286038 31568 leader_election.cc:290] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
W20260709 12:14:09.288113 31401 leader_election.cc:343] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.298045 31560 tablet_bootstrap.cc:654] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.303130 31558 tablet_bootstrap.cc:492] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:09.288430 31557 ts_tablet_manager.cc:1434] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:14:09.303836 31558 ts_tablet_manager.cc:1403] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.019s
I20260709 12:14:09.307722 31558 raft_consensus.cc:359] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.308362 31557 tablet_bootstrap.cc:492] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:09.308687 31558 raft_consensus.cc:385] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.309290 31558 raft_consensus.cc:740] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.312917 31620 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.313738 31620 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.326843 31558 consensus_queue.cc:260] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.329916 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:09.332221 31254 leader_election.cc:343] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.334744 31558 ts_tablet_manager.cc:1434] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.017s
I20260709 12:14:09.335999 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:09.336519 31558 tablet_bootstrap.cc:492] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:09.336961 31512 raft_consensus.cc:2468] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 0.
I20260709 12:14:09.334542 31511 raft_consensus.cc:2468] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:09.339632 31253 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:09.340662 31570 raft_consensus.cc:2804] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:09.341183 31570 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.341583 31570 raft_consensus.cc:3060] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.343343 31186 catalog_manager.cc:5697] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.348942 31558 tablet_bootstrap.cc:654] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.350015 31402 leader_election.cc:304] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:09.351303 31568 raft_consensus.cc:2804] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:09.351480 31559 tablet_bootstrap.cc:492] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:09.352195 31559 ts_tablet_manager.cc:1403] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.012s
I20260709 12:14:09.352618 31568 raft_consensus.cc:697] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:09.353574 31568 consensus_queue.cc:237] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.340693 31620 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:09.359472 31558 tablet_bootstrap.cc:492] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:09.360121 31558 ts_tablet_manager.cc:1403] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 12:14:09.362031 31570 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.345047 31560 tablet_bootstrap.cc:492] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:09.363729 31560 ts_tablet_manager.cc:1403] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.005s
I20260709 12:14:09.363994 31558 raft_consensus.cc:359] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.367017 31558 raft_consensus.cc:385] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.367389 31558 raft_consensus.cc:740] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.364619 31570 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:09.366418 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:09.366124 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:09.369124 31511 raft_consensus.cc:3060] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:09.370666 31254 leader_election.cc:343] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.367023 31560 raft_consensus.cc:359] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.372156 31560 raft_consensus.cc:385] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.372509 31560 raft_consensus.cc:740] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.365034 31557 tablet_bootstrap.cc:654] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.365372 31559 raft_consensus.cc:359] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.374199 31559 raft_consensus.cc:385] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.374544 31559 raft_consensus.cc:740] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.375957 31558 consensus_queue.cc:260] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.375715 31560 consensus_queue.cc:260] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.378582 31558 ts_tablet_manager.cc:1434] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.007s
I20260709 12:14:09.380195 31558 tablet_bootstrap.cc:492] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:09.380290 31560 ts_tablet_manager.cc:1434] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:14:09.381608 31560 tablet_bootstrap.cc:492] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:09.383500 31186 catalog_manager.cc:5697] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 1, leader changed from <none> to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 1 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.388139 31558 tablet_bootstrap.cc:654] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.388509 31559 consensus_queue.cc:260] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.388139 31560 tablet_bootstrap.cc:654] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.394325 31511 raft_consensus.cc:2468] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 1.
I20260709 12:14:09.399832 31559 ts_tablet_manager.cc:1434] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.003s
I20260709 12:14:09.401831 31559 tablet_bootstrap.cc:492] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:09.404172 31591 raft_consensus.cc:493] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.404891 31591 raft_consensus.cc:515] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.408450 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2607cd0103e94dec990c36aa6cbf89d0" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:09.410657 31614 raft_consensus.cc:493] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.411379 31614 raft_consensus.cc:515] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.415591 31253 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:09.416859 31559 tablet_bootstrap.cc:654] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.417951 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb07b495c85d4de88b7c752f4a6f7ee7" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:09.418814 31438 raft_consensus.cc:2468] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:09.419801 31570 raft_consensus.cc:2804] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:09.421546 31329 leader_election.cc:304] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:09.420550 31570 raft_consensus.cc:697] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:09.423239 31570 consensus_queue.cc:237] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.424456 31558 tablet_bootstrap.cc:492] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:09.425009 31558 ts_tablet_manager.cc:1403] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.045s	user 0.030s	sys 0.011s
I20260709 12:14:09.427135 31614 leader_election.cc:290] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:09.425904 31591 leader_election.cc:290] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:09.428577 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb07b495c85d4de88b7c752f4a6f7ee7" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:09.428714 31614 raft_consensus.cc:2804] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:09.429411 31288 raft_consensus.cc:2468] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:09.429633 31614 raft_consensus.cc:493] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.430202 31614 raft_consensus.cc:3060] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.429788 31558 raft_consensus.cc:359] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.430912 31558 raft_consensus.cc:385] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.431282 31558 raft_consensus.cc:740] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.419912 31557 tablet_bootstrap.cc:492] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:09.434052 31557 ts_tablet_manager.cc:1403] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.126s	user 0.006s	sys 0.014s
I20260709 12:14:09.432221 31558 consensus_queue.cc:260] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.437769 31560 tablet_bootstrap.cc:492] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:09.444553 31560 ts_tablet_manager.cc:1403] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.000s
I20260709 12:14:09.444610 31558 ts_tablet_manager.cc:1434] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:14:09.446219 31557 raft_consensus.cc:359] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.446961 31557 raft_consensus.cc:385] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.447383 31557 raft_consensus.cc:740] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.448163 31558 tablet_bootstrap.cc:492] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:09.448449 31560 raft_consensus.cc:359] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.449523 31560 raft_consensus.cc:385] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.449251 31557 consensus_queue.cc:260] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.449996 31560 raft_consensus.cc:740] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.451521 31560 consensus_queue.cc:260] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.452252 31557 ts_tablet_manager.cc:1434] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:09.454265 31567 raft_consensus.cc:493] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.454995 31557 tablet_bootstrap.cc:492] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:09.454934 31567 raft_consensus.cc:515] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.459220 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641ff77e975546a1824207bab77c2788" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
W20260709 12:14:09.461114 31478 leader_election.cc:343] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.461615 31614 raft_consensus.cc:515] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.461987 31567 leader_election.cc:290] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:09.463052 31558 tablet_bootstrap.cc:654] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.463893 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641ff77e975546a1824207bab77c2788" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:09.464504 31559 tablet_bootstrap.cc:492] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:09.464707 31438 raft_consensus.cc:2468] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:09.465119 31559 ts_tablet_manager.cc:1403] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.007s
I20260709 12:14:09.466250 31477 leader_election.cc:304] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:09.467204 31557 tablet_bootstrap.cc:654] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.467226 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb07b495c85d4de88b7c752f4a6f7ee7" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:09.468003 31288 raft_consensus.cc:3060] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.468135 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb07b495c85d4de88b7c752f4a6f7ee7" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:09.468902 31438 raft_consensus.cc:3060] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.464109 31614 leader_election.cc:290] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:09.475904 31614 raft_consensus.cc:493] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.476979 31567 raft_consensus.cc:2804] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:09.477686 31567 raft_consensus.cc:493] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.478173 31567 raft_consensus.cc:3060] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.480507 31558 tablet_bootstrap.cc:492] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:09.481129 31558 ts_tablet_manager.cc:1403] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.000s
I20260709 12:14:09.476646 31614 raft_consensus.cc:515] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.484443 31558 raft_consensus.cc:359] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.486831 31614 leader_election.cc:290] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:09.487205 31558 raft_consensus.cc:385] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.487517 31558 raft_consensus.cc:740] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.488195 31557 tablet_bootstrap.cc:492] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:09.488364 31558 consensus_queue.cc:260] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.488862 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215d8d9803624fe3b90591e545bf5024" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:09.489116 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2607cd0103e94dec990c36aa6cbf89d0" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:09.489530 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215d8d9803624fe3b90591e545bf5024" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:09.489912 31511 raft_consensus.cc:2393] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56add4c904c74a1bba90579b9204e45d in current term 1: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:09.490803 31557 ts_tablet_manager.cc:1403] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.018s
W20260709 12:14:09.490790 31330 leader_election.cc:343] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:09.491700 31328 leader_election.cc:343] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.492640 31328 leader_election.cc:304] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:09.493149 31560 ts_tablet_manager.cc:1434] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 12:14:09.494004 31328 leader_election.cc:304] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:09.494313 31288 raft_consensus.cc:2468] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:09.495818 31591 raft_consensus.cc:2749] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:09.495872 31330 leader_election.cc:304] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:09.496554 31591 raft_consensus.cc:3060] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.492229 31614 raft_consensus.cc:493] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.498113 31614 raft_consensus.cc:515] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.499624 31643 raft_consensus.cc:2804] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:09.490702 31558 ts_tablet_manager.cc:1434] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:09.502183 31558 tablet_bootstrap.cc:492] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:09.501873 31567 raft_consensus.cc:515] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.506150 31614 leader_election.cc:290] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:09.506788 31614 consensus_queue.cc:1048] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:09.507138 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:09.508555 31591 raft_consensus.cc:2749] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:09.510643 31186 catalog_manager.cc:5697] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.513214 31438 raft_consensus.cc:2468] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:09.516896 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641ff77e975546a1824207bab77c2788" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:09.517858 31437 raft_consensus.cc:3060] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.521974 31560 tablet_bootstrap.cc:492] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:09.532815 31631 raft_consensus.cc:493] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.533564 31631 raft_consensus.cc:515] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.537276 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191640019a84d1c9ec1470b18a33641" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:09.539737 31477 leader_election.cc:343] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.542992 31559 raft_consensus.cc:359] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.544023 31559 raft_consensus.cc:385] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.544267 31643 raft_consensus.cc:697] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:09.542934 31557 raft_consensus.cc:359] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.545691 31557 raft_consensus.cc:385] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.546008 31557 raft_consensus.cc:740] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.547109 31643 consensus_queue.cc:237] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.549612 31560 tablet_bootstrap.cc:654] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.544435 31559 raft_consensus.cc:740] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.550858 31557 consensus_queue.cc:260] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.553287 31438 raft_consensus.cc:3060] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:09.543850 31328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 49936.5us
I20260709 12:14:09.556238 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:09.556728 31558 tablet_bootstrap.cc:654] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.557473 31364 raft_consensus.cc:3060] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.562014 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191640019a84d1c9ec1470b18a33641" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:09.562801 31289 raft_consensus.cc:2468] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:09.563879 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641ff77e975546a1824207bab77c2788" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:09.564086 31567 leader_election.cc:290] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:09.564514 31288 raft_consensus.cc:3060] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.566864 31478 leader_election.cc:304] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:09.568081 31632 raft_consensus.cc:2804] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:09.568585 31632 raft_consensus.cc:493] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.568928 31632 raft_consensus.cc:3060] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.570391 31437 raft_consensus.cc:2468] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:09.571579 31328 leader_election.cc:304] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:09.571735 31477 leader_election.cc:304] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:09.572661 31559 consensus_queue.cc:260] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.577507 31650 raft_consensus.cc:493] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.577696 31567 raft_consensus.cc:2804] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:09.578157 31650 raft_consensus.cc:515] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.559719 31631 leader_election.cc:290] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:09.583532 31557 ts_tablet_manager.cc:1434] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.004s
I20260709 12:14:09.578740 31567 raft_consensus.cc:697] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:09.585762 31567 consensus_queue.cc:237] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.601718 31289 raft_consensus.cc:3060] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.603458 31650 leader_election.cc:290] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:09.606179 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
W20260709 12:14:09.608500 31330 leader_election.cc:343] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.629038 31643 raft_consensus.cc:493] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.629686 31643 raft_consensus.cc:515] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.632375 31643 leader_election.cc:290] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:09.633392 31557 tablet_bootstrap.cc:492] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:09.633858 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d045764fb04dbc819b8f88e9bb085f" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:09.609524 31632 raft_consensus.cc:515] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:09.635900 31330 leader_election.cc:343] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:09.622462 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 50839.5us
I20260709 12:14:09.641520 31560 tablet_bootstrap.cc:492] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:09.642308 31560 ts_tablet_manager.cc:1403] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.013s
I20260709 12:14:09.647444 31643 consensus_queue.cc:1048] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:09.648144 31185 catalog_manager.cc:5697] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.661945 31288 raft_consensus.cc:2468] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:09.659644 31560 raft_consensus.cc:359] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.663107 31560 raft_consensus.cc:385] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.663533 31560 raft_consensus.cc:740] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.669656 31560 consensus_queue.cc:260] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.670845 31559 ts_tablet_manager.cc:1434] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.165s	user 0.012s	sys 0.011s
I20260709 12:14:09.675248 31557 tablet_bootstrap.cc:654] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.677218 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191640019a84d1c9ec1470b18a33641" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:09.677630 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:09.678728 31477 leader_election.cc:343] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:09.679651 31328 leader_election.cc:343] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.680120 31328 leader_election.cc:304] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:09.683976 31560 ts_tablet_manager.cc:1434] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 12:14:09.685431 31560 tablet_bootstrap.cc:492] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:09.687676 31558 tablet_bootstrap.cc:492] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:09.688649 31558 ts_tablet_manager.cc:1403] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.187s	user 0.040s	sys 0.072s
I20260709 12:14:09.699631 31654 consensus_queue.cc:1048] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:14:09.688401 31643 raft_consensus.cc:2749] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:09.702432 31186 catalog_manager.cc:5697] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.704854 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d045764fb04dbc819b8f88e9bb085f" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:09.705657 31512 raft_consensus.cc:2468] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:09.707065 31328 leader_election.cc:304] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:09.707890 31643 raft_consensus.cc:2804] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:09.708313 31643 raft_consensus.cc:493] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.707455 31558 raft_consensus.cc:359] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.708688 31643 raft_consensus.cc:3060] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.709107 31558 raft_consensus.cc:385] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.709602 31558 raft_consensus.cc:740] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.710557 31558 consensus_queue.cc:260] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
W20260709 12:14:09.708525 31475 consensus_peers.cc:597] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:09.722223 31558 ts_tablet_manager.cc:1434] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.003s
I20260709 12:14:09.717804 31632 leader_election.cc:290] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:09.727087 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191640019a84d1c9ec1470b18a33641" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:09.728055 31288 raft_consensus.cc:3060] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.738847 31558 tablet_bootstrap.cc:492] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:09.740275 31560 tablet_bootstrap.cc:654] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.740473 31649 raft_consensus.cc:2749] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:09.740917 31559 tablet_bootstrap.cc:492] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:09.744060 31288 raft_consensus.cc:2468] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:09.750133 31478 leader_election.cc:304] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:09.740491 31643 raft_consensus.cc:515] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.751945 31632 raft_consensus.cc:2804] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:09.752496 31632 raft_consensus.cc:697] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:09.753612 31643 leader_election.cc:290] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:09.755432 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d045764fb04dbc819b8f88e9bb085f" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:09.756096 31512 raft_consensus.cc:3060] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.756699 31559 tablet_bootstrap.cc:654] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.757764 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d045764fb04dbc819b8f88e9bb085f" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:09.753383 31632 consensus_queue.cc:237] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:09.759403 31330 leader_election.cc:343] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.776008 31558 tablet_bootstrap.cc:654] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.776062 31619 raft_consensus.cc:493] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.776650 31619 raft_consensus.cc:515] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.779021 31619 leader_election.cc:290] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:09.780900 31557 tablet_bootstrap.cc:492] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:09.780742 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3110254469cd41d2bc5addd8675f1ddd" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:09.781883 31557 ts_tablet_manager.cc:1403] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.156s	user 0.019s	sys 0.021s
W20260709 12:14:09.783710 31404 leader_election.cc:343] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.780892 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3110254469cd41d2bc5addd8675f1ddd" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:09.784802 31557 raft_consensus.cc:359] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.785300 31364 raft_consensus.cc:2468] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
I20260709 12:14:09.787763 31401 leader_election.cc:304] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:09.793915 31619 raft_consensus.cc:2804] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:09.794656 31619 raft_consensus.cc:493] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.795469 31619 raft_consensus.cc:3060] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.785655 31557 raft_consensus.cc:385] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.801234 31557 raft_consensus.cc:740] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.820356 31557 consensus_queue.cc:260] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.828404 31512 raft_consensus.cc:2468] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:09.830452 31328 leader_election.cc:304] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:09.833098 31643 raft_consensus.cc:2804] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:09.833819 31643 raft_consensus.cc:697] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:09.834970 31643 consensus_queue.cc:237] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:09.837390 31254 consensus_peers.cc:597] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:09.840032 31557 ts_tablet_manager.cc:1434] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.004s
I20260709 12:14:09.839759 31568 consensus_queue.cc:1048] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:09.840958 31187 catalog_manager.cc:5697] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.842541 31557 tablet_bootstrap.cc:492] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:09.848920 31558 tablet_bootstrap.cc:492] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:09.849581 31558 ts_tablet_manager.cc:1403] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.016s
I20260709 12:14:09.849185 31649 raft_consensus.cc:493] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.853298 31649 raft_consensus.cc:515] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.874676 31558 raft_consensus.cc:359] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.875659 31558 raft_consensus.cc:385] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.876019 31558 raft_consensus.cc:740] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.875238 31557 tablet_bootstrap.cc:654] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.879217 31649 leader_election.cc:290] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:09.879918 31558 consensus_queue.cc:260] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:09.880486 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:09.880484 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:09.886945 31329 leader_election.cc:304] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:09.890277 31559 tablet_bootstrap.cc:492] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:09.891127 31559 ts_tablet_manager.cc:1403] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.151s	user 0.016s	sys 0.019s
I20260709 12:14:09.880447 31619 raft_consensus.cc:515] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.902709 31591 raft_consensus.cc:2749] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:09.926164 31558 ts_tablet_manager.cc:1434] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.004s
I20260709 12:14:09.922582 31567 raft_consensus.cc:493] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:09.930562 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:09.943252 31567 raft_consensus.cc:515] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.946949 31567 leader_election.cc:290] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:09.931842 31568 consensus_queue.cc:1048] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:09.949261 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad60c538b49e4a5fb4fa276ea5b25314" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:09.950678 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3110254469cd41d2bc5addd8675f1ddd" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:09.951083 31668 consensus_queue.cc:1048] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:09.951514 31558 tablet_bootstrap.cc:492] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:09.947438 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad60c538b49e4a5fb4fa276ea5b25314" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
W20260709 12:14:09.953811 31478 leader_election.cc:343] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.954351 31619 leader_election.cc:290] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:09.942119 31559 raft_consensus.cc:359] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:09.957270 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3110254469cd41d2bc5addd8675f1ddd" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:09.957726 31559 raft_consensus.cc:385] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.957937 31363 raft_consensus.cc:3060] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:09.958240 31559 raft_consensus.cc:740] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.959537 31559 consensus_queue.cc:260] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:09.952251 31404 leader_election.cc:343] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.967185 31185 catalog_manager.cc:5697] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.970618 31363 raft_consensus.cc:2468] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:09.970944 31559 ts_tablet_manager.cc:1434] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.001s
I20260709 12:14:09.972144 31560 tablet_bootstrap.cc:492] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
W20260709 12:14:09.972452 31477 leader_election.cc:343] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:09.972622 31560 ts_tablet_manager.cc:1403] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.288s	user 0.050s	sys 0.040s
I20260709 12:14:09.972929 31477 leader_election.cc:304] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:09.973317 31401 leader_election.cc:304] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:09.973798 31567 raft_consensus.cc:2749] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:09.975195 31559 tablet_bootstrap.cc:492] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:09.978019 31619 raft_consensus.cc:2804] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:09.985267 31619 raft_consensus.cc:697] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:09.986786 31619 consensus_queue.cc:237] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:09.993767 31560 raft_consensus.cc:359] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.994589 31560 raft_consensus.cc:385] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:09.994884 31560 raft_consensus.cc:740] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:09.995625 31560 consensus_queue.cc:260] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:09.997754 31560 ts_tablet_manager.cc:1434] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 12:14:09.979252 31558 tablet_bootstrap.cc:654] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:09.982295 31557 tablet_bootstrap.cc:492] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:10.000370 31557 ts_tablet_manager.cc:1403] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.158s	user 0.017s	sys 0.014s
I20260709 12:14:09.992753 31559 tablet_bootstrap.cc:654] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.002797 31560 tablet_bootstrap.cc:492] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:10.003429 31557 raft_consensus.cc:359] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.004143 31557 raft_consensus.cc:385] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.004400 31557 raft_consensus.cc:740] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.005132 31557 consensus_queue.cc:260] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.008404 31557 ts_tablet_manager.cc:1434] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 12:14:10.008955 31187 catalog_manager.cc:5697] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 1, leader changed from <none> to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 1 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.012172 31557 tablet_bootstrap.cc:492] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:10.019817 31557 tablet_bootstrap.cc:654] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.023658 31560 tablet_bootstrap.cc:654] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.047547 31559 tablet_bootstrap.cc:492] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:10.049485 31559 ts_tablet_manager.cc:1403] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.020s
I20260709 12:14:10.055317 31559 raft_consensus.cc:359] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.056294 31559 raft_consensus.cc:385] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.056659 31559 raft_consensus.cc:740] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.057018 31643 consensus_queue.cc:1048] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.057762 31559 consensus_queue.cc:260] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.060631 31558 tablet_bootstrap.cc:492] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:10.060840 31559 ts_tablet_manager.cc:1434] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:14:10.061197 31558 ts_tablet_manager.cc:1403] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.008s
I20260709 12:14:10.062600 31559 tablet_bootstrap.cc:492] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:10.064538 31558 raft_consensus.cc:359] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.065362 31558 raft_consensus.cc:385] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.068436 31558 raft_consensus.cc:740] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.070377 31558 consensus_queue.cc:260] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.072175 31559 tablet_bootstrap.cc:654] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.074329 31560 tablet_bootstrap.cc:492] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:10.074997 31560 ts_tablet_manager.cc:1403] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.073s	user 0.019s	sys 0.014s
I20260709 12:14:10.079334 31643 consensus_queue.cc:1048] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.079387 31560 raft_consensus.cc:359] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.080664 31560 raft_consensus.cc:385] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.081182 31560 raft_consensus.cc:740] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.083634 31674 raft_consensus.cc:493] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.084697 31643 raft_consensus.cc:493] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.082485 31560 consensus_queue.cc:260] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.085340 31643 raft_consensus.cc:515] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.088354 31560 ts_tablet_manager.cc:1434] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:14:10.088542 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb27277c309451f909355cb86a5d907" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:10.090466 31560 tablet_bootstrap.cc:492] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
W20260709 12:14:10.090756 31329 leader_election.cc:343] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.084348 31674 raft_consensus.cc:515] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.091848 31559 tablet_bootstrap.cc:492] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:10.092375 31559 ts_tablet_manager.cc:1403] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.016s
I20260709 12:14:10.095042 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:10.095737 31559 raft_consensus.cc:359] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.096520 31559 raft_consensus.cc:385] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:10.096735 31402 leader_election.cc:343] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.096809 31559 raft_consensus.cc:740] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.097839 31560 tablet_bootstrap.cc:654] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.098500 31559 consensus_queue.cc:260] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.102283 31559 ts_tablet_manager.cc:1434] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:10.107785 31567 raft_consensus.cc:493] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.108363 31567 raft_consensus.cc:515] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.108925 31559 tablet_bootstrap.cc:492] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:10.112900 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215d8d9803624fe3b90591e545bf5024" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:10.113675 31364 raft_consensus.cc:2468] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:10.115197 31475 leader_election.cc:304] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:10.116326 31656 raft_consensus.cc:2804] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.116648 31559 tablet_bootstrap.cc:654] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.116813 31656 raft_consensus.cc:493] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.117175 31656 raft_consensus.cc:3060] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.117951 31567 leader_election.cc:290] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:10.118855 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215d8d9803624fe3b90591e545bf5024" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:10.119670 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
W20260709 12:14:10.123555 31404 leader_election.cc:343] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.124018 31404 leader_election.cc:304] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:10.124913 31619 raft_consensus.cc:2749] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:10.128021 31478 leader_election.cc:343] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.131625 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb27277c309451f909355cb86a5d907" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:10.133081 31328 leader_election.cc:343] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.133554 31328 leader_election.cc:304] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:10.134824 31650 raft_consensus.cc:2749] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.138309 31557 tablet_bootstrap.cc:492] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:10.139050 31557 ts_tablet_manager.cc:1403] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.127s	user 0.005s	sys 0.011s
I20260709 12:14:10.125687 31674 leader_election.cc:290] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:10.130755 31558 ts_tablet_manager.cc:1434] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 12:14:10.127727 31643 leader_election.cc:290] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:10.142908 31656 raft_consensus.cc:515] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.149564 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215d8d9803624fe3b90591e545bf5024" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:10.149945 31656 leader_election.cc:290] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
W20260709 12:14:10.151043 31478 leader_election.cc:343] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.151495 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215d8d9803624fe3b90591e545bf5024" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:10.152160 31364 raft_consensus.cc:3060] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.153414 31559 tablet_bootstrap.cc:492] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:10.153995 31559 ts_tablet_manager.cc:1403] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.010s
I20260709 12:14:10.156574 31559 raft_consensus.cc:359] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.157271 31559 raft_consensus.cc:385] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.157529 31559 raft_consensus.cc:740] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.158252 31559 consensus_queue.cc:260] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.159188 31558 tablet_bootstrap.cc:492] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:10.160708 31559 ts_tablet_manager.cc:1434] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:10.162009 31559 tablet_bootstrap.cc:492] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:10.162472 31560 tablet_bootstrap.cc:492] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:10.162969 31560 ts_tablet_manager.cc:1403] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.008s
I20260709 12:14:10.167351 31557 raft_consensus.cc:359] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.167750 31560 raft_consensus.cc:359] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.168474 31559 tablet_bootstrap.cc:654] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.168599 31560 raft_consensus.cc:385] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.168968 31560 raft_consensus.cc:740] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.169818 31558 tablet_bootstrap.cc:654] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.168201 31557 raft_consensus.cc:385] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.172597 31557 raft_consensus.cc:740] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.173370 31557 consensus_queue.cc:260] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.175676 31557 ts_tablet_manager.cc:1434] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 12:14:10.177083 31557 tablet_bootstrap.cc:492] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:10.181404 31363 raft_consensus.cc:3060] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.182116 31364 raft_consensus.cc:2468] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:10.183467 31557 tablet_bootstrap.cc:654] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.183692 31475 leader_election.cc:304] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:10.188722 31558 tablet_bootstrap.cc:492] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:10.189267 31558 ts_tablet_manager.cc:1403] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.002s
I20260709 12:14:10.189172 31656 raft_consensus.cc:2804] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.189765 31656 raft_consensus.cc:697] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:10.190621 31656 consensus_queue.cc:237] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.191932 31559 tablet_bootstrap.cc:492] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:10.192536 31559 ts_tablet_manager.cc:1403] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.009s
I20260709 12:14:10.193069 31560 consensus_queue.cc:260] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.195861 31559 raft_consensus.cc:359] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.198167 31557 tablet_bootstrap.cc:492] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:10.198722 31557 ts_tablet_manager.cc:1403] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:14:10.198452 31558 raft_consensus.cc:359] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.199195 31558 raft_consensus.cc:385] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.199525 31558 raft_consensus.cc:740] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.200435 31558 consensus_queue.cc:260] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.201821 31557 raft_consensus.cc:359] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.202554 31557 raft_consensus.cc:385] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.202816 31557 raft_consensus.cc:740] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.202879 31184 catalog_manager.cc:5697] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.203577 31557 consensus_queue.cc:260] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.204624 31558 ts_tablet_manager.cc:1434] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:14:10.196592 31559 raft_consensus.cc:385] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.205152 31559 raft_consensus.cc:740] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.206075 31557 ts_tablet_manager.cc:1434] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:10.207255 31557 tablet_bootstrap.cc:492] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:10.207510 31567 consensus_queue.cc:1048] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:10.208245 31559 consensus_queue.cc:260] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.209832 31438 raft_consensus.cc:3060] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.210458 31559 ts_tablet_manager.cc:1434] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:14:10.211651 31559 tablet_bootstrap.cc:492] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:10.213791 31557 tablet_bootstrap.cc:654] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.220037 31656 consensus_queue.cc:1048] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.229036 31557 tablet_bootstrap.cc:492] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:10.229597 31557 ts_tablet_manager.cc:1403] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 12:14:10.230304 31620 raft_consensus.cc:493] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.230921 31620 raft_consensus.cc:515] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.232412 31557 raft_consensus.cc:359] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.233376 31557 raft_consensus.cc:385] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.233664 31557 raft_consensus.cc:740] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.233991 31559 tablet_bootstrap.cc:654] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.234453 31557 consensus_queue.cc:260] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.237872 31620 leader_election.cc:290] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:10.238195 31557 ts_tablet_manager.cc:1434] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:14:10.238145 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d045764fb04dbc819b8f88e9bb085f" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:10.239523 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d045764fb04dbc819b8f88e9bb085f" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:10.240433 31512 raft_consensus.cc:2393] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0769d57e6db04b2f86703e0ed60f6185 in current term 1: Already voted for candidate 56add4c904c74a1bba90579b9204e45d in this term.
I20260709 12:14:10.239516 31557 tablet_bootstrap.cc:492] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:10.242523 31253 leader_election.cc:304] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:10.243898 31570 raft_consensus.cc:3060] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.248649 31557 tablet_bootstrap.cc:654] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.249538 31559 tablet_bootstrap.cc:492] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:10.250159 31559 ts_tablet_manager.cc:1403] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.008s
I20260709 12:14:10.254377 31559 raft_consensus.cc:359] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.255165 31559 raft_consensus.cc:385] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.255517 31559 raft_consensus.cc:740] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.256388 31559 consensus_queue.cc:260] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.258965 31559 ts_tablet_manager.cc:1434] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:10.259747 31570 raft_consensus.cc:2749] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.260241 31559 tablet_bootstrap.cc:492] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:10.268245 31656 consensus_queue.cc:1048] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.258965 31560 ts_tablet_manager.cc:1434] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 12:14:10.270591 31560 tablet_bootstrap.cc:492] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:10.275856 31558 tablet_bootstrap.cc:492] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:10.286963 31560 tablet_bootstrap.cc:654] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.289223 31570 raft_consensus.cc:493] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.289999 31570 raft_consensus.cc:515] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.293326 31559 tablet_bootstrap.cc:654] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.294458 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215d8d9803624fe3b90591e545bf5024" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:10.298128 31558 tablet_bootstrap.cc:654] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.310215 31570 leader_election.cc:290] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:10.310618 31557 tablet_bootstrap.cc:492] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:10.310495 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215d8d9803624fe3b90591e545bf5024" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:10.311455 31557 ts_tablet_manager.cc:1403] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.072s	user 0.040s	sys 0.024s
I20260709 12:14:10.311776 31363 raft_consensus.cc:2393] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0769d57e6db04b2f86703e0ed60f6185 in current term 1: Already voted for candidate a209a5d7b61542d885ef601e8bcaa26c in this term.
I20260709 12:14:10.312557 31560 tablet_bootstrap.cc:492] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:10.313050 31560 ts_tablet_manager.cc:1403] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.001s
I20260709 12:14:10.313284 31252 leader_election.cc:304] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:10.314332 31620 raft_consensus.cc:3060] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.314867 31557 raft_consensus.cc:359] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.315548 31557 raft_consensus.cc:385] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.315853 31557 raft_consensus.cc:740] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.315686 31560 raft_consensus.cc:359] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.316370 31560 raft_consensus.cc:385] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.316656 31557 consensus_queue.cc:260] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.318722 31557 ts_tablet_manager.cc:1434] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:10.316638 31560 raft_consensus.cc:740] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.319525 31674 raft_consensus.cc:493] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.319800 31560 consensus_queue.cc:260] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.320144 31674 raft_consensus.cc:515] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.321617 31560 ts_tablet_manager.cc:1434] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:14:10.322525 31674 leader_election.cc:290] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:10.323339 31557 tablet_bootstrap.cc:492] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:10.323731 31620 raft_consensus.cc:2749] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.325098 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad60c538b49e4a5fb4fa276ea5b25314" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:10.325766 31512 raft_consensus.cc:2468] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
I20260709 12:14:10.326205 31558 tablet_bootstrap.cc:492] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:10.326745 31558 ts_tablet_manager.cc:1403] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 12:14:10.327235 31402 leader_election.cc:304] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:10.328333 31674 raft_consensus.cc:2804] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.328734 31674 raft_consensus.cc:493] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.329344 31674 raft_consensus.cc:3060] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.330464 31557 tablet_bootstrap.cc:654] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.333648 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad60c538b49e4a5fb4fa276ea5b25314" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:10.334599 31289 raft_consensus.cc:2468] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
I20260709 12:14:10.335212 31656 raft_consensus.cc:493] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.335924 31656 raft_consensus.cc:515] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.337080 31559 tablet_bootstrap.cc:492] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:10.337745 31559 ts_tablet_manager.cc:1403] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.078s	user 0.006s	sys 0.011s
I20260709 12:14:10.339792 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521c6b0664a14a35a1eca5919b44637f" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:10.340500 31289 raft_consensus.cc:2468] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:10.341145 31559 raft_consensus.cc:359] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.341861 31559 raft_consensus.cc:385] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.342124 31559 raft_consensus.cc:740] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.342912 31559 consensus_queue.cc:260] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.344915 31478 leader_election.cc:304] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:10.345862 31674 raft_consensus.cc:515] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.346185 31654 raft_consensus.cc:2804] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.346494 31559 ts_tablet_manager.cc:1434] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:10.346839 31654 raft_consensus.cc:493] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.353457 31558 raft_consensus.cc:359] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.354238 31558 raft_consensus.cc:385] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.354506 31558 raft_consensus.cc:740] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.355096 31559 tablet_bootstrap.cc:492] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:10.351081 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521c6b0664a14a35a1eca5919b44637f" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:10.355283 31558 consensus_queue.cc:260] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.356068 31363 raft_consensus.cc:2468] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:10.359164 31567 consensus_queue.cc:1048] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.362602 31559 tablet_bootstrap.cc:654] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.366220 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad60c538b49e4a5fb4fa276ea5b25314" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:10.367144 31512 raft_consensus.cc:3060] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.369053 31656 leader_election.cc:290] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:10.369316 31558 ts_tablet_manager.cc:1434] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:14:10.370973 31558 tablet_bootstrap.cc:492] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:10.375416 31632 raft_consensus.cc:493] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.376113 31632 raft_consensus.cc:515] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.387687 31632 leader_election.cc:290] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:10.388325 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
W20260709 12:14:10.391340 31475 leader_election.cc:343] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.398958 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:10.322532 31560 tablet_bootstrap.cc:492] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:10.351854 31674 leader_election.cc:290] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:10.353895 31654 raft_consensus.cc:3060] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:10.405910 31477 leader_election.cc:343] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.406585 31477 leader_election.cc:304] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:10.349490 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad60c538b49e4a5fb4fa276ea5b25314" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:10.408922 31705 raft_consensus.cc:2749] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.409719 31620 raft_consensus.cc:493] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.410288 31620 raft_consensus.cc:515] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.413834 31620 leader_election.cc:290] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:10.415804 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
W20260709 12:14:10.417788 31252 leader_election.cc:343] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.409192 31289 raft_consensus.cc:3060] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.431519 31288 raft_consensus.cc:3060] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.442257 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:10.449000 31254 leader_election.cc:343] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.449863 31254 leader_election.cc:304] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:10.452349 31620 raft_consensus.cc:2749] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.464861 31560 tablet_bootstrap.cc:654] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.469043 31512 raft_consensus.cc:2468] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:10.476955 31674 raft_consensus.cc:493] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.477805 31674 raft_consensus.cc:515] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.478374 31591 consensus_queue.cc:1048] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.481443 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2fa69725764633ab7d8cc899591b75" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:10.482223 31363 raft_consensus.cc:2468] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
I20260709 12:14:10.482760 31560 tablet_bootstrap.cc:492] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:10.483336 31560 ts_tablet_manager.cc:1403] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.161s	user 0.009s	sys 0.004s
I20260709 12:14:10.483512 31557 tablet_bootstrap.cc:492] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:10.484046 31557 ts_tablet_manager.cc:1403] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.161s	user 0.063s	sys 0.073s
I20260709 12:14:10.485800 31402 leader_election.cc:304] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:10.487234 31557 raft_consensus.cc:359] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.488336 31557 raft_consensus.cc:385] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.488960 31557 raft_consensus.cc:740] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.489437 31673 raft_consensus.cc:2804] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.489156 31401 leader_election.cc:304] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:10.490032 31557 consensus_queue.cc:260] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.481516 31674 leader_election.cc:290] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:10.491544 31568 raft_consensus.cc:2804] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.491945 31568 raft_consensus.cc:493] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.492332 31568 raft_consensus.cc:3060] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.486748 31560 raft_consensus.cc:359] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.494439 31560 raft_consensus.cc:385] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.495384 31557 ts_tablet_manager.cc:1434] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 12:14:10.496538 31557 tablet_bootstrap.cc:492] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:10.490001 31673 raft_consensus.cc:697] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:10.498190 31673 consensus_queue.cc:237] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.494776 31560 raft_consensus.cc:740] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.502079 31560 consensus_queue.cc:260] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.504712 31557 tablet_bootstrap.cc:654] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.516541 31674 raft_consensus.cc:493] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.517185 31674 raft_consensus.cc:515] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.520190 31674 leader_election.cc:290] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:10.524871 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2fa69725764633ab7d8cc899591b75" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:10.525518 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3043ea4e7aac4914af456073b1b6a33c" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:10.525880 31510 raft_consensus.cc:2468] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
W20260709 12:14:10.527062 31404 leader_election.cc:343] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.524917 31557 tablet_bootstrap.cc:492] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:10.527792 31705 raft_consensus.cc:493] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.528023 31643 raft_consensus.cc:493] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.528468 31705 raft_consensus.cc:515] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.528874 31649 consensus_queue.cc:1048] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.528741 31643 raft_consensus.cc:515] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.531087 31705 leader_election.cc:290] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:10.527863 31557 ts_tablet_manager.cc:1403] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.003s
I20260709 12:14:10.532235 31285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ee9c20206541cf9fdc5d65759ce8e9" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:10.532358 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3043ea4e7aac4914af456073b1b6a33c" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:10.533115 31285 raft_consensus.cc:2468] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:10.527748 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3043ea4e7aac4914af456073b1b6a33c" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:10.534063 31289 raft_consensus.cc:2468] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:10.534257 31363 raft_consensus.cc:2468] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
I20260709 12:14:10.535126 31478 leader_election.cc:304] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
W20260709 12:14:10.535384 31330 leader_election.cc:343] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.537637 31643 leader_election.cc:290] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:10.537457 31557 raft_consensus.cc:359] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.538021 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ee9c20206541cf9fdc5d65759ce8e9" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:10.538508 31557 raft_consensus.cc:385] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.538852 31557 raft_consensus.cc:740] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.538127 31401 leader_election.cc:304] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:10.539950 31557 consensus_queue.cc:260] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
W20260709 12:14:10.541025 31475 leader_election.cc:343] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.542610 31674 raft_consensus.cc:2804] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.543121 31674 raft_consensus.cc:493] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.543496 31674 raft_consensus.cc:3060] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.543624 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3043ea4e7aac4914af456073b1b6a33c" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:10.545039 31183 catalog_manager.cc:5697] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 1, leader changed from <none> to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 1 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.541011 31705 raft_consensus.cc:2804] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.546738 31705 raft_consensus.cc:493] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.547236 31705 raft_consensus.cc:3060] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.556149 31557 ts_tablet_manager.cc:1434] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.002s
I20260709 12:14:10.555835 31674 raft_consensus.cc:515] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.561020 31557 tablet_bootstrap.cc:492] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:10.565259 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3043ea4e7aac4914af456073b1b6a33c" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
W20260709 12:14:10.567510 31404 leader_election.cc:343] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.567780 31619 consensus_queue.cc:1048] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.571427 31674 leader_election.cc:290] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:10.576857 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3043ea4e7aac4914af456073b1b6a33c" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:10.577879 31362 raft_consensus.cc:3060] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.589361 31620 raft_consensus.cc:493] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.587600 31437 raft_consensus.cc:2393] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56add4c904c74a1bba90579b9204e45d in current term 1: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:10.589785 31557 tablet_bootstrap.cc:654] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.591022 31620 raft_consensus.cc:515] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.600570 31668 raft_consensus.cc:493] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.601320 31668 raft_consensus.cc:515] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.603926 31560 ts_tablet_manager.cc:1434] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.003s
I20260709 12:14:10.604892 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f21568498d48caad98d644ce34352a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:10.605744 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f21568498d48caad98d644ce34352a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:10.606937 31254 leader_election.cc:343] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:10.607540 31253 leader_election.cc:343] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.608065 31253 leader_election.cc:304] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:10.604103 31668 leader_election.cc:290] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:10.610237 31560 tablet_bootstrap.cc:492] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:10.611063 31668 raft_consensus.cc:2749] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.611784 31673 raft_consensus.cc:493] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.613372 31673 raft_consensus.cc:515] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.616714 31705 raft_consensus.cc:515] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.618561 31632 consensus_queue.cc:1048] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.629546 31654 raft_consensus.cc:515] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.515028 31568 raft_consensus.cc:515] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.655416 31329 leader_election.cc:304] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:10.658636 31560 tablet_bootstrap.cc:654] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.650935 31570 raft_consensus.cc:493] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.667081 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521c6b0664a14a35a1eca5919b44637f" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:10.667871 31286 raft_consensus.cc:3060] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.667605 31570 raft_consensus.cc:515] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.678205 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c3a704808243b09ae619420b9ef16c" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
W20260709 12:14:10.680642 31401 leader_election.cc:343] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:10.653893 31253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 46145.3us
I20260709 12:14:10.686319 31567 raft_consensus.cc:493] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.688695 31656 raft_consensus.cc:493] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:10.691926 31402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 122862us
I20260709 12:14:10.711707 31705 leader_election.cc:290] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:10.712211 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada87845b524af0b51a486204b74b96" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:10.706307 31620 leader_election.cc:290] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:10.713032 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ee9c20206541cf9fdc5d65759ce8e9" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:10.713780 31288 raft_consensus.cc:3060] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:10.713882 31254 leader_election.cc:343] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.699512 31567 raft_consensus.cc:515] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.717741 31567 leader_election.cc:290] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:10.702859 31656 raft_consensus.cc:515] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.703596 31673 leader_election.cc:290] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:10.720209 31656 leader_election.cc:290] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:10.704457 31654 leader_election.cc:290] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:10.720973 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2fa69725764633ab7d8cc899591b75" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:10.721663 31364 raft_consensus.cc:3060] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.722416 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:10.722728 31285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
W20260709 12:14:10.724233 31478 leader_election.cc:343] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:10.724972 31478 leader_election.cc:343] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:10.726658 31708 log.cc:927] Time spent T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:14:10.727332 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ee9c20206541cf9fdc5d65759ce8e9" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:10.728650 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:10.729343 31360 raft_consensus.cc:2468] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
W20260709 12:14:10.731413 31475 leader_election.cc:343] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.735160 31559 tablet_bootstrap.cc:492] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:10.735705 31559 ts_tablet_manager.cc:1403] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.381s	user 0.075s	sys 0.170s
I20260709 12:14:10.737779 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3110254469cd41d2bc5addd8675f1ddd" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:10.738724 31559 raft_consensus.cc:359] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.739431 31559 raft_consensus.cc:385] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.732168 31656 consensus_queue.cc:1048] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:14:10.739490 31362 raft_consensus.cc:2468] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:10.744083 31643 raft_consensus.cc:2749] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.746675 31475 leader_election.cc:304] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:10.748047 31704 raft_consensus.cc:2804] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.748452 31704 raft_consensus.cc:493] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.751124 31704 raft_consensus.cc:3060] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.752131 31286 raft_consensus.cc:2468] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:10.753822 31568 leader_election.cc:290] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:10.754683 31478 leader_election.cc:304] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:10.759418 31632 raft_consensus.cc:2804] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.759965 31632 raft_consensus.cc:697] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:10.760797 31632 consensus_queue.cc:237] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.768797 31364 raft_consensus.cc:2468] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:10.770304 31401 leader_election.cc:304] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:10.770516 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:10.739533 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada87845b524af0b51a486204b74b96" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:10.771397 31568 raft_consensus.cc:2804] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.771358 31438 raft_consensus.cc:2468] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:10.771770 31401 leader_election.cc:304] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:10.772086 31568 raft_consensus.cc:697] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:10.742576 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c3a704808243b09ae619420b9ef16c" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:10.773144 31674 raft_consensus.cc:2804] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.740983 31619 consensus_queue.cc:1048] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:14:10.773679 31674 raft_consensus.cc:697] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:10.775290 31674 consensus_queue.cc:237] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.775758 31568 consensus_queue.cc:237] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.776198 31704 raft_consensus.cc:515] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:10.776469 31252 leader_election.cc:343] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.777208 31252 leader_election.cc:304] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:10.778075 31620 raft_consensus.cc:2749] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:10.739718 31559 raft_consensus.cc:740] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.788529 31559 consensus_queue.cc:260] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.789835 31510 raft_consensus.cc:2468] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
I20260709 12:14:10.793443 31560 tablet_bootstrap.cc:492] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:10.794090 31560 ts_tablet_manager.cc:1403] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.184s	user 0.015s	sys 0.010s
I20260709 12:14:10.797703 31558 tablet_bootstrap.cc:654] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.803131 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3110254469cd41d2bc5addd8675f1ddd" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:10.803433 31557 tablet_bootstrap.cc:492] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:10.804086 31557 ts_tablet_manager.cc:1403] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.244s	user 0.029s	sys 0.007s
I20260709 12:14:10.804199 31285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:10.803133 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2fa69725764633ab7d8cc899591b75" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:10.805074 31511 raft_consensus.cc:3060] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.807340 31557 raft_consensus.cc:359] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
W20260709 12:14:10.807829 31478 leader_election.cc:343] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.808112 31557 raft_consensus.cc:385] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.808413 31557 raft_consensus.cc:740] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.809195 31557 consensus_queue.cc:260] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.811086 31254 leader_election.cc:304] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:10.811676 31557 ts_tablet_manager.cc:1434] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:14:10.812000 31560 raft_consensus.cc:359] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.812927 31557 tablet_bootstrap.cc:492] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:10.812719 31560 raft_consensus.cc:385] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.815372 31704 leader_election.cc:290] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:10.813696 31560 raft_consensus.cc:740] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.799618 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521c6b0664a14a35a1eca5919b44637f" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:10.818928 31363 raft_consensus.cc:3060] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.817886 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:10.819104 31560 consensus_queue.cc:260] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:10.820091 31360 raft_consensus.cc:3060] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.821187 31477 leader_election.cc:304] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:10.822182 31705 raft_consensus.cc:2804] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.794194 31288 raft_consensus.cc:2468] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:10.822991 31560 ts_tablet_manager.cc:1434] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 12:14:10.828552 31559 ts_tablet_manager.cc:1434] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 12:14:10.822770 31570 leader_election.cc:290] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:10.822614 31705 raft_consensus.cc:493] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.848105 31560 tablet_bootstrap.cc:492] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:10.850695 31478 leader_election.cc:304] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:10.841801 31705 raft_consensus.cc:3060] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.853732 31557 tablet_bootstrap.cc:654] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.852752 31567 raft_consensus.cc:2804] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.862149 31559 tablet_bootstrap.cc:492] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:10.853307 31402 leader_election.cc:304] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:10.869792 31714 raft_consensus.cc:2749] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:10.871963 31721 log.cc:927] Time spent T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da: Append to log took a long time: real 0.081s	user 0.005s	sys 0.000s
I20260709 12:14:10.872071 31511 raft_consensus.cc:2468] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:10.883074 31559 tablet_bootstrap.cc:654] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.878242 31560 tablet_bootstrap.cc:654] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.887639 31674 raft_consensus.cc:2804] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:10.888116 31674 raft_consensus.cc:493] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.888459 31674 raft_consensus.cc:3060] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.864699 31567 raft_consensus.cc:697] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:10.893641 31567 consensus_queue.cc:237] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.896744 31720 consensus_queue.cc:1048] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.908601 31705 raft_consensus.cc:515] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.912189 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:10.913014 31438 raft_consensus.cc:3060] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.910207 31674 raft_consensus.cc:515] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
W20260709 12:14:10.917524 31719 log.cc:927] Time spent T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:14:10.921386 31558 tablet_bootstrap.cc:492] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:10.921844 31360 raft_consensus.cc:2468] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:10.922019 31558 ts_tablet_manager.cc:1403] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.551s	user 0.021s	sys 0.014s
I20260709 12:14:10.923400 31475 leader_election.cc:304] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:10.923784 31438 raft_consensus.cc:2468] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:10.924913 31632 raft_consensus.cc:2804] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.925159 31477 leader_election.cc:304] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:10.925510 31632 raft_consensus.cc:697] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:10.926122 31654 raft_consensus.cc:2804] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.926656 31654 raft_consensus.cc:697] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:10.926720 31632 consensus_queue.cc:237] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.927904 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:10.925312 31558 raft_consensus.cc:359] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
W20260709 12:14:10.929549 31478 leader_election.cc:343] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.929731 31558 raft_consensus.cc:385] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.927604 31654 consensus_queue.cc:237] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:10.930261 31558 raft_consensus.cc:740] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.930660 31363 raft_consensus.cc:2468] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:10.931725 31558 consensus_queue.cc:260] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:10.936932 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c3a704808243b09ae619420b9ef16c" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:10.933971 31705 leader_election.cc:290] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:10.938385 31401 leader_election.cc:343] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:10.949965 31674 leader_election.cc:290] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
W20260709 12:14:10.950927 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:10.951612 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c3a704808243b09ae619420b9ef16c" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:10.952430 31511 raft_consensus.cc:3060] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.954669 31559 tablet_bootstrap.cc:492] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:10.955224 31559 ts_tablet_manager.cc:1403] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.001s
I20260709 12:14:10.958114 31559 raft_consensus.cc:359] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.958784 31559 raft_consensus.cc:385] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.959064 31559 raft_consensus.cc:740] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.959856 31558 ts_tablet_manager.cc:1434] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 12:14:10.960407 31185 catalog_manager.cc:5697] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 1, leader changed from <none> to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 1 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.961762 31558 tablet_bootstrap.cc:492] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:10.971714 31673 consensus_queue.cc:1048] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:10.973385 31560 tablet_bootstrap.cc:492] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:10.973922 31560 ts_tablet_manager.cc:1403] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.130s	user 0.017s	sys 0.000s
I20260709 12:14:10.981494 31559 consensus_queue.cc:260] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:10.988451 31557 tablet_bootstrap.cc:492] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:10.989162 31557 ts_tablet_manager.cc:1403] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.177s	user 0.020s	sys 0.018s
I20260709 12:14:10.991158 31559 ts_tablet_manager.cc:1434] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.002s
I20260709 12:14:10.993240 31559 tablet_bootstrap.cc:492] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:10.992897 31187 catalog_manager.cc:5697] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 1, leader changed from <none> to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 1 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.001864 31557 raft_consensus.cc:359] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:11.002713 31557 raft_consensus.cc:385] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.002998 31557 raft_consensus.cc:740] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.004086 31557 consensus_queue.cc:260] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:11.006664 31557 ts_tablet_manager.cc:1434] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:14:11.007800 31557 tablet_bootstrap.cc:492] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:11.002403 31559 tablet_bootstrap.cc:654] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.003085 31560 raft_consensus.cc:359] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.009178 31560 raft_consensus.cc:385] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.009431 31560 raft_consensus.cc:740] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.011183 31560 consensus_queue.cc:260] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.013645 31511 raft_consensus.cc:2468] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:11.015170 31558 tablet_bootstrap.cc:654] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.018968 31402 leader_election.cc:304] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:11.024977 31183 catalog_manager.cc:5697] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.027848 31183 catalog_manager.cc:5697] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.026585 31568 raft_consensus.cc:2804] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.032883 31568 raft_consensus.cc:697] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:11.033968 31568 consensus_queue.cc:237] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.041126 31557 tablet_bootstrap.cc:654] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.043416 31560 ts_tablet_manager.cc:1434] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 12:14:11.044684 31560 tablet_bootstrap.cc:492] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:11.051789 31559 tablet_bootstrap.cc:492] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:11.052145 31557 tablet_bootstrap.cc:492] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:11.052585 31559 ts_tablet_manager.cc:1403] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.028s
I20260709 12:14:11.052973 31557 ts_tablet_manager.cc:1403] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.004s
I20260709 12:14:11.055905 31559 raft_consensus.cc:359] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.056324 31557 raft_consensus.cc:359] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.057163 31557 raft_consensus.cc:385] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.057435 31568 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.057466 31557 raft_consensus.cc:740] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.058148 31568 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.058594 31557 consensus_queue.cc:260] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.060595 31568 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:11.061385 31557 ts_tablet_manager.cc:1434] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:14:11.062631 31557 tablet_bootstrap.cc:492] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:11.062664 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:11.064436 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:11.056841 31559 raft_consensus.cc:385] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.065161 31559 raft_consensus.cc:740] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.066056 31559 consensus_queue.cc:260] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.066291 31404 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:11.067795 31568 raft_consensus.cc:2749] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:11.068892 31559 ts_tablet_manager.cc:1434] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:14:11.070005 31559 tablet_bootstrap.cc:492] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:11.070549 31557 tablet_bootstrap.cc:654] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.076543 31559 tablet_bootstrap.cc:654] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.076543 31183 catalog_manager.cc:5697] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.086133 31567 raft_consensus.cc:493] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.086966 31567 raft_consensus.cc:515] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:11.091850 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31c0489c4404a649554f01c10277574" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
W20260709 12:14:11.094306 31478 leader_election.cc:343] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.097640 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31c0489c4404a649554f01c10277574" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
W20260709 12:14:11.100692 31475 leader_election.cc:343] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.101429 31475 leader_election.cc:304] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:11.102833 31654 raft_consensus.cc:2749] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:11.104089 31567 leader_election.cc:290] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:11.081535 31183 catalog_manager.cc:5697] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.106043 31557 tablet_bootstrap.cc:492] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:11.106876 31557 ts_tablet_manager.cc:1403] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.045s	user 0.029s	sys 0.008s
I20260709 12:14:11.115154 31557 raft_consensus.cc:359] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.115999 31557 raft_consensus.cc:385] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.116267 31557 raft_consensus.cc:740] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.117210 31557 consensus_queue.cc:260] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.120095 31557 ts_tablet_manager.cc:1434] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:14:11.121443 31557 tablet_bootstrap.cc:492] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:11.129052 31557 tablet_bootstrap.cc:654] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.135135 31591 raft_consensus.cc:493] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.136008 31591 raft_consensus.cc:515] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.141499 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada87845b524af0b51a486204b74b96" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:11.141820 31591 leader_election.cc:290] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
W20260709 12:14:11.143527 31329 leader_election.cc:343] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.149905 31557 tablet_bootstrap.cc:492] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:11.150553 31557 ts_tablet_manager.cc:1403] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.008s
I20260709 12:14:11.150512 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada87845b524af0b51a486204b74b96" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:11.151333 31286 raft_consensus.cc:2468] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:11.154374 31557 raft_consensus.cc:359] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.155359 31714 raft_consensus.cc:493] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.155900 31714 raft_consensus.cc:515] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.156443 31330 leader_election.cc:304] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:11.158267 31714 leader_election.cc:290] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:11.158860 31557 raft_consensus.cc:385] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.159229 31557 raft_consensus.cc:740] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.160535 31557 consensus_queue.cc:260] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.161279 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3043ea4e7aac4914af456073b1b6a33c" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:11.162567 31363 raft_consensus.cc:2393] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0769d57e6db04b2f86703e0ed60f6185 in current term 1: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:11.163403 31557 ts_tablet_manager.cc:1434] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:14:11.164916 31557 tablet_bootstrap.cc:492] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:11.165580 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3043ea4e7aac4914af456073b1b6a33c" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:11.159123 31649 raft_consensus.cc:2804] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.168972 31649 raft_consensus.cc:493] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.169557 31649 raft_consensus.cc:3060] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.172838 31714 raft_consensus.cc:493] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.182576 31254 leader_election.cc:304] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:11.184180 31620 raft_consensus.cc:3060] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.191315 31567 consensus_queue.cc:1048] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.212347 31714 raft_consensus.cc:515] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.216487 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:11.218674 31714 leader_election.cc:290] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:11.221442 31557 tablet_bootstrap.cc:654] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.224314 31184 catalog_manager.cc:5697] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 1, leader changed from <none> to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 1 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.229760 31620 raft_consensus.cc:2749] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:11.234127 31557 tablet_bootstrap.cc:492] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:11.234858 31557 ts_tablet_manager.cc:1403] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.009s
I20260709 12:14:11.238406 31557 raft_consensus.cc:359] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:11.239234 31557 raft_consensus.cc:385] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.239516 31557 raft_consensus.cc:740] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.240298 31557 consensus_queue.cc:260] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:11.242985 31557 ts_tablet_manager.cc:1434] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:11.244270 31557 tablet_bootstrap.cc:492] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:11.247926 31254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 65515us
I20260709 12:14:11.250535 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:11.251878 31438 raft_consensus.cc:2393] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0769d57e6db04b2f86703e0ed60f6185 in current term 1: Already voted for candidate a209a5d7b61542d885ef601e8bcaa26c in this term.
I20260709 12:14:11.256449 31254 leader_election.cc:304] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:11.257930 31620 raft_consensus.cc:3060] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.266831 31620 raft_consensus.cc:2749] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:11.276690 31557 tablet_bootstrap.cc:654] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:11.306169 31475 consensus_peers.cc:597] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:11.306857 31568 consensus_queue.cc:1048] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.316092 31568 raft_consensus.cc:493] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.317028 31568 raft_consensus.cc:515] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.321547 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:11.321707 31568 leader_election.cc:290] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
W20260709 12:14:11.326505 31401 leader_election.cc:343] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.329584 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:11.330639 31510 raft_consensus.cc:2468] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
I20260709 12:14:11.335530 31567 consensus_queue.cc:1048] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.335542 31674 consensus_queue.cc:1048] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:14:11.339810 31402 leader_election.cc:304] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:11.341214 31674 raft_consensus.cc:2804] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.342092 31674 raft_consensus.cc:493] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.342574 31674 raft_consensus.cc:3060] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.352138 31568 consensus_queue.cc:1048] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.368280 31558 tablet_bootstrap.cc:492] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:11.387527 31560 tablet_bootstrap.cc:654] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.388293 31558 ts_tablet_manager.cc:1403] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.427s	user 0.014s	sys 0.001s
I20260709 12:14:11.394887 31438 raft_consensus.cc:3060] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.405113 31649 raft_consensus.cc:515] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.411525 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada87845b524af0b51a486204b74b96" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:11.412556 31288 raft_consensus.cc:3060] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.422401 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada87845b524af0b51a486204b74b96" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
W20260709 12:14:11.424264 31329 leader_election.cc:343] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.431906 31720 consensus_queue.cc:1048] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.433272 31620 raft_consensus.cc:493] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.433811 31620 raft_consensus.cc:515] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:11.436093 31620 leader_election.cc:290] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:11.427569 31558 raft_consensus.cc:359] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.437901 31558 raft_consensus.cc:385] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.438232 31558 raft_consensus.cc:740] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.446344 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:11.447363 31360 raft_consensus.cc:2393] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0769d57e6db04b2f86703e0ed60f6185 in current term 1: Already voted for candidate a209a5d7b61542d885ef601e8bcaa26c in this term.
I20260709 12:14:11.450770 31559 tablet_bootstrap.cc:492] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:11.451380 31559 ts_tablet_manager.cc:1403] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.382s	user 0.107s	sys 0.210s
I20260709 12:14:11.436822 31674 raft_consensus.cc:515] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.454175 31559 raft_consensus.cc:359] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.454469 31567 consensus_queue.cc:1048] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.456753 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:11.439175 31649 leader_election.cc:290] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:11.458626 31253 leader_election.cc:304] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:11.460103 31620 raft_consensus.cc:3060] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.465646 31632 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.466301 31632 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.468694 31632 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:11.472178 31285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:11.473559 31285 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:11.474720 31478 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:11.475662 31632 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.476086 31632 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.476425 31632 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.477607 31568 consensus_queue.cc:1048] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.454897 31559 raft_consensus.cc:385] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.482012 31559 raft_consensus.cc:740] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.480647 31620 raft_consensus.cc:2749] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:11.484433 31558 consensus_queue.cc:260] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.485666 31559 consensus_queue.cc:260] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.481339 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:11.497531 31558 ts_tablet_manager.cc:1434] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.001s
I20260709 12:14:11.491425 31288 raft_consensus.cc:2468] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:11.497866 31656 consensus_queue.cc:1048] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:14:11.508145 31559 ts_tablet_manager.cc:1434] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.001s
I20260709 12:14:11.509644 31559 tablet_bootstrap.cc:492] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:11.511656 31557 tablet_bootstrap.cc:492] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:11.512274 31557 ts_tablet_manager.cc:1403] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.268s	user 0.053s	sys 0.060s
I20260709 12:14:11.514777 31567 consensus_queue.cc:1048] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.516404 31560 tablet_bootstrap.cc:492] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:11.516966 31560 ts_tablet_manager.cc:1403] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.473s	user 0.018s	sys 0.019s
I20260709 12:14:11.517388 31632 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.519979 31558 tablet_bootstrap.cc:492] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:11.543089 31620 raft_consensus.cc:493] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.544116 31620 raft_consensus.cc:515] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.575942 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53171289fe984298815d6d30885bf378" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:11.577708 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
W20260709 12:14:11.578395 31252 leader_election.cc:343] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.578621 31674 leader_election.cc:290] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:11.579790 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
W20260709 12:14:11.581362 31401 leader_election.cc:343] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.582715 31656 consensus_queue.cc:1048] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.575866 31330 leader_election.cc:304] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:11.584146 31288 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.585408 31649 raft_consensus.cc:2804] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.586203 31649 raft_consensus.cc:697] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:11.587252 31649 consensus_queue.cc:237] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.589057 31567 consensus_queue.cc:1048] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.590138 31557 raft_consensus.cc:359] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.584100 31632 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:11.594420 31360 raft_consensus.cc:3060] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.590894 31557 raft_consensus.cc:385] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.596043 31557 raft_consensus.cc:740] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.607157 31620 leader_election.cc:290] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:11.607064 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53171289fe984298815d6d30885bf378" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:11.609478 31254 leader_election.cc:343] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.610216 31254 leader_election.cc:304] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:11.611321 31620 raft_consensus.cc:2749] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:11.592145 31560 raft_consensus.cc:359] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.617609 31560 raft_consensus.cc:385] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.616964 31557 consensus_queue.cc:260] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.617884 31560 raft_consensus.cc:740] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.620054 31560 consensus_queue.cc:260] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.629081 31557 ts_tablet_manager.cc:1434] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.116s	user 0.004s	sys 0.017s
I20260709 12:14:11.632079 31560 ts_tablet_manager.cc:1434] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.115s	user 0.009s	sys 0.009s
I20260709 12:14:11.638552 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
W20260709 12:14:11.639166 31477 leader_election.cc:343] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.641392 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:11.642175 31510 raft_consensus.cc:3060] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:11.657063 31477 leader_election.cc:343] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.658298 31558 tablet_bootstrap.cc:654] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.660527 31673 raft_consensus.cc:493] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.661511 31673 raft_consensus.cc:515] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.663815 31673 leader_election.cc:290] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:11.664940 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:11.666031 31557 tablet_bootstrap.cc:492] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:11.681828 31560 tablet_bootstrap.cc:492] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
W20260709 12:14:11.674655 31401 leader_election.cc:343] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.687196 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:11.690100 31287 raft_consensus.cc:2468] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
I20260709 12:14:11.690217 31710 consensus_queue.cc:1048] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.693526 31404 leader_election.cc:304] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:11.695518 31710 raft_consensus.cc:2804] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.695941 31710 raft_consensus.cc:493] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.696359 31710 raft_consensus.cc:3060] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.702910 31288 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:11.700392 31714 raft_consensus.cc:493] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.705421 31557 tablet_bootstrap.cc:654] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.704988 31714 raft_consensus.cc:515] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:11.706661 31478 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:11.709792 31620 raft_consensus.cc:493] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.710526 31620 raft_consensus.cc:515] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.713274 31620 leader_election.cc:290] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:11.713919 31705 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.714576 31705 raft_consensus.cc:697] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:11.714612 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:11.715721 31705 consensus_queue.cc:237] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:11.717083 31253 leader_election.cc:343] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.718530 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:11.725241 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:11.714974 31714 leader_election.cc:290] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
W20260709 12:14:11.732882 31253 leader_election.cc:343] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:11.740096 31252 leader_election.cc:343] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.745792 31559 tablet_bootstrap.cc:654] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.745626 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:11.772318 31756 log.cc:927] Time spent T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:14:11.777405 31710 raft_consensus.cc:515] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.778779 31510 raft_consensus.cc:2468] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
W20260709 12:14:11.783639 31254 leader_election.cc:343] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.799866 31254 leader_election.cc:304] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:11.784749 31252 leader_election.cc:304] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:11.802143 31620 raft_consensus.cc:2749] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:11.802328 31252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 69733.6us
I20260709 12:14:11.802642 31714 raft_consensus.cc:2749] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:11.801980 31558 tablet_bootstrap.cc:492] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:11.805754 31402 leader_election.cc:304] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:11.805055 31558 ts_tablet_manager.cc:1403] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.302s	user 0.021s	sys 0.002s
I20260709 12:14:11.808967 31720 raft_consensus.cc:2804] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.811100 31720 raft_consensus.cc:697] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:11.818887 31557 tablet_bootstrap.cc:492] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:11.819520 31557 ts_tablet_manager.cc:1403] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.184s	user 0.047s	sys 0.015s
I20260709 12:14:11.818979 31720 consensus_queue.cc:237] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.822309 31557 raft_consensus.cc:359] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.822927 31557 raft_consensus.cc:385] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.823172 31557 raft_consensus.cc:740] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.823782 31557 consensus_queue.cc:260] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.832362 31710 leader_election.cc:290] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:11.832688 31184 catalog_manager.cc:5697] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.837989 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:11.838150 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:11.839409 31286 raft_consensus.cc:3060] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:11.840605 31401 leader_election.cc:343] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.845259 31557 ts_tablet_manager.cc:1434] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 12:14:11.846918 31557 tablet_bootstrap.cc:492] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:11.837162 31558 raft_consensus.cc:359] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:11.849061 31558 raft_consensus.cc:385] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.849427 31558 raft_consensus.cc:740] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.850342 31558 consensus_queue.cc:260] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:11.855533 31557 tablet_bootstrap.cc:654] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.858431 31286 raft_consensus.cc:2468] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:11.860659 31404 leader_election.cc:304] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:11.862532 31710 raft_consensus.cc:2804] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.863283 31710 raft_consensus.cc:697] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:11.864673 31710 consensus_queue.cc:237] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.867559 31560 tablet_bootstrap.cc:654] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.874887 31559 tablet_bootstrap.cc:492] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:11.875505 31559 ts_tablet_manager.cc:1403] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.366s	user 0.011s	sys 0.040s
I20260709 12:14:11.878665 31559 raft_consensus.cc:359] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.879498 31559 raft_consensus.cc:385] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.879807 31559 raft_consensus.cc:740] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.852646 31558 ts_tablet_manager.cc:1434] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.000s
I20260709 12:14:11.881906 31558 tablet_bootstrap.cc:492] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:11.884583 31557 tablet_bootstrap.cc:492] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:11.885254 31557 ts_tablet_manager.cc:1403] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.006s
I20260709 12:14:11.888386 31557 raft_consensus.cc:359] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.889138 31557 raft_consensus.cc:385] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.889421 31557 raft_consensus.cc:740] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.890098 31557 consensus_queue.cc:260] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.892195 31559 consensus_queue.cc:260] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.895051 31557 ts_tablet_manager.cc:1434] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:11.896381 31557 tablet_bootstrap.cc:492] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:11.899446 31558 tablet_bootstrap.cc:654] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.902721 31560 tablet_bootstrap.cc:492] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:11.903280 31560 ts_tablet_manager.cc:1403] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.226s	user 0.010s	sys 0.004s
I20260709 12:14:11.906839 31558 tablet_bootstrap.cc:492] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:11.908660 31632 raft_consensus.cc:493] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.909211 31632 raft_consensus.cc:515] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.911618 31632 leader_election.cc:290] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:11.907456 31558 ts_tablet_manager.cc:1403] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 12:14:11.912829 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb27277c309451f909355cb86a5d907" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:11.912634 31560 raft_consensus.cc:359] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.912971 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb27277c309451f909355cb86a5d907" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:11.914494 31560 raft_consensus.cc:385] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.914721 31361 raft_consensus.cc:2468] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
W20260709 12:14:11.915930 31477 leader_election.cc:343] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.915725 31558 raft_consensus.cc:359] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.916541 31558 raft_consensus.cc:385] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.916870 31558 raft_consensus.cc:740] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.917054 31475 leader_election.cc:304] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:11.917646 31558 consensus_queue.cc:260] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.919065 31632 raft_consensus.cc:2804] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.919577 31632 raft_consensus.cc:493] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.919983 31632 raft_consensus.cc:3060] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.920470 31558 ts_tablet_manager.cc:1434] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:11.917157 31559 ts_tablet_manager.cc:1434] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 12:14:11.921696 31558 tablet_bootstrap.cc:492] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:11.921844 31559 tablet_bootstrap.cc:492] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:11.922864 31557 tablet_bootstrap.cc:654] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.928814 31558 tablet_bootstrap.cc:654] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.931253 31632 raft_consensus.cc:515] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.914853 31560 raft_consensus.cc:740] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.934151 31560 consensus_queue.cc:260] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:11.938038 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb27277c309451f909355cb86a5d907" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:11.939004 31361 raft_consensus.cc:3060] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.957149 31632 leader_election.cc:290] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:11.957551 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb27277c309451f909355cb86a5d907" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
W20260709 12:14:11.963384 31477 leader_election.cc:343] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.965883 31361 raft_consensus.cc:2468] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:11.959088 31560 ts_tablet_manager.cc:1434] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 12:14:11.968127 31475 leader_election.cc:304] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:11.970062 31632 raft_consensus.cc:2804] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.971170 31632 raft_consensus.cc:697] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:11.972524 31632 consensus_queue.cc:237] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:11.973500 31560 tablet_bootstrap.cc:492] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:11.975960 31559 tablet_bootstrap.cc:654] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.982191 31557 tablet_bootstrap.cc:492] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:11.982782 31557 ts_tablet_manager.cc:1403] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.087s	user 0.030s	sys 0.015s
I20260709 12:14:11.985960 31557 raft_consensus.cc:359] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.986738 31557 raft_consensus.cc:385] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.987164 31557 raft_consensus.cc:740] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.988166 31557 consensus_queue.cc:260] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:11.986545 31560 tablet_bootstrap.cc:654] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.994967 31557 ts_tablet_manager.cc:1434] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:14:11.994457 31183 catalog_manager.cc:5697] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:12.004256 31557 tablet_bootstrap.cc:492] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:11.998682 31560 tablet_bootstrap.cc:492] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:12.010315 31560 ts_tablet_manager.cc:1403] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.003s
I20260709 12:14:12.013402 31557 tablet_bootstrap.cc:654] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.014022 31558 tablet_bootstrap.cc:492] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:12.014629 31558 ts_tablet_manager.cc:1403] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.093s	user 0.021s	sys 0.021s
I20260709 12:14:12.014884 31560 raft_consensus.cc:359] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.015710 31560 raft_consensus.cc:385] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.016077 31560 raft_consensus.cc:740] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.018139 31558 raft_consensus.cc:359] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:12.018930 31558 raft_consensus.cc:385] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.019207 31558 raft_consensus.cc:740] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.019976 31558 consensus_queue.cc:260] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:12.022641 31558 ts_tablet_manager.cc:1434] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:12.024003 31558 tablet_bootstrap.cc:492] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:12.031733 31558 tablet_bootstrap.cc:654] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.041608 31557 tablet_bootstrap.cc:492] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:12.042285 31557 ts_tablet_manager.cc:1403] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.011s
I20260709 12:14:12.045430 31557 raft_consensus.cc:359] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:12.046211 31557 raft_consensus.cc:385] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.046530 31557 raft_consensus.cc:740] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.047322 31557 consensus_queue.cc:260] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:12.049980 31557 ts_tablet_manager.cc:1434] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:12.051169 31557 tablet_bootstrap.cc:492] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:12.051606 31620 raft_consensus.cc:493] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.051838 31558 tablet_bootstrap.cc:492] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:12.052631 31558 ts_tablet_manager.cc:1403] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.008s
I20260709 12:14:12.052207 31620 raft_consensus.cc:515] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:12.053364 31560 consensus_queue.cc:260] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.056248 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb5c33d2a8a4010b336be5c5c4635cc" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:12.058431 31253 leader_election.cc:343] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:12.056340 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb5c33d2a8a4010b336be5c5c4635cc" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:12.058633 31558 raft_consensus.cc:359] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.059397 31558 raft_consensus.cc:385] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.059677 31558 raft_consensus.cc:740] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.059002 31186 catalog_manager.cc:5697] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 1, leader changed from <none> to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 1 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:12.060112 31252 leader_election.cc:343] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:12.060350 31558 consensus_queue.cc:260] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.060680 31252 leader_election.cc:304] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:12.061761 31714 raft_consensus.cc:2749] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:12.063429 31620 leader_election.cc:290] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:12.064043 31558 ts_tablet_manager.cc:1434] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:14:12.065335 31558 tablet_bootstrap.cc:492] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:12.069017 31559 tablet_bootstrap.cc:492] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:12.069636 31559 ts_tablet_manager.cc:1403] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.148s	user 0.021s	sys 0.017s
W20260709 12:14:12.072363 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:12.065508 31560 ts_tablet_manager.cc:1434] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 12:14:12.073164 31558 tablet_bootstrap.cc:654] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.072795 31559 raft_consensus.cc:359] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.073468 31557 tablet_bootstrap.cc:654] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.073633 31559 raft_consensus.cc:385] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.074091 31559 raft_consensus.cc:740] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.074316 31560 tablet_bootstrap.cc:492] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:12.074921 31559 consensus_queue.cc:260] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.060680 31186 catalog_manager.cc:5697] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 1, leader changed from <none> to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 1 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:12.083771 31560 tablet_bootstrap.cc:654] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.084677 31620 raft_consensus.cc:493] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.085366 31558 tablet_bootstrap.cc:492] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:12.085320 31620 raft_consensus.cc:515] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.086107 31558 ts_tablet_manager.cc:1403] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 12:14:12.088187 31620 leader_election.cc:290] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:12.089154 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:12.089566 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:12.090072 31557 tablet_bootstrap.cc:492] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:12.090570 31557 ts_tablet_manager.cc:1403] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.008s
W20260709 12:14:12.091086 31254 leader_election.cc:343] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:12.091866 31253 leader_election.cc:343] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:12.092334 31253 leader_election.cc:304] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:12.093294 31620 raft_consensus.cc:2749] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:12.097908 31558 raft_consensus.cc:359] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.098847 31558 raft_consensus.cc:385] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.099195 31558 raft_consensus.cc:740] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.100186 31558 consensus_queue.cc:260] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.102420 31560 tablet_bootstrap.cc:492] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:12.096627 31557 raft_consensus.cc:359] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:12.102593 31558 ts_tablet_manager.cc:1434] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:14:12.102999 31557 raft_consensus.cc:385] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.103207 31560 ts_tablet_manager.cc:1403] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.013s
I20260709 12:14:12.103415 31557 raft_consensus.cc:740] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.103993 31558 tablet_bootstrap.cc:492] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:12.104387 31557 consensus_queue.cc:260] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:12.106992 31557 ts_tablet_manager.cc:1434] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 12:14:12.106962 31560 raft_consensus.cc:359] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.107893 31560 raft_consensus.cc:385] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.108278 31557 tablet_bootstrap.cc:492] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:12.108227 31560 raft_consensus.cc:740] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.109978 31560 consensus_queue.cc:260] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.116005 31557 tablet_bootstrap.cc:654] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.117722 31560 ts_tablet_manager.cc:1434] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:14:12.117970 31558 tablet_bootstrap.cc:654] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.118760 31559 ts_tablet_manager.cc:1434] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:14:12.122597 31557 tablet_bootstrap.cc:492] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:12.123090 31557 ts_tablet_manager.cc:1403] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 12:14:12.125825 31557 raft_consensus.cc:359] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:12.126471 31557 raft_consensus.cc:385] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.126717 31557 raft_consensus.cc:740] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.127367 31557 consensus_queue.cc:260] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:12.128544 31560 tablet_bootstrap.cc:492] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:12.129426 31559 tablet_bootstrap.cc:492] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:12.129580 31557 ts_tablet_manager.cc:1434] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:14:12.135741 31591 consensus_queue.cc:1048] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:12.139036 31558 tablet_bootstrap.cc:492] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:12.139581 31558 ts_tablet_manager.cc:1403] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.005s
I20260709 12:14:12.142549 31557 tablet_bootstrap.cc:492] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:12.142526 31559 tablet_bootstrap.cc:654] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.145314 31558 raft_consensus.cc:359] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.146190 31558 raft_consensus.cc:385] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.147292 31558 raft_consensus.cc:740] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.148375 31558 consensus_queue.cc:260] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.148978 31560 tablet_bootstrap.cc:654] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.151372 31558 ts_tablet_manager.cc:1434] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:14:12.152871 31558 tablet_bootstrap.cc:492] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:12.160918 31557 tablet_bootstrap.cc:654] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.168408 31714 raft_consensus.cc:493] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.169126 31714 raft_consensus.cc:515] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.170368 31558 tablet_bootstrap.cc:654] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.169782 31183 catalog_manager.cc:5697] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:12.173048 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:12.174232 31714 leader_election.cc:290] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
W20260709 12:14:12.175294 31253 leader_election.cc:343] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:12.180761 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:12.183549 31558 tablet_bootstrap.cc:492] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:12.184288 31558 ts_tablet_manager.cc:1403] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.002s
W20260709 12:14:12.188294 31329 consensus_peers.cc:597] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:12.193701 31558 raft_consensus.cc:359] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
W20260709 12:14:12.189321 31254 leader_election.cc:343] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:12.200311 31558 raft_consensus.cc:385] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.200608 31254 leader_election.cc:304] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:12.200855 31558 raft_consensus.cc:740] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.201946 31558 consensus_queue.cc:260] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:12.202503 31714 raft_consensus.cc:2749] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:12.204286 31558 ts_tablet_manager.cc:1434] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 12:14:12.221515 31558 tablet_bootstrap.cc:492] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:12.224701 31559 tablet_bootstrap.cc:492] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:12.225561 31559 ts_tablet_manager.cc:1403] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.104s	user 0.021s	sys 0.050s
I20260709 12:14:12.218618 31591 raft_consensus.cc:493] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.239470 31558 tablet_bootstrap.cc:654] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.240684 31632 consensus_queue.cc:1048] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:12.241271 31360 raft_consensus.cc:3060] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.251184 31620 raft_consensus.cc:493] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.251838 31620 raft_consensus.cc:515] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:12.253027 31649 raft_consensus.cc:493] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.253686 31649 raft_consensus.cc:515] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:12.254148 31620 leader_election.cc:290] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:12.247709 31591 raft_consensus.cc:515] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:12.261960 31654 raft_consensus.cc:493] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:12.262652 31477 consensus_peers.cc:597] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:12.262552 31654 raft_consensus.cc:515] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.265537 31557 tablet_bootstrap.cc:492] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:12.266188 31557 ts_tablet_manager.cc:1403] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.020s
I20260709 12:14:12.268119 31705 raft_consensus.cc:493] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.268402 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ee9c20206541cf9fdc5d65759ce8e9" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:12.268702 31720 raft_consensus.cc:493] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.268832 31705 raft_consensus.cc:515] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.269369 31720 raft_consensus.cc:515] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.272020 31720 leader_election.cc:290] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:12.273274 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f21568498d48caad98d644ce34352a" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:12.273723 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ebece119174df8b0065e09199cb74a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:12.276589 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ebece119174df8b0065e09199cb74a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:12.268003 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8c6788cec8476ba424246e634c4712" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:12.283078 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb27277c309451f909355cb86a5d907" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:12.283986 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb27277c309451f909355cb86a5d907" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:12.285574 31361 raft_consensus.cc:2468] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:12.287353 31362 raft_consensus.cc:2393] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 1: Already voted for candidate a209a5d7b61542d885ef601e8bcaa26c in this term.
I20260709 12:14:12.289746 31475 leader_election.cc:304] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
W20260709 12:14:12.290519 31254 leader_election.cc:343] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:12.290975 31632 raft_consensus.cc:2804] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:12.291442 31632 raft_consensus.cc:493] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.291831 31632 raft_consensus.cc:3060] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.297040 31437 raft_consensus.cc:2468] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:12.298923 31591 leader_election.cc:290] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:12.271330 31705 leader_election.cc:290] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:12.339784 31557 raft_consensus.cc:359] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.341019 31560 tablet_bootstrap.cc:492] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:12.341712 31557 raft_consensus.cc:385] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.341908 31560 ts_tablet_manager.cc:1403] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.214s	user 0.022s	sys 0.020s
I20260709 12:14:12.342247 31557 raft_consensus.cc:740] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.382270 31557 consensus_queue.cc:260] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.387693 31402 leader_election.cc:304] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:12.332018 31649 leader_election.cc:290] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:12.331362 31654 leader_election.cc:290] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:12.401964 31557 ts_tablet_manager.cc:1434] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.135s	user 0.006s	sys 0.005s
I20260709 12:14:12.385023 31591 raft_consensus.cc:493] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.399080 31710 raft_consensus.cc:3060] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.420282 31560 raft_consensus.cc:359] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.422323 31560 raft_consensus.cc:385] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.422590 31560 raft_consensus.cc:740] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
W20260709 12:14:12.403867 31402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 59441.3us
I20260709 12:14:12.405483 31591 raft_consensus.cc:515] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:12.426836 31673 raft_consensus.cc:493] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.432222 31560 consensus_queue.cc:260] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.434784 31673 raft_consensus.cc:515] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.441350 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31c0489c4404a649554f01c10277574" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:12.442090 31643 raft_consensus.cc:493] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.442577 31363 raft_consensus.cc:3060] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.432726 31477 leader_election.cc:304] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:12.444161 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8c6788cec8476ba424246e634c4712" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:12.450083 31643 raft_consensus.cc:515] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.454517 31654 raft_consensus.cc:2804] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:12.454978 31654 raft_consensus.cc:493] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.455394 31654 raft_consensus.cc:3060] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.457916 31558 tablet_bootstrap.cc:492] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:12.458443 31558 ts_tablet_manager.cc:1403] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.247s	user 0.028s	sys 0.012s
I20260709 12:14:12.461030 31437 raft_consensus.cc:2468] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:12.461494 31558 raft_consensus.cc:359] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:12.462363 31558 raft_consensus.cc:385] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.462664 31558 raft_consensus.cc:740] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.463460 31558 consensus_queue.cc:260] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:12.465714 31654 raft_consensus.cc:515] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.450199 31632 raft_consensus.cc:515] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.450361 31674 consensus_queue.cc:1048] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.452350 31560 ts_tablet_manager.cc:1434] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.001s
I20260709 12:14:12.472642 31654 leader_election.cc:290] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:12.473956 31560 tablet_bootstrap.cc:492] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:12.477921 31558 ts_tablet_manager.cc:1434] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:14:12.453171 31510 raft_consensus.cc:2468] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:12.468617 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8c6788cec8476ba424246e634c4712" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:12.481511 31559 raft_consensus.cc:359] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.486166 31559 raft_consensus.cc:385] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.488056 31632 leader_election.cc:290] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:12.489027 31591 leader_election.cc:290] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:12.495131 31710 raft_consensus.cc:2749] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:12.486557 31559 raft_consensus.cc:740] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.710868 31559 consensus_queue.cc:260] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.611354 31360 raft_consensus.cc:2468] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
I20260709 12:14:12.714233 31591 raft_consensus.cc:493] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.714977 31591 raft_consensus.cc:515] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:12.481456 31673 leader_election.cc:290] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:12.734099 31558 tablet_bootstrap.cc:492] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:12.737331 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8c6788cec8476ba424246e634c4712" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:12.740645 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f21568498d48caad98d644ce34352a" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:12.741428 31436 raft_consensus.cc:3060] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.766525 31560 tablet_bootstrap.cc:654] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.766352 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8c6788cec8476ba424246e634c4712" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:12.767221 31512 raft_consensus.cc:2393] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 1: Already voted for candidate a209a5d7b61542d885ef601e8bcaa26c in this term.
I20260709 12:14:12.767311 31643 leader_election.cc:290] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:12.768373 31643 raft_consensus.cc:493] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.778524 31559 ts_tablet_manager.cc:1434] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.553s	user 0.008s	sys 0.003s
I20260709 12:14:12.758843 31401 leader_election.cc:304] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 
W20260709 12:14:12.786253 31401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 47447.5us
I20260709 12:14:12.786976 31673 raft_consensus.cc:2804] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:12.787400 31673 raft_consensus.cc:493] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.787724 31673 raft_consensus.cc:3060] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.782994 31591 leader_election.cc:290] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:12.795094 31705 consensus_queue.cc:1048] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.801640 31673 raft_consensus.cc:515] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
W20260709 12:14:12.778980 31559 ts_tablet_manager.cc:1467] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c: Tablet startup took 553ms
I20260709 12:14:12.773588 31643 raft_consensus.cc:515] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:12.804876 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8c6788cec8476ba424246e634c4712" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
W20260709 12:14:12.805004 31559 ts_tablet_manager.cc:1469] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c: Trace:
0709 12:14:07.252348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.788403 (+536055us) service_pool.cc:224] Handling call
0709 12:14:07.886049 (+ 97646us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.898533 (+ 12484us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:08.027616 (+129083us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.038258 (+ 10642us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.038739 (+   481us) inbound_call.cc:177] Queueing success response
0709 12:14:12.121746 (+4083007us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:14:12.225928 (+104182us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:14:12.433482 (+207554us) tablet_replica.cc:261] Starting instrumentation
0709 12:14:12.441006 (+  7524us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":34643,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":15359,"tablet-open.queue_time_us":4083030}
I20260709 12:14:12.810070 31436 raft_consensus.cc:2468] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:12.815388 31360 raft_consensus.cc:3060] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.815155 31673 leader_election.cc:290] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:12.829754 31559 tablet_bootstrap.cc:492] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:12.832336 31649 raft_consensus.cc:493] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.844566 31649 raft_consensus.cc:515] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
W20260709 12:14:12.871805 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 76793.2us
I20260709 12:14:12.876003 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:12.876075 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e602beb4a714f99a8480a347d7add2e" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:12.891687 31560 tablet_bootstrap.cc:492] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:12.892503 31560 ts_tablet_manager.cc:1403] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.419s	user 0.027s	sys 0.004s
I20260709 12:14:12.893095 31557 tablet_bootstrap.cc:492] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:12.869978 31643 leader_election.cc:290] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:12.876199 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8c6788cec8476ba424246e634c4712" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:12.898070 31558 tablet_bootstrap.cc:654] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.895016 31512 raft_consensus.cc:2468] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:12.900187 31509 raft_consensus.cc:2393] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 1: Already voted for candidate a209a5d7b61542d885ef601e8bcaa26c in this term.
I20260709 12:14:12.902757 31559 tablet_bootstrap.cc:654] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.908257 31557 tablet_bootstrap.cc:654] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.909855 31560 raft_consensus.cc:359] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:12.910666 31560 raft_consensus.cc:385] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.910959 31560 raft_consensus.cc:740] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.914657 31649 leader_election.cc:290] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:12.899303 31477 leader_election.cc:304] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:12.922128 31560 consensus_queue.cc:260] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:12.936018 31559 tablet_bootstrap.cc:492] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:12.936875 31559 ts_tablet_manager.cc:1403] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.113s	user 0.027s	sys 0.014s
I20260709 12:14:12.941012 31559 raft_consensus.cc:359] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.941972 31559 raft_consensus.cc:385] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.942368 31559 raft_consensus.cc:740] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.943279 31559 consensus_queue.cc:260] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.945981 31559 ts_tablet_manager.cc:1434] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:14:12.947377 31559 tablet_bootstrap.cc:492] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:12.932258 31795 raft_consensus.cc:2804] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:12.954752 31560 ts_tablet_manager.cc:1434] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:14:12.961246 31557 tablet_bootstrap.cc:492] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:12.961889 31557 ts_tablet_manager.cc:1403] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.001s
I20260709 12:14:12.956471 31720 consensus_queue.cc:1048] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:14:12.969981 31557 raft_consensus.cc:359] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:12.971415 31557 raft_consensus.cc:385] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:12.971732 31557 raft_consensus.cc:740] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:12.972615 31557 consensus_queue.cc:260] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:12.977128 31558 tablet_bootstrap.cc:492] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:12.977946 31558 ts_tablet_manager.cc:1403] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.273s	user 0.026s	sys 0.032s
I20260709 12:14:12.965005 31795 raft_consensus.cc:697] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:12.981629 31795 consensus_queue.cc:237] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:12.983703 31559 tablet_bootstrap.cc:654] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:12.980302 31360 raft_consensus.cc:2468] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:12.996969 31558 raft_consensus.cc:359] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:13.004135 31558 raft_consensus.cc:385] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:13.003994 31557 ts_tablet_manager.cc:1434] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.042s	user 0.020s	sys 0.000s
I20260709 12:14:13.004671 31558 raft_consensus.cc:740] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:13.006326 31558 consensus_queue.cc:260] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:13.010782 31558 ts_tablet_manager.cc:1434] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:14:13.012953 31558 tablet_bootstrap.cc:492] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:13.015277 31557 tablet_bootstrap.cc:492] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:13.020977 31558 tablet_bootstrap.cc:654] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:13.023027 31557 tablet_bootstrap.cc:654] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:13.023936 31559 tablet_bootstrap.cc:492] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:13.024461 31559 ts_tablet_manager.cc:1403] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.006s
I20260709 12:14:13.027907 31559 raft_consensus.cc:359] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:13.130693 31252 leader_election.cc:343] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:13.705284 31252 leader_election.cc:304] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:13.179342 31804 raft_consensus.cc:493] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.181880 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f21568498d48caad98d644ce34352a" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:13.183126 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f21568498d48caad98d644ce34352a" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:13.706810 31804 raft_consensus.cc:515] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:13.195925 31803 consensus_queue.cc:1048] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:13.708046 31815 raft_consensus.cc:493] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
I20260709 12:14:13.190654 31560 tablet_bootstrap.cc:492] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:13.711426 31559 raft_consensus.cc:385] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:13.711510 31433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385e15f5c0b14702a8444e0e908bff77" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:13.711807 31559 raft_consensus.cc:740] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:13.217653 31810 raft_consensus.cc:493] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.713088 31810 raft_consensus.cc:515] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:13.714011 31559 consensus_queue.cc:260] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:13.715632 31810 leader_election.cc:290] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
W20260709 12:14:13.713904 31254 leader_election.cc:343] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:13.237015 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ee9c20206541cf9fdc5d65759ce8e9" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:13.237433 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31c0489c4404a649554f01c10277574" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:13.704592 31643 raft_consensus.cc:493] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:13.245800 31282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385e15f5c0b14702a8444e0e908bff77" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:13.246771 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53171289fe984298815d6d30885bf378" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:13.248965 31792 raft_consensus.cc:493] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
I20260709 12:14:13.718621 31284 raft_consensus.cc:2468] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:13.249701 31812 raft_consensus.cc:493] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.718997 31792 raft_consensus.cc:515] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:13.719384 31812 raft_consensus.cc:515] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:13.719265 31559 ts_tablet_manager.cc:1434] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.695s	user 0.020s	sys 0.004s
W20260709 12:14:13.720871 31559 ts_tablet_manager.cc:1467] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c: Tablet startup took 696ms
I20260709 12:14:13.721385 31792 leader_election.cc:290] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:13.721776 31812 leader_election.cc:290] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:13.361006 31817 raft_consensus.cc:493] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.722500 31817 raft_consensus.cc:515] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:13.723940 31330 leader_election.cc:304] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:13.411535 31793 raft_consensus.cc:493] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
I20260709 12:14:13.725040 31793 raft_consensus.cc:515] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:13.725838 31792 raft_consensus.cc:2749] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:13.721166 31559 ts_tablet_manager.cc:1469] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c: Trace:
0709 12:14:07.208509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.743940 (+535431us) service_pool.cc:224] Handling call
0709 12:14:07.747583 (+  3643us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:07.747698 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:07.911469 (+163771us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:08.107869 (+196400us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:08.108424 (+   555us) inbound_call.cc:177] Queueing success response
0709 12:14:12.946865 (+4838441us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:14:13.024713 (+ 77848us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:14:13.025256 (+   543us) tablet_replica.cc:261] Starting instrumentation
0709 12:14:13.025862 (+   606us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":237,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"tablet-open.queue_time_us":4838504}
I20260709 12:14:13.726907 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:13.567163 31820 consensus_queue.cc:1048] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:13.728137 31284 raft_consensus.cc:2468] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:13.578362 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:13.579625 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e602beb4a714f99a8480a347d7add2e" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:13.580928 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:13.732067 31289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.486s	user 0.088s	sys 0.224s
W20260709 12:14:13.584000 31557 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.056s	sys 0.064s
I20260709 12:14:13.584714 31821 raft_consensus.cc:493] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.584805 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53171289fe984298815d6d30885bf378" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:13.739037 31821 raft_consensus.cc:515] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:13.590389 31591 raft_consensus.cc:493] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d5caa720fddf4dd3958f076ff03df8da)
I20260709 12:14:13.590838 31401 leader_election.cc:304] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:13.740373 31591 raft_consensus.cc:515] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
W20260709 12:14:13.740922 31401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 150224us
I20260709 12:14:13.741971 31821 leader_election.cc:290] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:13.600131 31819 raft_consensus.cc:493] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.743391 31819 raft_consensus.cc:515] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:13.744381 31830 raft_consensus.cc:2804] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:14:13.738904 31289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.493s	user 0.089s	sys 0.224s
I20260709 12:14:13.746057 31819 leader_election.cc:290] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:13.746383 31289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55530 (request call id 53) took 1502 ms. Trace:
I20260709 12:14:13.746810 31821 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
I20260709 12:14:13.601368 31822 raft_consensus.cc:493] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.749038 31821 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:13.746783 31289 rpcz_store.cc:276] 0709 12:14:12.244004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.244169 (+   165us) service_pool.cc:224] Handling call
0709 12:14:12.244811 (+   642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:12.245188 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:12.245223 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:12.245652 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:14:13.745928 (+1500276us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:14:13.745983 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.746078 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:13.746136 (+    58us) raft_consensus.cc:1685] finished
0709 12:14:13.746152 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.746297 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2691,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":2307,"spinlock_wait_cycles":511744,"thread_start_us":1499848,"threads_started":1,"wal-append.queue_time_us":183763,"wal-append.run_cpu_time_us":3303,"wal-append.run_wall_time_us":1058517}
I20260709 12:14:13.709229 31804 leader_election.cc:290] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:13.749835 31822 raft_consensus.cc:515] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:13.751171 31830 raft_consensus.cc:697] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:13.708844 31815 raft_consensus.cc:515] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:13.069572 31674 raft_consensus.cc:493] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.239037 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:13.810153 31283 raft_consensus.cc:2393] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56add4c904c74a1bba90579b9204e45d in current term 1: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:13.725272 31330 leader_election.cc:304] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:13.811316 31430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:13.812129 31792 raft_consensus.cc:2804] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:13.727311 31793 leader_election.cc:290] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:13.812575 31792 raft_consensus.cc:493] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.812997 31792 raft_consensus.cc:3060] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:13.813544 31429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:13.563055 31567 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:13.815014 31567 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:13.583567 31434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385e15f5c0b14702a8444e0e908bff77" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:13.731982 31286 raft_consensus.cc:2468] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:13.817592 31567 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:13.733194 31280 raft_consensus.cc:2468] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:13.735786 31433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f21568498d48caad98d644ce34352a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:13.736527 31817 leader_election.cc:290] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:13.575734 31436 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:13.822922 31567 raft_consensus.cc:493] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.823523 31567 raft_consensus.cc:515] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:13.718719 31282 raft_consensus.cc:2468] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
W20260709 12:14:13.738822 31557 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.057s	sys 0.064s
I20260709 12:14:13.828332 31817 raft_consensus.cc:493] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.829202 31817 raft_consensus.cc:515] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:13.829350 31434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:13.834242 31557 tablet_bootstrap.cc:492] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:13.835145 31557 ts_tablet_manager.cc:1403] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.820s	user 0.064s	sys 0.071s
I20260709 12:14:13.742797 31591 leader_election.cc:290] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:13.627904 31720 raft_consensus.cc:493] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
I20260709 12:14:13.853168 31720 raft_consensus.cc:515] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:13.716451 31810 raft_consensus.cc:2749] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:13.770658 31643 raft_consensus.cc:515] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:13.856556 31720 leader_election.cc:290] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:13.771373 31821 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:13.752136 31830 consensus_queue.cc:237] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:13.752547 31822 leader_election.cc:290] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:13.870013 31822 raft_consensus.cc:493] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
W20260709 12:14:13.837204 31286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55530 (request call id 56) took 1515 ms (client timeout 1714 ms). Trace:
I20260709 12:14:13.789129 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88d7f9369fa4e8eaa71b635d908ee34" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:13.789532 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53171289fe984298815d6d30885bf378" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:13.804652 31329 leader_election.cc:343] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:13.872394 31329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 67829.6us
W20260709 12:14:13.872223 31286 rpcz_store.cc:269] 0709 12:14:13.177950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.181424 (+  3474us) service_pool.cc:224] Handling call
0709 12:14:13.820563 (+639139us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b5400823cd4. stack: 00007fcceaca3343 00007fcceaca3240 00007fccea6321d4 00007fccf4370304 00007fccf4370299 00007fccedd2b571 00007fcceddc62fa 00007fccf2d87b17 00007fccec3026d4 00007fccec302662 00007fccec302591 00007fccec30250c 00007fccec3017c2 00007fccec0fd48c 00007fccec0fc8c6 00007fccec0fc26f
0709 12:14:13.820702 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57317760}
W20260709 12:14:13.811478 31330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 86288.4us
I20260709 12:14:13.874352 31824 raft_consensus.cc:493] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.874635 31186 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46402 (request call id 44) took 1387 ms. Trace:
I20260709 12:14:13.874893 31330 leader_election.cc:304] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:13.874924 31824 raft_consensus.cc:515] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:13.727438 31559 tablet_bootstrap.cc:492] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:13.870676 31822 raft_consensus.cc:515] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:13.877089 31185 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46416 (request call id 43) took 1680 ms. Trace:
I20260709 12:14:13.877449 31185 rpcz_store.cc:276] 0709 12:14:12.196658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.212685 (+ 16027us) service_pool.cc:224] Handling call
0709 12:14:13.877017 (+1664332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":347186,"reported_tablets":1}
I20260709 12:14:13.783094 31815 leader_election.cc:290] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:13.878293 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30451bcaa4ca44f992ef5f47be40eda9" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:13.878826 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:13.892203 31821 raft_consensus.cc:493] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.004186 31674 raft_consensus.cc:515] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
W20260709 12:14:13.990597 31478 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.102.193:45623 timed out after 1.714s (SENT) [suppressed 342 similar messages]
I20260709 12:14:13.878894 31815 raft_consensus.cc:2804] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:14.005713 31432 raft_consensus.cc:3060] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.000934 31822 leader_election.cc:290] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:14.002995 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04626a79b549449386652742229e800a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:14.006270 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f21568498d48caad98d644ce34352a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:13.874979 31186 rpcz_store.cc:276] 0709 12:14:12.487666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.739853 (+252187us) service_pool.cc:224] Handling call
0709 12:14:13.874543 (+1134690us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 12:14:14.002002 31817 leader_election.cc:290] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:14.002559 31643 leader_election.cc:290] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:14.007690 31815 raft_consensus.cc:493] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
I20260709 12:14:14.007812 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04626a79b549449386652742229e800a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.010411 31815 raft_consensus.cc:3060] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.009361 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.012317 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.013135 31512 raft_consensus.cc:2468] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 0.
W20260709 12:14:14.014868 31253 leader_election.cc:343] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:14.015909 31253 leader_election.cc:343] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:13.994438 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.016660 31253 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.018637 31253 leader_election.cc:304] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:14.020083 31285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.022987 31254 leader_election.cc:304] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:13.928938 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.025679 31567 leader_election.cc:290] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:13.878402 31793 raft_consensus.cc:493] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
I20260709 12:14:14.026825 31793 raft_consensus.cc:515] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.029273 31815 raft_consensus.cc:515] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.035079 31815 leader_election.cc:290] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:14.046449 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88d7f9369fa4e8eaa71b635d908ee34" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.047219 31363 raft_consensus.cc:2468] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
W20260709 12:14:14.046495 31558 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.093s	sys 0.112s
W20260709 12:14:14.053128 31558 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.093s	sys 0.112s
I20260709 12:14:14.054736 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.054433 31792 raft_consensus.cc:515] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.055716 31363 raft_consensus.cc:2468] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:14.032480 31282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521c6b0664a14a35a1eca5919b44637f" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:13.880971 31330 leader_election.cc:304] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
W20260709 12:14:14.057852 31330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 177036us
I20260709 12:14:14.058902 31330 leader_election.cc:304] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:14.060665 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.065930 31643 raft_consensus.cc:2749] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.066716 31643 raft_consensus.cc:2804] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:14.066783 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:14.004241 31821 raft_consensus.cc:515] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.038475 31361 raft_consensus.cc:1240] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Rejecting Update request from peer a209a5d7b61542d885ef601e8bcaa26c for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:14.071229 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:14.071585 31478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 81069.1us
W20260709 12:14:14.038224 31401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 253832us
I20260709 12:14:14.039769 31360 raft_consensus.cc:3060] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.073081 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2fa69725764633ab7d8cc899591b75" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.075129 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521c6b0664a14a35a1eca5919b44637f" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.043128 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8c6788cec8476ba424246e634c4712" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:14.067150 31643 raft_consensus.cc:493] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.072089 31710 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
W20260709 12:14:14.035823 31329 leader_election.cc:343] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.087838 31560 tablet_bootstrap.cc:654] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:14.088279 31558 tablet_bootstrap.cc:492] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:14.090613 31558 ts_tablet_manager.cc:1403] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 1.078s	user 0.104s	sys 0.112s
I20260709 12:14:14.095853 31824 leader_election.cc:290] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:14.099467 31557 raft_consensus.cc:359] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.103174 31557 raft_consensus.cc:385] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:14.103643 31557 raft_consensus.cc:740] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:14.092355 31819 raft_consensus.cc:2804] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:14:14.104413 31254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 77527.7us
I20260709 12:14:14.104709 31819 raft_consensus.cc:493] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.086779 31817 raft_consensus.cc:2749] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.105130 31819 raft_consensus.cc:3060] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:14.106951 31254 leader_election.cc:343] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:14.107692 31254 leader_election.cc:343] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.108069 31254 leader_election.cc:304] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.096227 31804 raft_consensus.cc:2749] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.086616 31643 raft_consensus.cc:3060] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.111783 31559 tablet_bootstrap.cc:654] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:14.113376 31557 consensus_queue.cc:260] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.093328 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:14.085346 31253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 66818.9us
I20260709 12:14:14.121964 31792 leader_election.cc:290] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:14.119120 31187 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46388 (request call id 34) took 1182 ms. Trace:
I20260709 12:14:14.123116 31187 rpcz_store.cc:276] 0709 12:14:12.937181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.938081 (+   900us) service_pool.cc:224] Handling call
0709 12:14:14.119046 (+1180965us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":734048,"reported_tablets":2}
I20260709 12:14:14.119853 31330 leader_election.cc:304] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.120365 31281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
W20260709 12:14:14.096134 31329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 60339.2us
W20260709 12:14:14.125165 31328 leader_election.cc:343] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.121060 31364 raft_consensus.cc:2393] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 1: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:14.125852 31826 raft_consensus.cc:2804] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:14.126672 31826 raft_consensus.cc:493] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.126726 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:14.127173 31826 raft_consensus.cc:3060] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.125859 31328 leader_election.cc:304] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.129410 31815 raft_consensus.cc:2749] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.129843 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:14.129981 31328 leader_election.cc:304] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.131009 31815 raft_consensus.cc:2804] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:14.131534 31815 raft_consensus.cc:493] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election (detected failure of leader d5caa720fddf4dd3958f076ff03df8da)
I20260709 12:14:14.131906 31815 raft_consensus.cc:3060] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.092676 31710 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:14.133786 31477 leader_election.cc:343] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.137687 31710 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:14.113739 31817 raft_consensus.cc:2749] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.139539 31822 consensus_queue.cc:1048] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:14.139638 31815 raft_consensus.cc:515] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:14.142135 31815 leader_election.cc:290] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:14.142038 31475 leader_election.cc:304] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.150426 31475 leader_election.cc:304] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:14.146978 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641ff77e975546a1824207bab77c2788" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.151868 31824 raft_consensus.cc:2804] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:14.152016 31475 leader_election.cc:304] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.150703 31821 leader_election.cc:290] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:14.115798 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:14.152633 31824 raft_consensus.cc:493] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.153331 31824 raft_consensus.cc:3060] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.153426 31674 leader_election.cc:290] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:14.153952 31705 consensus_queue.cc:1059] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:14.154369 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.155123 31509 raft_consensus.cc:2468] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 0.
I20260709 12:14:14.155337 31705 raft_consensus.cc:2749] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.155845 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada87845b524af0b51a486204b74b96" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.156337 31253 leader_election.cc:304] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:14.157009 31820 raft_consensus.cc:3055] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:14.157414 31820 raft_consensus.cc:740] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
W20260709 12:14:14.137820 31477 leader_election.cc:343] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:14.154233 31254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 46574.2us
I20260709 12:14:14.152402 31654 raft_consensus.cc:2804] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:14.157722 31819 raft_consensus.cc:515] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:14.173882 31477 leader_election.cc:343] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.177104 31819 leader_election.cc:290] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:14.176440 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:14.177214 31820 consensus_queue.cc:260] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.165794 31821 raft_consensus.cc:2804] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:14:14.178656 31252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 1.04082e+06us
I20260709 12:14:14.192153 31710 consensus_queue.cc:1048] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:14.192543 31819 raft_consensus.cc:493] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.193158 31819 raft_consensus.cc:515] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.195647 31819 leader_election.cc:290] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
W20260709 12:14:14.196149 31329 leader_election.cc:343] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.196691 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2fa69725764633ab7d8cc899591b75" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:14.181809 31821 raft_consensus.cc:493] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.197750 31821 raft_consensus.cc:3060] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.196220 31509 raft_consensus.cc:3060] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.199082 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:14.201200 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.171721 31654 raft_consensus.cc:493] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:14.203699 31654 raft_consensus.cc:3060] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:14.203192 31253 leader_election.cc:343] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.193203 31558 raft_consensus.cc:359] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.205392 31558 raft_consensus.cc:385] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:14.205852 31558 raft_consensus.cc:740] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:14.208582 31557 ts_tablet_manager.cc:1434] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.373s	user 0.011s	sys 0.004s
I20260709 12:14:14.207213 31558 consensus_queue.cc:260] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.192323 31820 raft_consensus.cc:3060] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.243433 31557 tablet_bootstrap.cc:492] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:14.245515 31643 raft_consensus.cc:515] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.250662 31558 ts_tablet_manager.cc:1434] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.160s	user 0.008s	sys 0.002s
W20260709 12:14:14.217022 31310 debug-util.cc:398] Leaking SignalData structure 0x7b0800282f40 after lost signal to thread 20894
I20260709 12:14:14.254856 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:14.256315 31310 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6d60 after lost signal to thread 31221
I20260709 12:14:14.257618 31826 raft_consensus.cc:515] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
W20260709 12:14:14.259146 31310 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2a60 after lost signal to thread 31313
W20260709 12:14:14.259752 31310 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfac0 after lost signal to thread 31314
I20260709 12:14:14.258690 31558 tablet_bootstrap.cc:492] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:14.260914 31821 raft_consensus.cc:515] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.263339 31821 leader_election.cc:290] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:14.266618 31558 tablet_bootstrap.cc:654] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:14.269687 31826 leader_election.cc:290] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:14.286720 31364 raft_consensus.cc:1240] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Rejecting Update request from peer d5caa720fddf4dd3958f076ff03df8da for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:14.290181 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385e15f5c0b14702a8444e0e908bff77" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:14.290539 31720 consensus_queue.cc:1059] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:14.291672 31720 raft_consensus.cc:3055] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:14.292083 31720 raft_consensus.cc:740] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:14.293012 31720 consensus_queue.cc:260] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:14.293452 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:14.294162 31511 raft_consensus.cc:3060] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.294299 31720 raft_consensus.cc:3060] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.240927 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:14.300913 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53171289fe984298815d6d30885bf378" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
W20260709 12:14:14.302604 31329 leader_election.cc:343] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.312831 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.313885 31283 raft_consensus.cc:2393] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 1: Already voted for candidate 0769d57e6db04b2f86703e0ed60f6185 in this term.
I20260709 12:14:14.317505 31821 raft_consensus.cc:493] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.318056 31821 raft_consensus.cc:515] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.319337 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:14.320022 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215d8d9803624fe3b90591e545bf5024" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.320281 31821 leader_election.cc:290] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:14.320958 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.319445 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31c0489c4404a649554f01c10277574" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:14.334602 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215d8d9803624fe3b90591e545bf5024" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.322028 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f21568498d48caad98d644ce34352a" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.323383 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.325322 31283 raft_consensus.cc:3060] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.336382 31284 raft_consensus.cc:2393] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 1: Already voted for candidate 0769d57e6db04b2f86703e0ed60f6185 in this term.
I20260709 12:14:14.337577 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385e15f5c0b14702a8444e0e908bff77" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:14.338335 31288 raft_consensus.cc:3060] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.242898 31793 leader_election.cc:290] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:14.331702 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31c0489c4404a649554f01c10277574" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:14.333150 31720 consensus_queue.cc:1048] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:14.340996 31289 raft_consensus.cc:3060] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.342134 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53171289fe984298815d6d30885bf378" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:14.342973 31284 raft_consensus.cc:3060] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:14.328027 31329 leader_election.cc:343] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.334653 31510 raft_consensus.cc:3060] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.360751 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385e15f5c0b14702a8444e0e908bff77" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.361673 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:14.361945 31364 raft_consensus.cc:2393] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0769d57e6db04b2f86703e0ed60f6185 in current term 1: Already voted for candidate 56add4c904c74a1bba90579b9204e45d in this term.
I20260709 12:14:14.253535 31643 leader_election.cc:290] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:14.377761 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30451bcaa4ca44f992ef5f47be40eda9" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.361825 31478 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
W20260709 12:14:14.370630 31310 debug-util.cc:398] Leaking SignalData structure 0x7b0800342ba0 after lost signal to thread 31388
I20260709 12:14:14.406019 31825 raft_consensus.cc:2749] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.424243 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53171289fe984298815d6d30885bf378" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.425216 31364 raft_consensus.cc:2393] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0769d57e6db04b2f86703e0ed60f6185 in current term 1: Already voted for candidate 56add4c904c74a1bba90579b9204e45d in this term.
I20260709 12:14:14.426589 31560 tablet_bootstrap.cc:492] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:14.426403 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada87845b524af0b51a486204b74b96" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.427205 31560 ts_tablet_manager.cc:1403] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 1.237s	user 0.037s	sys 0.061s
I20260709 12:14:14.428942 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "641ff77e975546a1824207bab77c2788" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.437443 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a490d738b8e443a857242c089199946" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:14.442240 31328 leader_election.cc:304] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.443343 31793 raft_consensus.cc:2749] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.443874 31328 leader_election.cc:304] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.444787 31793 raft_consensus.cc:2749] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.445210 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.446424 31558 tablet_bootstrap.cc:492] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:14.447117 31558 ts_tablet_manager.cc:1403] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.189s	user 0.007s	sys 0.016s
W20260709 12:14:14.448616 31254 leader_election.cc:343] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:14.449900 31254 leader_election.cc:343] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:14.450947 31254 leader_election.cc:343] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:14.423236 31310 debug-util.cc:398] Leaking SignalData structure 0x7b0800377960 after lost signal to thread 31462
W20260709 12:14:14.455196 31310 debug-util.cc:398] Leaking SignalData structure 0x7b080017aca0 after lost signal to thread 31536
I20260709 12:14:14.457297 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:14.458700 31557 tablet_bootstrap.cc:654] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:14.443809 31824 raft_consensus.cc:515] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:14.461922 31824 leader_election.cc:290] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:14.415941 31643 raft_consensus.cc:493] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.468976 31643 raft_consensus.cc:515] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.477908 31511 raft_consensus.cc:2468] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 1.
I20260709 12:14:14.478200 31654 raft_consensus.cc:515] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:14.478906 31643 leader_election.cc:290] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:14.483052 31560 raft_consensus.cc:359] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.483908 31560 raft_consensus.cc:385] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:14.484202 31560 raft_consensus.cc:740] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:14.436524 31509 raft_consensus.cc:2468] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 1.
I20260709 12:14:14.484926 31253 leader_election.cc:304] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:14.486474 31821 raft_consensus.cc:2804] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:14.486970 31821 raft_consensus.cc:697] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:14.487895 31821 consensus_queue.cc:237] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.486970 31512 raft_consensus.cc:1240] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Rejecting Update request from peer 0769d57e6db04b2f86703e0ed60f6185 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:14.489909 31654 leader_election.cc:290] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:14.492065 31560 consensus_queue.cc:260] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.496373 31559 tablet_bootstrap.cc:492] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:14.496963 31559 ts_tablet_manager.cc:1403] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.770s	user 0.022s	sys 0.004s
I20260709 12:14:14.505323 31284 raft_consensus.cc:2468] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:14.504752 31560 ts_tablet_manager.cc:1434] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.003s
I20260709 12:14:14.508354 31253 leader_election.cc:304] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.493173 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.473729 31846 raft_consensus.cc:493] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56add4c904c74a1bba90579b9204e45d)
I20260709 12:14:14.494110 31404 leader_election.cc:304] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:14.510251 31560 tablet_bootstrap.cc:492] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:14.511461 31819 raft_consensus.cc:2804] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:14.512107 31827 raft_consensus.cc:493] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.511758 31846 raft_consensus.cc:515] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.512540 31817 consensus_queue.cc:1059] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:14.511466 31288 raft_consensus.cc:2468] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:14.520314 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ebece119174df8b0065e09199cb74a" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:14.521415 31280 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:14.523921 31404 leader_election.cc:304] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:14.524600 31720 raft_consensus.cc:2749] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.527262 31560 tablet_bootstrap.cc:654] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:14.419401 31478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 57557.4us
I20260709 12:14:14.536499 31827 raft_consensus.cc:515] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.537568 31804 raft_consensus.cc:3055] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:14.492555 31289 raft_consensus.cc:2468] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:14.539572 31559 raft_consensus.cc:359] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.546367 31559 raft_consensus.cc:385] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:14.546698 31559 raft_consensus.cc:740] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:14.534794 31186 catalog_manager.cc:5697] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } }
W20260709 12:14:14.475950 31254 leader_election.cc:343] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:14.551447 31254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 76525.3us
I20260709 12:14:14.552402 31330 leader_election.cc:304] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.527745 31819 raft_consensus.cc:697] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:14.544674 31810 raft_consensus.cc:493] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.549643 31510 raft_consensus.cc:2468] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:14.550168 31831 raft_consensus.cc:2749] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.554361 31186 catalog_manager.cc:5697] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 1, leader changed from <none> to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 1 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:14.555100 31559 consensus_queue.cc:260] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.559271 31810 raft_consensus.cc:515] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:14.510008 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 103220us
I20260709 12:14:14.545975 31804 raft_consensus.cc:740] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:14.567312 31558 raft_consensus.cc:359] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.569732 31558 raft_consensus.cc:385] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:14.570055 31558 raft_consensus.cc:740] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:14.559652 31643 raft_consensus.cc:2804] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:14.545545 31328 leader_election.cc:304] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:14.577777 31558 consensus_queue.cc:260] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:14.568545 31329 leader_election.cc:343] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.581018 31404 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da; no voters: 
W20260709 12:14:14.581570 31254 leader_election.cc:343] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.582377 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ebece119174df8b0065e09199cb74a" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.587636 31280 raft_consensus.cc:2468] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:14.576403 31478 leader_election.cc:304] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.585150 31810 leader_election.cc:290] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:14.585976 31559 ts_tablet_manager.cc:1434] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260709 12:14:14.586920 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb5c33d2a8a4010b336be5c5c4635cc" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.587817 31831 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:14.579098 31643 raft_consensus.cc:697] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:14.591547 31591 raft_consensus.cc:2749] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.579406 31330 leader_election.cc:304] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.566560 31819 consensus_queue.cc:237] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.597477 31558 ts_tablet_manager.cc:1434] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.150s	user 0.007s	sys 0.004s
I20260709 12:14:14.601347 31591 raft_consensus.cc:2804] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:14.605221 31591 raft_consensus.cc:697] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:14.605316 31820 raft_consensus.cc:2749] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.606828 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.606624 31591 consensus_queue.cc:237] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
W20260709 12:14:14.608650 31253 leader_election.cc:343] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.609282 31846 leader_election.cc:290] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:14.594856 31831 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
I20260709 12:14:14.610095 31831 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.611593 31478 leader_election.cc:304] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.612525 31846 raft_consensus.cc:2749] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.587658 31804 consensus_queue.cc:260] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:14.613976 31804 raft_consensus.cc:3060] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.614226 31846 consensus_queue.cc:1048] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:14.602314 31330 leader_election.cc:304] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:14.601349 31827 leader_election.cc:290] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:14.617379 31815 raft_consensus.cc:2804] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:14.618098 31815 raft_consensus.cc:697] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:14.619158 31815 consensus_queue.cc:237] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.622745 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:14.624851 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d045764fb04dbc819b8f88e9bb085f" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
W20260709 12:14:14.602479 31328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 72306.8us
I20260709 12:14:14.628834 31643 consensus_queue.cc:237] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.637137 31559 tablet_bootstrap.cc:492] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:14.629310 31328 leader_election.cc:304] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
W20260709 12:14:14.629417 31253 leader_election.cc:343] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:14.632241 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 47128us
I20260709 12:14:14.638808 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:14.641870 31851 raft_consensus.cc:2749] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:14.644713 31254 leader_election.cc:343] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.645967 31254 leader_election.cc:304] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.646135 31330 leader_election.cc:304] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.639525 31328 leader_election.cc:304] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:14.645037 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88d7f9369fa4e8eaa71b635d908ee34" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:14.648243 31793 raft_consensus.cc:2804] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:14.648674 31793 raft_consensus.cc:493] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.649055 31793 raft_consensus.cc:3060] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.649384 31851 raft_consensus.cc:2749] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.623879 31184 catalog_manager.cc:5697] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:14.658536 31793 raft_consensus.cc:515] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.665202 31558 tablet_bootstrap.cc:492] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:14.671198 31821 raft_consensus.cc:2749] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.679458 31557 tablet_bootstrap.cc:492] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:14.680333 31557 ts_tablet_manager.cc:1403] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.445s	user 0.014s	sys 0.008s
I20260709 12:14:14.695201 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ebece119174df8b0065e09199cb74a" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:14.700193 31557 raft_consensus.cc:359] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.701417 31557 raft_consensus.cc:385] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:14.701756 31557 raft_consensus.cc:740] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:14.702967 31557 consensus_queue.cc:260] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.718557 31557 ts_tablet_manager.cc:1434] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.038s	user 0.012s	sys 0.000s
W20260709 12:14:14.688654 31254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 44002.9us
I20260709 12:14:14.719781 31557 tablet_bootstrap.cc:492] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:14.723744 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ebece119174df8b0065e09199cb74a" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:14.733101 31821 raft_consensus.cc:493] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.709945 31793 leader_election.cc:290] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:14.704399 31328 leader_election.cc:304] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
W20260709 12:14:14.716498 31329 leader_election.cc:343] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.751806 31284 raft_consensus.cc:3060] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.751499 31821 raft_consensus.cc:515] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.758420 31793 raft_consensus.cc:2749] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.766700 31821 leader_election.cc:290] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:14.766914 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdc9dd0bb6b443791a0ffbe39829943" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:14.768918 31253 leader_election.cc:343] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:14.773576 31477 leader_election.cc:343] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.778258 31831 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.783368 31831 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:14.782815 31643 raft_consensus.cc:493] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.798447 31560 tablet_bootstrap.cc:492] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:14.799257 31560 ts_tablet_manager.cc:1403] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.291s	user 0.031s	sys 0.011s
I20260709 12:14:14.790926 31643 raft_consensus.cc:515] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:14.783382 31328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 98024.8us
I20260709 12:14:14.803141 31559 tablet_bootstrap.cc:654] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:14.793865 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:14.807390 31284 raft_consensus.cc:2468] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:14.810613 31557 tablet_bootstrap.cc:654] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:14.810335 31330 leader_election.cc:304] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.811200 31830 raft_consensus.cc:493] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.812031 31793 raft_consensus.cc:2804] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:14.812635 31793 raft_consensus.cc:697] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:14.813870 31643 leader_election.cc:290] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:14.813596 31793 consensus_queue.cc:237] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.811754 31830 raft_consensus.cc:515] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.818456 31560 raft_consensus.cc:359] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.819231 31560 raft_consensus.cc:385] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:14.819514 31560 raft_consensus.cc:740] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:14.820312 31710 consensus_queue.cc:1048] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:14.820793 31865 log.cc:927] Time spent T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:14:14.820710 31830 leader_election.cc:290] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:14.823339 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53171289fe984298815d6d30885bf378" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.820269 31560 consensus_queue.cc:260] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.824991 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.825713 31283 raft_consensus.cc:2468] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:14.826478 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53171289fe984298815d6d30885bf378" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.827342 31280 raft_consensus.cc:2393] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 1: Already voted for candidate 56add4c904c74a1bba90579b9204e45d in this term.
I20260709 12:14:14.828243 31558 tablet_bootstrap.cc:654] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:14.829675 31404 leader_election.cc:304] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:14.830885 31330 leader_election.cc:304] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:14.832523 31815 raft_consensus.cc:2804] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:14.832973 31815 raft_consensus.cc:493] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.833185 31830 raft_consensus.cc:3060] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.833357 31815 raft_consensus.cc:3060] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.837685 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:14.839361 31560 ts_tablet_manager.cc:1434] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.004s
I20260709 12:14:14.840325 31402 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:14.841327 31710 raft_consensus.cc:2749] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.841786 31328 leader_election.cc:304] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:14.842681 31643 raft_consensus.cc:2749] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.847131 31252 leader_election.cc:304] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.848371 31804 raft_consensus.cc:2749] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:14.866951 31252 leader_election.cc:343] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.867612 31252 leader_election.cc:304] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:14.867995 31559 tablet_bootstrap.cc:492] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:14.868870 31559 ts_tablet_manager.cc:1403] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.232s	user 0.019s	sys 0.000s
I20260709 12:14:14.869226 31560 tablet_bootstrap.cc:492] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:14.871122 31830 raft_consensus.cc:2749] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.872886 31289 raft_consensus.cc:2468] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 2.
I20260709 12:14:14.873059 31804 raft_consensus.cc:2749] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.873399 31559 raft_consensus.cc:359] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.874508 31559 raft_consensus.cc:385] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:14.874858 31559 raft_consensus.cc:740] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:14.875901 31559 consensus_queue.cc:260] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.878479 31432 raft_consensus.cc:1240] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Rejecting Update request from peer a209a5d7b61542d885ef601e8bcaa26c for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:14.880417 31560 tablet_bootstrap.cc:654] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:14.881403 31815 raft_consensus.cc:515] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.882678 31559 ts_tablet_manager.cc:1434] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:14:14.884025 31478 leader_election.cc:304] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:14.895167 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:14.888664 31822 consensus_queue.cc:1059] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:14:14.896018 31512 raft_consensus.cc:2468] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:14.897008 31824 raft_consensus.cc:3055] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:14.897423 31824 raft_consensus.cc:740] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:14.897717 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8603c16c544a4d349593068e0a1788fa" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:14.898315 31846 raft_consensus.cc:2804] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:14.899027 31846 raft_consensus.cc:697] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 2 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:14.898370 31824 consensus_queue.cc:260] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.899159 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88d7f9369fa4e8eaa71b635d908ee34" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:14.899827 31360 raft_consensus.cc:3060] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.900271 31824 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.901099 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb5c33d2a8a4010b336be5c5c4635cc" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.901422 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d045764fb04dbc819b8f88e9bb085f" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.902828 31359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdc9dd0bb6b443791a0ffbe39829943" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.904237 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.905110 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a490d738b8e443a857242c089199946" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:14.911365 31252 leader_election.cc:304] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.899972 31846 consensus_queue.cc:237] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:14.912323 31820 raft_consensus.cc:493] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.912955 31820 raft_consensus.cc:515] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:14.915004 31475 leader_election.cc:304] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:14.916692 31854 raft_consensus.cc:2749] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.916874 31804 raft_consensus.cc:2749] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.918228 31559 tablet_bootstrap.cc:492] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:14.915217 31820 leader_election.cc:290] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:14.918453 31252 leader_election.cc:304] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.918965 31815 leader_election.cc:290] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:14.905110 31362 raft_consensus.cc:2393] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0769d57e6db04b2f86703e0ed60f6185 in current term 1: Already voted for candidate 56add4c904c74a1bba90579b9204e45d in this term.
I20260709 12:14:14.919533 31804 raft_consensus.cc:2749] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:14.919759 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:14.920956 31252 leader_election.cc:343] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.921480 31252 leader_election.cc:304] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:14.922370 31804 raft_consensus.cc:2749] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.923062 31558 tablet_bootstrap.cc:492] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:14.923637 31558 ts_tablet_manager.cc:1403] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.287s	user 0.014s	sys 0.003s
W20260709 12:14:14.923605 31477 leader_election.cc:343] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:14.923563 31252 leader_election.cc:343] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.925452 31559 tablet_bootstrap.cc:654] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:14.919763 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:14.924940 31252 leader_election.cc:304] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:14.929996 31289 raft_consensus.cc:3060] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.930219 31804 raft_consensus.cc:2749] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:14.931680 31252 leader_election.cc:343] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.932269 31252 leader_election.cc:304] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.933411 31804 raft_consensus.cc:2749] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.933966 31360 raft_consensus.cc:2468] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:14.935182 31557 tablet_bootstrap.cc:492] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:14.936026 31557 ts_tablet_manager.cc:1403] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.217s	user 0.026s	sys 0.037s
I20260709 12:14:14.941573 31252 leader_election.cc:304] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:14.942848 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:14.943490 31557 raft_consensus.cc:359] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.944193 31557 raft_consensus.cc:385] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:14.944456 31557 raft_consensus.cc:740] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
W20260709 12:14:14.945139 31478 leader_election.cc:343] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:14.945776 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:14.945174 31557 consensus_queue.cc:260] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:14.952054 31512 raft_consensus.cc:3060] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:14.956118 31558 raft_consensus.cc:359] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.957521 31478 leader_election.cc:304] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.963241 31557 ts_tablet_manager.cc:1434] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:14:14.963570 31475 leader_election.cc:304] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:14.964576 31557 tablet_bootstrap.cc:492] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:14.962690 31558 raft_consensus.cc:385] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:14.965123 31512 raft_consensus.cc:2468] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:14.967161 31846 raft_consensus.cc:2804] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:14.967645 31558 raft_consensus.cc:740] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:14.962466 31289 raft_consensus.cc:2468] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:14.971390 31330 leader_election.cc:304] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:14.971980 31804 raft_consensus.cc:2749] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.972524 31815 raft_consensus.cc:2804] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:14.973248 31815 raft_consensus.cc:697] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:14.974200 31815 consensus_queue.cc:237] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.968508 31824 raft_consensus.cc:2749] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:14.976053 31558 consensus_queue.cc:260] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:14.987459 31846 raft_consensus.cc:697] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:14.988610 31846 consensus_queue.cc:237] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:14.993386 31558 ts_tablet_manager.cc:1434] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.001s
I20260709 12:14:15.013933 31830 raft_consensus.cc:493] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.014690 31830 raft_consensus.cc:515] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:15.015934 31558 tablet_bootstrap.cc:492] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:15.032269 31830 leader_election.cc:290] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:15.052825 31643 raft_consensus.cc:493] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.062786 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:15.063608 31643 raft_consensus.cc:515] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:15.073891 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:15.074942 31511 raft_consensus.cc:2393] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 1: Already voted for candidate 0769d57e6db04b2f86703e0ed60f6185 in this term.
I20260709 12:14:15.075155 31643 leader_election.cc:290] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:15.075830 31643 consensus_queue.cc:1048] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:15.077328 31402 leader_election.cc:304] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:15.079079 31831 raft_consensus.cc:3060] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:15.080221 31557 tablet_bootstrap.cc:654] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:15.076334 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb5c33d2a8a4010b336be5c5c4635cc" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:15.087172 31288 raft_consensus.cc:2468] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:15.088809 31330 leader_election.cc:304] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:15.092512 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb5c33d2a8a4010b336be5c5c4635cc" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:15.097689 31328 leader_election.cc:343] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:15.098124 31186 catalog_manager.cc:5697] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 1 to 2, leader changed from 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193) to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 2 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.100662 31186 catalog_manager.cc:5697] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.107638 31559 tablet_bootstrap.cc:492] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:15.108475 31559 ts_tablet_manager.cc:1403] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.190s	user 0.020s	sys 0.000s
I20260709 12:14:15.097137 31815 raft_consensus.cc:2804] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:15.113306 31815 raft_consensus.cc:493] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:15.115000 31329 consensus_peers.cc:597] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:15.120059 31831 raft_consensus.cc:2749] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:15.126027 31804 consensus_queue.cc:1048] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:15.114967 31815 raft_consensus.cc:3060] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:15.151150 31883 log.cc:927] Time spent T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:14:15.148319 31187 catalog_manager.cc:5697] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.159790 31559 raft_consensus.cc:359] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:15.166335 31804 consensus_queue.cc:1048] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:15.167769 31821 consensus_queue.cc:1048] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:15.169057 31560 tablet_bootstrap.cc:492] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:15.169685 31560 ts_tablet_manager.cc:1403] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.316s	user 0.014s	sys 0.018s
I20260709 12:14:15.175660 31558 tablet_bootstrap.cc:654] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:15.160697 31559 raft_consensus.cc:385] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:15.177399 31559 raft_consensus.cc:740] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:15.183144 31591 consensus_queue.cc:1048] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:15.185463 31559 consensus_queue.cc:260] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:15.188687 31560 raft_consensus.cc:359] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:15.189719 31560 raft_consensus.cc:385] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:15.190057 31560 raft_consensus.cc:740] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:15.191565 31184 catalog_manager.cc:5697] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.195477 31557 tablet_bootstrap.cc:492] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:15.196472 31557 ts_tablet_manager.cc:1403] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.232s	user 0.018s	sys 0.027s
I20260709 12:14:15.196085 31184 catalog_manager.cc:5697] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.195631 31560 consensus_queue.cc:260] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:15.198158 31184 catalog_manager.cc:5697] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.200796 31560 ts_tablet_manager.cc:1434] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.031s	user 0.001s	sys 0.008s
I20260709 12:14:15.204527 31431 raft_consensus.cc:3060] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:15.205296 31184 catalog_manager.cc:5697] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.208869 31184 catalog_manager.cc:5697] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.215224 31559 ts_tablet_manager.cc:1434] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 12:14:15.223912 31558 tablet_bootstrap.cc:492] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:15.224570 31558 ts_tablet_manager.cc:1403] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.225s	user 0.008s	sys 0.020s
I20260709 12:14:15.227252 31846 raft_consensus.cc:493] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d5caa720fddf4dd3958f076ff03df8da)
I20260709 12:14:15.227854 31846 raft_consensus.cc:515] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:15.228113 31815 raft_consensus.cc:515] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:15.231638 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:15.232399 31437 raft_consensus.cc:2468] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 2.
I20260709 12:14:15.236044 31559 tablet_bootstrap.cc:492] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:15.238600 31560 tablet_bootstrap.cc:492] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:15.241392 31557 raft_consensus.cc:359] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:15.242766 31557 raft_consensus.cc:385] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:15.243083 31557 raft_consensus.cc:740] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:15.244159 31557 consensus_queue.cc:260] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:15.237473 31846 leader_election.cc:290] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:15.254268 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:15.254897 31477 leader_election.cc:304] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:15.255309 31360 raft_consensus.cc:2393] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 2: Already voted for candidate 56add4c904c74a1bba90579b9204e45d in this term.
I20260709 12:14:15.255923 31820 raft_consensus.cc:2804] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.256315 31820 raft_consensus.cc:493] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d5caa720fddf4dd3958f076ff03df8da)
I20260709 12:14:15.256672 31820 raft_consensus.cc:3060] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.275517 31557 ts_tablet_manager.cc:1434] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.001s
I20260709 12:14:15.276643 31851 consensus_queue.cc:1048] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:14:15.290804 31820 raft_consensus.cc:515] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:15.282598 31558 raft_consensus.cc:359] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:15.309185 31558 raft_consensus.cc:385] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:15.309667 31558 raft_consensus.cc:740] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:15.311283 31558 consensus_queue.cc:260] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:15.313423 31558 ts_tablet_manager.cc:1434] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.001s
I20260709 12:14:15.314400 31558 tablet_bootstrap.cc:492] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:15.296231 31815 leader_election.cc:290] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:15.338905 31891 log.cc:927] Time spent T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:14:15.353956 31820 leader_election.cc:290] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:15.354030 31846 raft_consensus.cc:493] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.354898 31846 raft_consensus.cc:515] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:15.359087 31560 tablet_bootstrap.cc:654] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:15.361922 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdc9dd0bb6b443791a0ffbe39829943" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:15.362624 31289 raft_consensus.cc:2468] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:15.364137 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:15.365156 31478 leader_election.cc:304] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:15.366320 31857 raft_consensus.cc:2804] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:15.366725 31857 raft_consensus.cc:493] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.367054 31857 raft_consensus.cc:3060] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:15.368991 31793 consensus_queue.cc:1048] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:15.370518 31793 consensus_queue.cc:1048] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:15.372943 31846 leader_election.cc:290] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:15.376477 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb5c33d2a8a4010b336be5c5c4635cc" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:15.377198 31283 raft_consensus.cc:3060] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:15.389251 31557 tablet_bootstrap.cc:492] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:15.402149 31559 tablet_bootstrap.cc:654] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:15.401160 31857 raft_consensus.cc:515] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:15.425530 31253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 72141.8us
I20260709 12:14:15.435250 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75145062a94b45be996b563319044cd4" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:15.436085 31360 raft_consensus.cc:2393] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 2: Already voted for candidate 56add4c904c74a1bba90579b9204e45d in this term.
I20260709 12:14:15.436724 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb5c33d2a8a4010b336be5c5c4635cc" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
W20260709 12:14:15.428824 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:15.448725 31558 tablet_bootstrap.cc:654] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:15.457340 31851 consensus_queue.cc:1048] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:15.460646 31437 raft_consensus.cc:2468] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 2.
I20260709 12:14:15.461792 31557 tablet_bootstrap.cc:654] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:15.471529 31288 raft_consensus.cc:1275] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Refusing update from remote peer a209a5d7b61542d885ef601e8bcaa26c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:15.482977 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdc9dd0bb6b443791a0ffbe39829943" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:15.486268 31820 raft_consensus.cc:493] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:15.491341 31254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 63295.9us
I20260709 12:14:15.494349 31897 consensus_queue.cc:1048] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:14:15.518121 31900 raft_consensus.cc:493] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.518651 31900 raft_consensus.cc:515] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:15.516970 31824 consensus_queue.cc:1048] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:14:15.506760 31820 raft_consensus.cc:515] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:15.511271 31359 raft_consensus.cc:3060] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.508327 31360 raft_consensus.cc:2468] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:15.520726 31900 leader_election.cc:290] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
W20260709 12:14:15.526038 31328 leader_election.cc:343] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:15.574450 31857 leader_election.cc:290] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:15.555852 31283 raft_consensus.cc:2468] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:15.591542 31477 leader_election.cc:304] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d
W20260709 12:14:15.588395 31328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 77250.5us
I20260709 12:14:15.622581 31558 tablet_bootstrap.cc:492] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:15.628232 31558 ts_tablet_manager.cc:1403] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.314s	user 0.009s	sys 0.029s
I20260709 12:14:15.636297 31559 tablet_bootstrap.cc:492] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:15.637187 31560 tablet_bootstrap.cc:492] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:15.637847 31560 ts_tablet_manager.cc:1403] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.417s	user 0.016s	sys 0.013s
I20260709 12:14:15.640887 31559 ts_tablet_manager.cc:1403] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.405s	user 0.022s	sys 0.001s
W20260709 12:14:15.631181 31401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 132876us
I20260709 12:14:15.639214 31824 raft_consensus.cc:2804] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:15.652881 31824 raft_consensus.cc:697] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 2 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:15.653782 31824 consensus_queue.cc:237] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:15.656255 31359 raft_consensus.cc:1275] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer a209a5d7b61542d885ef601e8bcaa26c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:15.632342 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:15.671052 31820 leader_election.cc:290] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:15.675868 31557 tablet_bootstrap.cc:492] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:15.676136 31909 raft_consensus.cc:493] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.676443 31557 ts_tablet_manager.cc:1403] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.289s	user 0.009s	sys 0.010s
W20260709 12:14:15.676962 31898 log.cc:927] Time spent T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c: Append to log took a long time: real 0.185s	user 0.003s	sys 0.000s
I20260709 12:14:15.678574 31909 raft_consensus.cc:515] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:15.680830 31558 raft_consensus.cc:359] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:15.700882 31558 raft_consensus.cc:385] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:15.687700 31857 consensus_queue.cc:1048] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:15.690085 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdc9dd0bb6b443791a0ffbe39829943" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:15.690954 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4977dacca462483d9bc0b0929a806d10" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:15.657616 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 72760.6us
I20260709 12:14:15.692020 31330 leader_election.cc:304] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:15.663708 31284 raft_consensus.cc:2468] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:15.720645 31283 raft_consensus.cc:3060] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:15.721809 31559 raft_consensus.cc:359] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:15.694181 31557 raft_consensus.cc:359] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:15.662848 31902 raft_consensus.cc:493] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.710526 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4977dacca462483d9bc0b0929a806d10" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:15.711858 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebdc9dd0bb6b443791a0ffbe39829943" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:15.717422 31560 raft_consensus.cc:359] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:15.722587 31559 raft_consensus.cc:385] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:15.734474 31560 raft_consensus.cc:385] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:15.734601 31559 raft_consensus.cc:740] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:15.722882 31557 raft_consensus.cc:385] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:15.735639 31557 raft_consensus.cc:740] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:15.736498 31557 consensus_queue.cc:260] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:15.701378 31558 raft_consensus.cc:740] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:15.734848 31560 raft_consensus.cc:740] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:15.738860 31558 consensus_queue.cc:260] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:15.740388 31559 consensus_queue.cc:260] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:15.756669 31557 ts_tablet_manager.cc:1434] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.080s	user 0.004s	sys 0.003s
I20260709 12:14:15.722425 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:15.780207 31559 ts_tablet_manager.cc:1434] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.139s	user 0.010s	sys 0.000s
I20260709 12:14:15.774267 31560 consensus_queue.cc:260] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:15.755153 31363 raft_consensus.cc:3060] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:15.783738 31558 ts_tablet_manager.cc:1434] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.155s	user 0.012s	sys 0.000s
I20260709 12:14:15.782421 31557 tablet_bootstrap.cc:492] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:15.769634 31362 raft_consensus.cc:2468] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 0.
I20260709 12:14:15.800283 31560 ts_tablet_manager.cc:1434] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.162s	user 0.008s	sys 0.000s
I20260709 12:14:15.778476 31916 raft_consensus.cc:2804] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:15.811750 31824 consensus_queue.cc:1048] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:14:15.779762 31330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 82997.2us
W20260709 12:14:15.825644 31477 consensus_peers.cc:597] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:15.826136 31815 consensus_queue.cc:1048] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:15.740326 31902 raft_consensus.cc:515] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:15.769857 31478 leader_election.cc:304] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
W20260709 12:14:15.828347 31478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 85291.8us
I20260709 12:14:15.828872 31902 leader_election.cc:290] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:15.830739 31909 leader_election.cc:290] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:15.831341 31846 raft_consensus.cc:2804] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.831864 31846 raft_consensus.cc:493] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.832146 31916 raft_consensus.cc:697] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:15.833344 31916 consensus_queue.cc:237] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:15.835238 31329 consensus_peers.cc:597] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:15.785223 31432 raft_consensus.cc:2468] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 0.
I20260709 12:14:15.817837 31184 catalog_manager.cc:5697] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 1 to 2, leader changed from d5caa720fddf4dd3958f076ff03df8da (127.20.102.195) to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 2 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.781926 31361 raft_consensus.cc:2468] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 2.
W20260709 12:14:15.823486 31921 log.cc:927] Time spent T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:15.832244 31846 raft_consensus.cc:3060] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.821146 31558 tablet_bootstrap.cc:492] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:15.879196 31560 tablet_bootstrap.cc:492] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:15.923163 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:15.917791 31815 consensus_queue.cc:1048] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:14:15.938140 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:15.938912 31506 raft_consensus.cc:2468] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 0.
I20260709 12:14:15.964414 31253 leader_election.cc:304] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:15.967448 31894 raft_consensus.cc:2804] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:15.967937 31894 raft_consensus.cc:493] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.968319 31894 raft_consensus.cc:3060] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:15.972056 31557 tablet_bootstrap.cc:654] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:15.968422 31363 raft_consensus.cc:2468] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:15.967954 31283 raft_consensus.cc:2468] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:15.993714 31815 raft_consensus.cc:493] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.000492 31815 raft_consensus.cc:515] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.002697 31815 leader_election.cc:290] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:15.992094 31846 raft_consensus.cc:515] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:16.005861 31559 tablet_bootstrap.cc:492] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:16.013705 31475 leader_election.cc:304] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:16.015635 31919 raft_consensus.cc:2804] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.016323 31919 raft_consensus.cc:697] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:16.017334 31919 consensus_queue.cc:237] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:16.008634 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e602beb4a714f99a8480a347d7add2e" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:16.033883 31506 raft_consensus.cc:2468] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:16.043708 31558 tablet_bootstrap.cc:654] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.068368 31328 leader_election.cc:304] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:16.069530 31915 raft_consensus.cc:2804] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.069921 31915 raft_consensus.cc:493] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.070228 31915 raft_consensus.cc:3060] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.064141 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e602beb4a714f99a8480a347d7add2e" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:16.083002 31329 leader_election.cc:343] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.085009 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:16.063903 31252 leader_election.cc:304] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:16.089613 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:16.091285 31894 raft_consensus.cc:515] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:16.097499 31905 raft_consensus.cc:493] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.099655 31905 raft_consensus.cc:515] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:16.091063 31902 raft_consensus.cc:2804] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.116961 31559 tablet_bootstrap.cc:654] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.113183 31902 raft_consensus.cc:493] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.132328 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:16.133075 31283 raft_consensus.cc:3060] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:16.129688 31902 raft_consensus.cc:3060] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.135994 31905 leader_election.cc:290] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:16.137507 31432 raft_consensus.cc:1275] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Refusing update from remote peer a209a5d7b61542d885ef601e8bcaa26c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.140357 31821 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
I20260709 12:14:16.141153 31821 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:16.143348 31404 leader_election.cc:304] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:16.146253 31909 raft_consensus.cc:2749] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.143905 31821 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:16.144330 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:16.148320 31560 tablet_bootstrap.cc:654] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.156198 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b21175df55ee43caab9a53db893f84a5" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:16.157996 31820 consensus_queue.cc:1048] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:16.159935 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:16.160624 31506 raft_consensus.cc:3060] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.123850 31894 leader_election.cc:290] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:16.163333 31186 catalog_manager.cc:5697] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.163647 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b21175df55ee43caab9a53db893f84a5" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:16.153228 31283 raft_consensus.cc:2468] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 3.
I20260709 12:14:16.172577 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:16.173448 31558 tablet_bootstrap.cc:492] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:16.173818 31510 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:16.174124 31558 ts_tablet_manager.cc:1403] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.371s	user 0.014s	sys 0.012s
I20260709 12:14:16.176314 31478 leader_election.cc:304] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:16.177493 31926 raft_consensus.cc:2804] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:16.177286 31558 raft_consensus.cc:359] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.178246 31558 raft_consensus.cc:385] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.178197 31926 raft_consensus.cc:697] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:16.179036 31558 raft_consensus.cc:740] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.179620 31926 consensus_queue.cc:237] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:16.164674 31252 leader_election.cc:343] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.180351 31558 consensus_queue.cc:260] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
W20260709 12:14:16.182510 31253 leader_election.cc:343] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.183004 31253 leader_election.cc:304] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:16.183241 31558 ts_tablet_manager.cc:1434] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:14:16.184442 31558 tablet_bootstrap.cc:492] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:16.184703 31894 raft_consensus.cc:2749] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.186067 31253 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:16.187124 31894 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:16.187568 31894 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
I20260709 12:14:16.187958 31894 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:16.188395 31254 leader_election.cc:343] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.189333 31358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
W20260709 12:14:16.189760 31254 leader_election.cc:343] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.190052 31358 raft_consensus.cc:3060] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:16.191239 31558 tablet_bootstrap.cc:654] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.194571 31361 raft_consensus.cc:1275] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer a209a5d7b61542d885ef601e8bcaa26c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.195703 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:16.196589 31431 raft_consensus.cc:2393] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0769d57e6db04b2f86703e0ed60f6185 in current term 2: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:16.196977 31567 consensus_queue.cc:1048] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:16.167167 31915 raft_consensus.cc:515] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.209827 31902 raft_consensus.cc:515] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:16.211547 31915 leader_election.cc:290] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:16.213222 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e602beb4a714f99a8480a347d7add2e" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:16.214124 31509 raft_consensus.cc:3060] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.224851 31509 raft_consensus.cc:2468] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:16.167822 31846 leader_election.cc:290] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:16.212647 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e602beb4a714f99a8480a347d7add2e" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:16.226428 31328 leader_election.cc:304] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:16.230006 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4977dacca462483d9bc0b0929a806d10" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:16.230799 31363 raft_consensus.cc:3060] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:16.231040 31329 leader_election.cc:343] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.239256 31915 raft_consensus.cc:2804] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.240044 31915 raft_consensus.cc:697] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
W20260709 12:14:16.202657 31934 log.cc:927] Time spent T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:14:16.234975 31558 tablet_bootstrap.cc:492] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:16.242664 31558 ts_tablet_manager.cc:1403] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.000s
I20260709 12:14:16.237401 31557 tablet_bootstrap.cc:492] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:16.244143 31557 ts_tablet_manager.cc:1403] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.462s	user 0.025s	sys 0.014s
I20260709 12:14:16.255421 31821 raft_consensus.cc:493] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.257624 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4977dacca462483d9bc0b0929a806d10" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:16.258365 31431 raft_consensus.cc:3060] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.245194 31894 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:16.263190 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:16.256146 31821 raft_consensus.cc:515] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:16.264057 31437 raft_consensus.cc:2393] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0769d57e6db04b2f86703e0ed60f6185 in current term 2: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:16.244129 31915 consensus_queue.cc:237] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.268399 31916 consensus_queue.cc:1048] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:16.272498 31821 leader_election.cc:290] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:16.272699 31557 raft_consensus.cc:359] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:16.273916 31557 raft_consensus.cc:385] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.274292 31557 raft_consensus.cc:740] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.275326 31894 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:16.276293 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04626a79b549449386652742229e800a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:16.277115 31328 consensus_peers.cc:597] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d -> Peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Couldn't send request to peer a209a5d7b61542d885ef601e8bcaa26c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:16.286460 31358 raft_consensus.cc:2468] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 3.
I20260709 12:14:16.288565 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04626a79b549449386652742229e800a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:16.289748 31254 leader_election.cc:343] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.290009 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
W20260709 12:14:16.295338 31253 leader_election.cc:343] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.295889 31253 leader_election.cc:304] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:16.297613 31821 raft_consensus.cc:2749] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.282519 31902 leader_election.cc:290] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:16.298288 31363 raft_consensus.cc:2468] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 1.
W20260709 12:14:16.299268 31943 log.cc:927] Time spent T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:14:16.299921 31252 leader_election.cc:304] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:16.298324 31558 raft_consensus.cc:359] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:16.302632 31558 raft_consensus.cc:385] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.303037 31558 raft_consensus.cc:740] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.332579 31558 consensus_queue.cc:260] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:16.284569 31557 consensus_queue.cc:260] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:16.366168 31557 ts_tablet_manager.cc:1434] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.122s	user 0.010s	sys 0.000s
I20260709 12:14:16.370126 31558 ts_tablet_manager.cc:1434] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.127s	user 0.009s	sys 0.001s
I20260709 12:14:16.301443 31506 raft_consensus.cc:2468] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 1.
I20260709 12:14:16.381680 31559 tablet_bootstrap.cc:492] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:16.389214 31559 ts_tablet_manager.cc:1403] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.384s	user 0.023s	sys 0.001s
I20260709 12:14:16.348997 31902 raft_consensus.cc:2804] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.392510 31559 raft_consensus.cc:359] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.396840 31559 raft_consensus.cc:385] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.397150 31559 raft_consensus.cc:740] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.352883 31431 raft_consensus.cc:2468] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 1.
I20260709 12:14:16.411222 31509 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:16.399423 31894 raft_consensus.cc:493] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.434908 31557 tablet_bootstrap.cc:492] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:16.436048 31560 tablet_bootstrap.cc:492] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:16.436575 31560 ts_tablet_manager.cc:1403] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.578s	user 0.030s	sys 0.031s
I20260709 12:14:16.401314 31902 raft_consensus.cc:697] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:16.443025 31253 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:16.444859 31253 leader_election.cc:304] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:16.446091 31904 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.446684 31904 raft_consensus.cc:697] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:16.437968 31894 raft_consensus.cc:515] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:16.447724 31904 consensus_queue.cc:237] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:16.448815 31894 leader_election.cc:290] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:16.449023 31905 raft_consensus.cc:2804] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.449695 31905 raft_consensus.cc:697] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:16.450690 31905 consensus_queue.cc:237] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:16.454344 31558 tablet_bootstrap.cc:492] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:16.457518 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:16.469103 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:16.472662 31254 leader_election.cc:343] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.440361 31559 consensus_queue.cc:260] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.484480 31559 ts_tablet_manager.cc:1434] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.095s	user 0.010s	sys 0.000s
I20260709 12:14:16.487147 31559 tablet_bootstrap.cc:492] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
W20260709 12:14:16.490185 31941 log.cc:927] Time spent T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c: Append to log took a long time: real 0.101s	user 0.004s	sys 0.000s
I20260709 12:14:16.493297 31558 tablet_bootstrap.cc:654] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.497309 31559 tablet_bootstrap.cc:654] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:16.482098 31253 leader_election.cc:343] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.506649 31902 consensus_queue.cc:237] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:16.514218 31820 consensus_queue.cc:1048] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:16.515455 31253 leader_election.cc:304] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:16.516453 31821 raft_consensus.cc:2749] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:16.517930 31946 log.cc:927] Time spent T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:14:16.553679 31559 tablet_bootstrap.cc:492] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:16.554894 31559 ts_tablet_manager.cc:1403] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.000s
I20260709 12:14:16.568987 31567 consensus_queue.cc:1048] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:16.573848 31559 raft_consensus.cc:359] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:16.575331 31890 raft_consensus.cc:493] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.575958 31890 raft_consensus.cc:515] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.578414 31890 leader_election.cc:290] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:16.579377 31559 raft_consensus.cc:385] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.580492 31559 raft_consensus.cc:740] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.584249 31821 raft_consensus.cc:493] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.591099 31821 raft_consensus.cc:515] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:16.589342 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:16.580623 31560 raft_consensus.cc:359] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.595726 31560 raft_consensus.cc:385] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.596014 31560 raft_consensus.cc:740] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
W20260709 12:14:16.596436 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:14:16.581210 31945 log.cc:927] Time spent T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:14:16.608274 31821 leader_election.cc:290] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:16.609623 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a490d738b8e443a857242c089199946" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:16.613240 31558 tablet_bootstrap.cc:492] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:16.615739 31558 ts_tablet_manager.cc:1403] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.011s
I20260709 12:14:16.614056 31559 consensus_queue.cc:260] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:16.618415 31560 consensus_queue.cc:260] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.621824 31560 ts_tablet_manager.cc:1434] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.185s	user 0.004s	sys 0.003s
I20260709 12:14:16.622987 31560 tablet_bootstrap.cc:492] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
W20260709 12:14:16.623530 31254 leader_election.cc:343] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:16.625300 31328 leader_election.cc:343] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.630698 31559 ts_tablet_manager.cc:1434] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.000s
I20260709 12:14:16.632357 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a490d738b8e443a857242c089199946" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:16.635388 31559 tablet_bootstrap.cc:492] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
W20260709 12:14:16.638643 31252 leader_election.cc:343] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.639272 31252 leader_election.cc:304] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:16.640839 31902 raft_consensus.cc:2749] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.645195 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:16.647827 31329 leader_election.cc:343] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.651041 31329 leader_election.cc:304] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:16.653913 31557 tablet_bootstrap.cc:654] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.661072 31905 raft_consensus.cc:493] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.661764 31905 raft_consensus.cc:515] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:16.656183 31915 raft_consensus.cc:2749] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.667439 31905 leader_election.cc:290] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:16.668674 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30451bcaa4ca44f992ef5f47be40eda9" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:16.669572 31558 raft_consensus.cc:359] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.670610 31558 raft_consensus.cc:385] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.670956 31558 raft_consensus.cc:740] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
W20260709 12:14:16.672854 31253 leader_election.cc:343] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.677982 31558 consensus_queue.cc:260] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.685540 31560 tablet_bootstrap.cc:654] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.686050 31558 ts_tablet_manager.cc:1434] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.003s
I20260709 12:14:16.692893 31358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30451bcaa4ca44f992ef5f47be40eda9" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:16.701659 31905 raft_consensus.cc:493] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.702268 31905 raft_consensus.cc:515] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:16.702919 31559 tablet_bootstrap.cc:654] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:16.705852 31252 leader_election.cc:343] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.706425 31252 leader_election.cc:304] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:16.706633 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb35e6f710fb417fba28d448bf7cc140" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:16.708559 31821 raft_consensus.cc:2749] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.707227 31905 leader_election.cc:290] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
W20260709 12:14:16.710063 31253 leader_election.cc:343] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.686937 31956 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.714421 31909 raft_consensus.cc:493] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.715013 31909 raft_consensus.cc:515] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.717136 31909 leader_election.cc:290] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:16.722283 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88d7f9369fa4e8eaa71b635d908ee34" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:16.731686 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb35e6f710fb417fba28d448bf7cc140" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:16.732676 31363 raft_consensus.cc:2468] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 0.
I20260709 12:14:16.710947 31956 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:16.749293 31252 leader_election.cc:304] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:16.750336 31956 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:16.752130 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88d7f9369fa4e8eaa71b635d908ee34" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:16.764240 31401 leader_election.cc:304] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
W20260709 12:14:16.750360 31329 consensus_peers.cc:597] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:16.765487 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:16.781688 31557 tablet_bootstrap.cc:492] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:16.782254 31557 ts_tablet_manager.cc:1403] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.354s	user 0.027s	sys 0.013s
I20260709 12:14:16.783413 31905 raft_consensus.cc:2804] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.783951 31905 raft_consensus.cc:493] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.784340 31905 raft_consensus.cc:3060] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.785022 31557 raft_consensus.cc:359] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:16.785837 31557 raft_consensus.cc:385] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.786105 31557 raft_consensus.cc:740] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.766623 31956 raft_consensus.cc:2749] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.786687 31557 consensus_queue.cc:260] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:16.790518 31558 tablet_bootstrap.cc:492] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:16.792563 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:16.799401 31846 raft_consensus.cc:493] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.800091 31846 raft_consensus.cc:515] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.803656 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82bc50bbf494273a5cf986a398a5e4f" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:16.803992 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82bc50bbf494273a5cf986a398a5e4f" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:16.804948 31846 leader_election.cc:290] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
W20260709 12:14:16.805692 31475 leader_election.cc:343] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:16.806983 31477 leader_election.cc:343] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.807647 31477 leader_election.cc:304] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:16.766614 31511 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 2.
I20260709 12:14:16.815819 31557 ts_tablet_manager.cc:1434] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.001s
I20260709 12:14:16.813716 31567 raft_consensus.cc:2749] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.819197 31557 tablet_bootstrap.cc:492] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:16.819514 31288 raft_consensus.cc:1275] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Refusing update from remote peer a209a5d7b61542d885ef601e8bcaa26c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:16.822355 31915 raft_consensus.cc:493] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.822813 31560 tablet_bootstrap.cc:492] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:16.823791 31402 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:16.824136 31820 consensus_queue.cc:1048] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:16.823359 31560 ts_tablet_manager.cc:1403] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.201s	user 0.026s	sys 0.013s
I20260709 12:14:16.829265 31362 raft_consensus.cc:1275] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 3 FOLLOWER]: Refusing update from remote peer a209a5d7b61542d885ef601e8bcaa26c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:16.833480 31793 consensus_queue.cc:1048] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:16.833843 31846 consensus_queue.cc:1048] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:16.822965 31915 raft_consensus.cc:515] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:16.840473 31915 leader_election.cc:290] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:16.827271 31956 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:16.842417 31956 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.842634 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521fc30d365d455da547428401e26181" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:16.843083 31956 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:16.845536 31329 leader_election.cc:343] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.844406 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521fc30d365d455da547428401e26181" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:16.847591 31328 leader_election.cc:343] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.848124 31328 leader_election.cc:304] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:16.849479 31915 raft_consensus.cc:2749] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.858356 31559 tablet_bootstrap.cc:492] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:16.858951 31559 ts_tablet_manager.cc:1403] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.224s	user 0.046s	sys 0.047s
I20260709 12:14:16.862211 31559 raft_consensus.cc:359] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:16.862990 31559 raft_consensus.cc:385] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.863272 31559 raft_consensus.cc:740] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.864308 31558 tablet_bootstrap.cc:654] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.864077 31559 consensus_queue.cc:260] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:16.866290 31511 raft_consensus.cc:3060] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.866802 31559 ts_tablet_manager.cc:1434] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:14:16.867980 31559 tablet_bootstrap.cc:492] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:16.879264 31559 tablet_bootstrap.cc:654] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.884614 31821 raft_consensus.cc:493] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.885505 31821 raft_consensus.cc:515] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
W20260709 12:14:16.886627 31254 consensus_peers.cc:597] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:16.891789 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab02fdbdd944bfab62c752b0636f82c" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:16.893663 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab02fdbdd944bfab62c752b0636f82c" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:16.897662 31821 leader_election.cc:290] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
W20260709 12:14:16.898799 31254 leader_election.cc:343] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.848428 31905 raft_consensus.cc:515] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:16.905323 31252 leader_election.cc:343] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.905949 31252 leader_election.cc:304] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:16.909627 31186 catalog_manager.cc:5697] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.913626 31186 catalog_manager.cc:5697] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } }
I20260709 12:14:16.920163 31560 raft_consensus.cc:359] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:16.921269 31560 raft_consensus.cc:385] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.921640 31560 raft_consensus.cc:740] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.923121 31560 consensus_queue.cc:260] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:16.926108 31560 ts_tablet_manager.cc:1434] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 12:14:16.927515 31560 tablet_bootstrap.cc:492] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:16.914029 31902 raft_consensus.cc:2749] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.967063 31560 tablet_bootstrap.cc:654] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.976917 31510 raft_consensus.cc:1275] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.979333 31902 consensus_queue.cc:1048] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.985934 31905 leader_election.cc:290] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:16.989145 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb35e6f710fb417fba28d448bf7cc140" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:16.992414 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb35e6f710fb417fba28d448bf7cc140" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:16.993191 31362 raft_consensus.cc:3060] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.994871 31557 tablet_bootstrap.cc:654] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.000618 31902 consensus_queue.cc:1048] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.001067 31362 raft_consensus.cc:2468] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 1.
I20260709 12:14:17.002419 31437 raft_consensus.cc:3060] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.006265 31252 leader_election.cc:304] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:17.007400 31902 raft_consensus.cc:2804] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:14:17.007350 31253 leader_election.cc:343] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.008314 31902 raft_consensus.cc:697] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:17.014706 31956 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.015944 31432 raft_consensus.cc:1240] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Rejecting Update request from peer 0769d57e6db04b2f86703e0ed60f6185 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:17.017581 31902 consensus_queue.cc:237] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:17.034341 31905 consensus_queue.cc:1059] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:14:17.058187 31926 raft_consensus.cc:493] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.071118 31558 tablet_bootstrap.cc:492] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:17.072132 31558 ts_tablet_manager.cc:1403] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.294s	user 0.029s	sys 0.055s
I20260709 12:14:17.079619 31821 raft_consensus.cc:3055] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:17.080370 31821 raft_consensus.cc:740] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:17.085287 31956 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 3 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:17.102026 31902 consensus_queue.cc:1048] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.101720 31821 consensus_queue.cc:260] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.072901 31926 raft_consensus.cc:515] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.094352 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:17.105677 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:17.113528 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:17.114498 31289 raft_consensus.cc:2468] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:17.116379 31478 leader_election.cc:304] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:17.122351 31558 raft_consensus.cc:359] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.123021 31558 raft_consensus.cc:385] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.123261 31558 raft_consensus.cc:740] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.128942 31558 consensus_queue.cc:260] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.140302 31560 tablet_bootstrap.cc:492] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:17.136065 31187 catalog_manager.cc:5697] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.128932 31919 raft_consensus.cc:2804] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:17.140857 31560 ts_tablet_manager.cc:1403] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.214s	user 0.023s	sys 0.004s
I20260709 12:14:17.143262 31557 tablet_bootstrap.cc:492] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:17.146533 31557 ts_tablet_manager.cc:1403] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.328s	user 0.013s	sys 0.008s
I20260709 12:14:17.127718 31926 leader_election.cc:290] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:17.132978 31821 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.152562 31558 ts_tablet_manager.cc:1434] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.080s	user 0.011s	sys 0.000s
I20260709 12:14:17.147540 31919 raft_consensus.cc:493] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.169502 31558 tablet_bootstrap.cc:492] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:17.163013 31919 raft_consensus.cc:3060] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:17.160521 31402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 59039.9us
I20260709 12:14:17.170150 31431 raft_consensus.cc:3060] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.190842 31559 tablet_bootstrap.cc:492] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:17.196291 31559 ts_tablet_manager.cc:1403] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.329s	user 0.016s	sys 0.006s
I20260709 12:14:17.196278 31846 raft_consensus.cc:493] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56add4c904c74a1bba90579b9204e45d)
I20260709 12:14:17.208056 31846 raft_consensus.cc:515] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:17.214018 31560 raft_consensus.cc:359] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.203877 31557 raft_consensus.cc:359] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.218736 31557 raft_consensus.cc:385] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.215252 31560 raft_consensus.cc:385] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.219259 31557 raft_consensus.cc:740] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.219493 31560 raft_consensus.cc:740] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.222095 31557 consensus_queue.cc:260] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.235570 31846 leader_election.cc:290] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:17.238667 31890 raft_consensus.cc:493] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.240085 31890 raft_consensus.cc:515] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.240818 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:17.249168 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab02fdbdd944bfab62c752b0636f82c" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:17.249155 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab02fdbdd944bfab62c752b0636f82c" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:17.250020 31289 raft_consensus.cc:2468] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:17.252511 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb5c33d2a8a4010b336be5c5c4635cc" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:17.253950 31283 raft_consensus.cc:2410] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:14:17.254400 31329 leader_election.cc:343] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:17.257069 31477 leader_election.cc:343] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.258848 31559 raft_consensus.cc:359] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.259687 31559 raft_consensus.cc:385] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.260032 31890 leader_election.cc:290] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:17.259485 31404 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:17.261106 31913 raft_consensus.cc:2749] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:17.264066 31558 tablet_bootstrap.cc:654] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.265041 31560 consensus_queue.cc:260] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.266919 31184 catalog_manager.cc:5697] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 1 to 2, leader changed from a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:17.269017 31184 catalog_manager.cc:5697] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:17.270424 31475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 93948.6us
I20260709 12:14:17.274442 31330 leader_election.cc:304] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:17.260041 31559 raft_consensus.cc:740] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.285537 31560 ts_tablet_manager.cc:1434] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.138s	user 0.010s	sys 0.000s
I20260709 12:14:17.271713 31184 catalog_manager.cc:5697] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.284632 31559 consensus_queue.cc:260] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.305372 31438 raft_consensus.cc:3060] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.308465 31559 ts_tablet_manager.cc:1434] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.112s	user 0.008s	sys 0.000s
I20260709 12:14:17.309563 31559 tablet_bootstrap.cc:492] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:17.311870 31919 raft_consensus.cc:515] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.301347 31916 raft_consensus.cc:2804] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:17.317559 31916 raft_consensus.cc:493] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.318076 31916 raft_consensus.cc:3060] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.320629 31919 leader_election.cc:290] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:17.328020 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:17.328858 31283 raft_consensus.cc:3060] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.331056 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb5c33d2a8a4010b336be5c5c4635cc" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:17.333063 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:17.338282 31560 tablet_bootstrap.cc:492] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
W20260709 12:14:17.339314 31477 leader_election.cc:343] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.341120 31902 consensus_queue.cc:1048] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.342094 31475 leader_election.cc:304] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:17.348412 31557 ts_tablet_manager.cc:1434] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.202s	user 0.016s	sys 0.010s
I20260709 12:14:17.349965 31559 tablet_bootstrap.cc:654] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.349987 31557 tablet_bootstrap.cc:492] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:17.354285 31919 raft_consensus.cc:2749] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:17.402585 31560 tablet_bootstrap.cc:654] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.431243 31283 raft_consensus.cc:2468] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:17.432651 31478 leader_election.cc:304] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:17.433465 31846 raft_consensus.cc:2804] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:17.433786 31557 tablet_bootstrap.cc:654] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.433945 31846 raft_consensus.cc:697] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:17.435344 31846 consensus_queue.cc:237] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.414264 31187 catalog_manager.cc:5697] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.456633 31558 tablet_bootstrap.cc:492] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:17.457432 31558 ts_tablet_manager.cc:1403] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.288s	user 0.011s	sys 0.012s
I20260709 12:14:17.461001 31558 raft_consensus.cc:359] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.461726 31558 raft_consensus.cc:385] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.462002 31558 raft_consensus.cc:740] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.462659 31558 consensus_queue.cc:260] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.465224 31559 tablet_bootstrap.cc:492] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:17.465857 31559 ts_tablet_manager.cc:1403] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.157s	user 0.008s	sys 0.009s
I20260709 12:14:17.465937 31916 raft_consensus.cc:515] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.483048 31559 raft_consensus.cc:359] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:17.483886 31559 raft_consensus.cc:385] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.484187 31559 raft_consensus.cc:740] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.484892 31559 consensus_queue.cc:260] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:17.487279 31559 ts_tablet_manager.cc:1434] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:14:17.495246 31916 leader_election.cc:290] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:17.495471 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab02fdbdd944bfab62c752b0636f82c" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:17.496739 31289 raft_consensus.cc:3060] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.495822 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab02fdbdd944bfab62c752b0636f82c" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
W20260709 12:14:17.498502 31329 leader_election.cc:343] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.504475 31289 raft_consensus.cc:2468] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:17.518625 31330 leader_election.cc:304] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:17.519711 31851 raft_consensus.cc:2804] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:17.520263 31851 raft_consensus.cc:697] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:17.520524 31558 ts_tablet_manager.cc:1434] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.001s
I20260709 12:14:17.521943 31558 tablet_bootstrap.cc:492] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:17.521409 31851 consensus_queue.cc:237] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.524240 31560 tablet_bootstrap.cc:492] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:17.524811 31560 ts_tablet_manager.cc:1403] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.187s	user 0.027s	sys 0.000s
I20260709 12:14:17.529919 31902 raft_consensus.cc:493] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.530504 31902 raft_consensus.cc:515] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.532859 31902 leader_election.cc:290] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:17.535321 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ead5d3f281f4adb8e218fc8979158f2" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:17.537099 31253 leader_election.cc:343] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.537387 31559 tablet_bootstrap.cc:492] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:17.538966 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ead5d3f281f4adb8e218fc8979158f2" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:17.540441 31254 leader_election.cc:343] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.543789 31560 raft_consensus.cc:359] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:17.545187 31560 raft_consensus.cc:385] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:17.546690 31253 consensus_peers.cc:597] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 -> Peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Couldn't send request to peer a209a5d7b61542d885ef601e8bcaa26c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:17.547439 31915 raft_consensus.cc:493] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.547919 31915 raft_consensus.cc:515] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.545670 31560 raft_consensus.cc:740] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.540949 31254 leader_election.cc:304] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:17.545791 31187 catalog_manager.cc:5697] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.569562 31560 consensus_queue.cc:260] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:17.576478 31902 raft_consensus.cc:2749] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:17.577733 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a490d738b8e443a857242c089199946" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:17.578915 31289 raft_consensus.cc:2468] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:17.583678 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a490d738b8e443a857242c089199946" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:17.587258 31329 leader_election.cc:343] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.591620 31902 consensus_queue.cc:1048] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.594075 31330 leader_election.cc:304] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:17.596385 31890 raft_consensus.cc:2804] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:17.596982 31890 raft_consensus.cc:493] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.597479 31890 raft_consensus.cc:3060] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.562450 31915 leader_election.cc:290] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:17.634956 31558 tablet_bootstrap.cc:654] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.641103 31560 ts_tablet_manager.cc:1434] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.116s	user 0.010s	sys 0.000s
I20260709 12:14:17.654668 31890 raft_consensus.cc:515] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
W20260709 12:14:17.656666 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:17.663877 31559 tablet_bootstrap.cc:654] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.666875 31560 tablet_bootstrap.cc:492] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:17.675573 31890 leader_election.cc:290] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:17.674887 31187 catalog_manager.cc:5697] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.680998 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a490d738b8e443a857242c089199946" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:17.681669 31286 raft_consensus.cc:3060] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.686206 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a490d738b8e443a857242c089199946" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:17.695497 31975 raft_consensus.cc:493] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.696126 31975 raft_consensus.cc:515] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.698848 31557 tablet_bootstrap.cc:492] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:17.699460 31975 leader_election.cc:290] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:17.712833 31557 ts_tablet_manager.cc:1403] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.363s	user 0.036s	sys 0.021s
I20260709 12:14:17.716284 31557 raft_consensus.cc:359] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.717115 31557 raft_consensus.cc:385] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.717445 31557 raft_consensus.cc:740] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.705183 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04626a79b549449386652742229e800a" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:17.718343 31557 consensus_queue.cc:260] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.708212 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04626a79b549449386652742229e800a" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:17.731254 31477 leader_election.cc:343] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:17.705410 31329 leader_election.cc:343] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.721566 31560 tablet_bootstrap.cc:654] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.718909 31283 raft_consensus.cc:2468] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:17.737702 31478 leader_election.cc:304] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:17.740579 31975 raft_consensus.cc:2804] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:17.741086 31975 raft_consensus.cc:493] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.741537 31975 raft_consensus.cc:3060] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.742134 31557 ts_tablet_manager.cc:1434] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:14:17.743465 31557 tablet_bootstrap.cc:492] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:17.691725 31286 raft_consensus.cc:2468] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:17.763507 31330 leader_election.cc:304] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:17.768086 31919 raft_consensus.cc:493] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.768755 31919 raft_consensus.cc:515] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:17.771021 31919 leader_election.cc:290] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:17.773346 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b21175df55ee43caab9a53db893f84a5" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
W20260709 12:14:17.779791 31475 leader_election.cc:343] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.775691 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b21175df55ee43caab9a53db893f84a5" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:17.781178 31286 raft_consensus.cc:2468] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:17.785378 31890 raft_consensus.cc:2804] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:17.786016 31890 raft_consensus.cc:697] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:17.786899 31890 consensus_queue.cc:237] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:17.788312 31558 tablet_bootstrap.cc:492] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:17.788532 31438 raft_consensus.cc:3060] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.790573 31478 leader_election.cc:304] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:17.792914 31558 ts_tablet_manager.cc:1403] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.271s	user 0.012s	sys 0.005s
I20260709 12:14:17.794432 31919 raft_consensus.cc:2804] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:17.799742 31975 raft_consensus.cc:515] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.800348 31919 raft_consensus.cc:493] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.801043 31919 raft_consensus.cc:3060] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.802243 31975 leader_election.cc:290] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:17.807626 31560 tablet_bootstrap.cc:492] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:17.803705 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04626a79b549449386652742229e800a" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:17.808218 31560 ts_tablet_manager.cc:1403] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.160s	user 0.035s	sys 0.009s
I20260709 12:14:17.810526 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04626a79b549449386652742229e800a" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
W20260709 12:14:17.810606 31477 leader_election.cc:343] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.811429 31559 tablet_bootstrap.cc:492] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:17.812075 31557 tablet_bootstrap.cc:654] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.812160 31559 ts_tablet_manager.cc:1403] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.275s	user 0.016s	sys 0.001s
I20260709 12:14:17.811611 31286 raft_consensus.cc:3060] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.820695 31559 raft_consensus.cc:359] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:17.826821 31559 raft_consensus.cc:385] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.827171 31559 raft_consensus.cc:740] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.828065 31559 consensus_queue.cc:260] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:17.839015 31560 raft_consensus.cc:359] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:17.845371 31560 raft_consensus.cc:385] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.845743 31560 raft_consensus.cc:740] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.846477 31560 consensus_queue.cc:260] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:17.848762 31560 ts_tablet_manager.cc:1434] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.000s
I20260709 12:14:17.838402 31919 raft_consensus.cc:515] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:17.849757 31560 tablet_bootstrap.cc:492] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:17.850207 31558 raft_consensus.cc:359] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:17.851118 31558 raft_consensus.cc:385] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.851428 31558 raft_consensus.cc:740] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.857319 31560 tablet_bootstrap.cc:654] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.857112 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b21175df55ee43caab9a53db893f84a5" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:17.857836 31289 raft_consensus.cc:3060] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.858338 31557 tablet_bootstrap.cc:492] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:17.859063 31557 ts_tablet_manager.cc:1403] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.006s
I20260709 12:14:17.863705 31559 ts_tablet_manager.cc:1434] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:14:17.865275 31559 tablet_bootstrap.cc:492] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:17.865473 31919 leader_election.cc:290] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:17.865960 31558 consensus_queue.cc:260] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:17.869017 31286 raft_consensus.cc:2468] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:17.870368 31478 leader_election.cc:304] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:17.871990 31976 raft_consensus.cc:2804] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:17.872566 31976 raft_consensus.cc:697] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:17.873508 31976 consensus_queue.cc:237] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:17.873757 31186 catalog_manager.cc:5697] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.881515 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b21175df55ee43caab9a53db893f84a5" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
W20260709 12:14:17.891431 31475 leader_election.cc:343] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.893784 31558 ts_tablet_manager.cc:1434] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.003s
I20260709 12:14:17.901944 31557 raft_consensus.cc:359] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:17.904891 31557 raft_consensus.cc:385] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.903196 31558 tablet_bootstrap.cc:492] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:17.905265 31557 raft_consensus.cc:740] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.911288 31557 consensus_queue.cc:260] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:17.919005 31289 raft_consensus.cc:2468] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:17.924362 31557 ts_tablet_manager.cc:1434] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 12:14:17.927415 31557 tablet_bootstrap.cc:492] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:17.933483 31478 leader_election.cc:304] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:17.940047 31985 raft_consensus.cc:493] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.958052 31558 tablet_bootstrap.cc:654] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.958004 31985 raft_consensus.cc:515] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:17.952152 31329 consensus_peers.cc:597] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:17.960443 31985 leader_election.cc:290] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:17.947268 31560 tablet_bootstrap.cc:492] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:17.986481 31976 consensus_queue.cc:1048] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:14:17.990175 31560 ts_tablet_manager.cc:1403] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.141s	user 0.022s	sys 0.033s
I20260709 12:14:17.959914 31559 tablet_bootstrap.cc:654] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.943650 31567 raft_consensus.cc:2804] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:17.997730 31567 raft_consensus.cc:697] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:17.998721 31567 consensus_queue.cc:237] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:17.962122 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbd74b64bc44ffea43757f3bdbfe1c3" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:17.993444 31560 raft_consensus.cc:359] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:18.002295 31477 consensus_peers.cc:597] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:17.965515 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbd74b64bc44ffea43757f3bdbfe1c3" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:17.996968 31558 tablet_bootstrap.cc:492] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:18.003400 31558 ts_tablet_manager.cc:1403] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.101s	user 0.024s	sys 0.024s
W20260709 12:14:18.004539 31253 leader_election.cc:343] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.002589 31560 raft_consensus.cc:385] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.005687 31560 raft_consensus.cc:740] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.006482 31560 consensus_queue.cc:260] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:18.006716 31558 raft_consensus.cc:359] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.007623 31558 raft_consensus.cc:385] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.007921 31558 raft_consensus.cc:740] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.008603 31558 consensus_queue.cc:260] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.009361 31560 ts_tablet_manager.cc:1434] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:14:18.012042 31560 tablet_bootstrap.cc:492] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
W20260709 12:14:18.009750 31252 leader_election.cc:343] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.014056 31252 leader_election.cc:304] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:18.014971 31985 raft_consensus.cc:2749] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:18.010757 31558 ts_tablet_manager.cc:1434] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:18.016556 31558 tablet_bootstrap.cc:492] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:18.023162 31558 tablet_bootstrap.cc:654] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.049937 31559 tablet_bootstrap.cc:492] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:18.050459 31559 ts_tablet_manager.cc:1403] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.185s	user 0.010s	sys 0.004s
I20260709 12:14:18.052501 31557 tablet_bootstrap.cc:654] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.064949 31560 tablet_bootstrap.cc:654] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.081548 31559 raft_consensus.cc:359] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.089053 31559 raft_consensus.cc:385] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.085201 31187 catalog_manager.cc:5697] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.099927 31890 raft_consensus.cc:493] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.089457 31559 raft_consensus.cc:740] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.108671 31559 consensus_queue.cc:260] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.112428 31560 tablet_bootstrap.cc:492] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:18.113109 31560 ts_tablet_manager.cc:1403] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.000s
I20260709 12:14:18.107683 31890 raft_consensus.cc:515] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.115986 31559 ts_tablet_manager.cc:1434] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.001s
I20260709 12:14:18.116556 31851 consensus_queue.cc:1048] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:18.118119 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbd74b64bc44ffea43757f3bdbfe1c3" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:18.121833 31328 leader_election.cc:343] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.118721 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbd74b64bc44ffea43757f3bdbfe1c3" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:18.123237 31289 raft_consensus.cc:2468] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:18.126860 31558 tablet_bootstrap.cc:492] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:18.127517 31558 ts_tablet_manager.cc:1403] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.111s	user 0.023s	sys 0.039s
I20260709 12:14:18.128350 31559 tablet_bootstrap.cc:492] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:18.126228 31330 leader_election.cc:304] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:18.129487 31915 raft_consensus.cc:2804] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:18.129889 31915 raft_consensus.cc:493] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.130232 31915 raft_consensus.cc:3060] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.124320 31890 leader_election.cc:290] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:18.134660 31558 raft_consensus.cc:359] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.135852 31558 raft_consensus.cc:385] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.136121 31558 raft_consensus.cc:740] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.137215 31558 consensus_queue.cc:260] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.138749 31560 raft_consensus.cc:359] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.139549 31560 raft_consensus.cc:385] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.139827 31560 raft_consensus.cc:740] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.140480 31557 tablet_bootstrap.cc:492] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:18.141129 31557 ts_tablet_manager.cc:1403] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.215s	user 0.023s	sys 0.010s
I20260709 12:14:18.145326 31985 raft_consensus.cc:493] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.145692 31560 consensus_queue.cc:260] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.145972 31985 raft_consensus.cc:515] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.143646 31558 ts_tablet_manager.cc:1434] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:14:18.148725 31985 leader_election.cc:290] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:18.165128 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:18.166445 31890 raft_consensus.cc:493] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.149560 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:18.167001 31890 raft_consensus.cc:515] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.169099 31890 leader_election.cc:290] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:18.166500 31252 leader_election.cc:343] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:18.173481 31254 leader_election.cc:343] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.173892 31254 leader_election.cc:304] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:18.175125 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30451bcaa4ca44f992ef5f47be40eda9" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:18.176200 31902 raft_consensus.cc:2749] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:18.176716 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30451bcaa4ca44f992ef5f47be40eda9" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:18.177536 31289 raft_consensus.cc:2468] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
W20260709 12:14:18.179060 31328 leader_election.cc:343] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.180016 31558 tablet_bootstrap.cc:492] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:18.151734 31557 raft_consensus.cc:359] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.181012 31557 raft_consensus.cc:385] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.181303 31557 raft_consensus.cc:740] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.158223 31560 ts_tablet_manager.cc:1434] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:14:18.145326 31559 tablet_bootstrap.cc:654] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.188252 31330 leader_election.cc:304] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:18.189525 32015 raft_consensus.cc:2804] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:18.176312 31187 catalog_manager.cc:5697] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.190016 32015 raft_consensus.cc:493] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.198894 31975 raft_consensus.cc:493] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.192852 31915 raft_consensus.cc:515] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.201393 31560 tablet_bootstrap.cc:492] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:18.200466 32015 raft_consensus.cc:3060] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.199973 31975 raft_consensus.cc:515] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.205978 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521fc30d365d455da547428401e26181" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:18.206650 31360 raft_consensus.cc:2468] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:18.207638 31558 tablet_bootstrap.cc:654] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.208331 31475 leader_election.cc:304] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:18.209343 31919 raft_consensus.cc:2804] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:18.209496 31557 consensus_queue.cc:260] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.209755 31919 raft_consensus.cc:493] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.210556 31919 raft_consensus.cc:3060] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.215085 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbd74b64bc44ffea43757f3bdbfe1c3" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
W20260709 12:14:18.216889 31328 leader_election.cc:343] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.239106 31557 ts_tablet_manager.cc:1434] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.094s	user 0.012s	sys 0.000s
I20260709 12:14:18.242084 31557 tablet_bootstrap.cc:492] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:18.251384 31890 raft_consensus.cc:493] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.252038 31890 raft_consensus.cc:515] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.270777 31560 tablet_bootstrap.cc:654] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.272522 31975 leader_election.cc:290] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:18.273656 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521fc30d365d455da547428401e26181" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:18.275341 31477 leader_election.cc:343] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.279266 32015 raft_consensus.cc:515] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.259572 31915 leader_election.cc:290] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:18.289934 31851 raft_consensus.cc:493] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.288517 31902 raft_consensus.cc:493] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.284839 31913 raft_consensus.cc:493] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.292618 31851 raft_consensus.cc:515] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.293498 31913 raft_consensus.cc:515] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.295395 31851 leader_election.cc:290] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:18.291603 31283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbd74b64bc44ffea43757f3bdbfe1c3" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:18.300110 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a490d738b8e443a857242c089199946" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:18.302778 31890 leader_election.cc:290] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:18.296372 31913 leader_election.cc:290] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:18.279527 31919 raft_consensus.cc:515] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.313302 31283 raft_consensus.cc:3060] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.312992 31956 raft_consensus.cc:493] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.333269 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82bc50bbf494273a5cf986a398a5e4f" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:18.331638 31956 raft_consensus.cc:515] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.340158 31956 leader_election.cc:290] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:18.341454 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:18.342806 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:18.303085 31902 raft_consensus.cc:515] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.343472 31360 raft_consensus.cc:2468] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 0.
W20260709 12:14:18.345057 31402 leader_election.cc:343] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.340610 31283 raft_consensus.cc:2468] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:18.345752 31902 leader_election.cc:290] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:18.346365 31401 leader_election.cc:304] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:18.342881 31558 tablet_bootstrap.cc:492] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:18.347273 31558 ts_tablet_manager.cc:1403] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.167s	user 0.020s	sys 0.020s
I20260709 12:14:18.348150 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:18.348745 31438 raft_consensus.cc:2468] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:18.350078 31558 raft_consensus.cc:359] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.350761 31558 raft_consensus.cc:385] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.351024 31558 raft_consensus.cc:740] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.341630 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a490d738b8e443a857242c089199946" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:18.351217 31976 consensus_queue.cc:1048] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:18.351544 32015 leader_election.cc:290] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:18.352042 31280 raft_consensus.cc:2393] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 1: Already voted for candidate 56add4c904c74a1bba90579b9204e45d in this term.
I20260709 12:14:18.354022 31919 leader_election.cc:290] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
W20260709 12:14:18.355196 31329 leader_election.cc:343] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.355140 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521fc30d365d455da547428401e26181" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:18.356395 31557 tablet_bootstrap.cc:654] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:18.356803 31477 leader_election.cc:343] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.359424 31558 consensus_queue.cc:260] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.360999 31956 raft_consensus.cc:2804] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:18.361259 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82bc50bbf494273a5cf986a398a5e4f" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:18.361505 31956 raft_consensus.cc:493] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.363473 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30451bcaa4ca44f992ef5f47be40eda9" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:18.363852 31558 ts_tablet_manager.cc:1434] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:14:18.365031 31558 tablet_bootstrap.cc:492] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:18.365726 31404 leader_election.cc:304] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:18.366624 31511 raft_consensus.cc:2468] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:18.367834 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:18.369143 31329 leader_election.cc:304] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:18.369916 31558 tablet_bootstrap.cc:654] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.370095 32017 raft_consensus.cc:2804] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:18.370635 32017 raft_consensus.cc:493] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.371093 32017 raft_consensus.cc:3060] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.370896 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e23c1349714ee8b522e1b92accebc2" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:18.371744 31360 raft_consensus.cc:2468] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 0.
W20260709 12:14:18.373261 31328 leader_election.cc:343] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.374418 31328 leader_election.cc:304] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:18.372910 31252 leader_election.cc:304] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:18.377887 31330 leader_election.cc:304] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:18.378963 31890 raft_consensus.cc:2804] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:18.379428 31890 raft_consensus.cc:493] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.379460 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30451bcaa4ca44f992ef5f47be40eda9" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:18.393795 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e23c1349714ee8b522e1b92accebc2" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:18.379935 31890 raft_consensus.cc:3060] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.403491 31915 raft_consensus.cc:2804] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:18.373649 31956 raft_consensus.cc:3060] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.380699 31913 raft_consensus.cc:3060] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.411715 31559 tablet_bootstrap.cc:492] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:18.414927 31559 ts_tablet_manager.cc:1403] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.288s	user 0.012s	sys 0.019s
W20260709 12:14:18.415983 31254 leader_election.cc:343] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.391165 31286 raft_consensus.cc:3060] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.398146 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521fc30d365d455da547428401e26181" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:18.388420 32018 raft_consensus.cc:2804] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:14:18.453085 31330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 53743.8us
I20260709 12:14:18.462996 31846 raft_consensus.cc:493] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.463382 31558 tablet_bootstrap.cc:492] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:18.464033 31558 ts_tablet_manager.cc:1403] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.099s	user 0.038s	sys 0.022s
I20260709 12:14:18.463758 31846 raft_consensus.cc:515] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.466184 31560 tablet_bootstrap.cc:492] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:18.467043 31560 ts_tablet_manager.cc:1403] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.269s	user 0.014s	sys 0.009s
I20260709 12:14:18.447359 31362 raft_consensus.cc:3060] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:18.445925 31328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 71597.4us
I20260709 12:14:18.508410 31915 raft_consensus.cc:697] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:18.510020 31915 consensus_queue.cc:237] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.511873 31913 raft_consensus.cc:2749] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:18.419346 32024 consensus_queue.cc:1048] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.104s
I20260709 12:14:18.448298 32018 raft_consensus.cc:493] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.538091 32018 raft_consensus.cc:3060] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.547052 31846 leader_election.cc:290] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:18.548611 31560 raft_consensus.cc:359] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.549499 31560 raft_consensus.cc:385] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.549782 31560 raft_consensus.cc:740] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.550488 31560 consensus_queue.cc:260] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.550854 31362 raft_consensus.cc:2468] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:18.562444 31558 raft_consensus.cc:359] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.563251 31558 raft_consensus.cc:385] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.563537 31558 raft_consensus.cc:740] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
W20260709 12:14:18.569113 32027 log.cc:927] Time spent T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: Append to log took a long time: real 0.056s	user 0.000s	sys 0.003s
W20260709 12:14:18.569459 31328 leader_election.cc:343] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.570575 31475 leader_election.cc:304] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:18.571692 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27155e412e29424db98323b0a5e9d620" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:18.571911 31846 raft_consensus.cc:2804] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:18.571960 31976 consensus_queue.cc:1048] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:18.572562 31846 raft_consensus.cc:697] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:18.573552 31846 consensus_queue.cc:237] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.577201 31358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27155e412e29424db98323b0a5e9d620" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:18.593288 31559 raft_consensus.cc:359] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.594053 31559 raft_consensus.cc:385] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.594296 31559 raft_consensus.cc:740] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.594887 31559 consensus_queue.cc:260] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.596290 31559 ts_tablet_manager.cc:1434] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.181s	user 0.004s	sys 0.001s
I20260709 12:14:18.564211 31558 consensus_queue.cc:260] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.605260 31558 ts_tablet_manager.cc:1434] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.000s
I20260709 12:14:18.576507 31286 raft_consensus.cc:2468] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
W20260709 12:14:18.608361 31475 consensus_peers.cc:597] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:18.611862 31559 tablet_bootstrap.cc:492] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
W20260709 12:14:18.627345 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 49386.2us
I20260709 12:14:18.611292 31358 raft_consensus.cc:2468] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
W20260709 12:14:18.632848 31477 leader_election.cc:343] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:18.635054 31477 consensus_peers.cc:597] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:18.637818 31558 tablet_bootstrap.cc:492] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:18.640709 31560 ts_tablet_manager.cc:1434] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.173s	user 0.011s	sys 0.006s
I20260709 12:14:18.644135 31438 raft_consensus.cc:3060] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.652263 31560 tablet_bootstrap.cc:492] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:18.659381 32035 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:18.660187 32035 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:18.680981 31557 tablet_bootstrap.cc:492] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:18.681722 31557 ts_tablet_manager.cc:1403] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.440s	user 0.014s	sys 0.022s
I20260709 12:14:18.685407 31330 leader_election.cc:304] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:18.686021 31890 raft_consensus.cc:515] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.685288 31557 raft_consensus.cc:359] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.687489 31557 raft_consensus.cc:385] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.687865 31557 raft_consensus.cc:740] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.643000 31851 consensus_queue.cc:1048] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 12:14:18.693385 31557 consensus_queue.cc:260] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.647153 31956 raft_consensus.cc:515] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.671257 32035 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:18.645216 32018 raft_consensus.cc:515] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.721390 31557 ts_tablet_manager.cc:1434] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:14:18.695560 32032 raft_consensus.cc:2804] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:14:18.746444 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:18.696842 32017 raft_consensus.cc:515] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:18.743642 32032 raft_consensus.cc:697] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:18.751230 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:18.775983 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:18.776542 31902 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.777208 31902 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:18.780170 31558 tablet_bootstrap.cc:654] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.781431 31902 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:18.782294 31280 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 3.
I20260709 12:14:18.784262 31559 tablet_bootstrap.cc:654] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.786158 31557 tablet_bootstrap.cc:492] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:18.787586 31431 raft_consensus.cc:2393] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 3: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:18.798019 32032 consensus_queue.cc:237] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.799980 32017 leader_election.cc:290] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:18.801963 31956 leader_election.cc:290] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:18.803598 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:18.804502 31512 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:18.792524 32018 leader_election.cc:290] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:18.808825 31560 tablet_bootstrap.cc:654] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.818228 31478 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:18.820050 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:18.820214 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82bc50bbf494273a5cf986a398a5e4f" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
W20260709 12:14:18.831627 31402 leader_election.cc:343] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.832583 32038 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:18.863507 32038 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:18.879105 32038 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.890516 31185 catalog_manager.cc:5697] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:18.849072 31253 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:18.839013 32026 raft_consensus.cc:493] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a209a5d7b61542d885ef601e8bcaa26c)
I20260709 12:14:18.907043 31567 raft_consensus.cc:493] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.907819 31567 raft_consensus.cc:515] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.903770 31985 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:18.902288 31253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 61915.5us
I20260709 12:14:18.924511 31567 leader_election.cc:290] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:18.926543 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e23c1349714ee8b522e1b92accebc2" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
W20260709 12:14:18.928882 31254 leader_election.cc:343] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.923616 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:18.932761 31437 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 3.
I20260709 12:14:18.935211 31557 tablet_bootstrap.cc:654] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.941310 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:18.942258 31431 raft_consensus.cc:2393] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56add4c904c74a1bba90579b9204e45d in current term 1: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:18.943614 32018 raft_consensus.cc:493] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.944229 32018 raft_consensus.cc:515] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:18.946422 32018 leader_election.cc:290] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:18.906860 32026 raft_consensus.cc:515] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:18.948086 32030 raft_consensus.cc:493] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.948886 32030 raft_consensus.cc:515] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:18.950246 31890 leader_election.cc:290] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:18.952459 32030 leader_election.cc:290] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:18.954799 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e23c1349714ee8b522e1b92accebc2" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:18.955222 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbd74b64bc44ffea43757f3bdbfe1c3" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:18.955551 31357 raft_consensus.cc:3060] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:18.956065 31286 raft_consensus.cc:2393] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 1: Already voted for candidate 56add4c904c74a1bba90579b9204e45d in this term.
I20260709 12:14:18.970353 31559 tablet_bootstrap.cc:492] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:18.971040 31559 ts_tablet_manager.cc:1403] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.360s	user 0.010s	sys 0.006s
I20260709 12:14:18.921617 31985 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.975548 31985 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:18.979509 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb12da9e1bf4477cb726be970f4406e7" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:18.981364 31253 leader_election.cc:343] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:18.987627 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab02fdbdd944bfab62c752b0636f82c" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:18.989252 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:18.990298 31363 raft_consensus.cc:2393] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 1: Already voted for candidate 56add4c904c74a1bba90579b9204e45d in this term.
I20260709 12:14:18.996197 32026 leader_election.cc:290] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:18.998561 32038 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.010636 31475 leader_election.cc:304] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:19.051004 31567 raft_consensus.cc:2804] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:19.051461 31567 raft_consensus.cc:493] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.051831 31567 raft_consensus.cc:3060] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:19.014855 31401 leader_election.cc:304] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:19.055451 32044 raft_consensus.cc:2749] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:19.015419 31435 raft_consensus.cc:3060] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:18.940764 31329 leader_election.cc:343] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:19.061933 31329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 121226us
I20260709 12:14:19.062637 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb12da9e1bf4477cb726be970f4406e7" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:19.065415 31985 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.066298 31567 raft_consensus.cc:515] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:19.069731 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:19.022428 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:19.023461 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82bc50bbf494273a5cf986a398a5e4f" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:19.070968 31567 leader_election.cc:290] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:19.071382 31511 raft_consensus.cc:3060] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:19.071861 31252 leader_election.cc:343] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:19.072316 31252 leader_election.cc:304] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:19.073060 31902 raft_consensus.cc:2749] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:19.023804 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:19.021677 31186 catalog_manager.cc:5697] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:19.038467 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab02fdbdd944bfab62c752b0636f82c" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:19.040046 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:19.047286 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbd74b64bc44ffea43757f3bdbfe1c3" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:19.020144 31559 raft_consensus.cc:359] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.081036 31559 raft_consensus.cc:385] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.081580 31559 raft_consensus.cc:740] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.082719 31559 consensus_queue.cc:260] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.084272 31404 leader_election.cc:304] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:19.089262 31902 raft_consensus.cc:493] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.089903 31902 raft_consensus.cc:515] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.083125 31511 raft_consensus.cc:2468] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:19.067946 31985 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 4 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:19.092161 31902 leader_election.cc:290] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:19.099673 31402 leader_election.cc:304] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:19.100078 31508 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:19.101357 32038 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:19.102231 32026 raft_consensus.cc:2749] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.102475 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:19.103428 31286 raft_consensus.cc:2368] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c for earlier term 3. Current term is 4.
I20260709 12:14:19.099673 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27155e412e29424db98323b0a5e9d620" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:19.104882 31478 leader_election.cc:400] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 election: Vote denied by peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623) with higher term. Message: Invalid argument: T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c for earlier term 3. Current term is 4.
I20260709 12:14:19.105294 31478 leader_election.cc:403] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:14:19.106958 31557 tablet_bootstrap.cc:492] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:19.107512 31557 ts_tablet_manager.cc:1403] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.322s	user 0.021s	sys 0.023s
I20260709 12:14:19.109480 31508 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 4.
I20260709 12:14:19.108600 31475 leader_election.cc:304] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:19.110169 32040 raft_consensus.cc:2749] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623) with higher term. Message: Invalid argument: T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c for earlier term 3. Current term is 4.
I20260709 12:14:19.117585 31508 raft_consensus.cc:3060] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:19.119809 31253 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:19.121002 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:19.121692 31438 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:19.122565 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ead5d3f281f4adb8e218fc8979158f2" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:19.123270 31512 raft_consensus.cc:2468] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 0.
I20260709 12:14:19.112241 31559 ts_tablet_manager.cc:1434] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.141s	user 0.009s	sys 0.001s
I20260709 12:14:19.124428 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
W20260709 12:14:19.107671 31328 leader_election.cc:343] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:19.125188 31328 leader_election.cc:304] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:19.126552 31328 leader_election.cc:304] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:19.123348 32055 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:19.127452 32055 raft_consensus.cc:697] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:19.128611 32040 raft_consensus.cc:2749] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:19.128398 32055 consensus_queue.cc:237] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:19.130419 31477 leader_election.cc:343] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:19.131760 31477 consensus_peers.cc:597] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.132048 32032 raft_consensus.cc:2749] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:19.132923 32032 raft_consensus.cc:2804] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:19.133651 31438 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 4.
I20260709 12:14:19.133836 32032 raft_consensus.cc:697] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:19.134749 32032 consensus_queue.cc:237] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:19.124714 31559 tablet_bootstrap.cc:492] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:19.152110 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27155e412e29424db98323b0a5e9d620" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:19.152812 31360 raft_consensus.cc:3060] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:19.153312 31560 tablet_bootstrap.cc:492] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:19.153946 31560 ts_tablet_manager.cc:1403] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.502s	user 0.022s	sys 0.022s
I20260709 12:14:19.161566 31558 tablet_bootstrap.cc:492] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:19.162209 31558 ts_tablet_manager.cc:1403] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.525s	user 0.010s	sys 0.010s
I20260709 12:14:19.163690 31360 raft_consensus.cc:2468] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:19.164424 31560 raft_consensus.cc:359] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.165083 31558 raft_consensus.cc:359] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:19.048748 31357 raft_consensus.cc:2468] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 1.
I20260709 12:14:19.166811 31558 raft_consensus.cc:385] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.167258 31558 raft_consensus.cc:740] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.167920 31558 consensus_queue.cc:260] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:19.170354 31558 ts_tablet_manager.cc:1434] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:14:19.171097 32044 raft_consensus.cc:2749] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:19.171401 31558 tablet_bootstrap.cc:492] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:19.165428 31560 raft_consensus.cc:385] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.164901 31557 raft_consensus.cc:359] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.174700 31557 raft_consensus.cc:385] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.174996 31557 raft_consensus.cc:740] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.175603 31557 consensus_queue.cc:260] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.177433 31557 ts_tablet_manager.cc:1434] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.001s
I20260709 12:14:19.178005 31560 raft_consensus.cc:740] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.244861 31253 leader_election.cc:304] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
W20260709 12:14:19.256970 31328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 97859.2us
I20260709 12:14:19.265920 31252 leader_election.cc:304] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:19.282919 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ead5d3f281f4adb8e218fc8979158f2" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:19.290604 31557 tablet_bootstrap.cc:492] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:19.287919 31475 leader_election.cc:304] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:19.342585 31558 tablet_bootstrap.cc:654] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:19.178975 31560 consensus_queue.cc:260] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.347779 31559 tablet_bootstrap.cc:654] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:19.379243 32018 raft_consensus.cc:2804] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:19.379992 32018 raft_consensus.cc:493] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.380379 32018 raft_consensus.cc:3060] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:19.383273 32055 raft_consensus.cc:2804] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:19.384032 32055 raft_consensus.cc:697] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:19.403280 32047 consensus_queue.cc:1048] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:19.407157 32035 raft_consensus.cc:2804] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:19.407912 32035 raft_consensus.cc:697] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:19.409440 32035 consensus_queue.cc:237] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:19.425364 32055 consensus_queue.cc:237] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
W20260709 12:14:19.429313 31946 log.cc:927] Time spent T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 12:14:19.430177 31435 raft_consensus.cc:2468] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 0.
I20260709 12:14:19.434274 31560 ts_tablet_manager.cc:1434] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.280s	user 0.012s	sys 0.004s
I20260709 12:14:19.436345 31560 tablet_bootstrap.cc:492] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
W20260709 12:14:19.459568 31328 consensus_peers.cc:597] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d -> Peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Couldn't send request to peer a209a5d7b61542d885ef601e8bcaa26c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.465844 31557 tablet_bootstrap.cc:654] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:19.503551 31475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 152066us
I20260709 12:14:19.341790 31890 consensus_queue.cc:1048] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.155s
I20260709 12:14:19.518460 31184 catalog_manager.cc:5697] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:19.530146 31254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 229209us
I20260709 12:14:19.561013 31184 catalog_manager.cc:5697] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:19.575040 32018 raft_consensus.cc:515] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.576704 31559 tablet_bootstrap.cc:492] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
W20260709 12:14:19.586947 31254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 49588us
I20260709 12:14:19.593509 32018 leader_election.cc:290] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:19.595182 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ead5d3f281f4adb8e218fc8979158f2" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
W20260709 12:14:19.596203 31252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 330910us
I20260709 12:14:19.596251 31511 raft_consensus.cc:3060] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:19.577636 31559 ts_tablet_manager.cc:1403] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.453s	user 0.019s	sys 0.017s
W20260709 12:14:19.608410 31329 consensus_peers.cc:597] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.611544 31187 catalog_manager.cc:5697] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:19.621942 31558 tablet_bootstrap.cc:492] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:19.639386 32017 raft_consensus.cc:493] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.640118 32017 raft_consensus.cc:515] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:19.641657 31558 ts_tablet_manager.cc:1403] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.470s	user 0.013s	sys 0.016s
I20260709 12:14:19.651806 31560 tablet_bootstrap.cc:654] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:19.660962 31558 raft_consensus.cc:359] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:19.676947 32024 consensus_queue.cc:1048] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:14:19.673925 31558 raft_consensus.cc:385] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.682263 31558 raft_consensus.cc:740] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.694094 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5010c0b5047248748914c1dc813009c8" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:19.696081 31329 leader_election.cc:343] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:19.699259 32017 leader_election.cc:290] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:19.715644 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ead5d3f281f4adb8e218fc8979158f2" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:19.716579 31431 raft_consensus.cc:3060] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:19.718926 32017 consensus_queue.cc:1048] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:19.689073 31511 raft_consensus.cc:2468] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 1.
W20260709 12:14:19.742460 32072 log.cc:927] Time spent T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:14:19.744804 31253 leader_election.cc:304] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:19.746162 32018 raft_consensus.cc:2804] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:19.746774 32018 raft_consensus.cc:697] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:19.747787 32018 consensus_queue.cc:237] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.748385 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5010c0b5047248748914c1dc813009c8" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:19.750753 32017 consensus_queue.cc:1048] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:19.761101 31558 consensus_queue.cc:260] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:19.769999 31328 leader_election.cc:343] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:19.770601 31328 leader_election.cc:304] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:19.756543 31559 raft_consensus.cc:359] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:19.785966 31559 raft_consensus.cc:385] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.786387 31559 raft_consensus.cc:740] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.778823 32024 raft_consensus.cc:2749] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:19.784103 31431 raft_consensus.cc:2468] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 1.
I20260709 12:14:19.800021 31558 ts_tablet_manager.cc:1434] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.158s	user 0.004s	sys 0.006s
I20260709 12:14:19.806921 31558 tablet_bootstrap.cc:492] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:19.809213 31559 consensus_queue.cc:260] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:19.811363 31559 ts_tablet_manager.cc:1434] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.193s	user 0.008s	sys 0.000s
I20260709 12:14:19.802747 31985 raft_consensus.cc:493] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.817292 31559 tablet_bootstrap.cc:492] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:19.823901 31557 tablet_bootstrap.cc:492] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185: No bootstrap required, opened a new log
I20260709 12:14:19.824481 31557 ts_tablet_manager.cc:1403] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.535s	user 0.026s	sys 0.019s
I20260709 12:14:19.827864 31557 raft_consensus.cc:359] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.828405 31557 raft_consensus.cc:385] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.828644 31557 raft_consensus.cc:740] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.829958 31557 consensus_queue.cc:260] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:19.835911 31985 raft_consensus.cc:515] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:19.838353 31985 leader_election.cc:290] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:19.843273 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:19.851444 31438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:19.853469 31252 leader_election.cc:343] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:19.855494 31254 leader_election.cc:343] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:19.855914 31254 leader_election.cc:304] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:19.877508 31557 ts_tablet_manager.cc:1434] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:14:19.864331 32018 raft_consensus.cc:2749] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:19.887542 31560 tablet_bootstrap.cc:492] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:19.892992 31560 ts_tablet_manager.cc:1403] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.457s	user 0.015s	sys 0.005s
I20260709 12:14:19.938681 31558 tablet_bootstrap.cc:654] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:19.941656 31985 raft_consensus.cc:493] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.951628 31851 raft_consensus.cc:493] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:19.985731 31254 consensus_peers.cc:597] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.006589 32043 raft_consensus.cc:493] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.007336 32043 raft_consensus.cc:515] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:19.975919 31851 raft_consensus.cc:515] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:19.981290 31985 raft_consensus.cc:515] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:20.035174 31560 raft_consensus.cc:359] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:20.035687 31851 leader_election.cc:290] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:20.036051 31560 raft_consensus.cc:385] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.036106 31905 raft_consensus.cc:493] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.036399 31560 raft_consensus.cc:740] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.042274 31905 raft_consensus.cc:515] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:20.044154 31437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050680dae66642369827ee0318291dac" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:20.037317 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b21175df55ee43caab9a53db893f84a5" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:20.037182 32043 leader_election.cc:290] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:20.042881 31985 leader_election.cc:290] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
W20260709 12:14:20.048337 31254 leader_election.cc:343] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.053223 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050680dae66642369827ee0318291dac" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:20.057476 31560 consensus_queue.cc:260] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:20.060010 31253 leader_election.cc:343] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.069182 31253 leader_election.cc:304] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:20.070123 31985 raft_consensus.cc:2749] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.070817 31560 ts_tablet_manager.cc:1434] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.177s	user 0.004s	sys 0.004s
I20260709 12:14:20.071905 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49cdc6c4a86a4b57b1df61deb0767165" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:20.075309 31477 consensus_peers.cc:597] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.062122 31905 leader_election.cc:290] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:20.063526 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49cdc6c4a86a4b57b1df61deb0767165" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:20.079407 31253 leader_election.cc:343] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.042858 31559 tablet_bootstrap.cc:654] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:20.086557 31254 consensus_peers.cc:597] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:20.087302 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:20.088016 31361 raft_consensus.cc:3060] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.107698 31360 raft_consensus.cc:2393] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 1: Already voted for candidate 56add4c904c74a1bba90579b9204e45d in this term.
I20260709 12:14:20.117895 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b21175df55ee43caab9a53db893f84a5" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:20.122511 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:20.123509 31435 raft_consensus.cc:2393] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 1: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
W20260709 12:14:20.122511 31254 leader_election.cc:343] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.124806 31254 leader_election.cc:304] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185; no voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:20.125623 32055 raft_consensus.cc:2749] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.127879 31437 raft_consensus.cc:1275] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 4 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:20.128957 31905 consensus_queue.cc:1048] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:20.140661 31328 leader_election.cc:304] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:20.150887 31905 consensus_queue.cc:1048] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:14:20.155689 32038 consensus_queue.cc:1048] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:20.156145 31185 catalog_manager.cc:5697] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.170070 31512 raft_consensus.cc:1275] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:20.177421 31477 leader_election.cc:304] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:20.189962 31560 tablet_bootstrap.cc:492] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:20.191633 31558 tablet_bootstrap.cc:492] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:20.192231 31558 ts_tablet_manager.cc:1403] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.386s	user 0.016s	sys 0.010s
I20260709 12:14:20.204823 32069 consensus_queue.cc:1048] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:14:20.198035 32041 raft_consensus.cc:3060] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.210546 31186 catalog_manager.cc:5697] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.215307 31186 catalog_manager.cc:5697] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:20.238785 31404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 55817.7us
W20260709 12:14:20.241971 31402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 44680.1us
I20260709 12:14:20.243793 32089 raft_consensus.cc:2749] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:20.248560 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:20.250810 32020 raft_consensus.cc:493] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.251438 32020 raft_consensus.cc:515] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:20.252130 32041 raft_consensus.cc:2749] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.293648 32069 consensus_queue.cc:1048] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:20.295456 32020 leader_election.cc:290] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:20.295499 31558 raft_consensus.cc:359] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:20.298216 31558 raft_consensus.cc:385] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.300240 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:20.301858 31558 raft_consensus.cc:740] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.313712 31558 consensus_queue.cc:260] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:20.318719 31558 ts_tablet_manager.cc:1434] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.126s	user 0.005s	sys 0.003s
I20260709 12:14:20.319785 31558 tablet_bootstrap.cc:492] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d: Bootstrap starting.
I20260709 12:14:20.356541 31559 tablet_bootstrap.cc:492] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:20.357592 31559 ts_tablet_manager.cc:1403] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.545s	user 0.017s	sys 0.012s
I20260709 12:14:20.388379 31559 raft_consensus.cc:359] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:20.389814 31559 raft_consensus.cc:385] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.390126 31559 raft_consensus.cc:740] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
W20260709 12:14:20.396411 31475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 88114.6us
I20260709 12:14:20.398483 31559 consensus_queue.cc:260] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:20.400628 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:20.408957 31402 leader_election.cc:304] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:20.410256 32045 raft_consensus.cc:2749] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.416245 31558 tablet_bootstrap.cc:654] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.418119 31435 raft_consensus.cc:3060] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.427888 32055 consensus_queue.cc:1048] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:20.448027 31253 consensus_peers.cc:597] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 -> Peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Couldn't send request to peer a209a5d7b61542d885ef601e8bcaa26c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:20.450512 31560 tablet_bootstrap.cc:654] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.471887 31558 tablet_bootstrap.cc:492] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d: No bootstrap required, opened a new log
I20260709 12:14:20.472502 31558 ts_tablet_manager.cc:1403] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d: Time spent bootstrapping tablet: real 0.153s	user 0.018s	sys 0.006s
I20260709 12:14:20.475695 31558 raft_consensus.cc:359] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:20.479466 31558 raft_consensus.cc:385] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.479864 31558 raft_consensus.cc:740] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.478374 31559 ts_tablet_manager.cc:1434] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.120s	user 0.010s	sys 0.003s
W20260709 12:14:20.497474 32108 log.cc:927] Time spent T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da: Append to log took a long time: real 0.075s	user 0.003s	sys 0.000s
I20260709 12:14:20.517432 31559 tablet_bootstrap.cc:492] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:20.528297 31558 consensus_queue.cc:260] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:20.536695 31560 tablet_bootstrap.cc:492] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:20.537514 31560 ts_tablet_manager.cc:1403] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.373s	user 0.019s	sys 0.000s
I20260709 12:14:20.540589 31560 raft_consensus.cc:359] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:20.541467 31560 raft_consensus.cc:385] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.542171 31560 raft_consensus.cc:740] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
W20260709 12:14:20.545828 31478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 66084.2us
I20260709 12:14:20.572613 31560 consensus_queue.cc:260] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:20.571139 31890 raft_consensus.cc:493] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.591156 31890 raft_consensus.cc:515] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:20.594244 31890 leader_election.cc:290] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:20.598951 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:20.599994 31558 ts_tablet_manager.cc:1434] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d: Time spent starting tablet: real 0.127s	user 0.009s	sys 0.000s
W20260709 12:14:20.608667 31329 leader_election.cc:343] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:20.612257 31478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 43784.4us
W20260709 12:14:20.611057 31475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 60277.6us
I20260709 12:14:20.617763 32089 raft_consensus.cc:493] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.625538 32089 raft_consensus.cc:515] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:20.642611 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb12da9e1bf4477cb726be970f4406e7" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
W20260709 12:14:20.645011 31328 leader_election.cc:343] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.645856 32043 raft_consensus.cc:493] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.646436 32043 raft_consensus.cc:515] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:20.649519 32043 leader_election.cc:290] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:20.656508 31431 raft_consensus.cc:3060] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.646124 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:20.671048 31288 raft_consensus.cc:2468] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:20.673754 31330 leader_election.cc:304] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:20.675433 32017 raft_consensus.cc:2804] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:20.676102 32017 raft_consensus.cc:493] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.676343 31559 tablet_bootstrap.cc:654] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.676740 31560 ts_tablet_manager.cc:1434] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.132s	user 0.013s	sys 0.003s
I20260709 12:14:20.676673 32017 raft_consensus.cc:3060] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.684252 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30451bcaa4ca44f992ef5f47be40eda9" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:20.691843 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb12da9e1bf4477cb726be970f4406e7" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:20.698711 31288 raft_consensus.cc:2468] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 0.
I20260709 12:14:20.699141 31560 tablet_bootstrap.cc:492] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:20.700241 31509 raft_consensus.cc:3060] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.701733 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30451bcaa4ca44f992ef5f47be40eda9" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:20.704277 31330 leader_election.cc:304] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:20.731992 31560 tablet_bootstrap.cc:654] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.696489 32089 leader_election.cc:290] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:20.718786 32088 raft_consensus.cc:2804] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:20.748517 32088 raft_consensus.cc:493] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.749099 32088 raft_consensus.cc:3060] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:20.786028 31478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 62804.6us
I20260709 12:14:20.825583 31478 leader_election.cc:304] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:20.799616 32017 raft_consensus.cc:515] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:20.827889 31559 tablet_bootstrap.cc:492] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:20.828567 31559 ts_tablet_manager.cc:1403] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.311s	user 0.011s	sys 0.008s
I20260709 12:14:20.849822 32043 raft_consensus.cc:2749] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.863220 32017 leader_election.cc:290] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:20.865686 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:20.866755 31559 raft_consensus.cc:359] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:20.867152 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:20.867632 31559 raft_consensus.cc:385] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.867980 31280 raft_consensus.cc:3060] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.864892 31560 tablet_bootstrap.cc:492] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
W20260709 12:14:20.879014 31329 leader_election.cc:343] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.881253 32088 raft_consensus.cc:515] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:20.889036 31560 ts_tablet_manager.cc:1403] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.190s	user 0.036s	sys 0.027s
I20260709 12:14:20.868048 31559 raft_consensus.cc:740] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.890689 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb12da9e1bf4477cb726be970f4406e7" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:20.891474 31287 raft_consensus.cc:3060] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.892163 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb12da9e1bf4477cb726be970f4406e7" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:20.894991 31559 consensus_queue.cc:260] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:20.896174 31511 raft_consensus.cc:3060] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.894130 32088 leader_election.cc:290] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:20.899660 32020 raft_consensus.cc:493] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.907799 32020 raft_consensus.cc:515] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:20.910687 32020 leader_election.cc:290] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:20.911458 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:20.912127 31360 raft_consensus.cc:2468] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:20.912346 31559 ts_tablet_manager.cc:1434] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.004s
I20260709 12:14:20.913462 31401 leader_election.cc:304] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:20.914606 32020 raft_consensus.cc:2804] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:20.915019 32020 raft_consensus.cc:493] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.915491 32020 raft_consensus.cc:3060] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:20.923481 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:20.924350 31509 raft_consensus.cc:2468] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:20.934068 31511 raft_consensus.cc:2468] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:20.935724 31560 raft_consensus.cc:359] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:20.941146 31328 leader_election.cc:304] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:20.948388 32017 raft_consensus.cc:2804] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:20.955595 32017 raft_consensus.cc:697] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:20.956171 31560 raft_consensus.cc:385] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.956570 31560 raft_consensus.cc:740] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.956753 32017 consensus_queue.cc:237] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:20.941486 31287 raft_consensus.cc:2468] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:20.943169 31280 raft_consensus.cc:2468] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:20.974680 31330 leader_election.cc:304] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:20.977138 31915 raft_consensus.cc:2804] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:20.977733 31915 raft_consensus.cc:697] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:20.978717 31915 consensus_queue.cc:237] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:20.978020 31560 consensus_queue.cc:260] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:20.984318 31560 ts_tablet_manager.cc:1434] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.000s
I20260709 12:14:20.985594 31560 tablet_bootstrap.cc:492] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:21.001180 31559 tablet_bootstrap.cc:492] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:20.955309 32020 raft_consensus.cc:515] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.008262 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:21.009475 31357 raft_consensus.cc:3060] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:21.012992 32045 raft_consensus.cc:493] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.013857 32045 raft_consensus.cc:515] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.018829 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82bc50bbf494273a5cf986a398a5e4f" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:21.024888 32020 leader_election.cc:290] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:21.028605 31560 tablet_bootstrap.cc:654] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.036962 31559 tablet_bootstrap.cc:654] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.044797 31560 tablet_bootstrap.cc:492] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:21.045342 31560 ts_tablet_manager.cc:1403] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.000s
I20260709 12:14:21.048139 31184 catalog_manager.cc:5697] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:21.057869 31560 raft_consensus.cc:359] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.058723 31560 raft_consensus.cc:385] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.058996 31560 raft_consensus.cc:740] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.060218 32045 leader_election.cc:290] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:21.060750 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c82bc50bbf494273a5cf986a398a5e4f" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:21.061226 31560 consensus_queue.cc:260] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.063257 31402 leader_election.cc:304] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:21.064215 32020 raft_consensus.cc:2749] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:21.066605 31560 ts_tablet_manager.cc:1434] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:14:21.067514 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f955719b6b1451eaf77381e2047ffff" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:21.068285 31511 raft_consensus.cc:3060] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:21.069449 31559 tablet_bootstrap.cc:492] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:21.070047 31559 ts_tablet_manager.cc:1403] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.005s
I20260709 12:14:21.088176 31559 raft_consensus.cc:359] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.088994 31559 raft_consensus.cc:385] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.089275 31559 raft_consensus.cc:740] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.091392 31559 consensus_queue.cc:260] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.096127 31511 raft_consensus.cc:2468] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 2.
I20260709 12:14:21.101121 31402 leader_election.cc:304] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:21.104441 32045 raft_consensus.cc:2804] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:21.116983 31559 ts_tablet_manager.cc:1434] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.003s
I20260709 12:14:21.118405 31559 tablet_bootstrap.cc:492] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:21.109696 32045 raft_consensus.cc:697] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:21.120608 32045 consensus_queue.cc:237] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.123944 32020 raft_consensus.cc:493] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.124575 32020 raft_consensus.cc:515] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.129583 31559 tablet_bootstrap.cc:654] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.130677 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521fc30d365d455da547428401e26181" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:21.137097 31560 tablet_bootstrap.cc:492] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:21.138028 32020 leader_election.cc:290] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:21.140558 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521fc30d365d455da547428401e26181" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:21.142840 31402 leader_election.cc:304] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:21.147709 32095 raft_consensus.cc:2749] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:21.160496 31560 tablet_bootstrap.cc:654] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.183166 31559 tablet_bootstrap.cc:492] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:21.184010 31559 ts_tablet_manager.cc:1403] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.005s
I20260709 12:14:21.186123 31357 raft_consensus.cc:2468] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 2.
I20260709 12:14:21.190181 31187 catalog_manager.cc:5697] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 0 to 2, leader changed from <none> to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 2 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.199486 31559 raft_consensus.cc:359] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:21.200253 31559 raft_consensus.cc:385] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.200525 31559 raft_consensus.cc:740] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.201572 31559 consensus_queue.cc:260] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:21.206935 31559 ts_tablet_manager.cc:1434] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:14:21.211552 31184 catalog_manager.cc:5697] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 1 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.222683 31559 tablet_bootstrap.cc:492] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:21.232811 31436 raft_consensus.cc:3060] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.246080 31559 tablet_bootstrap.cc:654] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.257822 31560 tablet_bootstrap.cc:492] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:21.265688 31560 ts_tablet_manager.cc:1403] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.138s	user 0.022s	sys 0.007s
I20260709 12:14:21.271529 31560 raft_consensus.cc:359] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.272342 31560 raft_consensus.cc:385] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.276005 31559 tablet_bootstrap.cc:492] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:21.276846 31559 ts_tablet_manager.cc:1403] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.006s
I20260709 12:14:21.272663 31560 raft_consensus.cc:740] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.281926 31560 consensus_queue.cc:260] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.288671 31559 raft_consensus.cc:359] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:21.289670 31559 raft_consensus.cc:385] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.290117 31559 raft_consensus.cc:740] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.290987 31559 consensus_queue.cc:260] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:21.293776 31559 ts_tablet_manager.cc:1434] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.005s
I20260709 12:14:21.295078 31560 ts_tablet_manager.cc:1434] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 12:14:21.295130 31559 tablet_bootstrap.cc:492] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c: Bootstrap starting.
I20260709 12:14:21.302968 31559 tablet_bootstrap.cc:654] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.296476 31560 tablet_bootstrap.cc:492] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:21.314883 31559 tablet_bootstrap.cc:492] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c: No bootstrap required, opened a new log
I20260709 12:14:21.315524 31559 ts_tablet_manager.cc:1403] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:14:21.318811 31559 raft_consensus.cc:359] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:21.321707 31559 raft_consensus.cc:385] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.323127 31559 raft_consensus.cc:740] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.324082 31559 consensus_queue.cc:260] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:21.326531 31559 ts_tablet_manager.cc:1434] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:14:21.336297 31560 tablet_bootstrap.cc:654] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.350656 31431 raft_consensus.cc:3060] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.386616 32089 consensus_queue.cc:1048] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.412726 31505 raft_consensus.cc:3060] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.490206 32017 consensus_queue.cc:1048] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.496363 32041 raft_consensus.cc:493] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.497233 32041 raft_consensus.cc:515] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.500375 32041 leader_election.cc:290] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:21.502637 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5010c0b5047248748914c1dc813009c8" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:21.503598 31360 raft_consensus.cc:2468] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:21.504842 31475 leader_election.cc:304] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:21.508641 32041 raft_consensus.cc:2804] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:21.509138 32041 raft_consensus.cc:493] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.509523 32041 raft_consensus.cc:3060] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.529035 32089 consensus_queue.cc:1048] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.583101 32134 raft_consensus.cc:493] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.596761 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5010c0b5047248748914c1dc813009c8" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:21.584048 32134 raft_consensus.cc:515] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.602581 32134 leader_election.cc:290] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
W20260709 12:14:21.722841 31329 consensus_peers.cc:597] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:21.730759 31361 raft_consensus.cc:1275] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer d5caa720fddf4dd3958f076ff03df8da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:21.732564 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27155e412e29424db98323b0a5e9d620" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:21.744038 32043 raft_consensus.cc:493] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.778152 32043 raft_consensus.cc:515] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:21.774402 32041 raft_consensus.cc:515] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:21.782366 32043 leader_election.cc:290] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:21.788864 31436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.054s	sys 0.147s
W20260709 12:14:21.789367 31436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.054s	sys 0.147s
I20260709 12:14:21.789414 32041 leader_election.cc:290] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
W20260709 12:14:21.753010 32141 log.cc:927] Time spent T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:14:21.758383 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27155e412e29424db98323b0a5e9d620" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:21.760672 31506 raft_consensus.cc:1275] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer d5caa720fddf4dd3958f076ff03df8da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:14:21.799285 31329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 76627.3us
W20260709 12:14:21.833539 32148 log.cc:927] Time spent T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da: Append to log took a long time: real 0.108s	user 0.000s	sys 0.005s
W20260709 12:14:21.840574 31478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 275756us
I20260709 12:14:21.853698 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050680dae66642369827ee0318291dac" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:21.854470 31284 raft_consensus.cc:2468] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:21.856556 32095 consensus_queue.cc:1048] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:21.864861 31477 leader_election.cc:343] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:21.865706 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 103614us
I20260709 12:14:21.895079 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5010c0b5047248748914c1dc813009c8" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:21.904090 31360 raft_consensus.cc:3060] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.914192 31560 tablet_bootstrap.cc:492] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:21.934353 32154 raft_consensus.cc:493] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:21.949200 31475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 90577.3us
I20260709 12:14:21.989965 31560 ts_tablet_manager.cc:1403] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.694s	user 0.104s	sys 0.121s
I20260709 12:14:21.990326 32154 raft_consensus.cc:515] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:21.950517 31402 leader_election.cc:304] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:21.994515 32095 raft_consensus.cc:2749] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:21.996658 31402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 46247.3us
I20260709 12:14:21.952756 31478 leader_election.cc:304] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:21.997828 32146 raft_consensus.cc:2804] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:21.998231 32146 raft_consensus.cc:493] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.998567 32146 raft_consensus.cc:3060] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:22.004328 31478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 51656.7us
I20260709 12:14:22.015331 32095 consensus_queue.cc:1048] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:22.018850 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050680dae66642369827ee0318291dac" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:22.019693 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5010c0b5047248748914c1dc813009c8" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:22.040293 31560 raft_consensus.cc:359] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:22.047760 31560 raft_consensus.cc:385] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.051776 31560 raft_consensus.cc:740] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.065929 31560 consensus_queue.cc:260] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:22.073436 31360 raft_consensus.cc:2468] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:22.084566 31475 leader_election.cc:304] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:22.085903 32043 raft_consensus.cc:2804] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.086493 32043 raft_consensus.cc:697] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:22.087406 32043 consensus_queue.cc:237] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:22.076371 32154 leader_election.cc:290] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:22.095329 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 113204us
I20260709 12:14:22.075975 31560 ts_tablet_manager.cc:1434] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.085s	user 0.004s	sys 0.004s
I20260709 12:14:22.098194 31560 tablet_bootstrap.cc:492] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
W20260709 12:14:22.106117 31477 leader_election.cc:343] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:22.107465 31477 leader_election.cc:343] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.113474 31560 tablet_bootstrap.cc:654] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.036226 32146 raft_consensus.cc:515] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:22.127784 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49cdc6c4a86a4b57b1df61deb0767165" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:22.128961 31284 raft_consensus.cc:2468] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:22.135546 31560 tablet_bootstrap.cc:492] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:22.136081 31560 ts_tablet_manager.cc:1403] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 12:14:22.138152 31478 leader_election.cc:304] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:22.138955 31560 raft_consensus.cc:359] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:22.139276 32154 raft_consensus.cc:2804] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.139715 31560 raft_consensus.cc:385] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.139794 32154 raft_consensus.cc:493] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.140067 31560 raft_consensus.cc:740] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.140215 32154 raft_consensus.cc:3060] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.140921 31560 consensus_queue.cc:260] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:22.154524 31560 ts_tablet_manager.cc:1434] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:14:22.155566 31560 tablet_bootstrap.cc:492] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:22.161474 31560 tablet_bootstrap.cc:654] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.161669 32154 raft_consensus.cc:515] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:22.165973 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49cdc6c4a86a4b57b1df61deb0767165" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:22.166633 31284 raft_consensus.cc:3060] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.169927 32146 leader_election.cc:290] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:22.174327 31282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050680dae66642369827ee0318291dac" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
I20260709 12:14:22.175251 31282 raft_consensus.cc:3060] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:22.189733 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 82294.9us
I20260709 12:14:22.196902 32154 leader_election.cc:290] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:22.199508 31282 raft_consensus.cc:2468] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:22.201081 31478 leader_election.cc:304] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:22.202642 31284 raft_consensus.cc:2468] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:22.207264 31560 tablet_bootstrap.cc:492] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:22.208284 31560 ts_tablet_manager.cc:1403] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.014s
I20260709 12:14:22.211582 31560 raft_consensus.cc:359] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:22.212400 31560 raft_consensus.cc:385] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.212728 31560 raft_consensus.cc:740] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.213799 31560 consensus_queue.cc:260] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:22.215983 31560 ts_tablet_manager.cc:1434] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:14:22.217118 31560 tablet_bootstrap.cc:492] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:22.224032 31560 tablet_bootstrap.cc:654] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:22.249989 31478 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:45623, user_credentials={real_user=slave}} blocked reactor thread for 49031.2us
I20260709 12:14:22.250196 32043 raft_consensus.cc:2804] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.251021 32043 raft_consensus.cc:697] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:22.250926 31478 leader_election.cc:304] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:22.259289 32041 raft_consensus.cc:2804] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.260130 32041 raft_consensus.cc:697] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:22.252149 32043 consensus_queue.cc:237] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:22.261399 32041 consensus_queue.cc:237] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:22.299690 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 108995us
I20260709 12:14:22.312985 32095 raft_consensus.cc:493] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.313774 32095 raft_consensus.cc:515] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:22.316426 32095 leader_election.cc:290] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:22.320183 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49cdc6c4a86a4b57b1df61deb0767165" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:22.321362 31280 raft_consensus.cc:2393] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 1: Already voted for candidate a209a5d7b61542d885ef601e8bcaa26c in this term.
I20260709 12:14:22.332787 31436 raft_consensus.cc:3060] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.334249 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49cdc6c4a86a4b57b1df61deb0767165" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:22.335212 31431 raft_consensus.cc:2468] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 0.
I20260709 12:14:22.363603 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49cdc6c4a86a4b57b1df61deb0767165" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:22.364233 31431 raft_consensus.cc:3060] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.369710 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050680dae66642369827ee0318291dac" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:22.383819 32095 raft_consensus.cc:493] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.384442 32095 raft_consensus.cc:515] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:22.386922 32095 leader_election.cc:290] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:22.388304 31560 tablet_bootstrap.cc:492] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:22.388939 31560 ts_tablet_manager.cc:1403] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.172s	user 0.025s	sys 0.061s
I20260709 12:14:22.391453 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5010c0b5047248748914c1dc813009c8" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:22.392319 31357 raft_consensus.cc:2393] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 1: Already voted for candidate a209a5d7b61542d885ef601e8bcaa26c in this term.
I20260709 12:14:22.391788 31560 raft_consensus.cc:359] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:22.394830 31560 raft_consensus.cc:385] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.395114 31560 raft_consensus.cc:740] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.395938 31560 consensus_queue.cc:260] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:22.399312 31235 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:22.406277 31560 ts_tablet_manager.cc:1434] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:14:22.410630 31560 tablet_bootstrap.cc:492] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da: Bootstrap starting.
I20260709 12:14:22.403774 31431 raft_consensus.cc:2468] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:22.414103 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5010c0b5047248748914c1dc813009c8" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:22.415834 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49cdc6c4a86a4b57b1df61deb0767165" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:22.416543 31560 tablet_bootstrap.cc:654] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.455936 31402 leader_election.cc:304] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:22.448694 31184 catalog_manager.cc:5697] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.459633 31184 catalog_manager.cc:5697] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.462741 32134 raft_consensus.cc:3060] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.464766 31402 leader_election.cc:304] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:22.467358 32095 raft_consensus.cc:2749] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:22.471326 32095 raft_consensus.cc:493] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.471835 32095 raft_consensus.cc:515] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:22.477489 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e23c1349714ee8b522e1b92accebc2" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:22.480388 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e23c1349714ee8b522e1b92accebc2" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:22.479417 31184 catalog_manager.cc:5697] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 0 to 1, leader changed from <none> to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 1 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:22.482216 31401 leader_election.cc:304] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:22.482672 32095 leader_election.cc:290] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:22.488662 31560 tablet_bootstrap.cc:492] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da: No bootstrap required, opened a new log
I20260709 12:14:22.488487 32020 raft_consensus.cc:2749] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:22.489637 31560 ts_tablet_manager.cc:1403] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.018s
I20260709 12:14:22.484203 32134 raft_consensus.cc:2749] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:22.494802 31560 raft_consensus.cc:359] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:22.495590 31560 raft_consensus.cc:385] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.495896 31560 raft_consensus.cc:740] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.496630 31560 consensus_queue.cc:260] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:22.499492 31560 ts_tablet_manager.cc:1434] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:22.502795 31431 raft_consensus.cc:3060] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:22.533167 31477 leader_election.cc:343] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.566717 32043 consensus_queue.cc:1048] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:22.604079 32043 consensus_queue.cc:1048] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:22.646677 32134 raft_consensus.cc:493] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.647209 32134 raft_consensus.cc:515] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:22.651588 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050680dae66642369827ee0318291dac" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:22.653105 31280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050680dae66642369827ee0318291dac" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:22.654089 31280 raft_consensus.cc:2393] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 1: Already voted for candidate a209a5d7b61542d885ef601e8bcaa26c in this term.
I20260709 12:14:22.654882 32146 consensus_queue.cc:1048] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:22.658138 31404 leader_election.cc:304] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:22.659721 32020 raft_consensus.cc:3060] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.668041 32154 consensus_queue.cc:1048] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:22.676214 32134 leader_election.cc:290] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:22.693235 32043 consensus_queue.cc:1048] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:22.711024 32095 raft_consensus.cc:493] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.711544 32095 raft_consensus.cc:515] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:22.715207 31284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0769d57e6db04b2f86703e0ed60f6185" is_pre_election: true
I20260709 12:14:22.718043 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:22.720564 31404 leader_election.cc:304] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:22.723070 32045 raft_consensus.cc:2749] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:22.731807 32095 leader_election.cc:290] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:22.742488 32020 raft_consensus.cc:2749] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:22.750245 31436 raft_consensus.cc:3060] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.771996 32146 consensus_queue.cc:1048] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:23.923240 20891 tablet_server.cc:179] TabletServer@127.20.102.193:0 shutting down...
W20260709 12:14:23.939960 31478 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:23.952401 31478 consensus_peers.cc:597] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:23.957527 31478 consensus_peers.cc:597] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:23.958326 31478 consensus_peers.cc:597] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:23.984974 31478 consensus_peers.cc:597] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:23.989070 31330 consensus_peers.cc:597] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.005262 31330 consensus_peers.cc:597] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.006057 31330 consensus_peers.cc:597] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.006699 31330 consensus_peers.cc:597] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.009660 31330 consensus_peers.cc:597] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.021279 31330 consensus_peers.cc:597] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.036530 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:14:24.036448 31478 consensus_peers.cc:597] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.037972 20891 tablet_replica.cc:333] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.039219 20891 raft_consensus.cc:2243] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.039875 20891 raft_consensus.cc:2272] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.042770 20891 tablet_replica.cc:333] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.043660 20891 raft_consensus.cc:2243] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.044725 20891 raft_consensus.cc:2272] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.047608 20891 tablet_replica.cc:333] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.048435 20891 raft_consensus.cc:2243] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.049048 20891 raft_consensus.cc:2272] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.052445 20891 tablet_replica.cc:333] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.053555 20891 raft_consensus.cc:2243] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.054726 20891 raft_consensus.cc:2272] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.057883 20891 tablet_replica.cc:333] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.058874 20891 raft_consensus.cc:2243] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.059492 20891 raft_consensus.cc:2272] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.062642 20891 tablet_replica.cc:333] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.063570 20891 raft_consensus.cc:2243] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.064168 20891 raft_consensus.cc:2272] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.068086 20891 tablet_replica.cc:333] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.069028 20891 raft_consensus.cc:2243] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.069620 20891 raft_consensus.cc:2272] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.072933 20891 tablet_replica.cc:333] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.073837 20891 raft_consensus.cc:2243] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.074939 20891 raft_consensus.cc:2272] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.078081 20891 tablet_replica.cc:333] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.079036 20891 raft_consensus.cc:2243] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.079629 20891 raft_consensus.cc:2272] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.082927 20891 tablet_replica.cc:333] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
W20260709 12:14:24.083570 31330 consensus_peers.cc:597] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.083866 20891 raft_consensus.cc:2243] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.084636 20891 raft_consensus.cc:2272] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:24.086735 31330 consensus_peers.cc:597] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.087522 31404 consensus_peers.cc:597] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.087999 20891 tablet_replica.cc:333] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.089038 20891 raft_consensus.cc:2243] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.089653 20891 raft_consensus.cc:2272] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.093086 20891 tablet_replica.cc:333] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
W20260709 12:14:24.093590 31478 consensus_peers.cc:597] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.094043 20891 raft_consensus.cc:2243] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.094883 20891 raft_consensus.cc:2272] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.098073 20891 tablet_replica.cc:333] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.099031 20891 raft_consensus.cc:2243] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.099671 20891 raft_consensus.cc:2272] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.102792 20891 tablet_replica.cc:333] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.103767 20891 raft_consensus.cc:2243] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.104959 20891 raft_consensus.cc:2272] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.108150 20891 tablet_replica.cc:333] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.109053 20891 raft_consensus.cc:2243] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.109653 20891 raft_consensus.cc:2272] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.112707 20891 tablet_replica.cc:333] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.113695 20891 raft_consensus.cc:2243] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.114372 20891 raft_consensus.cc:2272] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.117935 20891 tablet_replica.cc:333] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.118854 20891 raft_consensus.cc:2243] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.119452 20891 raft_consensus.cc:2272] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.122431 20891 tablet_replica.cc:333] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
W20260709 12:14:24.125749 31478 consensus_peers.cc:597] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.127528 31478 consensus_peers.cc:597] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.127540 20891 raft_consensus.cc:2243] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.128501 20891 raft_consensus.cc:2272] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.131570 20891 tablet_replica.cc:333] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.132427 20891 raft_consensus.cc:2243] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.133525 20891 raft_consensus.cc:2272] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.136433 20891 tablet_replica.cc:333] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.137445 20891 raft_consensus.cc:2243] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.138037 20891 raft_consensus.cc:2272] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.141227 20891 tablet_replica.cc:333] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.142144 20891 raft_consensus.cc:2243] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.143226 20891 raft_consensus.cc:2272] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.146335 20891 tablet_replica.cc:333] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.147300 20891 raft_consensus.cc:2243] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.148479 20891 raft_consensus.cc:2272] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.151526 20891 tablet_replica.cc:333] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.152451 20891 raft_consensus.cc:2243] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.153059 20891 raft_consensus.cc:2272] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.156358 20891 tablet_replica.cc:333] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.157198 20891 raft_consensus.cc:2243] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.157821 20891 raft_consensus.cc:2272] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:24.160970 31478 consensus_peers.cc:597] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.161355 20891 tablet_replica.cc:333] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.162487 20891 raft_consensus.cc:2243] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.163599 20891 raft_consensus.cc:2272] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.166574 20891 tablet_replica.cc:333] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.167403 20891 raft_consensus.cc:2243] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.168545 20891 raft_consensus.cc:2272] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.171622 20891 tablet_replica.cc:333] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.172490 20891 raft_consensus.cc:2243] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.173127 20891 raft_consensus.cc:2272] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.176188 20891 tablet_replica.cc:333] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.177140 20891 raft_consensus.cc:2243] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.177699 20891 raft_consensus.cc:2272] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.180666 20891 tablet_replica.cc:333] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.181583 20891 raft_consensus.cc:2243] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.182189 20891 raft_consensus.cc:2272] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:24.183596 31404 consensus_peers.cc:597] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.185161 20891 tablet_replica.cc:333] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
W20260709 12:14:24.185237 31478 consensus_peers.cc:597] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.186326 20891 raft_consensus.cc:2243] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.186964 20891 raft_consensus.cc:2272] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.189766 20891 tablet_replica.cc:333] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.190609 20891 raft_consensus.cc:2243] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.191238 20891 raft_consensus.cc:2272] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.194198 20891 tablet_replica.cc:333] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.195026 20891 raft_consensus.cc:2243] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.195533 20891 raft_consensus.cc:2272] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.198676 20891 tablet_replica.cc:333] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.199478 20891 raft_consensus.cc:2243] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.200029 20891 raft_consensus.cc:2272] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.202924 20891 tablet_replica.cc:333] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.203753 20891 raft_consensus.cc:2243] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.204339 20891 raft_consensus.cc:2272] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.207331 20891 tablet_replica.cc:333] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.208132 20891 raft_consensus.cc:2243] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.208818 20891 raft_consensus.cc:2272] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.212257 20891 tablet_replica.cc:333] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.213151 20891 raft_consensus.cc:2243] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.213749 20891 raft_consensus.cc:2272] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.216905 20891 tablet_replica.cc:333] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.217742 20891 raft_consensus.cc:2243] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.218394 20891 raft_consensus.cc:2272] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:24.220883 31478 consensus_peers.cc:597] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.221648 20891 tablet_replica.cc:333] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.222716 20891 raft_consensus.cc:2243] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.223342 20891 raft_consensus.cc:2272] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.226321 20891 tablet_replica.cc:333] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.227098 20891 raft_consensus.cc:2243] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.227711 20891 raft_consensus.cc:2272] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.231946 20891 tablet_replica.cc:333] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.232749 20891 raft_consensus.cc:2243] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.233330 20891 raft_consensus.cc:2272] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.236209 20891 tablet_replica.cc:333] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.237046 20891 raft_consensus.cc:2243] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.237623 20891 raft_consensus.cc:2272] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.240589 20891 tablet_replica.cc:333] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.241443 20891 raft_consensus.cc:2243] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.242013 20891 raft_consensus.cc:2272] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.244946 20891 tablet_replica.cc:333] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.245738 20891 raft_consensus.cc:2243] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.246318 20891 raft_consensus.cc:2272] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.249696 20891 tablet_replica.cc:333] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.250520 20891 raft_consensus.cc:2243] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.251118 20891 raft_consensus.cc:2272] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.254073 20891 tablet_replica.cc:333] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185: stopping tablet replica
I20260709 12:14:24.254817 20891 raft_consensus.cc:2243] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.255403 20891 raft_consensus.cc:2272] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:24.258958 31330 consensus_peers.cc:597] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.259738 31330 consensus_peers.cc:597] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.284812 31330 consensus_peers.cc:597] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.314814 31330 consensus_peers.cc:597] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.321236 31478 consensus_peers.cc:597] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.331784 31330 consensus_peers.cc:597] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.363852 31330 consensus_peers.cc:597] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.376827 31330 consensus_peers.cc:597] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.377382 31330 consensus_peers.cc:597] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.417459 31404 consensus_peers.cc:597] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.436659 31404 consensus_peers.cc:597] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.445436 31478 consensus_peers.cc:597] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.448546 31404 consensus_peers.cc:597] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.456607 31478 consensus_peers.cc:597] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.477475 31478 consensus_peers.cc:597] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.117813 32041 raft_consensus.cc:493] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.118392 32041 raft_consensus.cc:515] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:25.124814 32041 leader_election.cc:290] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:25.126242 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb35e6f710fb417fba28d448bf7cc140" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
W20260709 12:14:25.135703 31478 leader_election.cc:336] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.136382 31478 leader_election.cc:304] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:25.138906 32191 raft_consensus.cc:2749] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:25.186532 32203 raft_consensus.cc:493] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.187134 32203 raft_consensus.cc:515] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:25.190409 32203 leader_election.cc:290] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:25.190793 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e23c1349714ee8b522e1b92accebc2" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:25.193827 31330 leader_election.cc:336] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.194319 31330 leader_election.cc:304] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:25.194998 32203 raft_consensus.cc:2749] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:25.268591 32191 raft_consensus.cc:493] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.269299 32191 raft_consensus.cc:515] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.271915 32191 leader_election.cc:290] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.272724 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ead5d3f281f4adb8e218fc8979158f2" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:25.282833 31478 leader_election.cc:336] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.283376 31478 leader_election.cc:304] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:25.284210 32191 raft_consensus.cc:2749] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:25.291397 32153 raft_consensus.cc:493] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.292445 32153 raft_consensus.cc:515] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:25.294926 32153 leader_election.cc:290] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:25.296350 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4977dacca462483d9bc0b0929a806d10" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:25.297610 32191 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.301883 32041 raft_consensus.cc:493] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.302578 32041 raft_consensus.cc:515] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.302240 32191 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.304548 32041 leader_election.cc:290] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.305126 32191 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.306645 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:25.307042 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
W20260709 12:14:25.312937 31330 leader_election.cc:336] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.313814 31330 leader_election.cc:304] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:25.315806 32153 raft_consensus.cc:2749] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:25.316809 32020 raft_consensus.cc:493] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.317406 32020 raft_consensus.cc:515] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:25.320320 32020 leader_election.cc:290] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:25.321285 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4977dacca462483d9bc0b0929a806d10" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:25.322109 31357 raft_consensus.cc:2468] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:25.323376 31401 leader_election.cc:304] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:25.324270 32020 raft_consensus.cc:2804] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.324663 32020 raft_consensus.cc:493] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.325078 32020 raft_consensus.cc:3060] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:25.326159 31404 leader_election.cc:336] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
W20260709 12:14:25.328918 31478 leader_election.cc:336] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.329463 31478 leader_election.cc:304] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:25.330309 32191 raft_consensus.cc:2749] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:25.330511 31478 leader_election.cc:336] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.331149 31478 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:25.333209 32191 raft_consensus.cc:2749] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:25.334328 32020 raft_consensus.cc:515] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:25.338320 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4977dacca462483d9bc0b0929a806d10" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:25.339103 31357 raft_consensus.cc:3060] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:25.341917 31404 leader_election.cc:336] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.346690 32020 leader_election.cc:290] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:25.350397 31357 raft_consensus.cc:2468] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 2.
I20260709 12:14:25.351955 31401 leader_election.cc:304] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
W20260709 12:14:25.352617 20891 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 31310)
I20260709 12:14:25.352865 32020 raft_consensus.cc:2804] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:25.353853 32020 raft_consensus.cc:697] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:25.354738 32020 consensus_queue.cc:237] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:25.364511 32205 raft_consensus.cc:493] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.365577 32205 raft_consensus.cc:515] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.368439 32205 leader_election.cc:290] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.369195 31185 catalog_manager.cc:5697] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 1 to 2, leader changed from 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193) to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 2 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:25.371786 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ead5d3f281f4adb8e218fc8979158f2" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:25.372586 31511 raft_consensus.cc:2468] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
W20260709 12:14:25.378083 31404 leader_election.cc:336] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.380539 31402 leader_election.cc:304] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.381853 32020 raft_consensus.cc:2804] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.382296 32020 raft_consensus.cc:493] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.382714 32020 raft_consensus.cc:3060] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.393338 32020 raft_consensus.cc:515] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.395485 32020 leader_election.cc:290] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:25.407418 31404 leader_election.cc:336] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.427254 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ead5d3f281f4adb8e218fc8979158f2" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:25.428026 31511 raft_consensus.cc:3060] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.437994 31511 raft_consensus.cc:2468] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 2.
I20260709 12:14:25.443986 31402 leader_election.cc:304] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.444890 32020 raft_consensus.cc:2804] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:25.445396 32020 raft_consensus.cc:697] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:25.446214 32020 consensus_queue.cc:237] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.449635 32134 raft_consensus.cc:493] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.450443 32134 raft_consensus.cc:515] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:25.455943 31401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:33861, user_credentials={real_user=slave}} blocked reactor thread for 80235.2us
W20260709 12:14:25.460034 31404 leader_election.cc:336] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.460920 32205 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.461560 32205 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.461771 32134 leader_election.cc:290] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.463850 32205 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:25.479722 31404 leader_election.cc:336] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.487730 32205 raft_consensus.cc:493] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.488560 32191 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.488420 32205 raft_consensus.cc:515] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.489305 32191 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.491024 32205 leader_election.cc:290] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.491883 32191 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.493389 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:25.494266 31505 raft_consensus.cc:2468] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:25.494761 32205 raft_consensus.cc:493] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.495275 32191 raft_consensus.cc:493] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.495385 32205 raft_consensus.cc:515] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:25.495923 32191 raft_consensus.cc:515] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.496620 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:25.497776 32205 leader_election.cc:290] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:25.499359 31431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:25.505899 31431 raft_consensus.cc:2468] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:25.501667 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e23c1349714ee8b522e1b92accebc2" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d" is_pre_election: true
I20260709 12:14:25.507570 31357 raft_consensus.cc:2468] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:25.509295 31401 leader_election.cc:304] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 
W20260709 12:14:25.502981 31478 leader_election.cc:336] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.501554 31402 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.511029 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:25.517735 31511 raft_consensus.cc:2468] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
I20260709 12:14:25.518364 32205 raft_consensus.cc:2804] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.519049 32205 raft_consensus.cc:493] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.519546 32205 raft_consensus.cc:3060] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.523957 31477 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.524747 32134 raft_consensus.cc:2804] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.525489 32134 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.525971 32134 raft_consensus.cc:3060] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.526146 32190 raft_consensus.cc:493] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.526859 32190 raft_consensus.cc:515] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:25.529315 32190 leader_election.cc:290] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.531567 32204 raft_consensus.cc:2804] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.532078 32204 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.532469 32204 raft_consensus.cc:3060] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.537534 31402 leader_election.cc:304] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:25.540330 32020 raft_consensus.cc:2749] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:25.538897 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:25.543906 31432 raft_consensus.cc:2468] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:25.502631 32191 leader_election.cc:290] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:25.570152 31404 leader_election.cc:336] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
W20260709 12:14:25.574689 31404 leader_election.cc:336] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.575381 31402 leader_election.cc:304] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.561228 32041 raft_consensus.cc:493] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.584884 32041 raft_consensus.cc:515] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:25.574005 31478 leader_election.cc:336] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.586927 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb35e6f710fb417fba28d448bf7cc140" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:25.587805 31505 raft_consensus.cc:2468] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 1.
I20260709 12:14:25.551652 32204 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.587010 32041 leader_election.cc:290] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.589537 32020 raft_consensus.cc:2804] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.589934 32020 raft_consensus.cc:493] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
W20260709 12:14:25.580236 31330 leader_election.cc:336] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.590301 32020 raft_consensus.cc:3060] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.593393 32205 raft_consensus.cc:515] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:25.595621 32205 leader_election.cc:290] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Requested vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:25.597700 32134 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:25.602468 31404 leader_election.cc:336] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.602869 32134 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:25.608139 31404 leader_election.cc:336] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.610589 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e23c1349714ee8b522e1b92accebc2" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:25.611519 31328 leader_election.cc:304] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.611557 31362 raft_consensus.cc:3060] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.614748 32204 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.615978 32217 raft_consensus.cc:2804] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.616377 32217 raft_consensus.cc:493] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.616715 32217 raft_consensus.cc:3060] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.616858 31477 leader_election.cc:304] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.619155 32214 raft_consensus.cc:2804] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.619592 32214 raft_consensus.cc:493] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.619949 32214 raft_consensus.cc:3060] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.624751 32217 raft_consensus.cc:515] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:25.625905 32205 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.638228 32205 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.640583 32217 leader_election.cc:290] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.645526 31185 catalog_manager.cc:5697] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 1 to 2, leader changed from 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193) to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 2 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:25.646687 31404 leader_election.cc:336] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.635434 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:25.649591 31505 raft_consensus.cc:2393] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 2: Already voted for candidate a209a5d7b61542d885ef601e8bcaa26c in this term.
W20260709 12:14:25.652127 31330 leader_election.cc:336] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.656414 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb35e6f710fb417fba28d448bf7cc140" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:25.640609 32205 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.657261 32214 raft_consensus.cc:515] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.636226 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:25.661644 31432 raft_consensus.cc:2468] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 1.
I20260709 12:14:25.664397 32216 raft_consensus.cc:493] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.665069 32216 raft_consensus.cc:515] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:25.672857 31404 leader_election.cc:336] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.675999 32020 raft_consensus.cc:515] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.676694 32216 leader_election.cc:290] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.679313 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:25.679631 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:25.680123 31432 raft_consensus.cc:2393] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 2: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:25.680389 31435 raft_consensus.cc:2393] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a209a5d7b61542d885ef601e8bcaa26c in current term 2: Already voted for candidate d5caa720fddf4dd3958f076ff03df8da in this term.
I20260709 12:14:25.659864 32214 leader_election.cc:290] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.657214 31505 raft_consensus.cc:3060] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:25.684557 31478 leader_election.cc:336] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
W20260709 12:14:25.685132 31404 leader_election.cc:336] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.686607 31362 raft_consensus.cc:2468] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 2.
I20260709 12:14:25.687243 32020 leader_election.cc:290] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:25.685245 31478 leader_election.cc:336] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.691256 31402 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:25.692719 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:25.693528 31511 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 4.
I20260709 12:14:25.693564 31401 leader_election.cc:304] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.696277 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:25.696952 31511 raft_consensus.cc:2468] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 1.
W20260709 12:14:25.697829 31478 leader_election.cc:336] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.698244 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:25.699046 31511 raft_consensus.cc:2393] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d5caa720fddf4dd3958f076ff03df8da in current term 2: Already voted for candidate a209a5d7b61542d885ef601e8bcaa26c in this term.
I20260709 12:14:25.700947 31477 leader_election.cc:304] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.702471 31505 raft_consensus.cc:2468] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 2.
I20260709 12:14:25.703146 32191 raft_consensus.cc:2804] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.705003 32191 raft_consensus.cc:493] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.705464 32191 raft_consensus.cc:3060] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.716133 31328 leader_election.cc:304] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.717470 32190 raft_consensus.cc:2804] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:25.718019 32190 raft_consensus.cc:697] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 2 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:25.719000 32190 consensus_queue.cc:237] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:25.736763 32216 raft_consensus.cc:2749] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:25.736996 32205 raft_consensus.cc:2804] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:25.737845 32205 raft_consensus.cc:697] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
W20260709 12:14:25.738051 31402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 46897.1us
I20260709 12:14:25.738874 32205 consensus_queue.cc:237] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:25.742777 31477 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:25.752379 32213 raft_consensus.cc:2749] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:25.763950 31402 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.746001 32191 raft_consensus.cc:515] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.771252 31185 catalog_manager.cc:5697] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 1 to 2, leader changed from 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193) to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 2 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:25.779002 31402 leader_election.cc:304] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.780925 32191 leader_election.cc:290] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.782013 32134 raft_consensus.cc:2804] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.781874 31402 leader_election.cc:304] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c
I20260709 12:14:25.784408 32020 raft_consensus.cc:2749] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:25.782588 32134 raft_consensus.cc:493] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.793872 32134 raft_consensus.cc:3060] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.801422 31184 catalog_manager.cc:5697] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 1 to 2, leader changed from 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193) to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 2 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:25.803287 32134 raft_consensus.cc:515] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
W20260709 12:14:25.812728 31404 leader_election.cc:336] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.813812 32134 leader_election.cc:290] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.772253 31477 leader_election.cc:304] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
W20260709 12:14:25.775754 31478 leader_election.cc:336] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.776396 32216 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:25.819525 32216 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:25.820078 32216 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:25.824985 32191 raft_consensus.cc:2749] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:14:25.826166 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45203, user_credentials={real_user=slave}} blocked reactor thread for 54014.8us
I20260709 12:14:25.833516 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:25.834290 31435 raft_consensus.cc:3060] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.836014 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d502420b9f304f568a686ba8cdb9ae80" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:25.836755 31511 raft_consensus.cc:3060] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.843964 31435 raft_consensus.cc:2468] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 2.
I20260709 12:14:25.846230 31511 raft_consensus.cc:2468] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 2.
I20260709 12:14:25.846477 32216 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.849589 32216 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 5 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:25.850142 31477 leader_election.cc:304] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.852723 32204 raft_consensus.cc:2804] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:14:25.853834 31404 leader_election.cc:336] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:25.854122 32204 raft_consensus.cc:697] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 2 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:25.852514 31402 leader_election.cc:304] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.855176 32204 consensus_queue.cc:237] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.855839 32205 raft_consensus.cc:2804] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:25.856526 32205 raft_consensus.cc:697] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:25.857520 32205 consensus_queue.cc:237] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.860385 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:25.861094 31511 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:25.867177 31362 raft_consensus.cc:1275] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer d5caa720fddf4dd3958f076ff03df8da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:25.868984 32216 consensus_queue.cc:1048] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:25.901041 31511 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 5.
I20260709 12:14:25.902439 31402 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:25.905844 32208 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:25.906454 32208 raft_consensus.cc:697] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 5 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:25.906077 31184 catalog_manager.cc:5697] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 1 to 2, leader changed from 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193) to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 2 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:25.907433 32208 consensus_queue.cc:237] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:25.931772 31184 catalog_manager.cc:5697] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 4 to 5, leader changed from 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193) to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 5 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:25.916563 31185 catalog_manager.cc:5697] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 1 to 2, leader changed from 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193) to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 2 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:25.944981 31404 consensus_peers.cc:597] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:26.006538 31511 raft_consensus.cc:1275] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer d5caa720fddf4dd3958f076ff03df8da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:26.008190 32208 consensus_queue.cc:1048] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:26.040436 31404 consensus_peers.cc:597] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:26.114842 31330 consensus_peers.cc:597] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:26.227967 31404 consensus_peers.cc:597] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:26.230614 31330 consensus_peers.cc:597] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:26.231096 31508 raft_consensus.cc:1275] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer 56add4c904c74a1bba90579b9204e45d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:26.232929 32217 consensus_queue.cc:1048] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:26.294044 31478 consensus_peers.cc:597] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:26.298709 31478 consensus_peers.cc:597] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.298735 31404 consensus_peers.cc:597] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:26.321417 31435 raft_consensus.cc:1275] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Refusing update from remote peer a209a5d7b61542d885ef601e8bcaa26c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:26.323451 32214 consensus_queue.cc:1048] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:26.340914 31362 raft_consensus.cc:1275] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer d5caa720fddf4dd3958f076ff03df8da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:26.350207 31478 consensus_peers.cc:597] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.353150 20891 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 31310)
I20260709 12:14:26.347461 32208 consensus_queue.cc:1048] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:14:26.388329 31511 raft_consensus.cc:1275] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 5 FOLLOWER]: Refusing update from remote peer d5caa720fddf4dd3958f076ff03df8da: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:26.389950 32134 consensus_queue.cc:1048] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:14:26.401806 31330 consensus_peers.cc:597] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.409690 31404 consensus_peers.cc:597] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:26.412581 31478 consensus_peers.cc:597] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.462492 31330 consensus_peers.cc:597] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:26.465924 31511 raft_consensus.cc:1275] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer d5caa720fddf4dd3958f076ff03df8da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:26.467622 32134 consensus_queue.cc:1048] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:26.497363 31330 consensus_peers.cc:597] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.508387 31478 consensus_peers.cc:597] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.575323 31330 consensus_peers.cc:597] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.590296 31478 consensus_peers.cc:597] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.598615 31478 consensus_peers.cc:597] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.600672 31404 consensus_peers.cc:597] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.604641 31478 consensus_peers.cc:597] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.616158 31330 consensus_peers.cc:597] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.621577 31330 consensus_peers.cc:597] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.622160 31330 consensus_peers.cc:597] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.624574 31330 consensus_peers.cc:597] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.634111 31478 consensus_peers.cc:597] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.652961 31404 consensus_peers.cc:597] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.660838 31330 consensus_peers.cc:597] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.721480 31330 consensus_peers.cc:597] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.729702 31478 consensus_peers.cc:597] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.735466 31330 consensus_peers.cc:597] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.752003 31478 consensus_peers.cc:597] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.820489 31330 consensus_peers.cc:597] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.876981 31404 consensus_peers.cc:597] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.883653 31404 consensus_peers.cc:597] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.955204 31478 consensus_peers.cc:597] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.967947 31478 consensus_peers.cc:597] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.975863 31330 consensus_peers.cc:597] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.979817 31478 consensus_peers.cc:597] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:27.007493 31404 consensus_peers.cc:597] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:27.010993 31478 consensus_peers.cc:597] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:27.155043 31478 consensus_peers.cc:597] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:27.168642 31330 consensus_peers.cc:597] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:27.296331 31330 consensus_peers.cc:597] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:27.353698 20891 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 31310)
I20260709 12:14:27.428992 32235 raft_consensus.cc:493] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.429664 32235 raft_consensus.cc:515] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:27.432864 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c" is_pre_election: true
I20260709 12:14:27.433521 31511 raft_consensus.cc:2468] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 2.
I20260709 12:14:27.434207 32235 leader_election.cc:290] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:27.435052 31402 leader_election.cc:304] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:27.436447 32235 raft_consensus.cc:2804] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:27.437114 32235 raft_consensus.cc:493] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.437537 32235 raft_consensus.cc:3060] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:27.440532 31404 leader_election.cc:336] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:27.447624 32235 raft_consensus.cc:515] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:27.450384 32235 leader_election.cc:290] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 3 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:27.451531 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdc78b9bfcf344f389246d2a9db1c5eb" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:27.452358 31511 raft_consensus.cc:3060] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:27.455477 31404 leader_election.cc:336] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:27.460585 31511 raft_consensus.cc:2468] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 3.
I20260709 12:14:27.462409 31402 leader_election.cc:304] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:27.464000 32235 raft_consensus.cc:2804] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:27.464529 32235 raft_consensus.cc:697] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 3 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:27.468135 32235 consensus_queue.cc:237] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:27.494845 31185 catalog_manager.cc:5697] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 1 to 3, leader changed from 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193) to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 3 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.521539 32214 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.522186 32214 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:27.530133 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da" is_pre_election: true
I20260709 12:14:27.530964 31435 raft_consensus.cc:2468] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 2.
W20260709 12:14:27.534513 31478 leader_election.cc:336] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:27.536459 31477 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:27.537428 32213 raft_consensus.cc:2804] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:27.537832 32213 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.538148 32213 raft_consensus.cc:3060] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.524663 32214 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:27.548646 32213 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:27.555164 32213 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:27.558347 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "a209a5d7b61542d885ef601e8bcaa26c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:27.558996 31435 raft_consensus.cc:3060] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:27.562029 31478 leader_election.cc:336] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:27.567534 31435 raft_consensus.cc:2468] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a209a5d7b61542d885ef601e8bcaa26c in term 3.
I20260709 12:14:27.569226 31477 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c, d5caa720fddf4dd3958f076ff03df8da; no voters: 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:27.570335 32244 raft_consensus.cc:2804] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:27.572180 32244 raft_consensus.cc:697] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 LEADER]: Becoming Leader. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:27.573218 32244 consensus_queue.cc:237] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:27.590852 31185 catalog_manager.cc:5697] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c reported cstate change: term changed from 1 to 3, leader changed from 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193) to a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196). New cstate: current_term: 3 leader_uuid: "a209a5d7b61542d885ef601e8bcaa26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:27.947538 31404 consensus_peers.cc:597] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:27.993717 31478 consensus_peers.cc:597] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:28.010708 31508 raft_consensus.cc:1275] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Refusing update from remote peer d5caa720fddf4dd3958f076ff03df8da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:28.012356 32235 consensus_queue.cc:1048] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:28.108088 31435 raft_consensus.cc:1275] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Refusing update from remote peer a209a5d7b61542d885ef601e8bcaa26c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:28.109649 32244 consensus_queue.cc:1048] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:28.354281 20891 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 31310)
W20260709 12:14:28.357116 31404 consensus_peers.cc:597] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:28.376263 31330 consensus_peers.cc:597] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:28.539844 20891 tablet_server.cc:196] TabletServer@127.20.102.193:0 shutdown complete.
I20260709 12:14:28.627420 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:28.636677 32254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:28.638957 32253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:28.641947 32256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:28.643260 20891 server_base.cc:1061] running on GCE node
W20260709 12:14:28.645052 31404 consensus_peers.cc:597] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:28.646027 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:28.646288 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:28.646549 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599268646528 us; error 0 us; skew 500 ppm
I20260709 12:14:28.647215 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:28.651232 20891 webserver.cc:533] Webserver started at http://127.20.102.193:36579/ using document root <none> and password file <none>
I20260709 12:14:28.651911 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:28.652122 20891 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:14:28.656733 20891 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:14:28.667737 32261 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:28.671200 20891 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.000s
W20260709 12:14:28.671339 31404 consensus_peers.cc:597] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:28.671689 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-0-root
uuid: "0769d57e6db04b2f86703e0ed60f6185"
format_stamp: "Formatted at 2026-07-09 12:14:05 on dist-test-slave-296p"
I20260709 12:14:28.672293 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895025208-20891-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:28.695717 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:28.697432 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:28.699150 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:28.704300 32268 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:14:28.730288 31330 consensus_peers.cc:597] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:28.761889 31404 consensus_peers.cc:597] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:28.773453 31478 consensus_peers.cc:597] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:28.808733 31330 consensus_peers.cc:597] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:28.832216 31330 consensus_peers.cc:597] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:28.854225 31330 consensus_peers.cc:597] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:28.878881 31404 consensus_peers.cc:597] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:28.928603 31330 consensus_peers.cc:597] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:28.928824 31404 consensus_peers.cc:597] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:28.930016 31478 consensus_peers.cc:597] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:28.935333 31330 consensus_peers.cc:597] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:28.949896 31330 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111) [suppressed 443 similar messages]
W20260709 12:14:28.953505 31330 consensus_peers.cc:597] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.006047 31478 consensus_peers.cc:597] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.007887 31478 consensus_peers.cc:597] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.009594 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:14:29.010020 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.307s	user 0.009s	sys 0.001s
I20260709 12:14:29.010417 20891 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:14:29.016197 32268 tablet_bootstrap.cc:492] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:29.049434 32268 tablet_bootstrap.cc:492] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.050469 32268 tablet_bootstrap.cc:492] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.051157 32268 ts_tablet_manager.cc:1403] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.012s
I20260709 12:14:29.054575 32268 raft_consensus.cc:359] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:29.055349 32268 raft_consensus.cc:740] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.056255 32268 consensus_queue.cc:260] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
W20260709 12:14:29.069198 31478 consensus_peers.cc:597] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.090107 32268 ts_tablet_manager.cc:1434] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.021s
I20260709 12:14:29.091274 32268 tablet_bootstrap.cc:492] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:29.101874 31478 consensus_peers.cc:597] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.102586 31478 consensus_peers.cc:597] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.105913 31478 consensus_peers.cc:597] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:29.113535 32268 tablet_bootstrap.cc:492] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.114495 32268 tablet_bootstrap.cc:492] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.115257 32268 ts_tablet_manager.cc:1403] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:14:29.117868 32268 raft_consensus.cc:359] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:29.118582 32268 raft_consensus.cc:740] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.119401 32268 consensus_queue.cc:260] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:29.121660 32268 ts_tablet_manager.cc:1434] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:14:29.122491 32268 tablet_bootstrap.cc:492] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:29.131103 31478 consensus_peers.cc:597] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.151240 32268 tablet_bootstrap.cc:492] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.152326 32268 tablet_bootstrap.cc:492] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.153108 32268 ts_tablet_manager.cc:1403] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.012s
I20260709 12:14:29.155328 32268 raft_consensus.cc:359] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:29.155889 32268 raft_consensus.cc:740] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.156821 32268 consensus_queue.cc:260] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:29.158273 32268 ts_tablet_manager.cc:1434] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:29.159009 32268 tablet_bootstrap.cc:492] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:29.173586 31478 consensus_peers.cc:597] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.174955 32268 tablet_bootstrap.cc:492] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.175954 32268 tablet_bootstrap.cc:492] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.176604 32268 ts_tablet_manager.cc:1403] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 12:14:29.179140 32268 raft_consensus.cc:359] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.179811 32268 raft_consensus.cc:740] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.180486 32268 consensus_queue.cc:260] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.182590 32268 ts_tablet_manager.cc:1434] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:29.183341 32268 tablet_bootstrap.cc:492] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:29.185207 31478 consensus_peers.cc:597] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.200822 32268 tablet_bootstrap.cc:492] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.201819 32268 tablet_bootstrap.cc:492] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.202442 32268 ts_tablet_manager.cc:1403] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 12:14:29.204906 32268 raft_consensus.cc:359] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.205590 32268 raft_consensus.cc:740] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.206261 32268 consensus_queue.cc:260] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.208303 32268 ts_tablet_manager.cc:1434] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:14:29.209090 32268 tablet_bootstrap.cc:492] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:29.226751 32268 tablet_bootstrap.cc:492] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.227672 32268 tablet_bootstrap.cc:492] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.228276 32268 ts_tablet_manager.cc:1403] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 12:14:29.230687 32268 raft_consensus.cc:359] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:29.231405 32268 raft_consensus.cc:740] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.232261 32268 consensus_queue.cc:260] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:29.234375 32268 ts_tablet_manager.cc:1434] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:14:29.235287 32268 tablet_bootstrap.cc:492] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:29.257957 31330 consensus_peers.cc:597] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.263849 32268 tablet_bootstrap.cc:492] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.265116 32268 tablet_bootstrap.cc:492] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.265885 32268 ts_tablet_manager.cc:1403] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.007s
I20260709 12:14:29.268833 32268 raft_consensus.cc:359] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:29.269577 32268 raft_consensus.cc:740] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.270401 32268 consensus_queue.cc:260] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:29.272531 32268 ts_tablet_manager.cc:1434] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:29.273448 32268 tablet_bootstrap.cc:492] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:29.287035 31330 consensus_peers.cc:597] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.298882 31330 consensus_peers.cc:597] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.302055 31478 consensus_peers.cc:597] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.311105 31404 consensus_peers.cc:597] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.320245 32268 tablet_bootstrap.cc:492] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.321602 32268 tablet_bootstrap.cc:492] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.322355 32268 ts_tablet_manager.cc:1403] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.017s
W20260709 12:14:29.324970 31330 consensus_peers.cc:597] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.325047 32268 raft_consensus.cc:359] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:29.327778 32268 raft_consensus.cc:740] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.328900 32268 consensus_queue.cc:260] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:29.333550 32268 ts_tablet_manager.cc:1434] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:14:29.334764 32268 tablet_bootstrap.cc:492] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:29.344174 20891 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:14:29.344607 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.334s	user 0.244s	sys 0.026s
W20260709 12:14:29.346238 31404 consensus_peers.cc:597] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.353976 31478 consensus_peers.cc:597] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.359591 32268 tablet_bootstrap.cc:492] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.360529 32268 tablet_bootstrap.cc:492] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.361195 32268 ts_tablet_manager.cc:1403] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.007s
I20260709 12:14:29.363653 32268 raft_consensus.cc:359] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:29.364409 32268 raft_consensus.cc:740] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.365362 32268 consensus_queue.cc:260] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:29.367643 32268 ts_tablet_manager.cc:1434] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:29.368538 32268 tablet_bootstrap.cc:492] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:29.376690 31330 consensus_peers.cc:597] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.385795 32268 tablet_bootstrap.cc:492] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.386970 32268 tablet_bootstrap.cc:492] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.388017 32268 ts_tablet_manager.cc:1403] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:14:29.392242 32268 raft_consensus.cc:359] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.393116 32268 raft_consensus.cc:740] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.393981 32268 consensus_queue.cc:260] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.396517 32268 ts_tablet_manager.cc:1434] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 12:14:29.396817 31404 consensus_peers.cc:597] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.397459 32268 tablet_bootstrap.cc:492] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:29.418293 31478 consensus_peers.cc:597] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.420150 32268 tablet_bootstrap.cc:492] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.421375 32268 tablet_bootstrap.cc:492] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.422030 32268 ts_tablet_manager.cc:1403] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.003s
I20260709 12:14:29.424774 32268 raft_consensus.cc:359] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.425554 32268 raft_consensus.cc:740] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.426268 32268 consensus_queue.cc:260] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.428177 32268 ts_tablet_manager.cc:1434] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:14:29.429055 32268 tablet_bootstrap.cc:492] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:29.580991 31404 consensus_peers.cc:597] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.622756 31478 consensus_peers.cc:597] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.654568 31330 consensus_peers.cc:597] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.655550 31330 consensus_peers.cc:597] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.661700 31330 consensus_peers.cc:597] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:29.731825 31478 consensus_peers.cc:597] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.779928 32268 tablet_bootstrap.cc:492] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.784283 32268 tablet_bootstrap.cc:492] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.785652 32268 ts_tablet_manager.cc:1403] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.357s	user 0.027s	sys 0.028s
I20260709 12:14:29.813963 32268 raft_consensus.cc:359] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:29.828475 32268 raft_consensus.cc:740] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.830020 32268 consensus_queue.cc:260] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:29.836205 32268 ts_tablet_manager.cc:1434] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.007s
I20260709 12:14:29.837944 32268 tablet_bootstrap.cc:492] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:29.922899 32268 tablet_bootstrap.cc:492] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.924896 32268 tablet_bootstrap.cc:492] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.926283 32268 ts_tablet_manager.cc:1403] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.019s
I20260709 12:14:29.932124 32268 raft_consensus.cc:359] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.933331 32268 raft_consensus.cc:740] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.934545 32268 consensus_queue.cc:260] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.938541 32268 ts_tablet_manager.cc:1434] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:14:29.940120 32268 tablet_bootstrap.cc:492] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:29.962215 32268 tablet_bootstrap.cc:492] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.963315 32268 tablet_bootstrap.cc:492] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:29.964133 32268 ts_tablet_manager.cc:1403] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.005s
I20260709 12:14:29.966820 32268 raft_consensus.cc:359] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.967338 32268 raft_consensus.cc:740] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.968058 32268 consensus_queue.cc:260] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:29.969044 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.193:45623
I20260709 12:14:29.971227 32268 ts_tablet_manager.cc:1434] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:29.972121 32355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.193:45623 every 8 connection(s)
I20260709 12:14:29.974167 32268 tablet_bootstrap.cc:492] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.028539 32268 tablet_bootstrap.cc:492] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.030661 32268 tablet_bootstrap.cc:492] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.031685 32268 ts_tablet_manager.cc:1403] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.013s
I20260709 12:14:30.036048 32268 raft_consensus.cc:359] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.037065 32268 raft_consensus.cc:740] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.038146 32268 consensus_queue.cc:260] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.041324 32268 ts_tablet_manager.cc:1434] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:14:30.045135 32268 tablet_bootstrap.cc:492] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.102196 32357 heartbeater.cc:344] Connected to a master server at 127.20.102.254:38261
I20260709 12:14:30.102903 32357 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:30.113364 32357 heartbeater.cc:507] Master 127.20.102.254:38261 requested a full tablet report, sending...
I20260709 12:14:30.124758 32268 tablet_bootstrap.cc:492] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.126448 32268 tablet_bootstrap.cc:492] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.127408 32268 ts_tablet_manager.cc:1403] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.004s
I20260709 12:14:30.131510 32268 raft_consensus.cc:359] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.132105 32268 raft_consensus.cc:740] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.133155 32268 consensus_queue.cc:260] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.135524 32268 ts_tablet_manager.cc:1434] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:14:30.136556 32268 tablet_bootstrap.cc:492] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.164326 31185 ts_manager.cc:194] Re-registered known tserver with Master: 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:30.179297 32268 tablet_bootstrap.cc:492] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.180727 32268 tablet_bootstrap.cc:492] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.181610 32268 ts_tablet_manager.cc:1403] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.014s
I20260709 12:14:30.185065 32268 raft_consensus.cc:359] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.185959 32268 raft_consensus.cc:740] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.186848 32268 consensus_queue.cc:260] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.189682 32268 ts_tablet_manager.cc:1434] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:30.190780 32268 tablet_bootstrap.cc:492] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.219581 32268 tablet_bootstrap.cc:492] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.220961 32268 tablet_bootstrap.cc:492] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.221856 32268 ts_tablet_manager.cc:1403] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.005s
I20260709 12:14:30.225149 32268 raft_consensus.cc:359] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.226053 32268 raft_consensus.cc:740] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.226997 32268 consensus_queue.cc:260] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.229705 32268 ts_tablet_manager.cc:1434] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:14:30.231822 32268 tablet_bootstrap.cc:492] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.244393 31185 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32970
I20260709 12:14:30.251508 32357 heartbeater.cc:499] Master 127.20.102.254:38261 was elected leader, sending a full tablet report...
I20260709 12:14:30.253393 32268 tablet_bootstrap.cc:492] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.254607 32268 tablet_bootstrap.cc:492] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.255373 32268 ts_tablet_manager.cc:1403] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.007s
I20260709 12:14:30.258172 32268 raft_consensus.cc:359] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.258970 32268 raft_consensus.cc:740] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.259783 32268 consensus_queue.cc:260] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.261859 32268 ts_tablet_manager.cc:1434] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:30.262838 32268 tablet_bootstrap.cc:492] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.287703 32268 tablet_bootstrap.cc:492] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.289072 32268 tablet_bootstrap.cc:492] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.289882 32268 ts_tablet_manager.cc:1403] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.009s
I20260709 12:14:30.292968 32268 raft_consensus.cc:359] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.293849 32268 raft_consensus.cc:740] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.294600 32268 consensus_queue.cc:260] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.297156 32268 ts_tablet_manager.cc:1434] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:14:30.298151 32268 tablet_bootstrap.cc:492] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:30.306782 31478 consensus_peers.cc:597] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:30.318476 32268 tablet_bootstrap.cc:492] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.319808 32268 tablet_bootstrap.cc:492] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.320516 32268 ts_tablet_manager.cc:1403] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:14:30.323314 32268 raft_consensus.cc:359] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:30.324014 32268 raft_consensus.cc:740] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.324735 32268 consensus_queue.cc:260] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:30.326828 32268 ts_tablet_manager.cc:1434] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:30.327957 32268 tablet_bootstrap.cc:492] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.343689 32268 tablet_bootstrap.cc:492] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.344763 32268 tablet_bootstrap.cc:492] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.345577 32268 ts_tablet_manager.cc:1403] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:14:30.348533 32268 raft_consensus.cc:359] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.349283 32268 raft_consensus.cc:740] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.350003 32268 consensus_queue.cc:260] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.352357 32268 ts_tablet_manager.cc:1434] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:30.353262 32268 tablet_bootstrap.cc:492] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.366534 32327 raft_consensus.cc:3060] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.369227 32268 tablet_bootstrap.cc:492] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.370270 32268 tablet_bootstrap.cc:492] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.370918 32268 ts_tablet_manager.cc:1403] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:14:30.373607 32268 raft_consensus.cc:359] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.374471 32268 raft_consensus.cc:740] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.375299 32268 consensus_queue.cc:260] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.377830 32268 ts_tablet_manager.cc:1434] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:30.378759 32268 tablet_bootstrap.cc:492] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.394454 32268 tablet_bootstrap.cc:492] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.395344 32268 tablet_bootstrap.cc:492] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.395920 32268 ts_tablet_manager.cc:1403] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:14:30.398029 32268 raft_consensus.cc:359] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.398533 32268 raft_consensus.cc:740] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.399078 32268 consensus_queue.cc:260] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.400612 32268 ts_tablet_manager.cc:1434] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:14:30.401609 32268 tablet_bootstrap.cc:492] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.418949 32268 tablet_bootstrap.cc:492] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.420145 32268 tablet_bootstrap.cc:492] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.420914 32268 ts_tablet_manager.cc:1403] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:14:30.423738 32268 raft_consensus.cc:359] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.424520 32268 raft_consensus.cc:740] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.425282 32268 consensus_queue.cc:260] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.427441 32268 ts_tablet_manager.cc:1434] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:30.428426 32268 tablet_bootstrap.cc:492] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.431140 32327 raft_consensus.cc:3060] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.436499 32326 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.458120 32268 tablet_bootstrap.cc:492] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.460063 32268 tablet_bootstrap.cc:492] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.460819 32268 ts_tablet_manager.cc:1403] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.008s
I20260709 12:14:30.463565 32268 raft_consensus.cc:359] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.464313 32268 raft_consensus.cc:740] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.465081 32268 consensus_queue.cc:260] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.469177 32268 ts_tablet_manager.cc:1434] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:30.471593 32268 tablet_bootstrap.cc:492] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.486838 32268 tablet_bootstrap.cc:492] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.487818 32268 tablet_bootstrap.cc:492] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.488492 32268 ts_tablet_manager.cc:1403] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:14:30.491051 32268 raft_consensus.cc:359] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.491786 32268 raft_consensus.cc:740] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.495820 32268 consensus_queue.cc:260] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.498087 32268 ts_tablet_manager.cc:1434] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:14:30.505250 32268 tablet_bootstrap.cc:492] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.538480 32268 tablet_bootstrap.cc:492] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.539746 32268 tablet_bootstrap.cc:492] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.540640 32268 ts_tablet_manager.cc:1403] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.014s
I20260709 12:14:30.543830 32268 raft_consensus.cc:359] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.545022 32268 raft_consensus.cc:740] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.545853 32268 consensus_queue.cc:260] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.547925 32268 ts_tablet_manager.cc:1434] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:30.549288 32268 tablet_bootstrap.cc:492] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.567839 32268 tablet_bootstrap.cc:492] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.568610 32268 tablet_bootstrap.cc:492] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.569226 32268 ts_tablet_manager.cc:1403] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:14:30.571465 32268 raft_consensus.cc:359] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.572098 32268 raft_consensus.cc:740] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.572762 32268 consensus_queue.cc:260] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.575037 32268 ts_tablet_manager.cc:1434] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:30.576354 32268 tablet_bootstrap.cc:492] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.605443 32268 tablet_bootstrap.cc:492] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.606585 32268 tablet_bootstrap.cc:492] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.607261 32268 ts_tablet_manager.cc:1403] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.008s
I20260709 12:14:30.609391 32268 raft_consensus.cc:359] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.609891 32268 raft_consensus.cc:740] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.610592 32268 consensus_queue.cc:260] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.612578 32268 ts_tablet_manager.cc:1434] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:14:30.613940 32268 tablet_bootstrap.cc:492] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.635819 32268 tablet_bootstrap.cc:492] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.636816 32268 tablet_bootstrap.cc:492] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.637501 32268 ts_tablet_manager.cc:1403] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 12:14:30.640079 32268 raft_consensus.cc:359] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.640877 32268 raft_consensus.cc:740] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.641707 32268 consensus_queue.cc:260] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.650419 32268 ts_tablet_manager.cc:1434] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:14:30.651470 32268 tablet_bootstrap.cc:492] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.667572 32268 tablet_bootstrap.cc:492] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.668414 32268 tablet_bootstrap.cc:492] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.669078 32268 ts_tablet_manager.cc:1403] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:14:30.671293 32268 raft_consensus.cc:359] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.672014 32268 raft_consensus.cc:740] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.672749 32268 consensus_queue.cc:260] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.674877 32268 ts_tablet_manager.cc:1434] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:14:30.676329 32268 tablet_bootstrap.cc:492] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.694113 32268 tablet_bootstrap.cc:492] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.695036 32268 tablet_bootstrap.cc:492] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.696365 32268 ts_tablet_manager.cc:1403] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:14:30.698668 32268 raft_consensus.cc:359] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.699234 32268 raft_consensus.cc:740] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.699966 32268 consensus_queue.cc:260] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.702203 32268 ts_tablet_manager.cc:1434] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:30.703461 32268 tablet_bootstrap.cc:492] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.721736 32268 tablet_bootstrap.cc:492] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.738195 32268 tablet_bootstrap.cc:492] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.738950 32268 ts_tablet_manager.cc:1403] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.004s
I20260709 12:14:30.741645 32268 raft_consensus.cc:359] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.742364 32268 raft_consensus.cc:740] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.742561 32327 raft_consensus.cc:3060] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.743069 32268 consensus_queue.cc:260] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.745339 32268 ts_tablet_manager.cc:1434] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:14:30.746749 32268 tablet_bootstrap.cc:492] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:30.755229 31404 consensus_peers.cc:597] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:30.772642 32268 tablet_bootstrap.cc:492] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.773929 32268 tablet_bootstrap.cc:492] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.774827 32268 ts_tablet_manager.cc:1403] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.000s
I20260709 12:14:30.777878 32268 raft_consensus.cc:359] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.778461 32268 raft_consensus.cc:740] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.779141 32268 consensus_queue.cc:260] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.780907 32268 ts_tablet_manager.cc:1434] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:30.781581 32268 tablet_bootstrap.cc:492] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.810616 32268 tablet_bootstrap.cc:492] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.811784 32268 tablet_bootstrap.cc:492] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.812983 32268 ts_tablet_manager.cc:1403] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.032s	user 0.028s	sys 0.003s
I20260709 12:14:30.814622 32327 raft_consensus.cc:3060] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:30.816345 32268 raft_consensus.cc:359] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.817284 32268 raft_consensus.cc:740] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.818181 32268 consensus_queue.cc:260] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.819839 32268 ts_tablet_manager.cc:1434] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:30.820919 32268 tablet_bootstrap.cc:492] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.844381 32268 tablet_bootstrap.cc:492] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.845724 32268 tablet_bootstrap.cc:492] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.846654 32268 ts_tablet_manager.cc:1403] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 12:14:30.851013 32268 raft_consensus.cc:359] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.851727 32268 raft_consensus.cc:740] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.852443 32268 consensus_queue.cc:260] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:30.854427 32268 ts_tablet_manager.cc:1434] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:30.855679 32268 tablet_bootstrap.cc:492] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.929998 32326 raft_consensus.cc:3060] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.959740 32268 tablet_bootstrap.cc:492] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.960862 32268 tablet_bootstrap.cc:492] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.961591 32268 ts_tablet_manager.cc:1403] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.021s
I20260709 12:14:30.964195 32268 raft_consensus.cc:359] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.964939 32268 raft_consensus.cc:740] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.965684 32268 consensus_queue.cc:260] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:30.968161 32268 ts_tablet_manager.cc:1434] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:14:30.969166 32268 tablet_bootstrap.cc:492] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:30.983888 32268 tablet_bootstrap.cc:492] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:30.984885 32268 tablet_bootstrap.cc:492] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:30.985612 32268 ts_tablet_manager.cc:1403] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:14:30.988579 32268 raft_consensus.cc:359] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.989451 32268 raft_consensus.cc:740] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.990357 32268 consensus_queue.cc:260] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:30.992499 32268 ts_tablet_manager.cc:1434] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:30.996676 32268 tablet_bootstrap.cc:492] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:31.007566 32329 raft_consensus.cc:3060] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:31.055253 32268 tablet_bootstrap.cc:492] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:31.057832 32268 tablet_bootstrap.cc:492] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:31.058564 32268 ts_tablet_manager.cc:1403] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.012s
I20260709 12:14:31.061023 32268 raft_consensus.cc:359] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:31.061689 32268 raft_consensus.cc:740] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.062328 32268 consensus_queue.cc:260] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:31.063829 32268 ts_tablet_manager.cc:1434] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:31.064574 32268 tablet_bootstrap.cc:492] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:31.078837 32268 tablet_bootstrap.cc:492] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:31.079902 32268 tablet_bootstrap.cc:492] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:31.080576 32268 ts_tablet_manager.cc:1403] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:14:31.083081 32268 raft_consensus.cc:359] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:31.083729 32268 raft_consensus.cc:740] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.084321 32268 consensus_queue.cc:260] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:31.086305 32268 ts_tablet_manager.cc:1434] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:31.088430 32268 tablet_bootstrap.cc:492] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
W20260709 12:14:31.097337 31330 consensus_peers.cc:597] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:31.110273 32268 tablet_bootstrap.cc:492] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:31.111399 32268 tablet_bootstrap.cc:492] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:31.112125 32268 ts_tablet_manager.cc:1403] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 12:14:31.118954 32268 raft_consensus.cc:359] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:31.119722 32268 raft_consensus.cc:740] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.120476 32268 consensus_queue.cc:260] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:31.122336 32268 ts_tablet_manager.cc:1434] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:14:31.123577 32268 tablet_bootstrap.cc:492] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:31.150183 32268 tablet_bootstrap.cc:492] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:31.151333 32268 tablet_bootstrap.cc:492] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:31.152000 32268 ts_tablet_manager.cc:1403] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.004s
I20260709 12:14:31.154624 32268 raft_consensus.cc:359] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:31.155251 32268 raft_consensus.cc:740] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.155961 32268 consensus_queue.cc:260] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:31.158356 32268 ts_tablet_manager.cc:1434] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:14:31.159190 32268 tablet_bootstrap.cc:492] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:31.212224 32268 tablet_bootstrap.cc:492] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:31.213533 32268 tablet_bootstrap.cc:492] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:31.215072 32268 ts_tablet_manager.cc:1403] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.019s
I20260709 12:14:31.218480 32268 raft_consensus.cc:359] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:31.219612 32268 raft_consensus.cc:740] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.221401 32268 consensus_queue.cc:260] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:31.224051 32268 ts_tablet_manager.cc:1434] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:14:31.225334 32268 tablet_bootstrap.cc:492] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap starting.
I20260709 12:14:31.243068 32268 tablet_bootstrap.cc:492] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:31.244320 32268 tablet_bootstrap.cc:492] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185: Bootstrap complete.
I20260709 12:14:31.245150 32268 ts_tablet_manager.cc:1403] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:14:31.248159 32268 raft_consensus.cc:359] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:31.248996 32268 raft_consensus.cc:740] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.249889 32268 consensus_queue.cc:260] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:31.253928 32268 ts_tablet_manager.cc:1434] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:31.265585 32330 raft_consensus.cc:3060] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:31.496553 32329 raft_consensus.cc:3060] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.015793 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:40.076015 31362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ebece119174df8b0065e09199cb74a"
dest_uuid: "56add4c904c74a1bba90579b9204e45d"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:34670
I20260709 12:14:40.076860 31362 raft_consensus.cc:606] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:40.080071 31362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "385e15f5c0b14702a8444e0e908bff77"
dest_uuid: "56add4c904c74a1bba90579b9204e45d"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:34670
I20260709 12:14:40.080834 31362 raft_consensus.cc:606] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:40.083184 31362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9"
dest_uuid: "56add4c904c74a1bba90579b9204e45d"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:34670
I20260709 12:14:40.083640 31362 raft_consensus.cc:606] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:40.098907 31436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052"
dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:32910
I20260709 12:14:40.099570 31436 raft_consensus.cc:606] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:40.129242 31508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39"
dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:33762
I20260709 12:14:40.129961 31508 raft_consensus.cc:606] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 2 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:40.134673 31362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb12da9e1bf4477cb726be970f4406e7"
dest_uuid: "56add4c904c74a1bba90579b9204e45d"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:34670
I20260709 12:14:40.136085 31362 raft_consensus.cc:606] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:40.137945 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:14:40.139771 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:40.141189 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:40.142993 32427 raft_consensus.cc:993] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.143527 32427 raft_consensus.cc:1081] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.145426 32326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60090
I20260709 12:14:40.146082 32326 raft_consensus.cc:493] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.146456 32326 raft_consensus.cc:3060] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.154294 32425 raft_consensus.cc:993] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.154838 32425 raft_consensus.cc:1081] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.158218 32330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ebece119174df8b0065e09199cb74a"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60090
I20260709 12:14:40.158808 32330 raft_consensus.cc:493] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.159163 32330 raft_consensus.cc:3060] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.159564 32326 raft_consensus.cc:515] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.178215 32326 leader_election.cc:290] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:40.180547 32427 raft_consensus.cc:993] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.181203 32427 raft_consensus.cc:1081] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.185146 32326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb12da9e1bf4477cb726be970f4406e7"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60090
I20260709 12:14:40.185705 32326 raft_consensus.cc:493] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.186050 32326 raft_consensus.cc:3060] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.187167 32330 raft_consensus.cc:515] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.191952 32421 raft_consensus.cc:993] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.192641 32421 raft_consensus.cc:1081] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.199263 32330 leader_election.cc:290] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:40.202268 32328 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60080
I20260709 12:14:40.203109 32328 raft_consensus.cc:493] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.203572 32328 raft_consensus.cc:3060] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.219161 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:40.220067 31436 raft_consensus.cc:3060] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.219846 32326 raft_consensus.cc:515] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:40.221213 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ebece119174df8b0065e09199cb74a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:40.222030 31435 raft_consensus.cc:3060] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.229555 32326 leader_election.cc:290] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:40.247644 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb12da9e1bf4477cb726be970f4406e7" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:40.248248 31509 raft_consensus.cc:3060] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.255633 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d315efa422c24fa4a72ad1fc98375dc9" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:40.256305 31362 raft_consensus.cc:3055] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.256454 31509 raft_consensus.cc:2468] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:40.256659 31362 raft_consensus.cc:740] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:40.257251 31360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb12da9e1bf4477cb726be970f4406e7" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:40.258042 31360 raft_consensus.cc:3055] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.257647 31362 consensus_queue.cc:260] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.258363 31360 raft_consensus.cc:740] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:40.259172 31362 raft_consensus.cc:3060] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.259449 31360 consensus_queue.cc:260] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:40.261941 31357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ebece119174df8b0065e09199cb74a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:40.262537 31357 raft_consensus.cc:3055] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.262820 31357 raft_consensus.cc:740] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:40.263616 31357 consensus_queue.cc:260] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.265434 31360 raft_consensus.cc:3060] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.268378 32263 leader_election.cc:304] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:40.273953 31357 raft_consensus.cc:3060] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.277285 32328 raft_consensus.cc:515] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.282202 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:40.282930 31361 raft_consensus.cc:3060] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.283061 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3247f0fa74413892d5db3bbb4bb052" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:40.283774 31432 raft_consensus.cc:3055] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.284070 31432 raft_consensus.cc:740] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:40.287235 31432 consensus_queue.cc:260] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.289937 31432 raft_consensus.cc:3060] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.294137 32428 raft_consensus.cc:993] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.294740 32428 raft_consensus.cc:1081] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 2 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.296698 32329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60098
I20260709 12:14:40.297341 32329 raft_consensus.cc:493] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.297756 32329 raft_consensus.cc:3060] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.300427 31360 raft_consensus.cc:2468] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:40.306865 31361 raft_consensus.cc:2468] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:40.307669 31436 raft_consensus.cc:2468] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:40.308421 32262 leader_election.cc:304] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d; no voters: 
I20260709 12:14:40.309790 32264 leader_election.cc:304] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:40.297772 31435 raft_consensus.cc:2468] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:40.320281 32443 raft_consensus.cc:2804] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.322286 32264 leader_election.cc:304] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:40.322499 32444 raft_consensus.cc:2804] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.323812 31432 raft_consensus.cc:2468] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:40.324088 32445 raft_consensus.cc:2804] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.324540 32328 leader_election.cc:290] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:40.325122 32443 raft_consensus.cc:697] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:40.325816 31357 raft_consensus.cc:2468] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:40.326663 31362 raft_consensus.cc:2468] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
W20260709 12:14:40.329623 32263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.196:42171, user_credentials={real_user=slave}} blocked reactor thread for 61500.1us
I20260709 12:14:40.334750 32443 consensus_queue.cc:237] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:40.331032 32442 raft_consensus.cc:2804] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.337006 32442 raft_consensus.cc:697] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:40.331816 32329 raft_consensus.cc:515] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:40.334316 32445 raft_consensus.cc:697] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:40.337985 32442 consensus_queue.cc:237] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.339357 32445 consensus_queue.cc:237] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.340207 32329 leader_election.cc:290] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 3 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:40.343250 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:40.344172 31432 raft_consensus.cc:3060] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.345188 32444 raft_consensus.cc:697] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:40.348229 32444 consensus_queue.cc:237] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.355971 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed36eebaa333457eb2e68c91b95afb39" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:40.356585 31508 raft_consensus.cc:3055] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:40.356875 31508 raft_consensus.cc:740] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:40.357723 31508 consensus_queue.cc:260] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:40.359061 31508 raft_consensus.cc:3060] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.366568 31508 raft_consensus.cc:2468] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 3.
I20260709 12:14:40.372424 31184 catalog_manager.cc:5697] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 1 to 2, leader changed from 56add4c904c74a1bba90579b9204e45d (127.20.102.194) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.382048 32263 leader_election.cc:304] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:40.366833 31432 raft_consensus.cc:2468] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 3.
I20260709 12:14:40.383683 32444 raft_consensus.cc:2804] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:40.384287 32444 raft_consensus.cc:697] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:40.385653 32444 consensus_queue.cc:237] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:40.413110 31184 catalog_manager.cc:5697] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 1 to 2, leader changed from d5caa720fddf4dd3958f076ff03df8da (127.20.102.195) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.414494 31184 catalog_manager.cc:5697] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 1 to 2, leader changed from 56add4c904c74a1bba90579b9204e45d (127.20.102.194) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.415596 31184 catalog_manager.cc:5697] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 1 to 2, leader changed from 56add4c904c74a1bba90579b9204e45d (127.20.102.194) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.416635 31184 catalog_manager.cc:5697] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 2 to 3, leader changed from a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:40.703580 32433 raft_consensus.cc:993] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.704092 32427 raft_consensus.cc:1081] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:40.705739 32327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "385e15f5c0b14702a8444e0e908bff77"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60090
I20260709 12:14:40.706476 32327 raft_consensus.cc:493] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.706852 32327 raft_consensus.cc:3060] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.713136 32327 raft_consensus.cc:515] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.715319 32327 leader_election.cc:290] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203)
I20260709 12:14:40.715939 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385e15f5c0b14702a8444e0e908bff77" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:40.716529 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385e15f5c0b14702a8444e0e908bff77" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:40.716692 31432 raft_consensus.cc:3060] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.717187 31362 raft_consensus.cc:3055] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.717556 31362 raft_consensus.cc:740] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:40.723022 31362 consensus_queue.cc:260] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.724473 31362 raft_consensus.cc:3060] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.730023 31361 raft_consensus.cc:1275] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.731496 32444 consensus_queue.cc:1048] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.732934 31432 raft_consensus.cc:2468] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:40.734449 32264 leader_election.cc:304] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:40.735560 32444 raft_consensus.cc:2804] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.736056 32444 raft_consensus.cc:697] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:40.737447 31362 raft_consensus.cc:2468] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:40.738902 32444 consensus_queue.cc:237] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } }
I20260709 12:14:40.750358 31435 raft_consensus.cc:1275] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.752452 32445 consensus_queue.cc:1048] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:40.772974 31436 raft_consensus.cc:1275] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.772609 31187 catalog_manager.cc:5697] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 1 to 2, leader changed from 56add4c904c74a1bba90579b9204e45d (127.20.102.194) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.778023 32445 consensus_queue.cc:1048] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.791520 31362 raft_consensus.cc:1275] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.793417 32444 consensus_queue.cc:1048] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.806761 31361 raft_consensus.cc:1275] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.808310 32447 consensus_queue.cc:1048] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:40.837311 31432 raft_consensus.cc:1275] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.839218 32447 consensus_queue.cc:1048] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.870291 31509 raft_consensus.cc:1275] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.871687 32447 consensus_queue.cc:1048] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.881055 31432 raft_consensus.cc:1275] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:40.885258 32447 consensus_queue.cc:1048] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:40.931301 31361 raft_consensus.cc:1275] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.932515 31508 raft_consensus.cc:1275] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:40.934417 32447 consensus_queue.cc:1048] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:40.936480 32445 consensus_queue.cc:1048] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:41.179814 31432 raft_consensus.cc:1275] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:41.181450 32447 consensus_queue.cc:1048] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:41.192992 31361 raft_consensus.cc:1275] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:41.194583 32445 consensus_queue.cc:1048] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:41.218523 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:41.265261 31509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0191640019a84d1c9ec1470b18a33641"
dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:33762
I20260709 12:14:41.265846 31509 raft_consensus.cc:606] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:41.268410 31509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04626a79b549449386652742229e800a"
dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:33762
I20260709 12:14:41.269151 31509 raft_consensus.cc:606] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:41.272105 31509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27155e412e29424db98323b0a5e9d620"
dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
mode: GRACEFUL
new_leader_uuid: "d5caa720fddf4dd3958f076ff03df8da"
 from {username='slave'} at 127.0.0.1:33762
I20260709 12:14:41.272670 31509 raft_consensus.cc:606] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Received request to transfer leadership to TS d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:41.285529 31509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60"
dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:33762
I20260709 12:14:41.286324 31509 raft_consensus.cc:606] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:41.289057 31509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6"
dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
mode: GRACEFUL
new_leader_uuid: "56add4c904c74a1bba90579b9204e45d"
 from {username='slave'} at 127.0.0.1:33762
I20260709 12:14:41.289696 31509 raft_consensus.cc:606] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Received request to transfer leadership to TS 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:41.291064 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:41.292582 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:41.293269 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:41.484990 32428 raft_consensus.cc:993] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:41.485456 32304 raft_consensus.cc:1081] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:41.486892 32327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60098
I20260709 12:14:41.487433 32327 raft_consensus.cc:493] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:41.487730 32327 raft_consensus.cc:3060] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.492746 32327 raft_consensus.cc:515] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:41.494154 32327 leader_election.cc:290] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:41.495095 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:41.495270 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e9e7b1921647a199c915cb27208e60" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:41.495625 31432 raft_consensus.cc:3060] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.495986 31508 raft_consensus.cc:3055] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:41.496284 31508 raft_consensus.cc:740] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:41.497166 31508 consensus_queue.cc:260] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:41.498462 31508 raft_consensus.cc:3060] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.501157 31432 raft_consensus.cc:2468] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:41.502501 32264 leader_election.cc:304] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:41.503250 32447 raft_consensus.cc:2804] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:41.503669 32447 raft_consensus.cc:697] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:41.504559 32447 consensus_queue.cc:237] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:41.505033 31508 raft_consensus.cc:2468] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:41.514575 31185 catalog_manager.cc:5697] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 1 to 2, leader changed from a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.522557 32428 raft_consensus.cc:993] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:41.523178 32304 raft_consensus.cc:1081] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:41.526669 32327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0191640019a84d1c9ec1470b18a33641"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60098
I20260709 12:14:41.527232 32327 raft_consensus.cc:493] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:41.527591 32327 raft_consensus.cc:3060] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.537842 32327 raft_consensus.cc:515] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:41.539660 32327 leader_election.cc:290] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:41.540503 31432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191640019a84d1c9ec1470b18a33641" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:41.540705 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0191640019a84d1c9ec1470b18a33641" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:41.541285 31432 raft_consensus.cc:3060] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.541469 31508 raft_consensus.cc:3055] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:41.541906 31508 raft_consensus.cc:740] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:41.542688 31508 consensus_queue.cc:260] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:41.543779 31508 raft_consensus.cc:3060] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.549961 31508 raft_consensus.cc:2468] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:41.550544 31432 raft_consensus.cc:2468] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:41.551048 32263 leader_election.cc:304] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:41.552162 32445 raft_consensus.cc:2804] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:41.552729 32445 raft_consensus.cc:697] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:41.553853 32445 consensus_queue.cc:237] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:41.565855 31185 catalog_manager.cc:5697] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 1 to 2, leader changed from a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.684350 32304 raft_consensus.cc:993] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c: : Instructing follower d5caa720fddf4dd3958f076ff03df8da to start an election
I20260709 12:14:41.684857 32428 raft_consensus.cc:1081] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Signalling peer d5caa720fddf4dd3958f076ff03df8da to start an election
I20260709 12:14:41.686805 31432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27155e412e29424db98323b0a5e9d620"
dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:14:41.687467 31432 raft_consensus.cc:493] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:41.687809 31432 raft_consensus.cc:3060] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.698074 31432 raft_consensus.cc:515] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:41.700755 31432 leader_election.cc:290] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Requested vote from peers 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:41.701450 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27155e412e29424db98323b0a5e9d620" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:41.701885 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27155e412e29424db98323b0a5e9d620" candidate_uuid: "d5caa720fddf4dd3958f076ff03df8da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:41.702191 31362 raft_consensus.cc:3060] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.702553 31508 raft_consensus.cc:3055] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:41.702960 31508 raft_consensus.cc:740] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:41.703840 31508 consensus_queue.cc:260] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:41.705011 31508 raft_consensus.cc:3060] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.708351 31362 raft_consensus.cc:2468] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 2.
I20260709 12:14:41.709803 31401 leader_election.cc:304] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:41.710532 32481 raft_consensus.cc:2804] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:41.711109 32481 raft_consensus.cc:697] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Becoming Leader. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:41.712023 32481 consensus_queue.cc:237] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:41.712914 31508 raft_consensus.cc:2468] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5caa720fddf4dd3958f076ff03df8da in term 2.
I20260709 12:14:41.721967 31185 catalog_manager.cc:5697] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da reported cstate change: term changed from 1 to 2, leader changed from a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196) to d5caa720fddf4dd3958f076ff03df8da (127.20.102.195). New cstate: current_term: 2 leader_uuid: "d5caa720fddf4dd3958f076ff03df8da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:41.782344 32304 raft_consensus.cc:993] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:41.782984 32428 raft_consensus.cc:1081] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:41.785310 32327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04626a79b549449386652742229e800a"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60098
I20260709 12:14:41.785910 32327 raft_consensus.cc:493] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:41.786260 32327 raft_consensus.cc:3060] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.794241 32327 raft_consensus.cc:515] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:41.796468 32327 leader_election.cc:290] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:41.796986 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04626a79b549449386652742229e800a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:41.797034 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04626a79b549449386652742229e800a" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:41.797901 31435 raft_consensus.cc:3060] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.797945 31508 raft_consensus.cc:3055] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:41.798449 31508 raft_consensus.cc:740] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:41.799265 31508 consensus_queue.cc:260] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:41.800876 31508 raft_consensus.cc:3060] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.806655 31435 raft_consensus.cc:2468] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:41.807183 31508 raft_consensus.cc:2468] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:41.808034 32264 leader_election.cc:304] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:41.809481 32445 raft_consensus.cc:2804] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:41.810029 32445 raft_consensus.cc:697] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:41.810853 32445 consensus_queue.cc:237] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:41.822513 31185 catalog_manager.cc:5697] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 1 to 2, leader changed from a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.867400 32304 raft_consensus.cc:993] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c: : Instructing follower 56add4c904c74a1bba90579b9204e45d to start an election
I20260709 12:14:41.867950 32428 raft_consensus.cc:1081] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Signalling peer 56add4c904c74a1bba90579b9204e45d to start an election
I20260709 12:14:41.869457 31362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6"
dest_uuid: "56add4c904c74a1bba90579b9204e45d"
 from {username='slave'} at 127.0.0.1:58250
I20260709 12:14:41.869892 31362 raft_consensus.cc:493] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:41.870131 31362 raft_consensus.cc:3060] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.874882 31362 raft_consensus.cc:515] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:41.876663 31362 leader_election.cc:290] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:41.877740 31435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:41.877754 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab5b9c556a42dbba099f8a42b496f6" candidate_uuid: "56add4c904c74a1bba90579b9204e45d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:41.878522 31435 raft_consensus.cc:3060] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.878631 31508 raft_consensus.cc:3055] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:41.879060 31508 raft_consensus.cc:740] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:41.879825 31508 consensus_queue.cc:260] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:41.881122 31508 raft_consensus.cc:3060] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:41.888856 31508 raft_consensus.cc:2468] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 2.
I20260709 12:14:41.890027 31328 leader_election.cc:304] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56add4c904c74a1bba90579b9204e45d, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:41.890857 32427 raft_consensus.cc:2804] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:41.890872 31435 raft_consensus.cc:2468] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56add4c904c74a1bba90579b9204e45d in term 2.
I20260709 12:14:41.891532 32427 raft_consensus.cc:697] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 2 LEADER]: Becoming Leader. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:41.892936 32427 consensus_queue.cc:237] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } }
I20260709 12:14:41.912146 31185 catalog_manager.cc:5697] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d reported cstate change: term changed from 1 to 2, leader changed from a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196) to 56add4c904c74a1bba90579b9204e45d (127.20.102.194). New cstate: current_term: 2 leader_uuid: "56add4c904c74a1bba90579b9204e45d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:41.946306 31435 raft_consensus.cc:1275] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:41.946911 31509 raft_consensus.cc:1275] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:41.948176 32445 consensus_queue.cc:1048] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:41.949139 32442 consensus_queue.cc:1048] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:41.989296 31432 raft_consensus.cc:1275] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:41.995227 32442 consensus_queue.cc:1048] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:42.006247 31509 raft_consensus.cc:1275] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:42.013477 32442 consensus_queue.cc:1048] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:42.162571 31509 raft_consensus.cc:1275] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer d5caa720fddf4dd3958f076ff03df8da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:42.163960 32481 consensus_queue.cc:1048] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:42.167287 31362 raft_consensus.cc:1275] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer d5caa720fddf4dd3958f076ff03df8da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:42.170912 32421 consensus_queue.cc:1048] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:42.327771 31509 raft_consensus.cc:1275] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer 56add4c904c74a1bba90579b9204e45d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:42.329370 32485 consensus_queue.cc:1048] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:42.331722 31509 raft_consensus.cc:1275] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:42.332721 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:42.333756 32489 consensus_queue.cc:1048] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:42.354429 31435 raft_consensus.cc:1275] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Refusing update from remote peer 56add4c904c74a1bba90579b9204e45d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:42.357005 32485 consensus_queue.cc:1048] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:42.360400 31435 raft_consensus.cc:1275] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:42.362236 32490 consensus_queue.cc:1048] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:42.423377 31509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc"
dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:33762
I20260709 12:14:42.424134 31509 raft_consensus.cc:606] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:42.427582 31361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8"
dest_uuid: "56add4c904c74a1bba90579b9204e45d"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:34670
I20260709 12:14:42.428241 31361 raft_consensus.cc:606] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:42.431313 31509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0"
dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:33762
I20260709 12:14:42.431836 31509 raft_consensus.cc:606] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:42.434912 31436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1"
dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:32910
I20260709 12:14:42.435501 31436 raft_consensus.cc:606] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 5 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:42.439209 31509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0"
dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
mode: GRACEFUL
new_leader_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:33762
I20260709 12:14:42.439759 31509 raft_consensus.cc:606] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 LEADER]: Received request to transfer leadership to TS 0769d57e6db04b2f86703e0ed60f6185
I20260709 12:14:42.440982 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:42.442410 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:42.443123 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:42.464517 32304 raft_consensus.cc:993] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:42.465174 32304 raft_consensus.cc:1081] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:42.468036 32328 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60098
I20260709 12:14:42.468966 32328 raft_consensus.cc:493] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:42.470186 32328 raft_consensus.cc:3060] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:42.471812 32428 raft_consensus.cc:993] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:42.472570 32428 raft_consensus.cc:1081] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:42.474390 32327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60098
I20260709 12:14:42.474943 32327 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:42.475345 32327 raft_consensus.cc:3060] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:42.479617 32485 raft_consensus.cc:993] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:42.480260 32485 raft_consensus.cc:1081] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:42.483166 32327 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:42.484488 32329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60090
I20260709 12:14:42.485363 32329 raft_consensus.cc:493] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:42.485726 32329 raft_consensus.cc:3060] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:42.497264 32328 raft_consensus.cc:515] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:42.499711 32328 leader_election.cc:290] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 4 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:42.500388 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:42.501042 32327 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 4 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:42.501156 31436 raft_consensus.cc:3060] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:42.501861 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:42.502615 31508 raft_consensus.cc:3055] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:42.499917 32329 raft_consensus.cc:515] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:42.503008 31508 raft_consensus.cc:740] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:42.503522 31361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb3d3e1eb4043a8b0c90c5b76a60ac0" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:42.504040 31508 consensus_queue.cc:260] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:42.505857 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:42.506587 31511 raft_consensus.cc:3060] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:42.506950 31508 raft_consensus.cc:3060] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:42.503563 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a957f943814a47b2be47b8491e63b5c0" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:42.508342 31509 raft_consensus.cc:3055] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:42.508684 31509 raft_consensus.cc:740] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:42.512259 31509 consensus_queue.cc:260] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:42.504141 31361 raft_consensus.cc:3060] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:42.513651 31509 raft_consensus.cc:3060] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:42.514920 32329 leader_election.cc:290] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Requested vote from peers a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:42.517079 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f73b173ebeb4e0092ede2f6573824e8" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56add4c904c74a1bba90579b9204e45d"
I20260709 12:14:42.517717 31362 raft_consensus.cc:3055] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:42.518011 31362 raft_consensus.cc:740] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56add4c904c74a1bba90579b9204e45d, State: Running, Role: LEADER
I20260709 12:14:42.518813 31362 consensus_queue.cc:260] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:42.520136 31362 raft_consensus.cc:3060] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:42.520133 31511 raft_consensus.cc:2468] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:42.522166 32263 leader_election.cc:304] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:42.523172 32489 raft_consensus.cc:2804] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:42.525532 32489 raft_consensus.cc:697] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:42.526515 32489 consensus_queue.cc:237] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:42.520921 31436 raft_consensus.cc:2468] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 4.
I20260709 12:14:42.531421 31508 raft_consensus.cc:2468] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 4.
I20260709 12:14:42.531919 32264 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:42.533316 32263 leader_election.cc:304] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:42.535562 31509 raft_consensus.cc:2468] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 4.
I20260709 12:14:42.537178 32442 raft_consensus.cc:2804] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:42.537593 32490 raft_consensus.cc:2804] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:42.537781 32442 raft_consensus.cc:697] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:42.538858 32442 consensus_queue.cc:237] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:42.545468 32490 raft_consensus.cc:697] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:42.546700 32490 consensus_queue.cc:237] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:42.547878 31361 raft_consensus.cc:2468] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 4.
I20260709 12:14:42.560798 32481 raft_consensus.cc:993] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:42.561395 32481 raft_consensus.cc:1081] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 5 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:42.563796 31362 raft_consensus.cc:2468] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:42.564945 32329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60080
I20260709 12:14:42.568362 32329 raft_consensus.cc:493] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:42.568686 32329 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:42.573143 31186 catalog_manager.cc:5697] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 1 to 2, leader changed from 56add4c904c74a1bba90579b9204e45d (127.20.102.194) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.574122 32329 raft_consensus.cc:515] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:42.576109 32329 leader_election.cc:290] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 6 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:42.577097 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:42.577762 31436 raft_consensus.cc:3055] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:42.578048 31436 raft_consensus.cc:740] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d5caa720fddf4dd3958f076ff03df8da, State: Running, Role: LEADER
I20260709 12:14:42.578822 31436 consensus_queue.cc:260] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:42.579921 31436 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:42.577133 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddfe25b91d214455814522b83bc111d1" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:42.583168 31509 raft_consensus.cc:3060] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:42.586285 31436 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 6.
I20260709 12:14:42.588201 32264 leader_election.cc:304] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da; no voters: 
I20260709 12:14:42.589409 32489 raft_consensus.cc:2804] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:42.589942 32489 raft_consensus.cc:697] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 6 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:42.589917 31509 raft_consensus.cc:2468] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 6.
I20260709 12:14:42.591392 32489 consensus_queue.cc:237] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:42.605994 31186 catalog_manager.cc:5697] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 3 to 4, leader changed from a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 4 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.607332 31186 catalog_manager.cc:5697] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 3 to 4, leader changed from a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 4 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.608426 31186 catalog_manager.cc:5697] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 5 to 6, leader changed from d5caa720fddf4dd3958f076ff03df8da (127.20.102.195) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 6 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.704979 32428 raft_consensus.cc:993] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c: : Instructing follower 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:42.706301 32475 raft_consensus.cc:1081] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Signalling peer 0769d57e6db04b2f86703e0ed60f6185 to start an election
I20260709 12:14:42.708004 32329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc"
dest_uuid: "0769d57e6db04b2f86703e0ed60f6185"
 from {username='slave'} at 127.0.0.1:60098
I20260709 12:14:42.708676 32329 raft_consensus.cc:493] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:42.709069 32329 raft_consensus.cc:3060] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:42.715974 32329 raft_consensus.cc:515] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:42.718502 32329 leader_election.cc:290] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Requested vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196:42171)
I20260709 12:14:42.718868 31436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5caa720fddf4dd3958f076ff03df8da"
I20260709 12:14:42.719131 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e16b0bb459e4dcf906ddc86d14187bc" candidate_uuid: "0769d57e6db04b2f86703e0ed60f6185" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a209a5d7b61542d885ef601e8bcaa26c"
I20260709 12:14:42.719719 31436 raft_consensus.cc:3060] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:42.719820 31509 raft_consensus.cc:3055] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:42.720175 31509 raft_consensus.cc:740] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a209a5d7b61542d885ef601e8bcaa26c, State: Running, Role: LEADER
I20260709 12:14:42.720890 31509 consensus_queue.cc:260] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:42.722150 31509 raft_consensus.cc:3060] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:42.731969 31509 raft_consensus.cc:2468] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:42.733220 32263 leader_election.cc:304] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0769d57e6db04b2f86703e0ed60f6185, a209a5d7b61542d885ef601e8bcaa26c; no voters: 
I20260709 12:14:42.734076 32489 raft_consensus.cc:2804] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:42.734604 32489 raft_consensus.cc:697] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Becoming Leader. State: Replica: 0769d57e6db04b2f86703e0ed60f6185, State: Running, Role: LEADER
I20260709 12:14:42.735599 32489 consensus_queue.cc:237] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:42.737541 31436 raft_consensus.cc:2468] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0769d57e6db04b2f86703e0ed60f6185 in term 2.
I20260709 12:14:42.745918 31186 catalog_manager.cc:5697] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 reported cstate change: term changed from 1 to 2, leader changed from a209a5d7b61542d885ef601e8bcaa26c (127.20.102.196) to 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "0769d57e6db04b2f86703e0ed60f6185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.917431 31508 raft_consensus.cc:1275] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:42.919626 32490 consensus_queue.cc:1048] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:42.935685 31362 raft_consensus.cc:1275] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:42.938063 32490 consensus_queue.cc:1048] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:42.974128 31432 raft_consensus.cc:1275] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 4 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:42.975744 32490 consensus_queue.cc:1048] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:42.990321 31508 raft_consensus.cc:1275] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:42.991895 32490 consensus_queue.cc:1048] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:42.998589 31361 raft_consensus.cc:1275] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 4 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:43.002664 32489 consensus_queue.cc:1048] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:43.004922 31508 raft_consensus.cc:1275] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:43.007330 32489 consensus_queue.cc:1048] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:43.036650 31508 raft_consensus.cc:1275] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 6 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:43.038518 32489 consensus_queue.cc:1048] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:43.060595 31436 raft_consensus.cc:1275] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 6 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:43.062158 32442 consensus_queue.cc:1048] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:43.140612 31436 raft_consensus.cc:1275] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:43.141992 32442 consensus_queue.cc:1048] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:43.152545 31508 raft_consensus.cc:1275] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Refusing update from remote peer 0769d57e6db04b2f86703e0ed60f6185: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:43.154484 32489 consensus_queue.cc:1048] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:43.493907 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:43.530457 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:43.532150 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:43.532891 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:43.569082 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:43.605329 20891 tablet_server.cc:179] TabletServer@127.20.102.193:45623 shutting down...
W20260709 12:14:43.613376 31404 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 84 similar messages]
W20260709 12:14:43.645143 31330 consensus_peers.cc:597] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:43.650792 31404 consensus_peers.cc:597] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:43.659968 31478 consensus_peers.cc:597] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:43.674678 31478 consensus_peers.cc:597] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:43.683681 31330 consensus_peers.cc:597] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.690189 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:43.691169 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.692076 20891 raft_consensus.cc:2243] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.692621 20891 raft_consensus.cc:2272] T bb35e6f710fb417fba28d448bf7cc140 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.695052 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.695716 20891 raft_consensus.cc:2243] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.696518 20891 raft_consensus.cc:2272] T 77e9e7b1921647a199c915cb27208e60 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.698570 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.699173 20891 raft_consensus.cc:2243] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.699993 20891 raft_consensus.cc:2272] T d315efa422c24fa4a72ad1fc98375dc9 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.701918 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.702555 20891 raft_consensus.cc:2243] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.702934 20891 raft_consensus.cc:2272] T 3110254469cd41d2bc5addd8675f1ddd P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.704887 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.705613 20891 raft_consensus.cc:2243] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.706513 20891 raft_consensus.cc:2272] T 04626a79b549449386652742229e800a P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.708956 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.709700 20891 raft_consensus.cc:2243] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.710191 20891 raft_consensus.cc:2272] T ebdc9dd0bb6b443791a0ffbe39829943 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.713043 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.713871 20891 raft_consensus.cc:2243] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.714294 20891 raft_consensus.cc:2272] T 521c6b0664a14a35a1eca5919b44637f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.716333 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.716980 20891 raft_consensus.cc:2243] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.717408 20891 raft_consensus.cc:2272] T 95ee9c20206541cf9fdc5d65759ce8e9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.719516 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.720124 20891 raft_consensus.cc:2243] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.720598 20891 raft_consensus.cc:2272] T 08e23c1349714ee8b522e1b92accebc2 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.722630 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.723218 20891 raft_consensus.cc:2243] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.723598 20891 raft_consensus.cc:2272] T a31c0489c4404a649554f01c10277574 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.725970 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.726692 20891 raft_consensus.cc:2243] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.727473 20891 raft_consensus.cc:2272] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.731195 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.732015 20891 raft_consensus.cc:2243] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.732636 20891 raft_consensus.cc:2272] T efbd74b64bc44ffea43757f3bdbfe1c3 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.735395 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.736061 20891 raft_consensus.cc:2243] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.736987 20891 raft_consensus.cc:2272] T 6f73b173ebeb4e0092ede2f6573824e8 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.737082 31404 consensus_peers.cc:597] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.740131 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.740887 20891 raft_consensus.cc:2243] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.741364 20891 raft_consensus.cc:2272] T 8603c16c544a4d349593068e0a1788fa P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.743846 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.744619 20891 raft_consensus.cc:2243] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.745080 20891 raft_consensus.cc:2272] T 6ada87845b524af0b51a486204b74b96 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.747967 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.748831 20891 raft_consensus.cc:2243] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.749752 20891 raft_consensus.cc:2272] T a957f943814a47b2be47b8491e63b5c0 P 0769d57e6db04b2f86703e0ed60f6185 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.750391 31404 consensus_peers.cc:597] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.752645 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.753468 20891 raft_consensus.cc:2243] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.754011 20891 raft_consensus.cc:2272] T f4d045764fb04dbc819b8f88e9bb085f P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.756574 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.757475 20891 raft_consensus.cc:2243] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.757997 20891 raft_consensus.cc:2272] T 30451bcaa4ca44f992ef5f47be40eda9 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.760116 31478 consensus_peers.cc:597] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:43.761662 31330 consensus_peers.cc:597] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.763942 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.764818 20891 raft_consensus.cc:2243] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.765771 20891 raft_consensus.cc:2272] T 385e15f5c0b14702a8444e0e908bff77 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.768560 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.769384 20891 raft_consensus.cc:2243] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.769878 20891 raft_consensus.cc:2272] T 17f21568498d48caad98d644ce34352a P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.772710 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.773485 20891 raft_consensus.cc:2243] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.774530 20891 raft_consensus.cc:2272] T ed36eebaa333457eb2e68c91b95afb39 P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.776896 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.777684 20891 raft_consensus.cc:2243] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:43.777894 31330 consensus_peers.cc:597] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.778263 20891 raft_consensus.cc:2272] T d502420b9f304f568a686ba8cdb9ae80 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.781294 20891 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:43.781630 31478 consensus_peers.cc:597] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.781972 20891 raft_consensus.cc:2243] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.782533 20891 raft_consensus.cc:2272] T 3043ea4e7aac4914af456073b1b6a33c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.784693 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.785409 20891 raft_consensus.cc:2243] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.786197 20891 raft_consensus.cc:2272] T fb12da9e1bf4477cb726be970f4406e7 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.788755 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.789402 20891 raft_consensus.cc:2243] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.789973 20891 raft_consensus.cc:2272] T fdc78b9bfcf344f389246d2a9db1c5eb P 0769d57e6db04b2f86703e0ed60f6185 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.793329 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.794159 20891 raft_consensus.cc:2243] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.794711 20891 raft_consensus.cc:2272] T b21175df55ee43caab9a53db893f84a5 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.795536 31330 consensus_peers.cc:597] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.798028 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.798840 20891 raft_consensus.cc:2243] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.799316 20891 raft_consensus.cc:2272] T 75927c3304e84b06a5ca9baf08eda6f6 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.801124 31404 consensus_peers.cc:597] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.802368 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.803354 20891 raft_consensus.cc:2243] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.804122 20891 raft_consensus.cc:2272] T ddfe25b91d214455814522b83bc111d1 P 0769d57e6db04b2f86703e0ed60f6185 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.807650 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.808385 20891 raft_consensus.cc:2243] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.808983 20891 raft_consensus.cc:2272] T 7ead5d3f281f4adb8e218fc8979158f2 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.811764 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.812659 20891 raft_consensus.cc:2243] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.814330 20891 raft_consensus.cc:2272] T 49cdc6c4a86a4b57b1df61deb0767165 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.815354 31404 consensus_peers.cc:597] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.817257 20891 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:43.818295 31330 consensus_peers.cc:597] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.818579 20891 raft_consensus.cc:2243] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:14:43.819160 31478 consensus_peers.cc:597] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.819547 20891 raft_consensus.cc:2272] T 0191640019a84d1c9ec1470b18a33641 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.819911 31478 consensus_peers.cc:597] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.822569 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.823339 20891 raft_consensus.cc:2243] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.823817 20891 raft_consensus.cc:2272] T 8ab02fdbdd944bfab62c752b0636f82c P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.824293 31478 consensus_peers.cc:597] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.826377 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.827003 20891 raft_consensus.cc:2243] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.827931 20891 raft_consensus.cc:2272] T ea3247f0fa74413892d5db3bbb4bb052 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.830925 20891 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:43.831593 31478 consensus_peers.cc:597] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.831635 20891 raft_consensus.cc:2243] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.833853 20891 raft_consensus.cc:2272] T 1e16b0bb459e4dcf906ddc86d14187bc P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.836246 31330 consensus_peers.cc:597] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.837636 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.838512 20891 raft_consensus.cc:2243] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:43.838719 31404 consensus_peers.cc:597] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.838979 20891 raft_consensus.cc:2272] T 53171289fe984298815d6d30885bf378 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.841841 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.842362 20891 raft_consensus.cc:2243] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.842706 20891 raft_consensus.cc:2272] T 8a490d738b8e443a857242c089199946 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.844697 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.845265 20891 raft_consensus.cc:2243] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.845712 20891 raft_consensus.cc:2272] T 641ff77e975546a1824207bab77c2788 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.848176 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.848891 20891 raft_consensus.cc:2243] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.849346 20891 raft_consensus.cc:2272] T feb5c33d2a8a4010b336be5c5c4635cc P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.849725 31404 consensus_peers.cc:597] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.851619 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.852150 20891 raft_consensus.cc:2243] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.852505 20891 raft_consensus.cc:2272] T 215d8d9803624fe3b90591e545bf5024 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.854614 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.855288 20891 raft_consensus.cc:2243] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.855792 20891 raft_consensus.cc:2272] T 4977dacca462483d9bc0b0929a806d10 P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.858587 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.859242 20891 raft_consensus.cc:2243] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.860148 20891 raft_consensus.cc:2272] T 02ebece119174df8b0065e09199cb74a P 0769d57e6db04b2f86703e0ed60f6185 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.861202 31478 consensus_peers.cc:597] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.862632 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.863503 20891 raft_consensus.cc:2243] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.864029 20891 raft_consensus.cc:2272] T 050680dae66642369827ee0318291dac P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.866447 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.866884 20891 raft_consensus.cc:2243] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.867307 20891 raft_consensus.cc:2272] T ad60c538b49e4a5fb4fa276ea5b25314 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.869926 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.870628 20891 raft_consensus.cc:2243] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.871129 20891 raft_consensus.cc:2272] T d3a4e71f02b84b77a615d593e2bd3597 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.871518 31330 consensus_peers.cc:597] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.873689 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:43.874406 20891 raft_consensus.cc:2243] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.874832 20891 raft_consensus.cc:2272] T eb07b495c85d4de88b7c752f4a6f7ee7 P 0769d57e6db04b2f86703e0ed60f6185 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.940239 31330 consensus_peers.cc:597] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:43.940723 31330 consensus_peers.cc:597] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:43.951731 20891 tablet_server.cc:196] TabletServer@127.20.102.193:45623 shutdown complete.
W20260709 12:14:43.952174 31330 consensus_peers.cc:597] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:43.990130 31404 consensus_peers.cc:597] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:43.995765 31330 consensus_peers.cc:597] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:44.010751 31404 consensus_peers.cc:597] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.066298 20891 tablet_server.cc:179] TabletServer@127.20.102.194:0 shutting down...
W20260709 12:14:44.088894 31478 consensus_peers.cc:597] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Couldn't send request to peer 0769d57e6db04b2f86703e0ed60f6185. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:44.143750 31401 consensus_peers.cc:597] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:44.144486 31401 consensus_peers.cc:597] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:44.144860 31475 consensus_peers.cc:597] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.156004 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:44.160686 20891 tablet_replica.cc:333] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.162173 20891 raft_consensus.cc:2243] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.171053 20891 raft_consensus.cc:2272] T b21175df55ee43caab9a53db893f84a5 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.173861 31475 consensus_peers.cc:597] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.175662 20891 tablet_replica.cc:333] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.176880 20891 raft_consensus.cc:2243] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.177577 20891 raft_consensus.cc:2272] T 5010c0b5047248748914c1dc813009c8 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.181015 20891 tablet_replica.cc:333] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.181982 20891 raft_consensus.cc:2243] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.182648 20891 raft_consensus.cc:2272] T 08e23c1349714ee8b522e1b92accebc2 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.185501 20891 tablet_replica.cc:333] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.186196 20891 raft_consensus.cc:2243] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.186719 20891 raft_consensus.cc:2272] T 27155e412e29424db98323b0a5e9d620 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.189690 20891 tablet_replica.cc:333] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.190460 20891 raft_consensus.cc:2243] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.191465 20891 raft_consensus.cc:2272] T c82bc50bbf494273a5cf986a398a5e4f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.194135 20891 tablet_replica.cc:333] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.195096 20891 raft_consensus.cc:2243] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.196260 20891 raft_consensus.cc:2272] T 8ab02fdbdd944bfab62c752b0636f82c P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.199498 20891 tablet_replica.cc:333] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.200361 20891 raft_consensus.cc:2243] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.201500 20891 raft_consensus.cc:2272] T bb35e6f710fb417fba28d448bf7cc140 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.209296 20891 tablet_replica.cc:333] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.210232 20891 raft_consensus.cc:2243] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.210850 20891 raft_consensus.cc:2272] T ebdc9dd0bb6b443791a0ffbe39829943 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.214123 20891 tablet_replica.cc:333] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
W20260709 12:14:44.214250 31475 consensus_peers.cc:597] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.215039 20891 raft_consensus.cc:2243] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.215772 20891 raft_consensus.cc:2272] T 4977dacca462483d9bc0b0929a806d10 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.221089 31401 consensus_peers.cc:597] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.224327 20891 tablet_replica.cc:333] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.225206 20891 raft_consensus.cc:2243] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.225697 20891 raft_consensus.cc:2272] T 02ebece119174df8b0065e09199cb74a P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.228351 20891 tablet_replica.cc:333] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.229172 20891 raft_consensus.cc:2243] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.230337 20891 raft_consensus.cc:2272] T efbd74b64bc44ffea43757f3bdbfe1c3 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.233333 20891 tablet_replica.cc:333] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
W20260709 12:14:44.233541 31401 consensus_peers.cc:597] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.234184 20891 raft_consensus.cc:2243] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.234836 20891 raft_consensus.cc:2272] T 521fc30d365d455da547428401e26181 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.237541 20891 tablet_replica.cc:333] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.238300 20891 raft_consensus.cc:2243] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.238862 20891 raft_consensus.cc:2272] T 6f73b173ebeb4e0092ede2f6573824e8 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.240449 31475 consensus_peers.cc:597] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.241750 20891 tablet_replica.cc:333] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.242439 20891 raft_consensus.cc:2243] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.242861 20891 raft_consensus.cc:2272] T 1f955719b6b1451eaf77381e2047ffff P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.245083 20891 tablet_replica.cc:333] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.245687 20891 raft_consensus.cc:2243] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.246066 20891 raft_consensus.cc:2272] T e88d7f9369fa4e8eaa71b635d908ee34 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.248540 20891 tablet_replica.cc:333] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.249356 20891 raft_consensus.cc:2243] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.249926 20891 raft_consensus.cc:2272] T 215d8d9803624fe3b90591e545bf5024 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.253319 20891 tablet_replica.cc:333] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.254374 20891 raft_consensus.cc:2243] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.254995 20891 raft_consensus.cc:2272] T 3d8c6788cec8476ba424246e634c4712 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.258014 20891 tablet_replica.cc:333] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.258852 20891 raft_consensus.cc:2243] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.259958 20891 raft_consensus.cc:2272] T a31c0489c4404a649554f01c10277574 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.262475 20891 tablet_replica.cc:333] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.263254 20891 raft_consensus.cc:2243] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.263701 20891 raft_consensus.cc:2272] T ea3247f0fa74413892d5db3bbb4bb052 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.266044 20891 tablet_replica.cc:333] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.266624 20891 raft_consensus.cc:2243] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.267040 20891 raft_consensus.cc:2272] T 385e15f5c0b14702a8444e0e908bff77 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.269100 20891 tablet_replica.cc:333] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.269752 20891 raft_consensus.cc:2243] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.270211 20891 raft_consensus.cc:2272] T 75145062a94b45be996b563319044cd4 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.272163 20891 tablet_replica.cc:333] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.272966 20891 raft_consensus.cc:2243] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.274145 20891 raft_consensus.cc:2272] T f4d045764fb04dbc819b8f88e9bb085f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.277300 20891 tablet_replica.cc:333] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.278090 20891 raft_consensus.cc:2243] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.279111 20891 raft_consensus.cc:2272] T 6ada87845b524af0b51a486204b74b96 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.282173 20891 tablet_replica.cc:333] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.282872 20891 raft_consensus.cc:2243] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.283440 20891 raft_consensus.cc:2272] T 95ee9c20206541cf9fdc5d65759ce8e9 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.286149 20891 tablet_replica.cc:333] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
W20260709 12:14:44.286657 31401 consensus_peers.cc:597] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.286845 20891 raft_consensus.cc:2243] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.287632 20891 raft_consensus.cc:2272] T fb12da9e1bf4477cb726be970f4406e7 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.290459 20891 tablet_replica.cc:333] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
W20260709 12:14:44.291008 31401 consensus_peers.cc:597] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.291285 20891 raft_consensus.cc:2243] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.292112 20891 raft_consensus.cc:2272] T 3043ea4e7aac4914af456073b1b6a33c P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.295037 20891 tablet_replica.cc:333] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.295862 20891 raft_consensus.cc:2243] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.296926 20891 raft_consensus.cc:2272] T feb5c33d2a8a4010b336be5c5c4635cc P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.300403 20891 tablet_replica.cc:333] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.301260 20891 raft_consensus.cc:2243] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.301869 20891 raft_consensus.cc:2272] T dc2fa69725764633ab7d8cc899591b75 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.304725 20891 tablet_replica.cc:333] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.305603 20891 raft_consensus.cc:2243] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.307467 20891 raft_consensus.cc:2272] T 521c6b0664a14a35a1eca5919b44637f P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.310462 20891 tablet_replica.cc:333] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.311179 20891 raft_consensus.cc:2243] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.312086 20891 raft_consensus.cc:2272] T 85ab5b9c556a42dbba099f8a42b496f6 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.315099 20891 tablet_replica.cc:333] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
W20260709 12:14:44.315225 31475 consensus_peers.cc:597] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.315847 20891 raft_consensus.cc:2243] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.316478 20891 raft_consensus.cc:2272] T 45c3a704808243b09ae619420b9ef16c P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.319415 20891 tablet_replica.cc:333] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.320211 20891 raft_consensus.cc:2243] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.321281 20891 raft_consensus.cc:2272] T eb07b495c85d4de88b7c752f4a6f7ee7 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.321733 31401 consensus_peers.cc:597] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:44.323549 31475 consensus_peers.cc:597] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.324189 20891 tablet_replica.cc:333] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.325060 20891 raft_consensus.cc:2243] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.326081 20891 raft_consensus.cc:2272] T d3a4e71f02b84b77a615d593e2bd3597 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.329149 20891 tablet_replica.cc:333] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.329921 20891 raft_consensus.cc:2243] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.331015 20891 raft_consensus.cc:2272] T 30451bcaa4ca44f992ef5f47be40eda9 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.333938 20891 tablet_replica.cc:333] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.334626 20891 raft_consensus.cc:2243] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.335204 20891 raft_consensus.cc:2272] T 2607cd0103e94dec990c36aa6cbf89d0 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.338161 20891 tablet_replica.cc:333] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.338879 20891 raft_consensus.cc:2243] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.339368 20891 raft_consensus.cc:2272] T 4eb27277c309451f909355cb86a5d907 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.341918 20891 tablet_replica.cc:333] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.342654 20891 raft_consensus.cc:2243] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.343679 20891 raft_consensus.cc:2272] T 8a490d738b8e443a857242c089199946 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.346555 20891 tablet_replica.cc:333] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.347313 20891 raft_consensus.cc:2243] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.348404 20891 raft_consensus.cc:2272] T 53171289fe984298815d6d30885bf378 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.350797 31475 consensus_peers.cc:597] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.351598 20891 tablet_replica.cc:333] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.352670 20891 raft_consensus.cc:2243] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:44.353572 31475 consensus_peers.cc:597] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.353581 20891 raft_consensus.cc:2272] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P 56add4c904c74a1bba90579b9204e45d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.357936 20891 tablet_replica.cc:333] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.358882 20891 raft_consensus.cc:2243] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.359499 20891 raft_consensus.cc:2272] T d315efa422c24fa4a72ad1fc98375dc9 P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.361563 31401 consensus_peers.cc:597] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.362757 20891 tablet_replica.cc:333] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.363677 20891 raft_consensus.cc:2243] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.364907 20891 raft_consensus.cc:2272] T 1e602beb4a714f99a8480a347d7add2e P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.367448 20891 tablet_replica.cc:333] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.368057 20891 raft_consensus.cc:2243] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.368502 20891 raft_consensus.cc:2272] T 75927c3304e84b06a5ca9baf08eda6f6 P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.370965 20891 tablet_replica.cc:333] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.371743 20891 raft_consensus.cc:2243] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.372265 20891 raft_consensus.cc:2272] T 3110254469cd41d2bc5addd8675f1ddd P 56add4c904c74a1bba90579b9204e45d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.374806 20891 tablet_replica.cc:333] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d: stopping tablet replica
I20260709 12:14:44.375468 20891 raft_consensus.cc:2243] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.376034 20891 raft_consensus.cc:2272] T 8603c16c544a4d349593068e0a1788fa P 56add4c904c74a1bba90579b9204e45d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.425002 31475 consensus_peers.cc:597] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:44.443425 31401 consensus_peers.cc:597] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:44.452859 31475 consensus_peers.cc:597] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:33861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.465075 20891 tablet_server.cc:196] TabletServer@127.20.102.194:0 shutdown complete.
W20260709 12:14:44.481300 31401 consensus_peers.cc:597] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:33861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:44.511473 31401 consensus_peers.cc:597] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:33861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.543352 20891 tablet_server.cc:179] TabletServer@127.20.102.195:0 shutting down...
W20260709 12:14:44.583178 31477 consensus_peers.cc:597] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:44.592124 31475 consensus_peers.cc:597] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c -> Peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Couldn't send request to peer 56add4c904c74a1bba90579b9204e45d. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:33861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.605484 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:44.607704 20891 tablet_replica.cc:333] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.609627 20891 raft_consensus.cc:2243] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.610375 20891 raft_consensus.cc:2272] T 5010c0b5047248748914c1dc813009c8 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.613936 20891 tablet_replica.cc:333] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.614727 20891 raft_consensus.cc:2243] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.615697 20891 raft_consensus.cc:2272] T 08e23c1349714ee8b522e1b92accebc2 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.618263 20891 tablet_replica.cc:333] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.619010 20891 raft_consensus.cc:2243] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.620056 20891 raft_consensus.cc:2272] T 27155e412e29424db98323b0a5e9d620 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.623147 20891 tablet_replica.cc:333] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.623991 20891 raft_consensus.cc:2243] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.624516 20891 raft_consensus.cc:2272] T 521fc30d365d455da547428401e26181 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.626801 20891 tablet_replica.cc:333] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.627501 20891 raft_consensus.cc:2243] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.628014 20891 raft_consensus.cc:2272] T 77e9e7b1921647a199c915cb27208e60 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.630542 20891 tablet_replica.cc:333] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.631264 20891 raft_consensus.cc:2243] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.631737 20891 raft_consensus.cc:2272] T d315efa422c24fa4a72ad1fc98375dc9 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.633973 20891 tablet_replica.cc:333] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.634611 20891 raft_consensus.cc:2243] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.635092 20891 raft_consensus.cc:2272] T 1e602beb4a714f99a8480a347d7add2e P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.637617 20891 tablet_replica.cc:333] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.638252 20891 raft_consensus.cc:2243] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.638770 20891 raft_consensus.cc:2272] T 49cdc6c4a86a4b57b1df61deb0767165 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.641064 20891 tablet_replica.cc:333] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.641707 20891 raft_consensus.cc:2243] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.642609 20891 raft_consensus.cc:2272] T 1f955719b6b1451eaf77381e2047ffff P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.644714 20891 tablet_replica.cc:333] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.645344 20891 raft_consensus.cc:2243] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.645807 20891 raft_consensus.cc:2272] T e88d7f9369fa4e8eaa71b635d908ee34 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.648173 20891 tablet_replica.cc:333] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.648852 20891 raft_consensus.cc:2243] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.649339 20891 raft_consensus.cc:2272] T 02ebece119174df8b0065e09199cb74a P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.651413 20891 tablet_replica.cc:333] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.652006 20891 raft_consensus.cc:2243] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.653098 20891 raft_consensus.cc:2272] T 4977dacca462483d9bc0b0929a806d10 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.655838 20891 tablet_replica.cc:333] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.656831 20891 raft_consensus.cc:2243] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.657368 20891 raft_consensus.cc:2272] T c82bc50bbf494273a5cf986a398a5e4f P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.659822 20891 tablet_replica.cc:333] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.660504 20891 raft_consensus.cc:2243] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.661055 20891 raft_consensus.cc:2272] T ed36eebaa333457eb2e68c91b95afb39 P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.663190 20891 tablet_replica.cc:333] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.663801 20891 raft_consensus.cc:2243] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.664673 20891 raft_consensus.cc:2272] T d502420b9f304f568a686ba8cdb9ae80 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.666853 20891 tablet_replica.cc:333] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.667482 20891 raft_consensus.cc:2243] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.668335 20891 raft_consensus.cc:2272] T fdc78b9bfcf344f389246d2a9db1c5eb P d5caa720fddf4dd3958f076ff03df8da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.670588 20891 tablet_replica.cc:333] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.671198 20891 raft_consensus.cc:2243] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.671671 20891 raft_consensus.cc:2272] T 8a490d738b8e443a857242c089199946 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.673897 20891 tablet_replica.cc:333] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.674561 20891 raft_consensus.cc:2243] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.675024 20891 raft_consensus.cc:2272] T 641ff77e975546a1824207bab77c2788 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.677277 20891 tablet_replica.cc:333] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.677935 20891 raft_consensus.cc:2243] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.678421 20891 raft_consensus.cc:2272] T 53171289fe984298815d6d30885bf378 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.680620 20891 tablet_replica.cc:333] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.681388 20891 raft_consensus.cc:2243] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.682282 20891 raft_consensus.cc:2272] T 3d8c6788cec8476ba424246e634c4712 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.684373 20891 tablet_replica.cc:333] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.685070 20891 raft_consensus.cc:2243] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.685544 20891 raft_consensus.cc:2272] T 4eb27277c309451f909355cb86a5d907 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.687675 20891 tablet_replica.cc:333] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.688282 20891 raft_consensus.cc:2243] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.688743 20891 raft_consensus.cc:2272] T 17f21568498d48caad98d644ce34352a P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.690902 20891 tablet_replica.cc:333] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.691540 20891 raft_consensus.cc:2243] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.691982 20891 raft_consensus.cc:2272] T a957f943814a47b2be47b8491e63b5c0 P d5caa720fddf4dd3958f076ff03df8da [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.694109 20891 tablet_replica.cc:333] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.694677 20891 raft_consensus.cc:2243] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.695199 20891 raft_consensus.cc:2272] T 6ada87845b524af0b51a486204b74b96 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.697427 20891 tablet_replica.cc:333] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.698019 20891 raft_consensus.cc:2243] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.698894 20891 raft_consensus.cc:2272] T 7ead5d3f281f4adb8e218fc8979158f2 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.701215 20891 tablet_replica.cc:333] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.701804 20891 raft_consensus.cc:2243] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.702647 20891 raft_consensus.cc:2272] T 75927c3304e84b06a5ca9baf08eda6f6 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.705021 20891 tablet_replica.cc:333] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.705842 20891 raft_consensus.cc:2243] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.706403 20891 raft_consensus.cc:2272] T ddfe25b91d214455814522b83bc111d1 P d5caa720fddf4dd3958f076ff03df8da [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.709225 20891 tablet_replica.cc:333] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.709842 20891 raft_consensus.cc:2243] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.710297 20891 raft_consensus.cc:2272] T 385e15f5c0b14702a8444e0e908bff77 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.712752 20891 tablet_replica.cc:333] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.713415 20891 raft_consensus.cc:2243] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.713989 20891 raft_consensus.cc:2272] T 75145062a94b45be996b563319044cd4 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.716529 20891 tablet_replica.cc:333] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.717178 20891 raft_consensus.cc:2243] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.718004 20891 raft_consensus.cc:2272] T 3043ea4e7aac4914af456073b1b6a33c P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.720268 20891 tablet_replica.cc:333] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.720999 20891 raft_consensus.cc:2243] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.721407 20891 raft_consensus.cc:2272] T 050680dae66642369827ee0318291dac P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.723555 20891 tablet_replica.cc:333] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.724104 20891 raft_consensus.cc:2243] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.724638 20891 raft_consensus.cc:2272] T 85ab5b9c556a42dbba099f8a42b496f6 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.727599 20891 tablet_replica.cc:333] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.728346 20891 raft_consensus.cc:2243] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.729485 20891 raft_consensus.cc:2272] T ad60c538b49e4a5fb4fa276ea5b25314 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.735615 20891 tablet_replica.cc:333] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.736418 20891 raft_consensus.cc:2243] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.737706 20891 raft_consensus.cc:2272] T 45c3a704808243b09ae619420b9ef16c P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.740298 20891 tablet_replica.cc:333] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.741132 20891 raft_consensus.cc:2243] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.741726 20891 raft_consensus.cc:2272] T eb07b495c85d4de88b7c752f4a6f7ee7 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.744289 20891 tablet_replica.cc:333] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.744923 20891 raft_consensus.cc:2243] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.745366 20891 raft_consensus.cc:2272] T d3a4e71f02b84b77a615d593e2bd3597 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.747540 20891 tablet_replica.cc:333] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.748101 20891 raft_consensus.cc:2243] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.748549 20891 raft_consensus.cc:2272] T 8ab02fdbdd944bfab62c752b0636f82c P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.750881 20891 tablet_replica.cc:333] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.751570 20891 raft_consensus.cc:2243] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.752110 20891 raft_consensus.cc:2272] T 0191640019a84d1c9ec1470b18a33641 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.754508 31477 consensus_peers.cc:597] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.755039 20891 tablet_replica.cc:333] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.755790 20891 raft_consensus.cc:2243] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:44.755952 31477 consensus_peers.cc:597] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.756289 20891 raft_consensus.cc:2272] T 04626a79b549449386652742229e800a P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.758628 20891 tablet_replica.cc:333] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.759442 20891 raft_consensus.cc:2243] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.760435 20891 raft_consensus.cc:2272] T 3110254469cd41d2bc5addd8675f1ddd P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.762722 20891 tablet_replica.cc:333] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.763274 20891 raft_consensus.cc:2243] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.763702 20891 raft_consensus.cc:2272] T ea3247f0fa74413892d5db3bbb4bb052 P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.766297 20891 tablet_replica.cc:333] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.766862 20891 raft_consensus.cc:2243] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.767379 20891 raft_consensus.cc:2272] T 1e16b0bb459e4dcf906ddc86d14187bc P d5caa720fddf4dd3958f076ff03df8da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.770229 20891 tablet_replica.cc:333] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.770959 20891 raft_consensus.cc:2243] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.772001 20891 raft_consensus.cc:2272] T 2607cd0103e94dec990c36aa6cbf89d0 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.773602 31477 consensus_peers.cc:597] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.774932 20891 tablet_replica.cc:333] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da: stopping tablet replica
I20260709 12:14:44.775745 20891 raft_consensus.cc:2243] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.776618 20891 raft_consensus.cc:2272] T dc2fa69725764633ab7d8cc899591b75 P d5caa720fddf4dd3958f076ff03df8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.810907 32475 raft_consensus.cc:493] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:44.811533 32475 raft_consensus.cc:515] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:44.813712 32475 leader_election.cc:290] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:44.817662 31477 leader_election.cc:336] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:44.819190 31478 leader_election.cc:336] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:44.819689 31478 leader_election.cc:304] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:44.820518 32475 raft_consensus.cc:2749] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:44.841143 32540 raft_consensus.cc:493] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:44.841781 32540 raft_consensus.cc:515] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:44.844350 32540 leader_election.cc:290] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:44.848874 31477 leader_election.cc:336] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:44.849525 31478 leader_election.cc:336] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:44.849997 31478 leader_election.cc:304] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:44.850577 32540 raft_consensus.cc:2749] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:44.854990 31477 consensus_peers.cc:597] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.195:45203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.868487 20891 tablet_server.cc:196] TabletServer@127.20.102.195:0 shutdown complete.
I20260709 12:14:44.873960 32540 raft_consensus.cc:493] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:44.874526 32540 raft_consensus.cc:515] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:44.876997 32540 leader_election.cc:290] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:44.881585 31477 leader_election.cc:336] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Network error: Client connection negotiation failed: client connection to 127.20.102.195:45203: connect: Connection refused (error 111)
W20260709 12:14:44.882292 31477 consensus_peers.cc:597] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.195:45203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:44.883001 31478 leader_election.cc:336] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:44.883613 31478 leader_election.cc:304] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:44.884514 32475 raft_consensus.cc:2749] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:44.939988 32475 raft_consensus.cc:493] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:44.940649 32475 raft_consensus.cc:515] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:44.942808 32475 leader_election.cc:290] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:44.945060 32475 raft_consensus.cc:493] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:44.945585 32475 raft_consensus.cc:515] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:44.947839 32475 leader_election.cc:290] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
W20260709 12:14:44.949323 31475 leader_election.cc:336] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Network error: Client connection negotiation failed: client connection to 127.20.102.194:33861: connect: Connection refused (error 111)
W20260709 12:14:44.951247 31478 leader_election.cc:336] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
W20260709 12:14:44.953027 31477 leader_election.cc:336] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Network error: Client connection negotiation failed: client connection to 127.20.102.195:45203: connect: Connection refused (error 111)
I20260709 12:14:44.953466 31478 leader_election.cc:304] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:44.954559 32475 raft_consensus.cc:2749] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:44.956885 31478 leader_election.cc:336] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:44.957305 31478 leader_election.cc:304] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:44.957979 32475 raft_consensus.cc:2749] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:44.966787 20891 tablet_server.cc:179] TabletServer@127.20.102.196:0 shutting down...
I20260709 12:14:44.987771 32540 raft_consensus.cc:493] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:44.988560 32540 raft_consensus.cc:515] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:44.991257 32540 leader_election.cc:290] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
W20260709 12:14:45.000572 31475 leader_election.cc:336] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Network error: Client connection negotiation failed: client connection to 127.20.102.194:33861: connect: Connection refused (error 111)
W20260709 12:14:45.001201 31478 leader_election.cc:336] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:45.001780 31478 leader_election.cc:304] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:45.004851 32540 raft_consensus.cc:2749] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:45.011227 31477 consensus_peers.cc:597] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.195:45203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.015760 31477 consensus_peers.cc:597] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.195:45203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.032145 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:14:45.032426 31477 consensus_peers.cc:597] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c -> Peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Couldn't send request to peer d5caa720fddf4dd3958f076ff03df8da. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.195:45203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.033434 20891 tablet_replica.cc:333] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.034345 20891 raft_consensus.cc:2243] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.034987 20891 raft_consensus.cc:2272] T bb35e6f710fb417fba28d448bf7cc140 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.037858 20891 tablet_replica.cc:333] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.038529 20891 raft_consensus.cc:2243] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.039536 20891 raft_consensus.cc:2272] T 5010c0b5047248748914c1dc813009c8 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.041397 32539 raft_consensus.cc:493] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:45.041947 32539 raft_consensus.cc:515] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } } peers { permanent_uuid: "56add4c904c74a1bba90579b9204e45d" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 33861 } }
I20260709 12:14:45.042284 20891 tablet_replica.cc:333] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.043259 20891 raft_consensus.cc:2243] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.043795 20891 raft_consensus.cc:2272] T fb12da9e1bf4477cb726be970f4406e7 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.044242 32539 leader_election.cc:290] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623), 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861)
I20260709 12:14:45.046612 20891 tablet_replica.cc:333] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.047662 20891 raft_consensus.cc:2243] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.048264 20891 raft_consensus.cc:2272] T 27155e412e29424db98323b0a5e9d620 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:45.049284 31478 leader_election.cc:336] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
W20260709 12:14:45.049893 31475 leader_election.cc:336] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 56add4c904c74a1bba90579b9204e45d (127.20.102.194:33861): Network error: Client connection negotiation failed: client connection to 127.20.102.194:33861: connect: Connection refused (error 111)
I20260709 12:14:45.050369 31475 leader_election.cc:304] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, 56add4c904c74a1bba90579b9204e45d
I20260709 12:14:45.051143 32540 raft_consensus.cc:2749] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:45.051643 20891 tablet_replica.cc:333] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.052693 20891 raft_consensus.cc:2243] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.053404 20891 raft_consensus.cc:2272] T 04626a79b549449386652742229e800a P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.056365 20891 tablet_replica.cc:333] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.057091 20891 raft_consensus.cc:2243] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.057461 32540 raft_consensus.cc:493] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0769d57e6db04b2f86703e0ed60f6185)
I20260709 12:14:45.057698 20891 raft_consensus.cc:2272] T 77e9e7b1921647a199c915cb27208e60 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.058144 32540 raft_consensus.cc:515] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5caa720fddf4dd3958f076ff03df8da" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45203 } } peers { permanent_uuid: "a209a5d7b61542d885ef601e8bcaa26c" member_type: VOTER last_known_addr { host: "127.20.102.196" port: 42171 } } peers { permanent_uuid: "0769d57e6db04b2f86703e0ed60f6185" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 45623 } }
I20260709 12:14:45.060674 32540 leader_election.cc:290] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203), 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623)
I20260709 12:14:45.061223 20891 tablet_replica.cc:333] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.062095 20891 raft_consensus.cc:2243] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.062747 20891 raft_consensus.cc:2272] T 1e602beb4a714f99a8480a347d7add2e P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:45.065846 31478 leader_election.cc:336] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0769d57e6db04b2f86703e0ed60f6185 (127.20.102.193:45623): Network error: Client connection negotiation failed: client connection to 127.20.102.193:45623: connect: Connection refused (error 111)
I20260709 12:14:45.065874 20891 tablet_replica.cc:333] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
W20260709 12:14:45.066802 31477 leader_election.cc:336] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d5caa720fddf4dd3958f076ff03df8da (127.20.102.195:45203): Network error: Client connection negotiation failed: client connection to 127.20.102.195:45203: connect: Connection refused (error 111)
I20260709 12:14:45.067116 20891 raft_consensus.cc:2243] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.067250 31477 leader_election.cc:304] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a209a5d7b61542d885ef601e8bcaa26c; no voters: 0769d57e6db04b2f86703e0ed60f6185, d5caa720fddf4dd3958f076ff03df8da
I20260709 12:14:45.068123 32540 raft_consensus.cc:2749] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:45.068434 20891 raft_consensus.cc:2272] T ebdc9dd0bb6b443791a0ffbe39829943 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.071189 20891 tablet_replica.cc:333] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.071893 20891 raft_consensus.cc:2243] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.072396 20891 raft_consensus.cc:2272] T efbd74b64bc44ffea43757f3bdbfe1c3 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.074748 20891 tablet_replica.cc:333] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.075385 20891 raft_consensus.cc:2243] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.076267 20891 raft_consensus.cc:2272] T 521fc30d365d455da547428401e26181 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.078601 20891 tablet_replica.cc:333] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.079231 20891 raft_consensus.cc:2243] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.079731 20891 raft_consensus.cc:2272] T 6f73b173ebeb4e0092ede2f6573824e8 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.081931 20891 tablet_replica.cc:333] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.082723 20891 raft_consensus.cc:2243] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.083796 20891 raft_consensus.cc:2272] T b21175df55ee43caab9a53db893f84a5 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.086313 20891 tablet_replica.cc:333] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.086975 20891 raft_consensus.cc:2243] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.087491 20891 raft_consensus.cc:2272] T fdc78b9bfcf344f389246d2a9db1c5eb P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.089669 20891 tablet_replica.cc:333] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.090302 20891 raft_consensus.cc:2243] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.091197 20891 raft_consensus.cc:2272] T 49cdc6c4a86a4b57b1df61deb0767165 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.093537 20891 tablet_replica.cc:333] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.094149 20891 raft_consensus.cc:2243] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.094691 20891 raft_consensus.cc:2272] T 1f955719b6b1451eaf77381e2047ffff P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.096998 20891 tablet_replica.cc:333] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.097986 20891 raft_consensus.cc:2243] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.098917 20891 raft_consensus.cc:2272] T e88d7f9369fa4e8eaa71b635d908ee34 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.101257 20891 tablet_replica.cc:333] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.101846 20891 raft_consensus.cc:2243] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.102275 20891 raft_consensus.cc:2272] T c82bc50bbf494273a5cf986a398a5e4f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.104624 20891 tablet_replica.cc:333] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.105264 20891 raft_consensus.cc:2243] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.105691 20891 raft_consensus.cc:2272] T ed36eebaa333457eb2e68c91b95afb39 P a209a5d7b61542d885ef601e8bcaa26c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.107868 20891 tablet_replica.cc:333] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.108458 20891 raft_consensus.cc:2243] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.108894 20891 raft_consensus.cc:2272] T d502420b9f304f568a686ba8cdb9ae80 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.111081 20891 tablet_replica.cc:333] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.111847 20891 raft_consensus.cc:2243] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.112715 20891 raft_consensus.cc:2272] T 17f21568498d48caad98d644ce34352a P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.114769 20891 tablet_replica.cc:333] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.115299 20891 raft_consensus.cc:2243] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.116191 20891 raft_consensus.cc:2272] T 215d8d9803624fe3b90591e545bf5024 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.118379 20891 tablet_replica.cc:333] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.119001 20891 raft_consensus.cc:2243] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.119478 20891 raft_consensus.cc:2272] T 3d8c6788cec8476ba424246e634c4712 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.121654 20891 tablet_replica.cc:333] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.122258 20891 raft_consensus.cc:2243] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.123101 20891 raft_consensus.cc:2272] T 95ee9c20206541cf9fdc5d65759ce8e9 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.125277 20891 tablet_replica.cc:333] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.125869 20891 raft_consensus.cc:2243] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.126386 20891 raft_consensus.cc:2272] T a31c0489c4404a649554f01c10277574 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.128454 20891 tablet_replica.cc:333] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.129065 20891 raft_consensus.cc:2243] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.129448 20891 raft_consensus.cc:2272] T 1e16b0bb459e4dcf906ddc86d14187bc P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.131353 20891 tablet_replica.cc:333] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.131857 20891 raft_consensus.cc:2243] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.132227 20891 raft_consensus.cc:2272] T fdb3d3e1eb4043a8b0c90c5b76a60ac0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.134161 20891 tablet_replica.cc:333] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.134675 20891 raft_consensus.cc:2243] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.135033 20891 raft_consensus.cc:2272] T 7ead5d3f281f4adb8e218fc8979158f2 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.137009 20891 tablet_replica.cc:333] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.137511 20891 raft_consensus.cc:2243] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.138006 20891 raft_consensus.cc:2272] T ddfe25b91d214455814522b83bc111d1 P a209a5d7b61542d885ef601e8bcaa26c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.139886 20891 tablet_replica.cc:333] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.140376 20891 raft_consensus.cc:2243] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.141268 20891 raft_consensus.cc:2272] T 75145062a94b45be996b563319044cd4 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.143239 20891 tablet_replica.cc:333] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.143750 20891 raft_consensus.cc:2243] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.144131 20891 raft_consensus.cc:2272] T feb5c33d2a8a4010b336be5c5c4635cc P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.146131 20891 tablet_replica.cc:333] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.146625 20891 raft_consensus.cc:2243] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.146991 20891 raft_consensus.cc:2272] T dc2fa69725764633ab7d8cc899591b75 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.149051 20891 tablet_replica.cc:333] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.149575 20891 raft_consensus.cc:2243] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.149955 20891 raft_consensus.cc:2272] T 45c3a704808243b09ae619420b9ef16c P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.151918 20891 tablet_replica.cc:333] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.152455 20891 raft_consensus.cc:2243] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.152930 20891 raft_consensus.cc:2272] T 0191640019a84d1c9ec1470b18a33641 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.154879 20891 tablet_replica.cc:333] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.155417 20891 raft_consensus.cc:2243] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.156311 20891 raft_consensus.cc:2272] T 050680dae66642369827ee0318291dac P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.158453 20891 tablet_replica.cc:333] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.159019 20891 raft_consensus.cc:2243] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.159453 20891 raft_consensus.cc:2272] T 85ab5b9c556a42dbba099f8a42b496f6 P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.161537 20891 tablet_replica.cc:333] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.162086 20891 raft_consensus.cc:2243] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.162528 20891 raft_consensus.cc:2272] T ad60c538b49e4a5fb4fa276ea5b25314 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.164453 20891 tablet_replica.cc:333] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.165038 20891 raft_consensus.cc:2243] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.165891 20891 raft_consensus.cc:2272] T 521c6b0664a14a35a1eca5919b44637f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.167927 20891 tablet_replica.cc:333] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.168496 20891 raft_consensus.cc:2243] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.169409 20891 raft_consensus.cc:2272] T 641ff77e975546a1824207bab77c2788 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.171533 20891 tablet_replica.cc:333] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.172071 20891 raft_consensus.cc:2243] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.172501 20891 raft_consensus.cc:2272] T f4d045764fb04dbc819b8f88e9bb085f P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.174649 20891 tablet_replica.cc:333] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.175179 20891 raft_consensus.cc:2243] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.175606 20891 raft_consensus.cc:2272] T a957f943814a47b2be47b8491e63b5c0 P a209a5d7b61542d885ef601e8bcaa26c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.177613 20891 tablet_replica.cc:333] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.178180 20891 raft_consensus.cc:2243] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.178608 20891 raft_consensus.cc:2272] T 30451bcaa4ca44f992ef5f47be40eda9 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.180616 20891 tablet_replica.cc:333] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.181178 20891 raft_consensus.cc:2243] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.181608 20891 raft_consensus.cc:2272] T 2607cd0103e94dec990c36aa6cbf89d0 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.183650 20891 tablet_replica.cc:333] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.184165 20891 raft_consensus.cc:2243] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.185065 20891 raft_consensus.cc:2272] T 4eb27277c309451f909355cb86a5d907 P a209a5d7b61542d885ef601e8bcaa26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.187158 20891 tablet_replica.cc:333] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c: stopping tablet replica
I20260709 12:14:45.187651 20891 raft_consensus.cc:2243] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.188488 20891 raft_consensus.cc:2272] T 8603c16c544a4d349593068e0a1788fa P a209a5d7b61542d885ef601e8bcaa26c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.266958 20891 tablet_server.cc:196] TabletServer@127.20.102.196:0 shutdown complete.
I20260709 12:14:45.331933 20891 master.cc:562] Master@127.20.102.254:38261 shutting down...
I20260709 12:14:45.362277 20891 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:45.362901 20891 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.363278 20891 tablet_replica.cc:333] T 00000000000000000000000000000000 P b4f015f246414c2f972d92b85595c3e2: stopping tablet replica
I20260709 12:14:45.386346 20891 master.cc:584] Master@127.20.102.254:38261 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (39787 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:14:45.489362 20891 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.102.254:37471
I20260709 12:14:45.490819 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:45.497843 32544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:45.498102 32543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:45.498621 32546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:45.500061 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:45.501466 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:45.501657 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:45.501773 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599285501762 us; error 0 us; skew 500 ppm
I20260709 12:14:45.502305 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:45.505188 20891 webserver.cc:533] Webserver started at http://127.20.102.254:33113/ using document root <none> and password file <none>
I20260709 12:14:45.505666 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:45.505831 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:45.506060 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:45.507126 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/master-0-root/instance:
uuid: "ee2c770c576b48d99a252b5719d6b2d5"
format_stamp: "Formatted at 2026-07-09 12:14:45 on dist-test-slave-296p"
I20260709 12:14:45.511726 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:14:45.515440 32551 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:45.516462 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:45.516935 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/master-0-root
uuid: "ee2c770c576b48d99a252b5719d6b2d5"
format_stamp: "Formatted at 2026-07-09 12:14:45 on dist-test-slave-296p"
I20260709 12:14:45.517266 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:45.553534 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:45.554785 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:45.596913 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.254:37471
I20260709 12:14:45.597082 32602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.254:37471 every 8 connection(s)
I20260709 12:14:45.601217 32603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.613550 32603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5: Bootstrap starting.
I20260709 12:14:45.619230 32603 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:45.624383 32603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5: No bootstrap required, opened a new log
I20260709 12:14:45.627038 32603 raft_consensus.cc:359] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2c770c576b48d99a252b5719d6b2d5" member_type: VOTER }
I20260709 12:14:45.627476 32603 raft_consensus.cc:385] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:45.627725 32603 raft_consensus.cc:740] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee2c770c576b48d99a252b5719d6b2d5, State: Initialized, Role: FOLLOWER
I20260709 12:14:45.628469 32603 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2c770c576b48d99a252b5719d6b2d5" member_type: VOTER }
I20260709 12:14:45.628975 32603 raft_consensus.cc:399] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:45.629194 32603 raft_consensus.cc:493] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:45.629508 32603 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.634872 32603 raft_consensus.cc:515] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2c770c576b48d99a252b5719d6b2d5" member_type: VOTER }
I20260709 12:14:45.635445 32603 leader_election.cc:304] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee2c770c576b48d99a252b5719d6b2d5; no voters: 
I20260709 12:14:45.636736 32603 leader_election.cc:290] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:45.637367 32606 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:45.638899 32606 raft_consensus.cc:697] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [term 1 LEADER]: Becoming Leader. State: Replica: ee2c770c576b48d99a252b5719d6b2d5, State: Running, Role: LEADER
I20260709 12:14:45.639644 32606 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2c770c576b48d99a252b5719d6b2d5" member_type: VOTER }
I20260709 12:14:45.640291 32603 sys_catalog.cc:565] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:45.644315 32607 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee2c770c576b48d99a252b5719d6b2d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2c770c576b48d99a252b5719d6b2d5" member_type: VOTER } }
I20260709 12:14:45.644518 32608 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee2c770c576b48d99a252b5719d6b2d5. Latest consensus state: current_term: 1 leader_uuid: "ee2c770c576b48d99a252b5719d6b2d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2c770c576b48d99a252b5719d6b2d5" member_type: VOTER } }
I20260709 12:14:45.645128 32607 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:45.645710 32608 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:45.649207 32612 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:45.656519 32612 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:45.657542 20891 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:45.666268 32612 catalog_manager.cc:1383] Generated new cluster ID: 3ccee32cce9a45469a6da9fe9a8f9da4
I20260709 12:14:45.666635 32612 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:45.681460 32612 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:45.682960 32612 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:45.696938 32612 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5: Generated new TSK 0
I20260709 12:14:45.697711 32612 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:45.724165 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:45.731030 32624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:45.732307 32625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:45.737006 32627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:45.740511 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:45.745016 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:45.745275 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:45.745445 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599285745429 us; error 0 us; skew 500 ppm
I20260709 12:14:45.746017 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:45.748485 20891 webserver.cc:533] Webserver started at http://127.20.102.193:45595/ using document root <none> and password file <none>
I20260709 12:14:45.749058 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:45.749276 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:45.749545 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:45.750648 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-0-root/instance:
uuid: "f1f31b4cc29144da9485824a934ccac1"
format_stamp: "Formatted at 2026-07-09 12:14:45 on dist-test-slave-296p"
I20260709 12:14:45.755221 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:14:45.758868 32632 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:45.759994 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:45.760408 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-0-root
uuid: "f1f31b4cc29144da9485824a934ccac1"
format_stamp: "Formatted at 2026-07-09 12:14:45 on dist-test-slave-296p"
I20260709 12:14:45.760717 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:45.774626 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:45.775915 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:45.777617 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:45.780104 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:45.780287 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:45.780611 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:45.780813 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:45.829366 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.193:46581
I20260709 12:14:45.829493 32694 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.193:46581 every 8 connection(s)
I20260709 12:14:45.835086 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:45.844075 32699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:45.845578 32700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:45.850056 32702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:45.850485 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:45.851806 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:45.852128 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:45.852331 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599285852311 us; error 0 us; skew 500 ppm
I20260709 12:14:45.853511 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:45.857431 32695 heartbeater.cc:344] Connected to a master server at 127.20.102.254:37471
I20260709 12:14:45.857538 20891 webserver.cc:533] Webserver started at http://127.20.102.194:44661/ using document root <none> and password file <none>
I20260709 12:14:45.857940 32695 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:45.858386 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:45.858693 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:45.859020 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:45.858915 32695 heartbeater.cc:507] Master 127.20.102.254:37471 requested a full tablet report, sending...
I20260709 12:14:45.860868 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-1-root/instance:
uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
format_stamp: "Formatted at 2026-07-09 12:14:45 on dist-test-slave-296p"
I20260709 12:14:45.861706 32568 ts_manager.cc:194] Registered new tserver with Master: f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581)
I20260709 12:14:45.864995 32568 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54108
I20260709 12:14:45.868564 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:14:45.872963 32707 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:45.873937 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:45.874378 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-1-root
uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
format_stamp: "Formatted at 2026-07-09 12:14:45 on dist-test-slave-296p"
I20260709 12:14:45.874682 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:45.890117 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:45.892119 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:45.894209 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:45.897362 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:45.897740 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:45.898021 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:45.898216 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:45.950598 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.194:36707
I20260709 12:14:45.950733   301 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.194:36707 every 8 connection(s)
I20260709 12:14:45.956871 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:45.966360   305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:45.969053   306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:45.970892   308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:45.971675   302 heartbeater.cc:344] Connected to a master server at 127.20.102.254:37471
I20260709 12:14:45.972270   302 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:45.973250   302 heartbeater.cc:507] Master 127.20.102.254:37471 requested a full tablet report, sending...
I20260709 12:14:45.974714 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:45.976035 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:14:45.976105 32568 ts_manager.cc:194] Registered new tserver with Master: f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
W20260709 12:14:45.976403 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:45.976826 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599285976755 us; error 0 us; skew 500 ppm
I20260709 12:14:45.977643 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:45.978056 32568 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54110
I20260709 12:14:45.981144 20891 webserver.cc:533] Webserver started at http://127.20.102.195:44397/ using document root <none> and password file <none>
I20260709 12:14:45.981832 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:45.982103 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:45.982422 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:45.983841 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-2-root/instance:
uuid: "56f155685b8a404eb23d923b1e058264"
format_stamp: "Formatted at 2026-07-09 12:14:45 on dist-test-slave-296p"
I20260709 12:14:45.989161 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:14:45.993213   313 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:45.994227 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:14:45.994516 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-2-root
uuid: "56f155685b8a404eb23d923b1e058264"
format_stamp: "Formatted at 2026-07-09 12:14:45 on dist-test-slave-296p"
I20260709 12:14:45.994789 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:46.010017 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:46.011238 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:46.013201 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:46.016237 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:46.016589 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:46.016995 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:46.017217 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:46.064819 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.195:37197
I20260709 12:14:46.065106   375 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.195:37197 every 8 connection(s)
I20260709 12:14:46.081226   376 heartbeater.cc:344] Connected to a master server at 127.20.102.254:37471
I20260709 12:14:46.081736   376 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:46.082516   376 heartbeater.cc:507] Master 127.20.102.254:37471 requested a full tablet report, sending...
I20260709 12:14:46.084933 32568 ts_manager.cc:194] Registered new tserver with Master: 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:46.085592 20891 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017246162s
I20260709 12:14:46.087037 32568 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54120
I20260709 12:14:46.120601 32568 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54124:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:46.129333 32568 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:46.243070   341 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3c76d730e64bd1b30892611ad1ee19 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:46.246209   340 tablet_service.cc:1511] Processing CreateTablet for tablet de4e0e402ab741a0846f0b879f1b2681 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:46.248656 32734 tablet_service.cc:1511] Processing CreateTablet for tablet de4e0e402ab741a0846f0b879f1b2681 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:46.249266 32733 tablet_service.cc:1511] Processing CreateTablet for tablet 41bea463a96a4081aacf2d8a3646d398 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:46.250362 32734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4e0e402ab741a0846f0b879f1b2681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.251160   338 tablet_service.cc:1511] Processing CreateTablet for tablet a35a3899339541df8d9abd16b89a2a27 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:46.251610 32732 tablet_service.cc:1511] Processing CreateTablet for tablet a35a3899339541df8d9abd16b89a2a27 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:46.253098   341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3c76d730e64bd1b30892611ad1ee19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.253298 32732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35a3899339541df8d9abd16b89a2a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.253973   339 tablet_service.cc:1511] Processing CreateTablet for tablet 41bea463a96a4081aacf2d8a3646d398 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:46.255118 32660 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3c76d730e64bd1b30892611ad1ee19 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:46.255537   339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41bea463a96a4081aacf2d8a3646d398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.257270   340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4e0e402ab741a0846f0b879f1b2681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.258596   338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35a3899339541df8d9abd16b89a2a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.258224 32659 tablet_service.cc:1511] Processing CreateTablet for tablet de4e0e402ab741a0846f0b879f1b2681 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:46.260715 32658 tablet_service.cc:1511] Processing CreateTablet for tablet 41bea463a96a4081aacf2d8a3646d398 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:46.263051 32657 tablet_service.cc:1511] Processing CreateTablet for tablet a35a3899339541df8d9abd16b89a2a27 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:46.253162 32735 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3c76d730e64bd1b30892611ad1ee19 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:46.265834 32735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3c76d730e64bd1b30892611ad1ee19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.266168 32656 tablet_service.cc:1511] Processing CreateTablet for tablet 4accbab2923b42cfae4ddfad12ba95d6 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:46.267740 32733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41bea463a96a4081aacf2d8a3646d398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.269137 32660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3c76d730e64bd1b30892611ad1ee19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.273120 32657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35a3899339541df8d9abd16b89a2a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.274250 32656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4accbab2923b42cfae4ddfad12ba95d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.277165 32658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41bea463a96a4081aacf2d8a3646d398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.278251 32659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4e0e402ab741a0846f0b879f1b2681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.310575   392 tablet_bootstrap.cc:492] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c: Bootstrap starting.
I20260709 12:14:46.321902   392 tablet_bootstrap.cc:654] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.326725   391 tablet_bootstrap.cc:492] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264: Bootstrap starting.
I20260709 12:14:46.331991 32735 tablet_service.cc:1511] Processing CreateTablet for tablet 4accbab2923b42cfae4ddfad12ba95d6 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:46.333603 32735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4accbab2923b42cfae4ddfad12ba95d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.336020   339 tablet_service.cc:1511] Processing CreateTablet for tablet 4accbab2923b42cfae4ddfad12ba95d6 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:46.337576   339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4accbab2923b42cfae4ddfad12ba95d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.343083   391 tablet_bootstrap.cc:654] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.365826 32655 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd4ca8eb7d74f98aabe91f25f8fea9c (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:46.367308 32655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd4ca8eb7d74f98aabe91f25f8fea9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.370828   391 tablet_bootstrap.cc:492] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264: No bootstrap required, opened a new log
I20260709 12:14:46.371536   391 ts_tablet_manager.cc:1403] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.007s
I20260709 12:14:46.374229 32731 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd4ca8eb7d74f98aabe91f25f8fea9c (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:46.375670 32731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd4ca8eb7d74f98aabe91f25f8fea9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.379158   391 raft_consensus.cc:359] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.379493 32654 tablet_service.cc:1511] Processing CreateTablet for tablet aaa2908bf3dc4a478c336086f620644a (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:46.380002   391 raft_consensus.cc:385] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.380352   391 raft_consensus.cc:740] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.381209   391 consensus_queue.cc:260] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.382918 32733 tablet_service.cc:1511] Processing CreateTablet for tablet aaa2908bf3dc4a478c336086f620644a (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:46.384601 32733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa2908bf3dc4a478c336086f620644a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.384940 32654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa2908bf3dc4a478c336086f620644a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.390079   339 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd4ca8eb7d74f98aabe91f25f8fea9c (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:46.392310   339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd4ca8eb7d74f98aabe91f25f8fea9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.412154   338 tablet_service.cc:1511] Processing CreateTablet for tablet aaa2908bf3dc4a478c336086f620644a (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:46.413902   338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa2908bf3dc4a478c336086f620644a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.415268   392 tablet_bootstrap.cc:492] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c: No bootstrap required, opened a new log
I20260709 12:14:46.415894   392 ts_tablet_manager.cc:1403] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent bootstrapping tablet: real 0.107s	user 0.024s	sys 0.004s
I20260709 12:14:46.428818   376 heartbeater.cc:499] Master 127.20.102.254:37471 was elected leader, sending a full tablet report...
I20260709 12:14:46.430406   391 ts_tablet_manager.cc:1434] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264: Time spent starting tablet: real 0.059s	user 0.024s	sys 0.026s
I20260709 12:14:46.431650   391 tablet_bootstrap.cc:492] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264: Bootstrap starting.
I20260709 12:14:46.428999   395 raft_consensus.cc:493] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.446447   395 raft_consensus.cc:515] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.450524   397 tablet_bootstrap.cc:492] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:46.453269   395 leader_election.cc:290] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:46.462026   397 tablet_bootstrap.cc:654] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.420562   392 raft_consensus.cc:359] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:46.464001   392 raft_consensus.cc:385] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.464466   392 raft_consensus.cc:740] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.463454 32656 tablet_service.cc:1511] Processing CreateTablet for tablet 1393a73f0d20446a997cf1c7c6d2afc0 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:46.476577   392 consensus_queue.cc:260] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:46.483259 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1" is_pre_election: true
W20260709 12:14:46.485145   314 leader_election.cc:343] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.476471 32656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1393a73f0d20446a997cf1c7c6d2afc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.495051 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" is_pre_election: true
W20260709 12:14:46.496685   317 leader_election.cc:343] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.500015   392 ts_tablet_manager.cc:1434] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.009s
I20260709 12:14:46.501299   392 tablet_bootstrap.cc:492] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c: Bootstrap starting.
I20260709 12:14:46.501093 32733 tablet_service.cc:1511] Processing CreateTablet for tablet 1393a73f0d20446a997cf1c7c6d2afc0 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:46.502511 32733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1393a73f0d20446a997cf1c7c6d2afc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.500051   302 heartbeater.cc:499] Master 127.20.102.254:37471 was elected leader, sending a full tablet report...
I20260709 12:14:46.509743 32660 tablet_service.cc:1511] Processing CreateTablet for tablet cfce89c4adc94713aaeecebe61fa0fc0 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:46.508080   391 tablet_bootstrap.cc:654] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.497220   317 leader_election.cc:304] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56f155685b8a404eb23d923b1e058264; no voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1
I20260709 12:14:46.520134   396 raft_consensus.cc:2749] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:46.522955   338 tablet_service.cc:1511] Processing CreateTablet for tablet 1393a73f0d20446a997cf1c7c6d2afc0 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:46.524384   338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1393a73f0d20446a997cf1c7c6d2afc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.530273   341 tablet_service.cc:1511] Processing CreateTablet for tablet cfce89c4adc94713aaeecebe61fa0fc0 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:46.530759 32657 tablet_service.cc:1511] Processing CreateTablet for tablet 62ad3b37613c47ceb02efa66629df8eb (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:46.531742   341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfce89c4adc94713aaeecebe61fa0fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.532469 32732 tablet_service.cc:1511] Processing CreateTablet for tablet cfce89c4adc94713aaeecebe61fa0fc0 (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:46.533839 32732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfce89c4adc94713aaeecebe61fa0fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.542379 32734 tablet_service.cc:1511] Processing CreateTablet for tablet 62ad3b37613c47ceb02efa66629df8eb (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:46.550603   397 tablet_bootstrap.cc:492] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1: No bootstrap required, opened a new log
I20260709 12:14:46.550961 32734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ad3b37613c47ceb02efa66629df8eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.549052   339 tablet_service.cc:1511] Processing CreateTablet for tablet 62ad3b37613c47ceb02efa66629df8eb (DEFAULT_TABLE table=test-workload [id=b05ac5a3b0e54f55838b08f5e4b824a5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:46.565764   339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ad3b37613c47ceb02efa66629df8eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.524377 32660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfce89c4adc94713aaeecebe61fa0fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.536758   392 tablet_bootstrap.cc:654] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.567153   391 tablet_bootstrap.cc:492] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264: No bootstrap required, opened a new log
I20260709 12:14:46.567915   391 ts_tablet_manager.cc:1403] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.006s
W20260709 12:14:46.569350   377 tablet.cc:2406] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:46.571252   391 raft_consensus.cc:359] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.571873   391 raft_consensus.cc:385] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.572165   391 raft_consensus.cc:740] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.573192 32657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ad3b37613c47ceb02efa66629df8eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.572986   391 consensus_queue.cc:260] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.552084   397 ts_tablet_manager.cc:1403] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.022s
I20260709 12:14:46.578269   391 ts_tablet_manager.cc:1434] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:14:46.579545   391 tablet_bootstrap.cc:492] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264: Bootstrap starting.
I20260709 12:14:46.587074   397 raft_consensus.cc:359] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.588546   391 tablet_bootstrap.cc:654] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.593420   397 raft_consensus.cc:385] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.590442   392 tablet_bootstrap.cc:492] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c: No bootstrap required, opened a new log
I20260709 12:14:46.593851   397 raft_consensus.cc:740] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.596705   392 ts_tablet_manager.cc:1403] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.000s
I20260709 12:14:46.600284   392 raft_consensus.cc:359] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.600824   397 consensus_queue.cc:260] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.606388   392 raft_consensus.cc:385] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.606796   392 raft_consensus.cc:740] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.608877   392 consensus_queue.cc:260] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.610574 32695 heartbeater.cc:499] Master 127.20.102.254:37471 was elected leader, sending a full tablet report...
I20260709 12:14:46.610906   397 ts_tablet_manager.cc:1434] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 12:14:46.612423   397 tablet_bootstrap.cc:492] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:46.614501   392 ts_tablet_manager.cc:1434] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:14:46.615790   392 tablet_bootstrap.cc:492] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c: Bootstrap starting.
I20260709 12:14:46.621727   397 tablet_bootstrap.cc:654] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.621922   391 tablet_bootstrap.cc:492] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264: No bootstrap required, opened a new log
I20260709 12:14:46.622668   391 ts_tablet_manager.cc:1403] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.011s
I20260709 12:14:46.626241   391 raft_consensus.cc:359] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:46.627058   391 raft_consensus.cc:385] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.627450   391 raft_consensus.cc:740] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.628531   391 consensus_queue.cc:260] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:46.630276   397 tablet_bootstrap.cc:492] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1: No bootstrap required, opened a new log
I20260709 12:14:46.630980   397 ts_tablet_manager.cc:1403] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:14:46.631340   391 ts_tablet_manager.cc:1434] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:14:46.631795   392 tablet_bootstrap.cc:654] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.632580   391 tablet_bootstrap.cc:492] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264: Bootstrap starting.
I20260709 12:14:46.634339   397 raft_consensus.cc:359] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.635221   397 raft_consensus.cc:385] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.635573   397 raft_consensus.cc:740] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.636509   397 consensus_queue.cc:260] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.639356   397 ts_tablet_manager.cc:1434] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:46.640616   397 tablet_bootstrap.cc:492] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:46.641129   391 tablet_bootstrap.cc:654] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.643152   396 raft_consensus.cc:493] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.643797   396 raft_consensus.cc:515] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:46.644569   392 tablet_bootstrap.cc:492] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c: No bootstrap required, opened a new log
I20260709 12:14:46.645154   392 ts_tablet_manager.cc:1403] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.001s
I20260709 12:14:46.648526   392 raft_consensus.cc:359] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.649466   392 raft_consensus.cc:385] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.649794   392 raft_consensus.cc:740] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.650636   397 tablet_bootstrap.cc:654] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.650570   392 consensus_queue.cc:260] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.651340 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" is_pre_election: true
I20260709 12:14:46.652119 32745 raft_consensus.cc:2468] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 0.
I20260709 12:14:46.653210 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1" is_pre_election: true
W20260709 12:14:46.654302 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:46.656563   392 ts_tablet_manager.cc:1434] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:14:46.657573   317 leader_election.cc:304] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: 
I20260709 12:14:46.658654   395 raft_consensus.cc:2804] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:46.659701   395 raft_consensus.cc:493] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.660094   395 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.661790   391 tablet_bootstrap.cc:492] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264: No bootstrap required, opened a new log
I20260709 12:14:46.662731   391 ts_tablet_manager.cc:1403] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.018s
I20260709 12:14:46.663058   396 leader_election.cc:290] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:46.666951   391 raft_consensus.cc:359] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.667857   391 raft_consensus.cc:385] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.668215   391 raft_consensus.cc:740] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.668452   397 tablet_bootstrap.cc:492] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1: No bootstrap required, opened a new log
W20260709 12:14:46.659230   314 leader_election.cc:343] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.669121   397 ts_tablet_manager.cc:1403] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.006s
I20260709 12:14:46.657824   392 tablet_bootstrap.cc:492] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c: Bootstrap starting.
I20260709 12:14:46.669185   391 consensus_queue.cc:260] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.672081   391 ts_tablet_manager.cc:1434] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:46.674319   397 raft_consensus.cc:359] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.675213   397 raft_consensus.cc:385] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.675442   391 tablet_bootstrap.cc:492] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264: Bootstrap starting.
I20260709 12:14:46.675587   397 raft_consensus.cc:740] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.676574   395 raft_consensus.cc:515] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:46.676596   397 consensus_queue.cc:260] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.679538   397 ts_tablet_manager.cc:1434] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:14:46.679899   395 leader_election.cc:290] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:46.680063 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:46.680913   397 tablet_bootstrap.cc:492] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
W20260709 12:14:46.681529   314 leader_election.cc:343] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.682708 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:46.683089   392 tablet_bootstrap.cc:654] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.683416 32745 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.683605   391 tablet_bootstrap.cc:654] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.689638   397 tablet_bootstrap.cc:654] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.696256   392 tablet_bootstrap.cc:492] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c: No bootstrap required, opened a new log
I20260709 12:14:46.696925   392 ts_tablet_manager.cc:1403] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.000s
I20260709 12:14:46.697702   391 tablet_bootstrap.cc:492] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264: No bootstrap required, opened a new log
I20260709 12:14:46.698657   391 ts_tablet_manager.cc:1403] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.005s
I20260709 12:14:46.699829   395 raft_consensus.cc:493] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.700527   395 raft_consensus.cc:515] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.702907   395 leader_election.cc:290] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:46.703893   391 raft_consensus.cc:359] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.705137 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bea463a96a4081aacf2d8a3646d398" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1" is_pre_election: true
I20260709 12:14:46.705858 32744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bea463a96a4081aacf2d8a3646d398" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" is_pre_election: true
I20260709 12:14:46.706001 32670 raft_consensus.cc:2468] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 0.
I20260709 12:14:46.706597 32744 raft_consensus.cc:2468] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 0.
I20260709 12:14:46.705196   391 raft_consensus.cc:385] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.707726   314 leader_election.cc:304] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:46.708149   391 raft_consensus.cc:740] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.708992   395 raft_consensus.cc:2804] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:46.707736   404 raft_consensus.cc:493] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.709512   395 raft_consensus.cc:493] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.710021   395 raft_consensus.cc:3060] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.709723   404 raft_consensus.cc:515] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.709749   391 consensus_queue.cc:260] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.716810   391 ts_tablet_manager.cc:1434] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:14:46.718487   391 tablet_bootstrap.cc:492] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264: Bootstrap starting.
I20260709 12:14:46.718678   395 raft_consensus.cc:515] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.719822   404 leader_election.cc:290] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:46.720867   392 raft_consensus.cc:359] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.725744 32744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bea463a96a4081aacf2d8a3646d398" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:46.726183   392 raft_consensus.cc:385] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.726440 32744 raft_consensus.cc:3060] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.726547   392 raft_consensus.cc:740] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.727479   392 consensus_queue.cc:260] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.729477   391 tablet_bootstrap.cc:654] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.734289   392 ts_tablet_manager.cc:1434] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:14:46.735551   392 tablet_bootstrap.cc:492] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c: Bootstrap starting.
I20260709 12:14:46.739745 32744 raft_consensus.cc:2468] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 1.
I20260709 12:14:46.750103   317 leader_election.cc:304] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: 
I20260709 12:14:46.751169   396 raft_consensus.cc:2804] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:46.752555   391 tablet_bootstrap.cc:492] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264: No bootstrap required, opened a new log
I20260709 12:14:46.753531   391 ts_tablet_manager.cc:1403] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.003s
I20260709 12:14:46.748605   395 leader_election.cc:290] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:46.758140   391 raft_consensus.cc:359] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.759284   391 raft_consensus.cc:385] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.759794   391 raft_consensus.cc:740] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.761801   391 consensus_queue.cc:260] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.765336   391 ts_tablet_manager.cc:1434] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.002s
I20260709 12:14:46.767098   391 tablet_bootstrap.cc:492] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264: Bootstrap starting.
I20260709 12:14:46.773222   396 raft_consensus.cc:697] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:46.774678   396 consensus_queue.cc:237] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.776922   391 tablet_bootstrap.cc:654] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.785209 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bea463a96a4081aacf2d8a3646d398" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:46.786020 32670 raft_consensus.cc:3060] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.793656   391 tablet_bootstrap.cc:492] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264: No bootstrap required, opened a new log
I20260709 12:14:46.794350 32670 raft_consensus.cc:2468] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 1.
I20260709 12:14:46.794726   391 ts_tablet_manager.cc:1403] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264: Time spent bootstrapping tablet: real 0.028s	user 0.024s	sys 0.000s
I20260709 12:14:46.796648 32745 raft_consensus.cc:2468] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 1.
I20260709 12:14:46.798167   317 leader_election.cc:304] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: f1f31b4cc29144da9485824a934ccac1
I20260709 12:14:46.799510   396 raft_consensus.cc:2804] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:46.800068   396 raft_consensus.cc:697] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:46.799682 32565 catalog_manager.cc:5697] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:46.801115   396 consensus_queue.cc:237] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:46.799631   391 raft_consensus.cc:359] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.809147   391 raft_consensus.cc:385] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.809684   391 raft_consensus.cc:740] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.817020   392 tablet_bootstrap.cc:654] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.817233   391 consensus_queue.cc:260] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.821820   391 ts_tablet_manager.cc:1434] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 12:14:46.823624   391 tablet_bootstrap.cc:492] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264: Bootstrap starting.
I20260709 12:14:46.822136   397 tablet_bootstrap.cc:492] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1: No bootstrap required, opened a new log
I20260709 12:14:46.824440   397 ts_tablet_manager.cc:1403] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.144s	user 0.052s	sys 0.078s
I20260709 12:14:46.825340   351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accbab2923b42cfae4ddfad12ba95d6" candidate_uuid: "f1f31b4cc29144da9485824a934ccac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264" is_pre_election: true
I20260709 12:14:46.826138   351 raft_consensus.cc:2468] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f31b4cc29144da9485824a934ccac1 in term 0.
I20260709 12:14:46.827812 32635 leader_election.cc:304] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:46.828591   404 raft_consensus.cc:2804] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:46.829162   404 raft_consensus.cc:493] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.828979 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accbab2923b42cfae4ddfad12ba95d6" candidate_uuid: "f1f31b4cc29144da9485824a934ccac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" is_pre_election: true
I20260709 12:14:46.829516   404 raft_consensus.cc:3060] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.829809 32745 raft_consensus.cc:2468] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f31b4cc29144da9485824a934ccac1 in term 0.
I20260709 12:14:46.831821   391 tablet_bootstrap.cc:654] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.835415   392 tablet_bootstrap.cc:492] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c: No bootstrap required, opened a new log
I20260709 12:14:46.835950   392 ts_tablet_manager.cc:1403] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent bootstrapping tablet: real 0.101s	user 0.006s	sys 0.006s
I20260709 12:14:46.837497   404 raft_consensus.cc:515] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.838975   392 raft_consensus.cc:359] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.839720   392 raft_consensus.cc:385] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.840013   392 raft_consensus.cc:740] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.840533 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accbab2923b42cfae4ddfad12ba95d6" candidate_uuid: "f1f31b4cc29144da9485824a934ccac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:46.841145 32745 raft_consensus.cc:3060] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.840754   392 consensus_queue.cc:260] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.828506   397 raft_consensus.cc:359] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.842641   397 raft_consensus.cc:385] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.842936   397 raft_consensus.cc:740] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.843689   397 consensus_queue.cc:260] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.845578   391 tablet_bootstrap.cc:492] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264: No bootstrap required, opened a new log
I20260709 12:14:46.846163   391 ts_tablet_manager.cc:1403] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 12:14:46.846202   392 ts_tablet_manager.cc:1434] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:46.847504   392 tablet_bootstrap.cc:492] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c: Bootstrap starting.
I20260709 12:14:46.849220   391 raft_consensus.cc:359] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.849750   391 raft_consensus.cc:385] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.849972   391 raft_consensus.cc:740] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.850831   391 consensus_queue.cc:260] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.852752   391 ts_tablet_manager.cc:1434] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:46.853678   391 tablet_bootstrap.cc:492] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264: Bootstrap starting.
I20260709 12:14:46.853998   397 ts_tablet_manager.cc:1434] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 12:14:46.855129   397 tablet_bootstrap.cc:492] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:46.860323   391 tablet_bootstrap.cc:654] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.861809   397 tablet_bootstrap.cc:654] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.863401   392 tablet_bootstrap.cc:654] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.866636   404 leader_election.cc:290] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [CANDIDATE]: Term 1 election: Requested vote from peers f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:46.868055 32565 catalog_manager.cc:5697] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.871734 32745 raft_consensus.cc:2468] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f31b4cc29144da9485824a934ccac1 in term 1.
I20260709 12:14:46.873684   351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accbab2923b42cfae4ddfad12ba95d6" candidate_uuid: "f1f31b4cc29144da9485824a934ccac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:46.874339   351 raft_consensus.cc:3060] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.877080 32636 leader_election.cc:304] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:46.881152   404 raft_consensus.cc:2804] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:46.881780   404 raft_consensus.cc:697] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 1 LEADER]: Becoming Leader. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Running, Role: LEADER
I20260709 12:14:46.882817   404 consensus_queue.cc:237] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.896011   351 raft_consensus.cc:2468] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f31b4cc29144da9485824a934ccac1 in term 1.
I20260709 12:14:46.900573   391 tablet_bootstrap.cc:492] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264: No bootstrap required, opened a new log
I20260709 12:14:46.905892   391 ts_tablet_manager.cc:1403] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.024s
I20260709 12:14:46.906006 32565 catalog_manager.cc:5697] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1f31b4cc29144da9485824a934ccac1 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "f1f31b4cc29144da9485824a934ccac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.910202   391 raft_consensus.cc:359] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.911253   391 raft_consensus.cc:385] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.911589   391 raft_consensus.cc:740] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.914804   391 consensus_queue.cc:260] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.917811   391 ts_tablet_manager.cc:1434] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:14:46.918952   391 tablet_bootstrap.cc:492] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264: Bootstrap starting.
I20260709 12:14:46.921115   396 raft_consensus.cc:493] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.921142   397 tablet_bootstrap.cc:492] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1: No bootstrap required, opened a new log
I20260709 12:14:46.922012   397 ts_tablet_manager.cc:1403] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.024s
I20260709 12:14:46.921825   396 raft_consensus.cc:515] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.924306   396 leader_election.cc:290] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:46.925189 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1" is_pre_election: true
I20260709 12:14:46.925522 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" is_pre_election: true
I20260709 12:14:46.925822   397 raft_consensus.cc:359] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:46.926685   397 raft_consensus.cc:385] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:46.926971   314 leader_election.cc:343] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.927045   397 raft_consensus.cc:740] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
W20260709 12:14:46.927614   317 leader_election.cc:343] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.928161   317 leader_election.cc:304] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56f155685b8a404eb23d923b1e058264; no voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1
I20260709 12:14:46.928082   397 consensus_queue.cc:260] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:46.929498   396 raft_consensus.cc:2749] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:46.930682   397 ts_tablet_manager.cc:1434] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:14:46.931829   392 tablet_bootstrap.cc:492] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c: No bootstrap required, opened a new log
I20260709 12:14:46.931926   397 tablet_bootstrap.cc:492] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:46.932294   391 tablet_bootstrap.cc:654] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.932582   392 ts_tablet_manager.cc:1403] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.015s
I20260709 12:14:46.936668   392 raft_consensus.cc:359] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.937871   392 raft_consensus.cc:385] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.938337   392 raft_consensus.cc:740] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.939468   397 tablet_bootstrap.cc:654] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.939639   392 consensus_queue.cc:260] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.944046   392 ts_tablet_manager.cc:1434] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:14:46.945760   392 tablet_bootstrap.cc:492] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c: Bootstrap starting.
I20260709 12:14:46.949517   391 tablet_bootstrap.cc:492] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264: No bootstrap required, opened a new log
I20260709 12:14:46.950235   391 ts_tablet_manager.cc:1403] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.009s
I20260709 12:14:46.953585   391 raft_consensus.cc:359] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.954156   392 tablet_bootstrap.cc:654] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.954411   391 raft_consensus.cc:385] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.954773   391 raft_consensus.cc:740] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.955684   391 consensus_queue.cc:260] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.960824   397 tablet_bootstrap.cc:492] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1: No bootstrap required, opened a new log
I20260709 12:14:46.961539   397 ts_tablet_manager.cc:1403] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.010s
I20260709 12:14:46.961907   391 ts_tablet_manager.cc:1434] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:14:46.965003   397 raft_consensus.cc:359] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.965850   397 raft_consensus.cc:385] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.966156   397 raft_consensus.cc:740] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.966786   392 tablet_bootstrap.cc:492] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c: No bootstrap required, opened a new log
I20260709 12:14:46.966940   397 consensus_queue.cc:260] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.967549   392 ts_tablet_manager.cc:1403] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:14:46.969540   397 ts_tablet_manager.cc:1434] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:46.970743   397 tablet_bootstrap.cc:492] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:46.971359   392 raft_consensus.cc:359] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.972231   392 raft_consensus.cc:385] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.972528   392 raft_consensus.cc:740] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.973346   392 consensus_queue.cc:260] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.975421   392 ts_tablet_manager.cc:1434] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:14:46.976505   392 tablet_bootstrap.cc:492] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c: Bootstrap starting.
I20260709 12:14:46.980118   397 tablet_bootstrap.cc:654] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.982658   392 tablet_bootstrap.cc:654] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.989588   392 tablet_bootstrap.cc:492] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c: No bootstrap required, opened a new log
I20260709 12:14:46.989596   397 tablet_bootstrap.cc:492] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1: No bootstrap required, opened a new log
I20260709 12:14:46.990289   397 ts_tablet_manager.cc:1403] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 12:14:46.990289   392 ts_tablet_manager.cc:1403] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:14:46.993717   392 raft_consensus.cc:359] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.993674   397 raft_consensus.cc:359] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.994549   392 raft_consensus.cc:385] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.994715   397 raft_consensus.cc:385] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.994875   392 raft_consensus.cc:740] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.995322   397 raft_consensus.cc:740] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.995800   392 consensus_queue.cc:260] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.996140   397 consensus_queue.cc:260] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:46.997921   392 ts_tablet_manager.cc:1434] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:46.999064   397 ts_tablet_manager.cc:1434] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:46.999197   392 tablet_bootstrap.cc:492] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c: Bootstrap starting.
I20260709 12:14:47.000511   397 tablet_bootstrap.cc:492] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:47.006032   392 tablet_bootstrap.cc:654] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.009092   397 tablet_bootstrap.cc:654] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.011364   392 tablet_bootstrap.cc:492] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c: No bootstrap required, opened a new log
I20260709 12:14:47.012002   392 ts_tablet_manager.cc:1403] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:14:47.015539   392 raft_consensus.cc:359] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.016062   392 raft_consensus.cc:385] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.016286   392 raft_consensus.cc:740] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.016913   392 consensus_queue.cc:260] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.016996   397 tablet_bootstrap.cc:492] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1: No bootstrap required, opened a new log
I20260709 12:14:47.016966   396 raft_consensus.cc:493] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.017907   397 ts_tablet_manager.cc:1403] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:14:47.017838   396 raft_consensus.cc:515] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.018885   392 ts_tablet_manager.cc:1434] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:14:47.020184   392 tablet_bootstrap.cc:492] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c: Bootstrap starting.
I20260709 12:14:47.021600 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35a3899339541df8d9abd16b89a2a27" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1" is_pre_election: true
I20260709 12:14:47.021533   397 raft_consensus.cc:359] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.022516   397 raft_consensus.cc:385] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.022511 32670 raft_consensus.cc:2468] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 0.
I20260709 12:14:47.023048   397 raft_consensus.cc:740] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.023540 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35a3899339541df8d9abd16b89a2a27" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" is_pre_election: true
I20260709 12:14:47.024361 32745 raft_consensus.cc:2468] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 0.
I20260709 12:14:47.024004   397 consensus_queue.cc:260] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.025998   392 tablet_bootstrap.cc:654] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.026541   397 ts_tablet_manager.cc:1434] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:14:47.027863   397 tablet_bootstrap.cc:492] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:47.028245   317 leader_election.cc:304] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: 
I20260709 12:14:47.030828   392 tablet_bootstrap.cc:492] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c: No bootstrap required, opened a new log
I20260709 12:14:47.031442   392 ts_tablet_manager.cc:1403] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:14:47.030881   415 raft_consensus.cc:2804] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.032496   415 raft_consensus.cc:493] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.032917   415 raft_consensus.cc:3060] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.034279   392 raft_consensus.cc:359] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.034854   392 raft_consensus.cc:385] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.035022   397 tablet_bootstrap.cc:654] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.035087   392 raft_consensus.cc:740] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.036105   392 consensus_queue.cc:260] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.037693   399 raft_consensus.cc:493] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.037806   392 ts_tablet_manager.cc:1434] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:14:47.038203   399 raft_consensus.cc:515] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.040899   396 leader_election.cc:290] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:47.041541   397 tablet_bootstrap.cc:492] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1: No bootstrap required, opened a new log
I20260709 12:14:47.042163   397 ts_tablet_manager.cc:1403] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:14:47.045521   397 raft_consensus.cc:359] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.046262   397 raft_consensus.cc:385] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.046581   397 raft_consensus.cc:740] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.047322   397 consensus_queue.cc:260] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.049680   397 ts_tablet_manager.cc:1434] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:47.051299   397 tablet_bootstrap.cc:492] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:47.049635   399 leader_election.cc:290] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:47.058393   397 tablet_bootstrap.cc:654] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.058537   404 raft_consensus.cc:493] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.059154   404 raft_consensus.cc:515] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.059542   415 raft_consensus.cc:515] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.061498   404 leader_election.cc:290] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:47.063342 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "f1f31b4cc29144da9485824a934ccac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" is_pre_election: true
I20260709 12:14:47.064023 32745 raft_consensus.cc:2468] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f31b4cc29144da9485824a934ccac1 in term 0.
I20260709 12:14:47.064137   351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "f1f31b4cc29144da9485824a934ccac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264" is_pre_election: true
I20260709 12:14:47.065557   351 raft_consensus.cc:2468] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f31b4cc29144da9485824a934ccac1 in term 0.
I20260709 12:14:47.067068 32744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35a3899339541df8d9abd16b89a2a27" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:47.067261 32635 leader_election.cc:304] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:47.068135 32744 raft_consensus.cc:3060] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.068650   404 raft_consensus.cc:2804] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.069228   404 raft_consensus.cc:493] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.069626   404 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.064276 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35a3899339541df8d9abd16b89a2a27" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:47.073237 32670 raft_consensus.cc:3060] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.078326   404 raft_consensus.cc:515] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.081491 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "f1f31b4cc29144da9485824a934ccac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:47.082108 32745 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.061520   415 leader_election.cc:290] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:47.091957   404 leader_election.cc:290] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [CANDIDATE]: Term 1 election: Requested vote from peers f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:47.091984   351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "f1f31b4cc29144da9485824a934ccac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:47.092671 32745 raft_consensus.cc:2468] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f31b4cc29144da9485824a934ccac1 in term 1.
I20260709 12:14:47.093425   351 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.093600 32669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1393a73f0d20446a997cf1c7c6d2afc0" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1" is_pre_election: true
I20260709 12:14:47.094120 32636 leader_election.cc:304] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:47.094365 32669 raft_consensus.cc:2468] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 0.
I20260709 12:14:47.095137   424 raft_consensus.cc:2804] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.095501 32708 leader_election.cc:304] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:47.096387   399 raft_consensus.cc:2804] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.096747   399 raft_consensus.cc:493] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.097059   399 raft_consensus.cc:3060] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.104064   399 raft_consensus.cc:515] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.107447   415 raft_consensus.cc:493] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.111378   415 raft_consensus.cc:515] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.115578 32669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1" is_pre_election: true
I20260709 12:14:47.116689 32669 raft_consensus.cc:2468] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 0.
I20260709 12:14:47.118595   314 leader_election.cc:304] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:47.121574   396 raft_consensus.cc:2804] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.122175   396 raft_consensus.cc:493] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.122644   396 raft_consensus.cc:3060] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.125963   415 leader_election.cc:290] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:47.127827 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" is_pre_election: true
I20260709 12:14:47.132547   351 raft_consensus.cc:2468] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f31b4cc29144da9485824a934ccac1 in term 1.
I20260709 12:14:47.112205 32744 raft_consensus.cc:2468] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 1.
I20260709 12:14:47.129395 32670 raft_consensus.cc:2468] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 1.
I20260709 12:14:47.166599   314 leader_election.cc:304] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:47.169358   396 raft_consensus.cc:515] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.134219 32669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1393a73f0d20446a997cf1c7c6d2afc0" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:47.129652 32745 raft_consensus.cc:2468] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 0.
I20260709 12:14:47.128692   399 leader_election.cc:290] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:47.172343   415 raft_consensus.cc:2804] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.177405   415 raft_consensus.cc:697] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:47.177546   350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1393a73f0d20446a997cf1c7c6d2afc0" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:47.178032   443 raft_consensus.cc:493] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.178373   350 raft_consensus.cc:3060] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.178609   443 raft_consensus.cc:515] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.181566   443 leader_election.cc:290] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:47.173908 32669 raft_consensus.cc:3060] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.183035   349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfce89c4adc94713aaeecebe61fa0fc0" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264" is_pre_election: true
I20260709 12:14:47.183835   349 raft_consensus.cc:2468] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 0.
I20260709 12:14:47.177028   351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1393a73f0d20446a997cf1c7c6d2afc0" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264" is_pre_election: true
I20260709 12:14:47.178506   415 consensus_queue.cc:237] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.187058   396 leader_election.cc:290] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:47.185781 32710 leader_election.cc:304] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: 
I20260709 12:14:47.187984   397 tablet_bootstrap.cc:492] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1: No bootstrap required, opened a new log
I20260709 12:14:47.175771   399 raft_consensus.cc:493] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.191325   397 ts_tablet_manager.cc:1403] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.140s	user 0.054s	sys 0.057s
I20260709 12:14:47.191277   399 raft_consensus.cc:515] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.192229 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:47.189543 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfce89c4adc94713aaeecebe61fa0fc0" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1" is_pre_election: true
I20260709 12:14:47.188037   443 raft_consensus.cc:493] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.190059 32668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:47.194929 32668 raft_consensus.cc:3060] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.174196   424 raft_consensus.cc:697] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 1 LEADER]: Becoming Leader. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Running, Role: LEADER
I20260709 12:14:47.198586   397 raft_consensus.cc:359] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.199836   397 raft_consensus.cc:385] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.200258   397 raft_consensus.cc:740] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.196740   351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264" is_pre_election: true
I20260709 12:14:47.202883   351 raft_consensus.cc:2468] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 0.
I20260709 12:14:47.203326 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1" is_pre_election: true
I20260709 12:14:47.204077 32670 raft_consensus.cc:2468] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 0.
I20260709 12:14:47.205294   444 raft_consensus.cc:2804] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.204900 32710 leader_election.cc:304] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: 
I20260709 12:14:47.202488   424 consensus_queue.cc:237] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.205861   444 raft_consensus.cc:493] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.206382   444 raft_consensus.cc:3060] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.216351   442 raft_consensus.cc:493] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.197006 32745 raft_consensus.cc:3060] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.217064   442 raft_consensus.cc:515] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:47.221601   442 leader_election.cc:290] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:47.218125   397 consensus_queue.cc:260] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.224390 32744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "f1f31b4cc29144da9485824a934ccac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" is_pre_election: true
I20260709 12:14:47.224694   351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "f1f31b4cc29144da9485824a934ccac1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264" is_pre_election: true
I20260709 12:14:47.196539   443 raft_consensus.cc:515] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.225358 32744 raft_consensus.cc:2393] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1f31b4cc29144da9485824a934ccac1 in current term 1: Already voted for candidate 56f155685b8a404eb23d923b1e058264 in this term.
I20260709 12:14:47.226675 32636 leader_election.cc:304] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1f31b4cc29144da9485824a934ccac1; no voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c
I20260709 12:14:47.227941   442 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.227845   443 leader_election.cc:290] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:47.223810   397 ts_tablet_manager.cc:1434] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:14:47.197240   399 leader_election.cc:290] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:47.197594   350 raft_consensus.cc:2468] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 1.
I20260709 12:14:47.231434   443 raft_consensus.cc:2804] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:14:47.232128 32708 leader_election.cc:343] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.232359   443 raft_consensus.cc:493] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.232983   443 raft_consensus.cc:3060] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.232149 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1" is_pre_election: true
I20260709 12:14:47.235145 32670 raft_consensus.cc:2468] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 0.
I20260709 12:14:47.236735 32708 leader_election.cc:304] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:47.238117 32567 catalog_manager.cc:5697] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1f31b4cc29144da9485824a934ccac1 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "f1f31b4cc29144da9485824a934ccac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.238991   444 raft_consensus.cc:515] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.241243 32566 catalog_manager.cc:5697] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.244338   444 leader_election.cc:290] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:47.242039 32669 raft_consensus.cc:2468] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 1.
I20260709 12:14:47.244966   399 raft_consensus.cc:2804] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.245940   399 raft_consensus.cc:493] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.246344   399 raft_consensus.cc:3060] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.232163   351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264" is_pre_election: true
I20260709 12:14:47.240422 32668 raft_consensus.cc:2468] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 1.
I20260709 12:14:47.249114   314 leader_election.cc:304] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:47.250156   415 raft_consensus.cc:2804] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.250730   415 raft_consensus.cc:697] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:47.252936   351 raft_consensus.cc:2468] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 0.
I20260709 12:14:47.253095   350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfce89c4adc94713aaeecebe61fa0fc0" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:47.256343   415 consensus_queue.cc:237] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.257336   350 raft_consensus.cc:3060] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.257582   399 raft_consensus.cc:515] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.259927   399 leader_election.cc:290] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:47.250641 32745 raft_consensus.cc:2468] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 1.
I20260709 12:14:47.254560 32668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfce89c4adc94713aaeecebe61fa0fc0" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:47.261677 32668 raft_consensus.cc:3060] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.265450   350 raft_consensus.cc:2468] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 1.
I20260709 12:14:47.252583 32710 leader_election.cc:304] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: 
I20260709 12:14:47.269423 32710 leader_election.cc:304] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: 
I20260709 12:14:47.269902 32669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:47.270444   350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:47.270630 32669 raft_consensus.cc:3060] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.271165   350 raft_consensus.cc:3060] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.255000   442 raft_consensus.cc:2749] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.273496   444 raft_consensus.cc:2804] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.274089   444 raft_consensus.cc:697] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:47.275033   444 consensus_queue.cc:237] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.278712   446 raft_consensus.cc:2804] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.278920   443 raft_consensus.cc:515] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.282265   443 leader_election.cc:290] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:47.283418 32670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:47.284344 32670 raft_consensus.cc:3060] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.291000   351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:47.291802   351 raft_consensus.cc:3060] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.294461 32670 raft_consensus.cc:2468] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 1.
I20260709 12:14:47.295965 32708 leader_election.cc:304] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:47.297093   443 raft_consensus.cc:2804] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.297645   443 raft_consensus.cc:697] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:47.298594   443 consensus_queue.cc:237] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.300505   351 raft_consensus.cc:2468] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 1.
I20260709 12:14:47.302757 32669 raft_consensus.cc:2468] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 1.
I20260709 12:14:47.302135 32567 catalog_manager.cc:5697] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.280311 32668 raft_consensus.cc:2468] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 1.
I20260709 12:14:47.304312 32708 leader_election.cc:304] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:47.307374   399 raft_consensus.cc:2804] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.307894   399 raft_consensus.cc:697] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:47.312322   415 consensus_queue.cc:1048] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.321475   446 raft_consensus.cc:697] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:47.322563   446 consensus_queue.cc:237] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.309286   399 consensus_queue.cc:237] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:47.336115   350 raft_consensus.cc:2468] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 1.
I20260709 12:14:47.342072 32567 catalog_manager.cc:5697] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.348337   415 consensus_queue.cc:1048] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.358074   395 consensus_queue.cc:1048] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:47.373798   395 consensus_queue.cc:1048] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:47.388748 32566 catalog_manager.cc:5697] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.394495 32566 catalog_manager.cc:5697] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.396456 32566 catalog_manager.cc:5697] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 1 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.459735   442 consensus_queue.cc:1048] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:47.472664   424 consensus_queue.cc:1048] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.615309 20891 ts_manager.cc:295] Set tserver state for f1f31b4cc29144da9485824a934ccac1 to MAINTENANCE_MODE
I20260709 12:14:47.616365 20891 tablet_server.cc:179] TabletServer@127.20.102.193:0 shutting down...
I20260709 12:14:47.621919   424 consensus_queue.cc:1048] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.641322   442 consensus_queue.cc:1048] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:47.657682 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:47.663739 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:47.664918 20891 tablet_replica.cc:333] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1: stopping tablet replica
I20260709 12:14:47.666045 20891 raft_consensus.cc:2243] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.666574 20891 raft_consensus.cc:2272] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.669332 20891 tablet_replica.cc:333] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1: stopping tablet replica
I20260709 12:14:47.669970 20891 raft_consensus.cc:2243] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.670387 20891 raft_consensus.cc:2272] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.672418 20891 tablet_replica.cc:333] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1: stopping tablet replica
I20260709 12:14:47.673090 20891 raft_consensus.cc:2243] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.673616 20891 raft_consensus.cc:2272] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.675537 20891 tablet_replica.cc:333] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1: stopping tablet replica
I20260709 12:14:47.676218 20891 raft_consensus.cc:2243] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.676627 20891 raft_consensus.cc:2272] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.678651 20891 tablet_replica.cc:333] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1: stopping tablet replica
I20260709 12:14:47.679387 20891 raft_consensus.cc:2243] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.679829 20891 raft_consensus.cc:2272] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.681841 20891 tablet_replica.cc:333] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1: stopping tablet replica
I20260709 12:14:47.682350 20891 raft_consensus.cc:2243] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.682715 20891 raft_consensus.cc:2272] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.685105 20891 tablet_replica.cc:333] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1: stopping tablet replica
I20260709 12:14:47.685621 20891 raft_consensus.cc:2243] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.685933 20891 raft_consensus.cc:2272] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.687597 20891 tablet_replica.cc:333] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1: stopping tablet replica
I20260709 12:14:47.688088 20891 raft_consensus.cc:2243] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.689105 20891 raft_consensus.cc:2272] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.691567 20891 tablet_replica.cc:333] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1: stopping tablet replica
I20260709 12:14:47.692045 20891 raft_consensus.cc:2243] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.692871 20891 raft_consensus.cc:2272] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.695132 20891 tablet_replica.cc:333] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1: stopping tablet replica
I20260709 12:14:47.695585 20891 raft_consensus.cc:2243] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.695938 20891 raft_consensus.cc:2272] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:47.720084 32708 consensus_peers.cc:597] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.725332 32708 consensus_peers.cc:597] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.726917 20891 tablet_server.cc:196] TabletServer@127.20.102.193:0 shutdown complete.
W20260709 12:14:47.736145 32708 consensus_peers.cc:597] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.750800   314 consensus_peers.cc:597] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.801649 32708 consensus_peers.cc:597] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.807893   399 consensus_queue.cc:1048] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:47.808418   415 consensus_queue.cc:1048] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.838420   399 consensus_queue.cc:1048] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:47.857528   415 consensus_queue.cc:1048] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:47.859278   314 consensus_peers.cc:597] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.879388   446 consensus_queue.cc:1048] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:47.903384   444 consensus_queue.cc:1048] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:47.957201   314 consensus_peers.cc:597] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.964563   314 consensus_peers.cc:597] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:48.641330 32708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111) [suppressed 143 similar messages]
W20260709 12:14:48.658872 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:48.972070   475 raft_consensus.cc:493] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1f31b4cc29144da9485824a934ccac1)
I20260709 12:14:48.972666   475 raft_consensus.cc:515] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:48.974460   475 leader_election.cc:290] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:48.975716 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accbab2923b42cfae4ddfad12ba95d6" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" is_pre_election: true
I20260709 12:14:48.976306 32745 raft_consensus.cc:2468] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 1.
I20260709 12:14:48.977597   317 leader_election.cc:304] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: 
I20260709 12:14:48.978498   475 raft_consensus.cc:2804] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:48.978706   314 leader_election.cc:336] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111)
I20260709 12:14:48.978844   475 raft_consensus.cc:493] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1f31b4cc29144da9485824a934ccac1)
I20260709 12:14:48.979357   475 raft_consensus.cc:3060] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.985143   475 raft_consensus.cc:515] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:48.987293   475 leader_election.cc:290] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:48.988593 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accbab2923b42cfae4ddfad12ba95d6" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:48.989460 32745 raft_consensus.cc:3060] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:48.991669   314 leader_election.cc:336] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111)
I20260709 12:14:48.995365 32745 raft_consensus.cc:2468] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 2.
I20260709 12:14:48.996829   317 leader_election.cc:304] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: f1f31b4cc29144da9485824a934ccac1
I20260709 12:14:48.997691   475 raft_consensus.cc:2804] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:48.998795   475 raft_consensus.cc:697] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:48.999603   475 consensus_queue.cc:237] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:49.007457 32567 catalog_manager.cc:5697] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 1 to 2, leader changed from f1f31b4cc29144da9485824a934ccac1 (127.20.102.193) to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:49.145548   444 raft_consensus.cc:493] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1f31b4cc29144da9485824a934ccac1)
I20260709 12:14:49.146001   444 raft_consensus.cc:515] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:49.147636   444 leader_election.cc:290] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:49.149099   350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56f155685b8a404eb23d923b1e058264" is_pre_election: true
W20260709 12:14:49.151563 32708 leader_election.cc:336] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111)
I20260709 12:14:49.152145 32708 leader_election.cc:304] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c; no voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1
I20260709 12:14:49.152958   444 raft_consensus.cc:2749] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:49.162088   475 raft_consensus.cc:493] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1f31b4cc29144da9485824a934ccac1)
I20260709 12:14:49.162791   475 raft_consensus.cc:515] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:49.165198   475 leader_election.cc:290] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:49.166569 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" is_pre_election: true
I20260709 12:14:49.167460 32745 raft_consensus.cc:2468] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 1.
I20260709 12:14:49.168848   317 leader_election.cc:304] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: 
W20260709 12:14:49.169462   314 leader_election.cc:336] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111)
I20260709 12:14:49.169641   475 raft_consensus.cc:2804] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:49.170114   475 raft_consensus.cc:493] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1f31b4cc29144da9485824a934ccac1)
I20260709 12:14:49.170433   475 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.176429   475 raft_consensus.cc:515] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:49.178339   475 leader_election.cc:290] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:49.179656 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:49.180323 32745 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:49.182461   314 leader_election.cc:336] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111)
I20260709 12:14:49.185868 32745 raft_consensus.cc:2468] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 2.
I20260709 12:14:49.187139   317 leader_election.cc:304] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: f1f31b4cc29144da9485824a934ccac1
I20260709 12:14:49.187963   475 raft_consensus.cc:2804] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:49.188432   475 raft_consensus.cc:697] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:49.189203   475 consensus_queue.cc:237] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:49.197592 32567 catalog_manager.cc:5697] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 1 to 2, leader changed from f1f31b4cc29144da9485824a934ccac1 (127.20.102.193) to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:49.392347   314 consensus_peers.cc:597] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:49.630491 32745 raft_consensus.cc:1275] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.633721   476 consensus_queue.cc:1048] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:14:49.660301 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:49.704471   314 consensus_peers.cc:597] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:49.794740 32745 raft_consensus.cc:1275] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.796324   476 consensus_queue.cc:1048] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:50.094322 32708 consensus_peers.cc:597] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.128458 32708 consensus_peers.cc:597] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.213107   314 consensus_peers.cc:597] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.376906   314 consensus_peers.cc:597] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.379019 32708 consensus_peers.cc:597] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.466521 32708 consensus_peers.cc:597] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.501569   314 consensus_peers.cc:597] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.596576   314 consensus_peers.cc:597] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.661465 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:51.662770 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:51.687613   314 consensus_peers.cc:597] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:52.035346   314 consensus_peers.cc:597] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:52.498626 32708 consensus_peers.cc:597] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.663797 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:52.748641 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:52.759912   491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:52.759969   492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:52.761322   494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:52.762022 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:52.764503 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:52.764850 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:52.765100 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599292765076 us; error 0 us; skew 500 ppm
I20260709 12:14:52.765859 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:52.771463 20891 webserver.cc:533] Webserver started at http://127.20.102.193:45595/ using document root <none> and password file <none>
I20260709 12:14:52.772341 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:52.772603 20891 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:14:52.777748 20891 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:14:52.783345   499 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:52.785259 20891 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.000s
I20260709 12:14:52.785691 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-0-root
uuid: "f1f31b4cc29144da9485824a934ccac1"
format_stamp: "Formatted at 2026-07-09 12:14:45 on dist-test-slave-296p"
I20260709 12:14:52.786410 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895025208-20891-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:14:52.789059 32708 consensus_peers.cc:597] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:52.807346 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:52.809159 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:52.810957 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:52.815205   506 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:14:52.869406 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:14:52.869692 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.056s	user 0.001s	sys 0.002s
I20260709 12:14:52.870108 20891 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
W20260709 12:14:52.877345   314 consensus_peers.cc:597] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:52.877907   506 tablet_bootstrap.cc:492] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
W20260709 12:14:52.891393   314 consensus_peers.cc:597] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.895139 32708 consensus_peers.cc:597] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:52.898963   506 tablet_bootstrap.cc:492] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:52.900070   506 tablet_bootstrap.cc:492] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1: Bootstrap complete.
I20260709 12:14:52.900835   506 ts_tablet_manager.cc:1403] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.011s
I20260709 12:14:52.903765   506 raft_consensus.cc:359] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:52.904505   506 raft_consensus.cc:740] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.905354   506 consensus_queue.cc:260] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:52.907980   506 ts_tablet_manager.cc:1434] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:14:52.908715   506 tablet_bootstrap.cc:492] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
W20260709 12:14:52.915481 32708 consensus_peers.cc:597] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:52.921639   506 tablet_bootstrap.cc:492] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:52.922446   506 tablet_bootstrap.cc:492] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1: Bootstrap complete.
I20260709 12:14:52.923081   506 ts_tablet_manager.cc:1403] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:14:52.925462   506 raft_consensus.cc:359] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:52.926024   506 raft_consensus.cc:740] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.926635   506 consensus_queue.cc:260] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:52.928138   506 ts_tablet_manager.cc:1434] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:52.928926   506 tablet_bootstrap.cc:492] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:52.929064 20891 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:14:52.929508 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.059s	user 0.046s	sys 0.012s
I20260709 12:14:52.943467   506 tablet_bootstrap.cc:492] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:52.944336   506 tablet_bootstrap.cc:492] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1: Bootstrap complete.
I20260709 12:14:52.944983   506 ts_tablet_manager.cc:1403] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.006s
I20260709 12:14:52.947305   506 raft_consensus.cc:359] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:52.947863   506 raft_consensus.cc:740] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.948557   506 consensus_queue.cc:260] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:52.950606   506 ts_tablet_manager.cc:1434] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:52.951398   506 tablet_bootstrap.cc:492] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:52.965731   506 tablet_bootstrap.cc:492] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:52.966553   506 tablet_bootstrap.cc:492] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1: Bootstrap complete.
I20260709 12:14:52.967204   506 ts_tablet_manager.cc:1403] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:14:52.969501   506 raft_consensus.cc:359] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:52.970074   506 raft_consensus.cc:740] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.970763   506 consensus_queue.cc:260] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:52.972301   506 ts_tablet_manager.cc:1434] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:52.973142   506 tablet_bootstrap.cc:492] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:52.984637   506 tablet_bootstrap.cc:492] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:52.985409   506 tablet_bootstrap.cc:492] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1: Bootstrap complete.
I20260709 12:14:52.986140   506 ts_tablet_manager.cc:1403] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 12:14:52.988314   506 raft_consensus.cc:359] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:52.989014   506 raft_consensus.cc:740] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.989866   506 consensus_queue.cc:260] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:52.991511   506 ts_tablet_manager.cc:1434] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.002s
I20260709 12:14:52.992311   506 tablet_bootstrap.cc:492] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:52.998267 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.193:46581
I20260709 12:14:52.998399   568 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.193:46581 every 8 connection(s)
I20260709 12:14:53.005750 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:53.007493   506 tablet_bootstrap.cc:492] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:53.008597   506 tablet_bootstrap.cc:492] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1: Bootstrap complete.
I20260709 12:14:53.010699   506 ts_tablet_manager.cc:1403] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.006s
I20260709 12:14:53.018730   506 raft_consensus.cc:359] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.019834   506 raft_consensus.cc:740] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.020743   506 consensus_queue.cc:260] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.023008   506 ts_tablet_manager.cc:1434] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 12:14:53.023826   506 tablet_bootstrap.cc:492] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:53.037313   569 heartbeater.cc:344] Connected to a master server at 127.20.102.254:37471
I20260709 12:14:53.037981   569 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:53.038254   350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
mode: GRACEFUL
new_leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:44862
I20260709 12:14:53.039374   506 tablet_bootstrap.cc:492] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:53.039124   350 raft_consensus.cc:606] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Received request to transfer leadership to TS f0461bc9dac3437a822aa81b58ecbd3c
I20260709 12:14:53.039052   569 heartbeater.cc:507] Master 127.20.102.254:37471 requested a full tablet report, sending...
I20260709 12:14:53.040591   506 tablet_bootstrap.cc:492] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1: Bootstrap complete.
I20260709 12:14:53.041292   506 ts_tablet_manager.cc:1403] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:14:53.043035   350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
mode: GRACEFUL
new_leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:44862
I20260709 12:14:53.043671   350 raft_consensus.cc:606] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Received request to transfer leadership to TS f0461bc9dac3437a822aa81b58ecbd3c
I20260709 12:14:53.043840   506 raft_consensus.cc:359] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.044545   506 raft_consensus.cc:740] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.045425   506 consensus_queue.cc:260] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.047467   506 ts_tablet_manager.cc:1434] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:53.048367   506 tablet_bootstrap.cc:492] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:53.054014 32567 ts_manager.cc:194] Re-registered known tserver with Master: f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581)
I20260709 12:14:53.066521   506 tablet_bootstrap.cc:492] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:53.067619   506 tablet_bootstrap.cc:492] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1: Bootstrap complete.
I20260709 12:14:53.067648 32567 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52106
I20260709 12:14:53.068291   506 ts_tablet_manager.cc:1403] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.007s
W20260709 12:14:53.069744   314 consensus_peers.cc:597] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:53.071169   506 raft_consensus.cc:359] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.071688   506 raft_consensus.cc:740] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.071833   569 heartbeater.cc:499] Master 127.20.102.254:37471 was elected leader, sending a full tablet report...
I20260709 12:14:53.072482   506 consensus_queue.cc:260] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.074208   506 ts_tablet_manager.cc:1434] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:53.075058   506 tablet_bootstrap.cc:492] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:53.080950 32745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
mode: GRACEFUL
new_leader_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:35632
I20260709 12:14:53.081645 32745 raft_consensus.cc:606] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Received request to transfer leadership to TS 56f155685b8a404eb23d923b1e058264
I20260709 12:14:53.083272 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:53.084098 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:53.085106 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:53.091456   506 tablet_bootstrap.cc:492] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:53.092307   506 tablet_bootstrap.cc:492] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1: Bootstrap complete.
I20260709 12:14:53.092924   506 ts_tablet_manager.cc:1403] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:14:53.095394   506 raft_consensus.cc:359] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.095970   506 raft_consensus.cc:740] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.096786   506 consensus_queue.cc:260] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.098673   506 ts_tablet_manager.cc:1434] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:53.099566   506 tablet_bootstrap.cc:492] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1: Bootstrap starting.
I20260709 12:14:53.112108   506 tablet_bootstrap.cc:492] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:53.112964   506 tablet_bootstrap.cc:492] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1: Bootstrap complete.
I20260709 12:14:53.113557   506 ts_tablet_manager.cc:1403] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:14:53.115651   506 raft_consensus.cc:359] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.116199   506 raft_consensus.cc:740] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f31b4cc29144da9485824a934ccac1, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.116852   506 consensus_queue.cc:260] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.118515   506 ts_tablet_manager.cc:1434] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:53.203652   476 raft_consensus.cc:993] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264: : Instructing follower f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:53.204296   582 raft_consensus.cc:1081] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Signalling peer f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:53.206125 32745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:33252
I20260709 12:14:53.206820 32745 raft_consensus.cc:493] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:53.207203 32745 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.215261 32745 raft_consensus.cc:515] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:53.217338 32745 leader_election.cc:290] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 2 election: Requested vote from peers 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197), f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581)
I20260709 12:14:53.218420   350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:53.219354   350 raft_consensus.cc:3055] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:53.219702   350 raft_consensus.cc:740] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:53.220580   350 consensus_queue.cc:260] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:53.221908   350 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.228345   350 raft_consensus.cc:2468] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 2.
I20260709 12:14:53.228672   542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:53.229436   542 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.229974 32710 leader_election.cc:304] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: 
I20260709 12:14:53.231175   489 raft_consensus.cc:2804] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:53.232853   489 raft_consensus.cc:697] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:53.234017   489 consensus_queue.cc:237] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:53.236474   543 raft_consensus.cc:3060] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.238950   542 raft_consensus.cc:2468] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 2.
I20260709 12:14:53.244033 32567 catalog_manager.cc:5697] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 1 to 2, leader changed from 56f155685b8a404eb23d923b1e058264 (127.20.102.195) to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:53.464092   542 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.475024   583 raft_consensus.cc:993] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c: : Instructing follower 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:53.475857   489 raft_consensus.cc:1081] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Signalling peer 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:53.478266   350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:44716
I20260709 12:14:53.478883   350 raft_consensus.cc:493] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:53.479234   350 raft_consensus.cc:3060] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.486852   350 raft_consensus.cc:515] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.488996   350 leader_election.cc:290] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:53.489878   542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:53.490265 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:53.490654   542 raft_consensus.cc:3060] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.491108 32745 raft_consensus.cc:3055] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:53.491417 32745 raft_consensus.cc:740] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:53.492239 32745 consensus_queue.cc:260] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.493440 32745 raft_consensus.cc:3060] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.496248   542 raft_consensus.cc:2468] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 2.
I20260709 12:14:53.497574   314 leader_election.cc:304] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:53.498508   582 raft_consensus.cc:2804] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:53.498981   582 raft_consensus.cc:697] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:53.499913   582 consensus_queue.cc:237] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.500638 32745 raft_consensus.cc:2468] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 2.
I20260709 12:14:53.507470 32568 catalog_manager.cc:5697] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 1 to 2, leader changed from f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194) to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:53.613766   582 raft_consensus.cc:993] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264: : Instructing follower f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:53.614363   476 raft_consensus.cc:1081] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Signalling peer f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:53.616369 32744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:33252
I20260709 12:14:53.616930 32744 raft_consensus.cc:493] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:53.617198 32744 raft_consensus.cc:3060] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.623824 32744 raft_consensus.cc:515] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.625746 32744 leader_election.cc:290] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 2 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:53.626922   350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:53.626835   542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:53.627930   350 raft_consensus.cc:3055] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:53.627948   542 raft_consensus.cc:3060] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.628484   350 raft_consensus.cc:740] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:53.629519   350 consensus_queue.cc:260] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.630978   350 raft_consensus.cc:3060] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.636988   542 raft_consensus.cc:2468] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 2.
I20260709 12:14:53.638567 32708 leader_election.cc:304] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:53.639214   350 raft_consensus.cc:2468] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 2.
I20260709 12:14:53.639506   583 raft_consensus.cc:2804] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:53.640033   583 raft_consensus.cc:697] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:53.641184   583 consensus_queue.cc:237] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:53.649338 32568 catalog_manager.cc:5697] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 1 to 2, leader changed from 56f155685b8a404eb23d923b1e058264 (127.20.102.195) to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:53.664955 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:53.845970   542 raft_consensus.cc:1275] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:53.847455   583 consensus_queue.cc:1048] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:53.861524   350 raft_consensus.cc:1275] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:53.863655   598 consensus_queue.cc:1048] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:54.041293   542 raft_consensus.cc:1275] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:54.042924   583 consensus_queue.cc:1048] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:54.052001   350 raft_consensus.cc:1275] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:54.054097   598 consensus_queue.cc:1048] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:54.083755 32745 raft_consensus.cc:1275] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:54.085362   476 consensus_queue.cc:1048] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:54.097157 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:54.097571   542 raft_consensus.cc:1275] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:54.099419   476 consensus_queue.cc:1048] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:54.110472 32745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
mode: GRACEFUL
new_leader_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:35632
I20260709 12:14:54.111209 32745 raft_consensus.cc:606] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Received request to transfer leadership to TS 56f155685b8a404eb23d923b1e058264
I20260709 12:14:54.114204   350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4accbab2923b42cfae4ddfad12ba95d6"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
mode: GRACEFUL
new_leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:44862
I20260709 12:14:54.114861   350 raft_consensus.cc:606] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Received request to transfer leadership to TS f0461bc9dac3437a822aa81b58ecbd3c
I20260709 12:14:54.118014 32745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
mode: GRACEFUL
new_leader_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:35632
I20260709 12:14:54.118644 32745 raft_consensus.cc:606] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Received request to transfer leadership to TS 56f155685b8a404eb23d923b1e058264
I20260709 12:14:54.120064 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:54.120612 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:54.121275 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:54.231602   601 raft_consensus.cc:993] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264: : Instructing follower f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:54.232211   601 raft_consensus.cc:1081] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Signalling peer f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:54.233925 32745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4accbab2923b42cfae4ddfad12ba95d6"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:33252
I20260709 12:14:54.234647 32745 raft_consensus.cc:493] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:54.235005 32745 raft_consensus.cc:3060] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:54.241139 32745 raft_consensus.cc:515] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:54.243021 32745 leader_election.cc:290] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 3 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:54.244364   350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accbab2923b42cfae4ddfad12ba95d6" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:54.244741   542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4accbab2923b42cfae4ddfad12ba95d6" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:54.245278   350 raft_consensus.cc:3055] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:54.245401   542 raft_consensus.cc:3060] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:54.245725   350 raft_consensus.cc:740] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:54.246908   350 consensus_queue.cc:260] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:54.248431   350 raft_consensus.cc:3060] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:54.254779   542 raft_consensus.cc:2468] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 3.
I20260709 12:14:54.256420 32708 leader_election.cc:304] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:54.257151   350 raft_consensus.cc:2468] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 3.
I20260709 12:14:54.257345   598 raft_consensus.cc:2804] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:54.257853   598 raft_consensus.cc:697] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:54.258899   598 consensus_queue.cc:237] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:54.266162 32567 catalog_manager.cc:5697] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 2 to 3, leader changed from 56f155685b8a404eb23d923b1e058264 (127.20.102.195) to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 3 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:54.428716   489 raft_consensus.cc:993] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c: : Instructing follower 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:54.429262   489 raft_consensus.cc:1081] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Signalling peer 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:54.430856   350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:44716
I20260709 12:14:54.431479   350 raft_consensus.cc:493] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:54.431797   350 raft_consensus.cc:3060] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:54.437525   350 raft_consensus.cc:515] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:54.439201   350 leader_election.cc:290] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:54.440387   542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:54.440506 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:54.441311   542 raft_consensus.cc:3060] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:54.441402 32745 raft_consensus.cc:3055] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:54.441951 32745 raft_consensus.cc:740] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:54.442869 32745 consensus_queue.cc:260] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:54.443878 32745 raft_consensus.cc:3060] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:54.448122   542 raft_consensus.cc:2468] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 2.
I20260709 12:14:54.449010 32745 raft_consensus.cc:2468] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 2.
I20260709 12:14:54.449486   314 leader_election.cc:304] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:54.450520   601 raft_consensus.cc:2804] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:54.451081   601 raft_consensus.cc:697] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:54.452021   601 consensus_queue.cc:237] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:54.460037   489 raft_consensus.cc:993] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c: : Instructing follower 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:54.460572   598 raft_consensus.cc:1081] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Signalling peer 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:54.460983 32567 catalog_manager.cc:5697] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 1 to 2, leader changed from f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194) to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.462071   350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:44716
I20260709 12:14:54.462666   350 raft_consensus.cc:493] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:54.462973   350 raft_consensus.cc:3060] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:54.469086   350 raft_consensus.cc:515] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:54.471308   350 leader_election.cc:290] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 3 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:54.471912 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:54.471863   542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ad3b37613c47ceb02efa66629df8eb" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:54.472740 32745 raft_consensus.cc:3055] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:54.473037   542 raft_consensus.cc:3060] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:54.473168 32745 raft_consensus.cc:740] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:54.474118 32745 consensus_queue.cc:260] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:54.475033 32745 raft_consensus.cc:3060] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:54.480434 32745 raft_consensus.cc:2468] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 3.
I20260709 12:14:54.480815   542 raft_consensus.cc:2468] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 3.
I20260709 12:14:54.482273   314 leader_election.cc:304] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:54.483193   601 raft_consensus.cc:2804] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:54.484411   601 raft_consensus.cc:697] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 3 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:54.485248   601 consensus_queue.cc:237] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:54.493175 32567 catalog_manager.cc:5697] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 2 to 3, leader changed from f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194) to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:54.666116 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:54.728169   543 raft_consensus.cc:1275] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:54.729584   583 consensus_queue.cc:1048] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:54.741945   350 raft_consensus.cc:1275] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:54.744421   583 consensus_queue.cc:1048] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:54.841253 32745 raft_consensus.cc:1275] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:54.842912   582 consensus_queue.cc:1048] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:54.853822   543 raft_consensus.cc:1275] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:54.855619   582 consensus_queue.cc:1048] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:54.906967 32745 raft_consensus.cc:1275] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:54.908665   582 consensus_queue.cc:1048] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:54.917294   543 raft_consensus.cc:1275] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:54.918732   601 consensus_queue.cc:1048] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:55.127857 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:55.136448   350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
mode: GRACEFUL
new_leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:44862
I20260709 12:14:55.137054   350 raft_consensus.cc:606] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Received request to transfer leadership to TS f0461bc9dac3437a822aa81b58ecbd3c
I20260709 12:14:55.139801 32745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1393a73f0d20446a997cf1c7c6d2afc0"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
mode: GRACEFUL
new_leader_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:35632
I20260709 12:14:55.140269 32745 raft_consensus.cc:606] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Received request to transfer leadership to TS 56f155685b8a404eb23d923b1e058264
I20260709 12:14:55.143374   350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
mode: GRACEFUL
new_leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:44862
I20260709 12:14:55.144001   350 raft_consensus.cc:606] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Received request to transfer leadership to TS f0461bc9dac3437a822aa81b58ecbd3c
I20260709 12:14:55.145216 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:55.145773 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:55.146366 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:55.214964   598 raft_consensus.cc:993] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c: : Instructing follower 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:55.215571   583 raft_consensus.cc:1081] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Signalling peer 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:55.217312   350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1393a73f0d20446a997cf1c7c6d2afc0"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:44716
I20260709 12:14:55.217909   350 raft_consensus.cc:493] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:55.218286   350 raft_consensus.cc:3060] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:55.225819   350 raft_consensus.cc:515] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:55.227505   350 leader_election.cc:290] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:55.228564   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1393a73f0d20446a997cf1c7c6d2afc0" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:55.228696 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1393a73f0d20446a997cf1c7c6d2afc0" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:55.229446   543 raft_consensus.cc:3060] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:55.229513 32745 raft_consensus.cc:3055] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:55.229959 32745 raft_consensus.cc:740] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:55.230706 32745 consensus_queue.cc:260] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:55.231812 32745 raft_consensus.cc:3060] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:55.235261   543 raft_consensus.cc:2468] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 2.
I20260709 12:14:55.236629   314 leader_election.cc:304] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:55.237644   601 raft_consensus.cc:2804] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:55.238065 32745 raft_consensus.cc:2468] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 2.
I20260709 12:14:55.238181   601 raft_consensus.cc:697] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:55.239555   601 consensus_queue.cc:237] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:55.247161 32567 catalog_manager.cc:5697] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 1 to 2, leader changed from f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194) to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:55.377084   582 raft_consensus.cc:993] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264: : Instructing follower f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:55.377643   601 raft_consensus.cc:1081] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Signalling peer f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:55.379180 32744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:33252
I20260709 12:14:55.379748 32744 raft_consensus.cc:493] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:55.380026 32744 raft_consensus.cc:3060] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:55.385103 32744 raft_consensus.cc:515] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:55.386790 32744 leader_election.cc:290] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 3 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:55.387918   350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:55.387918   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd4ca8eb7d74f98aabe91f25f8fea9c" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:55.389035   543 raft_consensus.cc:3060] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:55.389043   350 raft_consensus.cc:3055] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:55.389586   350 raft_consensus.cc:740] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:55.390489   350 consensus_queue.cc:260] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:55.391839   350 raft_consensus.cc:3060] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:55.397456   543 raft_consensus.cc:2468] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 3.
I20260709 12:14:55.398813 32708 leader_election.cc:304] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:55.399497   350 raft_consensus.cc:2468] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 3.
I20260709 12:14:55.399533   598 raft_consensus.cc:2804] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:55.400199   598 raft_consensus.cc:697] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 3 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:55.401124   598 consensus_queue.cc:237] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:55.407092 32567 catalog_manager.cc:5697] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 2 to 3, leader changed from 56f155685b8a404eb23d923b1e058264 (127.20.102.195) to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 3 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.642635   543 raft_consensus.cc:1275] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:55.644178   582 consensus_queue.cc:1048] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:55.653088   627 raft_consensus.cc:993] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264: : Instructing follower f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:55.653688   582 raft_consensus.cc:1081] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Signalling peer f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:55.656188 32744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:33252
I20260709 12:14:55.657148 32744 raft_consensus.cc:493] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:55.657677 32744 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:55.664245 32745 raft_consensus.cc:1275] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:55.666653   627 consensus_queue.cc:1048] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:55.667547 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:55.670011 32744 raft_consensus.cc:515] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:55.672061 32744 leader_election.cc:290] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 3 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:55.673439   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:55.674075   543 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:55.674006   350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:55.674739   350 raft_consensus.cc:3055] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:55.675024   350 raft_consensus.cc:740] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:55.675969   350 consensus_queue.cc:260] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:55.677302   350 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:55.684479   543 raft_consensus.cc:2468] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 3.
I20260709 12:14:55.685388   350 raft_consensus.cc:2468] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 3.
I20260709 12:14:55.685623 32708 leader_election.cc:304] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:55.686573   598 raft_consensus.cc:2804] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:55.687116   598 raft_consensus.cc:697] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:55.688127   598 consensus_queue.cc:237] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:55.695699 32568 catalog_manager.cc:5697] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 2 to 3, leader changed from 56f155685b8a404eb23d923b1e058264 (127.20.102.195) to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 3 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.859790   543 raft_consensus.cc:1275] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:55.861332   598 consensus_queue.cc:1048] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:55.872473   350 raft_consensus.cc:1275] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:55.875048   598 consensus_queue.cc:1048] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:56.153968 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:56.161698 32745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
mode: GRACEFUL
new_leader_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:35632
I20260709 12:14:56.162374 32745 raft_consensus.cc:606] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Received request to transfer leadership to TS 56f155685b8a404eb23d923b1e058264
I20260709 12:14:56.166320   350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
mode: GRACEFUL
new_leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:44862
I20260709 12:14:56.167026   350 raft_consensus.cc:606] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Received request to transfer leadership to TS f0461bc9dac3437a822aa81b58ecbd3c
I20260709 12:14:56.169860 32745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfce89c4adc94713aaeecebe61fa0fc0"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
mode: GRACEFUL
new_leader_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:35632
I20260709 12:14:56.170432 32745 raft_consensus.cc:606] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Received request to transfer leadership to TS 56f155685b8a404eb23d923b1e058264
I20260709 12:14:56.171640 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:56.172183 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:56.172674 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:56.201107   630 raft_consensus.cc:993] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264: : Instructing follower f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:56.201803   640 raft_consensus.cc:1081] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Signalling peer f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:56.203665 32745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:33252
I20260709 12:14:56.204123 32745 raft_consensus.cc:493] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:56.204371 32745 raft_consensus.cc:3060] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:56.210891 32745 raft_consensus.cc:515] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:56.212736 32745 leader_election.cc:290] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 3 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:56.214241   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:56.215334   543 raft_consensus.cc:3060] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:56.215639   350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2908bf3dc4a478c336086f620644a" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:56.216437   350 raft_consensus.cc:3055] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:56.216830   350 raft_consensus.cc:740] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:56.217685   350 consensus_queue.cc:260] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:56.219193   350 raft_consensus.cc:3060] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:56.223519   543 raft_consensus.cc:2468] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 3.
I20260709 12:14:56.224857 32708 leader_election.cc:304] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:56.225697   638 raft_consensus.cc:2804] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:56.226184   638 raft_consensus.cc:697] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 3 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:56.227142   350 raft_consensus.cc:2468] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 3.
I20260709 12:14:56.227281   638 consensus_queue.cc:237] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:56.234905   543 raft_consensus.cc:1275] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:56.235425 32567 catalog_manager.cc:5697] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 2 to 3, leader changed from 56f155685b8a404eb23d923b1e058264 (127.20.102.195) to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 3 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:56.236230   638 consensus_queue.cc:1048] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:56.249076   350 raft_consensus.cc:1275] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:56.250970   638 consensus_queue.cc:1048] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:56.318526   598 raft_consensus.cc:993] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c: : Instructing follower 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:56.319060   598 raft_consensus.cc:1081] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Signalling peer 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:56.320621   350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfce89c4adc94713aaeecebe61fa0fc0"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:44716
I20260709 12:14:56.321125   350 raft_consensus.cc:493] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:56.321406   350 raft_consensus.cc:3060] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.325994   350 raft_consensus.cc:515] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:56.327378   350 leader_election.cc:290] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:56.328575 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfce89c4adc94713aaeecebe61fa0fc0" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:56.328608   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfce89c4adc94713aaeecebe61fa0fc0" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:56.329170 32745 raft_consensus.cc:3055] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:56.329535 32745 raft_consensus.cc:740] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:56.329587   543 raft_consensus.cc:3060] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.330323 32745 consensus_queue.cc:260] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:56.331248 32745 raft_consensus.cc:3060] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.335721 32745 raft_consensus.cc:2468] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 2.
I20260709 12:14:56.335907   543 raft_consensus.cc:2468] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 2.
I20260709 12:14:56.337031   317 leader_election.cc:304] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f0461bc9dac3437a822aa81b58ecbd3c; no voters: 
I20260709 12:14:56.337997   640 raft_consensus.cc:2804] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:56.338480   640 raft_consensus.cc:697] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:56.339242   640 consensus_queue.cc:237] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:56.350198 32567 catalog_manager.cc:5697] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 1 to 2, leader changed from f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194) to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:56.604419   637 raft_consensus.cc:993] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c: : Instructing follower 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:56.605100   637 raft_consensus.cc:1081] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Signalling peer 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:56.606923   350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:44716
I20260709 12:14:56.607544   350 raft_consensus.cc:493] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:56.607887   350 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:56.612689   350 raft_consensus.cc:515] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:56.614276   350 leader_election.cc:290] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 3 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:56.615417   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:56.615556 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:56.616039   543 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:56.616238 32745 raft_consensus.cc:3055] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:56.616611 32745 raft_consensus.cc:740] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:56.617398 32745 consensus_queue.cc:260] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:56.618371 32745 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:56.621316   543 raft_consensus.cc:2468] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 3.
I20260709 12:14:56.622474   314 leader_election.cc:304] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:56.623147   640 raft_consensus.cc:2804] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:56.623556   640 raft_consensus.cc:697] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 3 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:56.624217 32745 raft_consensus.cc:2468] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 3.
I20260709 12:14:56.624369   640 consensus_queue.cc:237] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:56.631268 32567 catalog_manager.cc:5697] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 2 to 3, leader changed from f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194) to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:56.668644 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:56.831035 32745 raft_consensus.cc:1275] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.832754   640 consensus_queue.cc:1048] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.843822   543 raft_consensus.cc:1275] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:56.845660   637 consensus_queue.cc:1048] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:56.851150   542 raft_consensus.cc:1275] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.851295   350 raft_consensus.cc:1275] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:56.853303   637 consensus_queue.cc:1048] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:56.857158   640 consensus_queue.cc:1048] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:57.100932 32745 raft_consensus.cc:1275] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:57.102295   651 consensus_queue.cc:1048] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:57.111406   543 raft_consensus.cc:1275] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:57.114791   651 consensus_queue.cc:1048] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:57.179003 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:57.188261   350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
mode: GRACEFUL
new_leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:44862
I20260709 12:14:57.188985   350 raft_consensus.cc:606] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 3 LEADER]: Received request to transfer leadership to TS f0461bc9dac3437a822aa81b58ecbd3c
I20260709 12:14:57.191794   350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a35a3899339541df8d9abd16b89a2a27"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
mode: GRACEFUL
new_leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:44862
I20260709 12:14:57.192231   350 raft_consensus.cc:606] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Received request to transfer leadership to TS f0461bc9dac3437a822aa81b58ecbd3c
I20260709 12:14:57.194799 32745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
mode: GRACEFUL
new_leader_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:35632
I20260709 12:14:57.195297 32745 raft_consensus.cc:606] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 LEADER]: Received request to transfer leadership to TS 56f155685b8a404eb23d923b1e058264
I20260709 12:14:57.196478 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:57.197216 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:57.197976 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:57.200538   638 raft_consensus.cc:993] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c: : Instructing follower 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:57.201122   598 raft_consensus.cc:1081] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 LEADER]: Signalling peer 56f155685b8a404eb23d923b1e058264 to start an election
I20260709 12:14:57.202675   350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681"
dest_uuid: "56f155685b8a404eb23d923b1e058264"
 from {username='slave'} at 127.0.0.1:44716
I20260709 12:14:57.203218   350 raft_consensus.cc:493] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:57.203564   350 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:57.209023   350 raft_consensus.cc:515] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:57.210430   350 leader_election.cc:290] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 4 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707)
I20260709 12:14:57.211532   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:57.211721 32745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e0e402ab741a0846f0b879f1b2681" candidate_uuid: "56f155685b8a404eb23d923b1e058264" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
I20260709 12:14:57.212163   543 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:57.212409 32745 raft_consensus.cc:3055] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:57.212832 32745 raft_consensus.cc:740] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:57.213543 32745 consensus_queue.cc:260] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:57.214594 32745 raft_consensus.cc:3060] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:57.217818   543 raft_consensus.cc:2468] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 4.
I20260709 12:14:57.219079   314 leader_election.cc:304] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56f155685b8a404eb23d923b1e058264, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:57.219962   651 raft_consensus.cc:2804] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:57.220455   651 raft_consensus.cc:697] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 4 LEADER]: Becoming Leader. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:57.220510 32745 raft_consensus.cc:2468] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f155685b8a404eb23d923b1e058264 in term 4.
I20260709 12:14:57.221489   651 consensus_queue.cc:237] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:57.229664 32566 catalog_manager.cc:5697] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 reported cstate change: term changed from 3 to 4, leader changed from f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194) to 56f155685b8a404eb23d923b1e058264 (127.20.102.195). New cstate: current_term: 4 leader_uuid: "56f155685b8a404eb23d923b1e058264" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:57.665103   630 raft_consensus.cc:993] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264: : Instructing follower f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:57.665712   640 raft_consensus.cc:1081] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Signalling peer f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:57.667331 32745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a35a3899339541df8d9abd16b89a2a27"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:33252
I20260709 12:14:57.667830 32745 raft_consensus.cc:493] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:57.668128 32745 raft_consensus.cc:3060] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:57.669776 32616 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:57.673720 32745 raft_consensus.cc:515] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:57.675355 32745 leader_election.cc:290] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 2 election: Requested vote from peers f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581), 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197)
I20260709 12:14:57.676311   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35a3899339541df8d9abd16b89a2a27" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:57.676656   351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35a3899339541df8d9abd16b89a2a27" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:57.677181   543 raft_consensus.cc:3060] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:57.677280   351 raft_consensus.cc:3055] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:57.677702   351 raft_consensus.cc:740] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:57.678651   351 consensus_queue.cc:260] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:57.680078   351 raft_consensus.cc:3060] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:57.685588   543 raft_consensus.cc:2468] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 2.
I20260709 12:14:57.687068 32708 leader_election.cc:304] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:57.688095   598 raft_consensus.cc:2804] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:57.688720   351 raft_consensus.cc:2468] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 2.
I20260709 12:14:57.688714   598 raft_consensus.cc:697] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:57.690405   630 raft_consensus.cc:993] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264: : Instructing follower f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:57.691056   640 raft_consensus.cc:1081] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 3 LEADER]: Signalling peer f0461bc9dac3437a822aa81b58ecbd3c to start an election
I20260709 12:14:57.690583   598 consensus_queue.cc:237] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } }
I20260709 12:14:57.692886 32745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19"
dest_uuid: "f0461bc9dac3437a822aa81b58ecbd3c"
 from {username='slave'} at 127.0.0.1:33252
I20260709 12:14:57.693434 32745 raft_consensus.cc:493] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:57.693799 32745 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:57.699482 32566 catalog_manager.cc:5697] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 1 to 2, leader changed from 56f155685b8a404eb23d923b1e058264 (127.20.102.195) to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 2 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:57.700188 32745 raft_consensus.cc:515] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:57.702770 32745 leader_election.cc:290] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 4 election: Requested vote from peers 56f155685b8a404eb23d923b1e058264 (127.20.102.195:37197), f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581)
I20260709 12:14:57.702840   351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "56f155685b8a404eb23d923b1e058264"
I20260709 12:14:57.703645   351 raft_consensus.cc:3055] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:57.704044   351 raft_consensus.cc:740] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56f155685b8a404eb23d923b1e058264, State: Running, Role: LEADER
I20260709 12:14:57.704164   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c76d730e64bd1b30892611ad1ee19" candidate_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f1f31b4cc29144da9485824a934ccac1"
I20260709 12:14:57.704823   543 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:57.706117   351 consensus_queue.cc:260] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:57.707273   351 raft_consensus.cc:3060] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:57.711091   543 raft_consensus.cc:2468] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 4.
I20260709 12:14:57.712145 32708 leader_election.cc:304] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0461bc9dac3437a822aa81b58ecbd3c, f1f31b4cc29144da9485824a934ccac1; no voters: 
I20260709 12:14:57.712860   598 raft_consensus.cc:2804] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:57.713425   598 raft_consensus.cc:697] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 4 LEADER]: Becoming Leader. State: Replica: f0461bc9dac3437a822aa81b58ecbd3c, State: Running, Role: LEADER
I20260709 12:14:57.713536   351 raft_consensus.cc:2468] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0461bc9dac3437a822aa81b58ecbd3c in term 4.
I20260709 12:14:57.714423   598 consensus_queue.cc:237] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } }
I20260709 12:14:57.721657 32566 catalog_manager.cc:5697] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c reported cstate change: term changed from 3 to 4, leader changed from 56f155685b8a404eb23d923b1e058264 (127.20.102.195) to f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194). New cstate: current_term: 4 leader_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:57.748258 32745 raft_consensus.cc:1275] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 4 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:57.749754   640 consensus_queue.cc:1048] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0461bc9dac3437a822aa81b58ecbd3c" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:57.760712   543 raft_consensus.cc:1275] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 4 FOLLOWER]: Refusing update from remote peer 56f155685b8a404eb23d923b1e058264: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:57.762981   651 consensus_queue.cc:1048] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:58.129724   542 raft_consensus.cc:1275] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:58.131072   598 consensus_queue.cc:1048] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:58.141937   351 raft_consensus.cc:1275] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:58.143400   638 consensus_queue.cc:1048] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:58.207194 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:58.207654   351 raft_consensus.cc:1275] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 4 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:58.209156   638 consensus_queue.cc:1048] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56f155685b8a404eb23d923b1e058264" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:58.227638   542 raft_consensus.cc:1275] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 4 FOLLOWER]: Refusing update from remote peer f0461bc9dac3437a822aa81b58ecbd3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:58.231475   598 consensus_queue.cc:1048] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f31b4cc29144da9485824a934ccac1" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:58.255038 20891 tablet_server.cc:179] TabletServer@127.20.102.193:46581 shutting down...
W20260709 12:14:58.264014 32708 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 89 similar messages]
W20260709 12:14:58.267870 32708 consensus_peers.cc:597] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:58.284375 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:58.285292 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:58.285970 20891 raft_consensus.cc:2243] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.286512 20891 raft_consensus.cc:2272] T cfce89c4adc94713aaeecebe61fa0fc0 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.288961 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:58.289640 20891 raft_consensus.cc:2243] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.290160 20891 raft_consensus.cc:2272] T de4e0e402ab741a0846f0b879f1b2681 P f1f31b4cc29144da9485824a934ccac1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.293471 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:58.294145 20891 raft_consensus.cc:2243] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.294668 20891 raft_consensus.cc:2272] T 62ad3b37613c47ceb02efa66629df8eb P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.297053 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:58.297668 20891 raft_consensus.cc:2243] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.298133 20891 raft_consensus.cc:2272] T aaa2908bf3dc4a478c336086f620644a P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.300096 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:58.300664 20891 raft_consensus.cc:2243] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.301175 20891 raft_consensus.cc:2272] T 1393a73f0d20446a997cf1c7c6d2afc0 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.303072 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:58.303622 20891 raft_consensus.cc:2243] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.304092 20891 raft_consensus.cc:2272] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.306047 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:58.306609 20891 raft_consensus.cc:2243] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.307070 20891 raft_consensus.cc:2272] T 7f3c76d730e64bd1b30892611ad1ee19 P f1f31b4cc29144da9485824a934ccac1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.309631 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:58.310194 20891 raft_consensus.cc:2243] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.310664 20891 raft_consensus.cc:2272] T a35a3899339541df8d9abd16b89a2a27 P f1f31b4cc29144da9485824a934ccac1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.313045 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:58.313601 20891 raft_consensus.cc:2243] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.313999 20891 raft_consensus.cc:2272] T 41bea463a96a4081aacf2d8a3646d398 P f1f31b4cc29144da9485824a934ccac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.315905 20891 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:58.316401 20891 raft_consensus.cc:2243] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.316869 20891 raft_consensus.cc:2272] T 4accbab2923b42cfae4ddfad12ba95d6 P f1f31b4cc29144da9485824a934ccac1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.348843 20891 tablet_server.cc:196] TabletServer@127.20.102.193:46581 shutdown complete.
W20260709 12:14:58.370941   314 consensus_peers.cc:597] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:58.374226 20891 tablet_server.cc:179] TabletServer@127.20.102.194:0 shutting down...
I20260709 12:14:58.402731 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:58.403702 20891 tablet_replica.cc:333] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c: stopping tablet replica
I20260709 12:14:58.404687 20891 raft_consensus.cc:2243] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.405285 20891 raft_consensus.cc:2272] T cfce89c4adc94713aaeecebe61fa0fc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.407593 20891 tablet_replica.cc:333] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c: stopping tablet replica
I20260709 12:14:58.408255 20891 raft_consensus.cc:2243] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.408730 20891 raft_consensus.cc:2272] T 1393a73f0d20446a997cf1c7c6d2afc0 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.411022 20891 tablet_replica.cc:333] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c: stopping tablet replica
I20260709 12:14:58.411666 20891 raft_consensus.cc:2243] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:58.412532 20891 raft_consensus.cc:2272] T a35a3899339541df8d9abd16b89a2a27 P f0461bc9dac3437a822aa81b58ecbd3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.415534 20891 tablet_replica.cc:333] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c: stopping tablet replica
I20260709 12:14:58.416277 20891 raft_consensus.cc:2243] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.416846 20891 raft_consensus.cc:2272] T 62ad3b37613c47ceb02efa66629df8eb P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.419697 20891 tablet_replica.cc:333] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c: stopping tablet replica
I20260709 12:14:58.420324 20891 raft_consensus.cc:2243] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:58.421212 20891 raft_consensus.cc:2272] T aaa2908bf3dc4a478c336086f620644a P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.423539 20891 tablet_replica.cc:333] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c: stopping tablet replica
I20260709 12:14:58.424189 20891 raft_consensus.cc:2243] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.424641 20891 raft_consensus.cc:2272] T de4e0e402ab741a0846f0b879f1b2681 P f0461bc9dac3437a822aa81b58ecbd3c [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:58.428612   317 consensus_peers.cc:597] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 -> Peer f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707): Couldn't send request to peer f0461bc9dac3437a822aa81b58ecbd3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:58.428653 20891 tablet_replica.cc:333] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c: stopping tablet replica
I20260709 12:14:58.430045 20891 raft_consensus.cc:2243] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:58.430966 20891 raft_consensus.cc:2272] T 4accbab2923b42cfae4ddfad12ba95d6 P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.433689 20891 tablet_replica.cc:333] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c: stopping tablet replica
I20260709 12:14:58.434423 20891 raft_consensus.cc:2243] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.435096 20891 raft_consensus.cc:2272] T 41bea463a96a4081aacf2d8a3646d398 P f0461bc9dac3437a822aa81b58ecbd3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.438199 20891 tablet_replica.cc:333] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c: stopping tablet replica
I20260709 12:14:58.438961 20891 raft_consensus.cc:2243] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:58.439864 20891 raft_consensus.cc:2272] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P f0461bc9dac3437a822aa81b58ecbd3c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.442342 20891 tablet_replica.cc:333] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c: stopping tablet replica
I20260709 12:14:58.443014 20891 raft_consensus.cc:2243] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:58.443878 20891 raft_consensus.cc:2272] T 7f3c76d730e64bd1b30892611ad1ee19 P f0461bc9dac3437a822aa81b58ecbd3c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.479987 20891 tablet_server.cc:196] TabletServer@127.20.102.194:0 shutdown complete.
W20260709 12:14:58.511709   314 consensus_peers.cc:597] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 -> Peer f1f31b4cc29144da9485824a934ccac1 (127.20.102.193:46581): Couldn't send request to peer f1f31b4cc29144da9485824a934ccac1. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:46581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:58.512420 20891 tablet_server.cc:179] TabletServer@127.20.102.195:0 shutting down...
I20260709 12:14:58.547739 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:58.548565 20891 tablet_replica.cc:333] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264: stopping tablet replica
I20260709 12:14:58.549399 20891 raft_consensus.cc:2243] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:58.550230 20891 raft_consensus.cc:2272] T 1393a73f0d20446a997cf1c7c6d2afc0 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.553314 20891 tablet_replica.cc:333] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264: stopping tablet replica
I20260709 12:14:58.554054 20891 raft_consensus.cc:2243] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:14:58.554797   317 consensus_peers.cc:597] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 -> Peer f0461bc9dac3437a822aa81b58ecbd3c (127.20.102.194:36707): Couldn't send request to peer f0461bc9dac3437a822aa81b58ecbd3c. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:36707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:58.554983 20891 raft_consensus.cc:2272] T cfce89c4adc94713aaeecebe61fa0fc0 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.557415 20891 tablet_replica.cc:333] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264: stopping tablet replica
I20260709 12:14:58.557993 20891 raft_consensus.cc:2243] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.558426 20891 raft_consensus.cc:2272] T 0cd4ca8eb7d74f98aabe91f25f8fea9c P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.560452 20891 tablet_replica.cc:333] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264: stopping tablet replica
I20260709 12:14:58.561084 20891 raft_consensus.cc:2243] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:58.561906 20891 raft_consensus.cc:2272] T 62ad3b37613c47ceb02efa66629df8eb P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.564031 20891 tablet_replica.cc:333] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264: stopping tablet replica
I20260709 12:14:58.564607 20891 raft_consensus.cc:2243] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.565033 20891 raft_consensus.cc:2272] T aaa2908bf3dc4a478c336086f620644a P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.566933 20891 tablet_replica.cc:333] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264: stopping tablet replica
I20260709 12:14:58.567467 20891 raft_consensus.cc:2243] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.567866 20891 raft_consensus.cc:2272] T a35a3899339541df8d9abd16b89a2a27 P 56f155685b8a404eb23d923b1e058264 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.570904 20891 tablet_replica.cc:333] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264: stopping tablet replica
I20260709 12:14:58.571405 20891 raft_consensus.cc:2243] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.571811 20891 raft_consensus.cc:2272] T 7f3c76d730e64bd1b30892611ad1ee19 P 56f155685b8a404eb23d923b1e058264 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.574393 20891 tablet_replica.cc:333] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264: stopping tablet replica
I20260709 12:14:58.574900 20891 raft_consensus.cc:2243] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:58.575312 20891 raft_consensus.cc:2272] T 4accbab2923b42cfae4ddfad12ba95d6 P 56f155685b8a404eb23d923b1e058264 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.577337 20891 tablet_replica.cc:333] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264: stopping tablet replica
I20260709 12:14:58.577802 20891 raft_consensus.cc:2243] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:58.578568 20891 raft_consensus.cc:2272] T 41bea463a96a4081aacf2d8a3646d398 P 56f155685b8a404eb23d923b1e058264 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.580544 20891 tablet_replica.cc:333] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264: stopping tablet replica
I20260709 12:14:58.581100 20891 raft_consensus.cc:2243] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:58.581807 20891 raft_consensus.cc:2272] T de4e0e402ab741a0846f0b879f1b2681 P 56f155685b8a404eb23d923b1e058264 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.615556 20891 tablet_server.cc:196] TabletServer@127.20.102.195:0 shutdown complete.
I20260709 12:14:58.642894 20891 master.cc:562] Master@127.20.102.254:37471 shutting down...
I20260709 12:14:58.671476 20891 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:58.672115 20891 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:58.672462 20891 tablet_replica.cc:333] T 00000000000000000000000000000000 P ee2c770c576b48d99a252b5719d6b2d5: stopping tablet replica
I20260709 12:14:58.694056 20891 master.cc:584] Master@127.20.102.254:37471 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13250 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:14:58.737141 20891 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.102.254:33201
I20260709 12:14:58.738302 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:58.744374   682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:58.744901   683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:58.745997   685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:58.746977 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:58.747960 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:58.748145 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:58.748281 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599298748263 us; error 0 us; skew 500 ppm
I20260709 12:14:58.748890 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:58.751479 20891 webserver.cc:533] Webserver started at http://127.20.102.254:45775/ using document root <none> and password file <none>
I20260709 12:14:58.751978 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:58.752147 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:58.752396 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:58.753710 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/master-0-root/instance:
uuid: "5358718033024682986705c0bfe78c48"
format_stamp: "Formatted at 2026-07-09 12:14:58 on dist-test-slave-296p"
I20260709 12:14:58.758818 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:58.762830   690 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:58.763715 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:14:58.764024 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/master-0-root
uuid: "5358718033024682986705c0bfe78c48"
format_stamp: "Formatted at 2026-07-09 12:14:58 on dist-test-slave-296p"
I20260709 12:14:58.764325 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:58.797262 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:58.798695 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:58.843537 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.254:33201
I20260709 12:14:58.843648   741 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.254:33201 every 8 connection(s)
I20260709 12:14:58.847760   742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:58.859140   742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48: Bootstrap starting.
I20260709 12:14:58.864378   742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:58.869781   742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48: No bootstrap required, opened a new log
I20260709 12:14:58.872298   742 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5358718033024682986705c0bfe78c48" member_type: VOTER }
I20260709 12:14:58.872727   742 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:58.873060   742 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5358718033024682986705c0bfe78c48, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.873778   742 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5358718033024682986705c0bfe78c48" member_type: VOTER }
I20260709 12:14:58.874243   742 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:58.874472   742 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:58.874776   742 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:58.879686   742 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5358718033024682986705c0bfe78c48" member_type: VOTER }
I20260709 12:14:58.880259   742 leader_election.cc:304] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5358718033024682986705c0bfe78c48; no voters: 
I20260709 12:14:58.881562   742 leader_election.cc:290] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:58.882148   745 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:58.883985   745 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [term 1 LEADER]: Becoming Leader. State: Replica: 5358718033024682986705c0bfe78c48, State: Running, Role: LEADER
I20260709 12:14:58.884693   742 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:58.884902   745 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5358718033024682986705c0bfe78c48" member_type: VOTER }
I20260709 12:14:58.890450   746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5358718033024682986705c0bfe78c48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5358718033024682986705c0bfe78c48" member_type: VOTER } }
I20260709 12:14:58.890686   747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5358718033024682986705c0bfe78c48. Latest consensus state: current_term: 1 leader_uuid: "5358718033024682986705c0bfe78c48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5358718033024682986705c0bfe78c48" member_type: VOTER } }
I20260709 12:14:58.891300   746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:58.891880   747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:58.895282   751 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:58.903807   751 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:58.904881 20891 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:58.913466   751 catalog_manager.cc:1383] Generated new cluster ID: e1b7aa698e284b17a4339c5355d313a1
I20260709 12:14:58.913830   751 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:58.934268   751 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:58.935810   751 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:58.957243   751 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48: Generated new TSK 0
I20260709 12:14:58.957950   751 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:58.972724 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:58.979532   763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:58.980974   764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:58.983202   766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:58.983294 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:58.984689 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:58.984973 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:58.985179 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599298985160 us; error 0 us; skew 500 ppm
I20260709 12:14:58.985883 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:58.988672 20891 webserver.cc:533] Webserver started at http://127.20.102.193:37901/ using document root <none> and password file <none>
I20260709 12:14:58.989287 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:58.989492 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:58.989810 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:58.991066 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-0-root/instance:
uuid: "dcb6dfaecd82416d8353d779b61b89e5"
format_stamp: "Formatted at 2026-07-09 12:14:58 on dist-test-slave-296p"
I20260709 12:14:58.995965 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:14:58.999905   771 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:59.000857 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:59.001233 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-0-root
uuid: "dcb6dfaecd82416d8353d779b61b89e5"
format_stamp: "Formatted at 2026-07-09 12:14:58 on dist-test-slave-296p"
I20260709 12:14:59.001538 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:59.036684 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:59.038136 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:59.039906 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:59.042483 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:59.042722 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:59.042991 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:59.043169 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:59.091125 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.193:43989
I20260709 12:14:59.091230   833 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.193:43989 every 8 connection(s)
I20260709 12:14:59.096576 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:59.105091   838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:59.107755   839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:59.113049   841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:59.113451   834 heartbeater.cc:344] Connected to a master server at 127.20.102.254:33201
I20260709 12:14:59.114006   834 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:59.114882   834 heartbeater.cc:507] Master 127.20.102.254:33201 requested a full tablet report, sending...
I20260709 12:14:59.115159 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:59.116392 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:59.116637 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:59.116861 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599299116842 us; error 0 us; skew 500 ppm
I20260709 12:14:59.117229   707 ts_manager.cc:194] Registered new tserver with Master: dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193:43989)
I20260709 12:14:59.117458 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:59.119364   707 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50518
I20260709 12:14:59.120899 20891 webserver.cc:533] Webserver started at http://127.20.102.194:35479/ using document root <none> and password file <none>
I20260709 12:14:59.121502 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:59.121726 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:59.122018 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:59.123224 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-1-root/instance:
uuid: "3dc7c8c387334b5c97a55dd98c7df969"
format_stamp: "Formatted at 2026-07-09 12:14:59 on dist-test-slave-296p"
I20260709 12:14:59.128039 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:14:59.131832   846 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:59.132845 20891 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:14:59.133172 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-1-root
uuid: "3dc7c8c387334b5c97a55dd98c7df969"
format_stamp: "Formatted at 2026-07-09 12:14:59 on dist-test-slave-296p"
I20260709 12:14:59.133508 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:59.164024 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:59.165655 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:59.167479 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:59.170030 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:59.170295 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:59.170571 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:59.170771 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:59.219302 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.194:38119
I20260709 12:14:59.219424   908 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.194:38119 every 8 connection(s)
I20260709 12:14:59.225175 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:59.233765   912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:59.234987   913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:59.238854   909 heartbeater.cc:344] Connected to a master server at 127.20.102.254:33201
W20260709 12:14:59.239095   915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:59.239455   909 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:59.239569 20891 server_base.cc:1061] running on GCE node
I20260709 12:14:59.240530   909 heartbeater.cc:507] Master 127.20.102.254:33201 requested a full tablet report, sending...
I20260709 12:14:59.240762 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:59.241243 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:59.241462 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599299241435 us; error 0 us; skew 500 ppm
I20260709 12:14:59.242110 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:59.243052   707 ts_manager.cc:194] Registered new tserver with Master: 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194:38119)
I20260709 12:14:59.244680   707 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50524
I20260709 12:14:59.247107 20891 webserver.cc:533] Webserver started at http://127.20.102.195:39333/ using document root <none> and password file <none>
I20260709 12:14:59.247745 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:59.247983 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:59.248266 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:59.249542 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-2-root/instance:
uuid: "f4c69c1ded3749f0ad8dcbd90e996a57"
format_stamp: "Formatted at 2026-07-09 12:14:59 on dist-test-slave-296p"
I20260709 12:14:59.254272 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:14:59.258093   920 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:59.259028 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:14:59.259379 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-2-root
uuid: "f4c69c1ded3749f0ad8dcbd90e996a57"
format_stamp: "Formatted at 2026-07-09 12:14:59 on dist-test-slave-296p"
I20260709 12:14:59.259681 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895025208-20891-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:59.287529 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:59.288728 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:59.290344 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:59.292744 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:59.293089 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:59.293358 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:59.293538 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:59.338589 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.195:39585
I20260709 12:14:59.338754   982 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.195:39585 every 8 connection(s)
I20260709 12:14:59.355593   983 heartbeater.cc:344] Connected to a master server at 127.20.102.254:33201
I20260709 12:14:59.356297   983 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:59.357280   983 heartbeater.cc:507] Master 127.20.102.254:33201 requested a full tablet report, sending...
I20260709 12:14:59.359612   707 ts_manager.cc:194] Registered new tserver with Master: f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195:39585)
I20260709 12:14:59.360540 20891 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018132s
I20260709 12:14:59.361404   707 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50538
I20260709 12:14:59.387923   707 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50542:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:59.390440   707 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:59.446786   874 tablet_service.cc:1511] Processing CreateTablet for tablet 2fbd67757b4845ca853b96af58779a35 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4ebbf0fdd3134577b9e6aca8716250ba]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:59.447082   873 tablet_service.cc:1511] Processing CreateTablet for tablet 53dcdf10ca094970b32ec33e1fe2ce85 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4ebbf0fdd3134577b9e6aca8716250ba]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:59.448303   874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fbd67757b4845ca853b96af58779a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.450124   873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53dcdf10ca094970b32ec33e1fe2ce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.462191   948 tablet_service.cc:1511] Processing CreateTablet for tablet 2fbd67757b4845ca853b96af58779a35 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4ebbf0fdd3134577b9e6aca8716250ba]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:59.462440   947 tablet_service.cc:1511] Processing CreateTablet for tablet 53dcdf10ca094970b32ec33e1fe2ce85 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4ebbf0fdd3134577b9e6aca8716250ba]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:59.463518   798 tablet_service.cc:1511] Processing CreateTablet for tablet 53dcdf10ca094970b32ec33e1fe2ce85 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4ebbf0fdd3134577b9e6aca8716250ba]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:59.462440   799 tablet_service.cc:1511] Processing CreateTablet for tablet 2fbd67757b4845ca853b96af58779a35 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4ebbf0fdd3134577b9e6aca8716250ba]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:59.463920   948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fbd67757b4845ca853b96af58779a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.465425   947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53dcdf10ca094970b32ec33e1fe2ce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.468480   798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53dcdf10ca094970b32ec33e1fe2ce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.469219   799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fbd67757b4845ca853b96af58779a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.494002   998 tablet_bootstrap.cc:492] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969: Bootstrap starting.
I20260709 12:14:59.500295   999 tablet_bootstrap.cc:492] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57: Bootstrap starting.
I20260709 12:14:59.502189   998 tablet_bootstrap.cc:654] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.507359  1000 tablet_bootstrap.cc:492] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5: Bootstrap starting.
I20260709 12:14:59.507517   999 tablet_bootstrap.cc:654] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.513893   998 tablet_bootstrap.cc:492] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969: No bootstrap required, opened a new log
I20260709 12:14:59.514525   998 ts_tablet_manager.cc:1403] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 12:14:59.516398  1000 tablet_bootstrap.cc:654] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.516568   999 tablet_bootstrap.cc:492] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57: No bootstrap required, opened a new log
I20260709 12:14:59.517172   999 ts_tablet_manager.cc:1403] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:14:59.517154   998 raft_consensus.cc:359] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.518010   998 raft_consensus.cc:385] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.518306   998 raft_consensus.cc:740] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc7c8c387334b5c97a55dd98c7df969, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.519091   998 consensus_queue.cc:260] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.521095   999 raft_consensus.cc:359] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:14:59.522112   999 raft_consensus.cc:385] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.522475   999 raft_consensus.cc:740] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4c69c1ded3749f0ad8dcbd90e996a57, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.523722   999 consensus_queue.cc:260] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:14:59.525624   909 heartbeater.cc:499] Master 127.20.102.254:33201 was elected leader, sending a full tablet report...
I20260709 12:14:59.526144   998 ts_tablet_manager.cc:1434] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.005s
I20260709 12:14:59.527190  1000 tablet_bootstrap.cc:492] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5: No bootstrap required, opened a new log
I20260709 12:14:59.527221   998 tablet_bootstrap.cc:492] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969: Bootstrap starting.
I20260709 12:14:59.528914   983 heartbeater.cc:499] Master 127.20.102.254:33201 was elected leader, sending a full tablet report...
I20260709 12:14:59.529381   999 ts_tablet_manager.cc:1434] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:14:59.530484   999 tablet_bootstrap.cc:492] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57: Bootstrap starting.
I20260709 12:14:59.536592   998 tablet_bootstrap.cc:654] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.539628   999 tablet_bootstrap.cc:654] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.527972  1000 ts_tablet_manager.cc:1403] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 12:14:59.544158  1000 raft_consensus.cc:359] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:14:59.544934  1000 raft_consensus.cc:385] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.545243  1000 raft_consensus.cc:740] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcb6dfaecd82416d8353d779b61b89e5, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.546162  1000 consensus_queue.cc:260] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:14:59.549144   834 heartbeater.cc:499] Master 127.20.102.254:33201 was elected leader, sending a full tablet report...
I20260709 12:14:59.550037   998 tablet_bootstrap.cc:492] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969: No bootstrap required, opened a new log
I20260709 12:14:59.550357   999 tablet_bootstrap.cc:492] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57: No bootstrap required, opened a new log
I20260709 12:14:59.550454  1000 ts_tablet_manager.cc:1434] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:14:59.550639   998 ts_tablet_manager.cc:1403] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.011s
I20260709 12:14:59.551187   999 ts_tablet_manager.cc:1403] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 12:14:59.552081  1000 tablet_bootstrap.cc:492] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5: Bootstrap starting.
I20260709 12:14:59.554669   999 raft_consensus.cc:359] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.554991   998 raft_consensus.cc:359] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:14:59.555524   999 raft_consensus.cc:385] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.555924   998 raft_consensus.cc:385] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.556042   999 raft_consensus.cc:740] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4c69c1ded3749f0ad8dcbd90e996a57, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.556439   998 raft_consensus.cc:740] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc7c8c387334b5c97a55dd98c7df969, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.557232   999 consensus_queue.cc:260] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.557349   998 consensus_queue.cc:260] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:14:59.559849   998 ts_tablet_manager.cc:1434] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:14:59.561304  1000 tablet_bootstrap.cc:654] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.562983   999 ts_tablet_manager.cc:1434] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:14:59.568634  1004 raft_consensus.cc:493] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.569291  1004 raft_consensus.cc:515] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.569938  1000 tablet_bootstrap.cc:492] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5: No bootstrap required, opened a new log
I20260709 12:14:59.570509  1000 ts_tablet_manager.cc:1403] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:14:59.572388  1004 leader_election.cc:290] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193:43989), f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195:39585)
I20260709 12:14:59.574043  1000 raft_consensus.cc:359] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.574882  1000 raft_consensus.cc:385] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.575192  1000 raft_consensus.cc:740] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcb6dfaecd82416d8353d779b61b89e5, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.576006  1000 consensus_queue.cc:260] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.578296  1000 ts_tablet_manager.cc:1434] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:59.587572   809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53dcdf10ca094970b32ec33e1fe2ce85" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5" is_pre_election: true
I20260709 12:14:59.588361   809 raft_consensus.cc:2468] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 0.
I20260709 12:14:59.589524   850 leader_election.cc:304] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc7c8c387334b5c97a55dd98c7df969, dcb6dfaecd82416d8353d779b61b89e5; no voters: 
I20260709 12:14:59.590428  1004 raft_consensus.cc:2804] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:59.590873  1004 raft_consensus.cc:493] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.591212  1004 raft_consensus.cc:3060] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.591483   958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53dcdf10ca094970b32ec33e1fe2ce85" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" is_pre_election: true
I20260709 12:14:59.592257   958 raft_consensus.cc:2468] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 0.
I20260709 12:14:59.597780  1004 raft_consensus.cc:515] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.599565  1004 leader_election.cc:290] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 election: Requested vote from peers dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193:43989), f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195:39585)
I20260709 12:14:59.600669   958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53dcdf10ca094970b32ec33e1fe2ce85" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57"
I20260709 12:14:59.600508   809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53dcdf10ca094970b32ec33e1fe2ce85" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
I20260709 12:14:59.601477   809 raft_consensus.cc:3060] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.601446   958 raft_consensus.cc:3060] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.610607   958 raft_consensus.cc:2468] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 1.
I20260709 12:14:59.610607   809 raft_consensus.cc:2468] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 1.
I20260709 12:14:59.612188   850 leader_election.cc:304] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc7c8c387334b5c97a55dd98c7df969, f4c69c1ded3749f0ad8dcbd90e996a57; no voters: 
I20260709 12:14:59.613052  1004 raft_consensus.cc:2804] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:59.614300  1004 raft_consensus.cc:697] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Becoming Leader. State: Replica: 3dc7c8c387334b5c97a55dd98c7df969, State: Running, Role: LEADER
I20260709 12:14:59.615424  1004 consensus_queue.cc:237] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.623896   706 catalog_manager.cc:5697] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "3dc7c8c387334b5c97a55dd98c7df969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.713132  1005 raft_consensus.cc:493] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.714068  1005 raft_consensus.cc:515] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:14:59.716939  1005 leader_election.cc:290] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194:38119), dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193:43989)
I20260709 12:14:59.732885   884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbd67757b4845ca853b96af58779a35" candidate_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc7c8c387334b5c97a55dd98c7df969" is_pre_election: true
I20260709 12:14:59.733621   809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbd67757b4845ca853b96af58779a35" candidate_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5" is_pre_election: true
I20260709 12:14:59.734421   884 raft_consensus.cc:2468] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4c69c1ded3749f0ad8dcbd90e996a57 in term 0.
I20260709 12:14:59.734800   809 raft_consensus.cc:2468] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4c69c1ded3749f0ad8dcbd90e996a57 in term 0.
I20260709 12:14:59.736613   922 leader_election.cc:304] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc7c8c387334b5c97a55dd98c7df969, f4c69c1ded3749f0ad8dcbd90e996a57; no voters: 
I20260709 12:14:59.737660  1005 raft_consensus.cc:2804] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:59.738123  1005 raft_consensus.cc:493] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.738889  1005 raft_consensus.cc:3060] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.750295  1005 raft_consensus.cc:515] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:14:59.752499  1005 leader_election.cc:290] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [CANDIDATE]: Term 1 election: Requested vote from peers 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194:38119), dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193:43989)
I20260709 12:14:59.753572   884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbd67757b4845ca853b96af58779a35" candidate_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc7c8c387334b5c97a55dd98c7df969"
I20260709 12:14:59.754098   809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbd67757b4845ca853b96af58779a35" candidate_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
I20260709 12:14:59.754257   884 raft_consensus.cc:3060] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.754796   809 raft_consensus.cc:3060] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.763937   809 raft_consensus.cc:2468] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4c69c1ded3749f0ad8dcbd90e996a57 in term 1.
I20260709 12:14:59.764073   884 raft_consensus.cc:2468] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4c69c1ded3749f0ad8dcbd90e996a57 in term 1.
I20260709 12:14:59.765292   924 leader_election.cc:304] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcb6dfaecd82416d8353d779b61b89e5, f4c69c1ded3749f0ad8dcbd90e996a57; no voters: 
I20260709 12:14:59.766265  1005 raft_consensus.cc:2804] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:59.767423  1005 raft_consensus.cc:697] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 LEADER]: Becoming Leader. State: Replica: f4c69c1ded3749f0ad8dcbd90e996a57, State: Running, Role: LEADER
I20260709 12:14:59.769055  1005 consensus_queue.cc:237] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:14:59.778965   706 catalog_manager.cc:5697] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.827399   706 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50556:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:59.830332   706 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:59.860922   798 tablet_service.cc:1511] Processing CreateTablet for tablet 138b91b65f4d44e8935e4dc1afccdd7c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7ad1a6a04ddd4484a05840792e7708af]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:59.862582   873 tablet_service.cc:1511] Processing CreateTablet for tablet 138b91b65f4d44e8935e4dc1afccdd7c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7ad1a6a04ddd4484a05840792e7708af]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:59.863322   798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138b91b65f4d44e8935e4dc1afccdd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.864882   873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138b91b65f4d44e8935e4dc1afccdd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.865234   947 tablet_service.cc:1511] Processing CreateTablet for tablet 138b91b65f4d44e8935e4dc1afccdd7c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7ad1a6a04ddd4484a05840792e7708af]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:59.866904   947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138b91b65f4d44e8935e4dc1afccdd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.867622   799 tablet_service.cc:1511] Processing CreateTablet for tablet 47689a25df3f4062a44795a2d76b56e8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7ad1a6a04ddd4484a05840792e7708af]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:59.869279   799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47689a25df3f4062a44795a2d76b56e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.883663   874 tablet_service.cc:1511] Processing CreateTablet for tablet 47689a25df3f4062a44795a2d76b56e8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7ad1a6a04ddd4484a05840792e7708af]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:59.885303   874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47689a25df3f4062a44795a2d76b56e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.890522  1000 tablet_bootstrap.cc:492] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5: Bootstrap starting.
I20260709 12:14:59.890334   948 tablet_service.cc:1511] Processing CreateTablet for tablet 47689a25df3f4062a44795a2d76b56e8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7ad1a6a04ddd4484a05840792e7708af]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:59.891953   948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47689a25df3f4062a44795a2d76b56e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:59.899436   755 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:59.901408  1000 tablet_bootstrap.cc:654] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.905088   999 tablet_bootstrap.cc:492] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57: Bootstrap starting.
I20260709 12:14:59.917584   998 tablet_bootstrap.cc:492] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969: Bootstrap starting.
I20260709 12:14:59.917923   999 tablet_bootstrap.cc:654] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.920710  1000 tablet_bootstrap.cc:492] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5: No bootstrap required, opened a new log
I20260709 12:14:59.921432  1000 ts_tablet_manager.cc:1403] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.015s
I20260709 12:14:59.926517  1000 raft_consensus.cc:359] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.927654   998 tablet_bootstrap.cc:654] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.927623  1000 raft_consensus.cc:385] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.929056  1000 raft_consensus.cc:740] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcb6dfaecd82416d8353d779b61b89e5, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.930056  1000 consensus_queue.cc:260] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.932207   999 tablet_bootstrap.cc:492] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57: No bootstrap required, opened a new log
I20260709 12:14:59.932838   999 ts_tablet_manager.cc:1403] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.004s
I20260709 12:14:59.932752  1000 ts_tablet_manager.cc:1434] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.006s
I20260709 12:14:59.935869  1000 tablet_bootstrap.cc:492] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5: Bootstrap starting.
I20260709 12:14:59.937177   999 raft_consensus.cc:359] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.938103   999 raft_consensus.cc:385] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.938452   999 raft_consensus.cc:740] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4c69c1ded3749f0ad8dcbd90e996a57, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.946938   999 consensus_queue.cc:260] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.949149   998 tablet_bootstrap.cc:492] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969: No bootstrap required, opened a new log
I20260709 12:14:59.949945   998 ts_tablet_manager.cc:1403] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.012s
I20260709 12:14:59.949913  1000 tablet_bootstrap.cc:654] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.954473   999 ts_tablet_manager.cc:1434] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:14:59.953955   998 raft_consensus.cc:359] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.955322   998 raft_consensus.cc:385] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.955724   999 tablet_bootstrap.cc:492] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57: Bootstrap starting.
I20260709 12:14:59.955799   998 raft_consensus.cc:740] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc7c8c387334b5c97a55dd98c7df969, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.957497   998 consensus_queue.cc:260] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.964727   998 ts_tablet_manager.cc:1434] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 12:14:59.966472   998 tablet_bootstrap.cc:492] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969: Bootstrap starting.
I20260709 12:14:59.968542   999 tablet_bootstrap.cc:654] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.977259   998 tablet_bootstrap.cc:654] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.984922   999 tablet_bootstrap.cc:492] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57: No bootstrap required, opened a new log
I20260709 12:14:59.985133  1000 tablet_bootstrap.cc:492] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5: No bootstrap required, opened a new log
I20260709 12:14:59.985468   999 ts_tablet_manager.cc:1403] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.011s
I20260709 12:14:59.985864  1000 ts_tablet_manager.cc:1403] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.033s
I20260709 12:14:59.987498   998 tablet_bootstrap.cc:492] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969: No bootstrap required, opened a new log
I20260709 12:14:59.988086   998 ts_tablet_manager.cc:1403] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.013s
I20260709 12:14:59.989037   999 raft_consensus.cc:359] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.989212  1000 raft_consensus.cc:359] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.989949   999 raft_consensus.cc:385] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.990036  1000 raft_consensus.cc:385] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.990474   999 raft_consensus.cc:740] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4c69c1ded3749f0ad8dcbd90e996a57, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.990593  1000 raft_consensus.cc:740] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcb6dfaecd82416d8353d779b61b89e5, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.991174   998 raft_consensus.cc:359] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.991555   999 consensus_queue.cc:260] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.992048   998 raft_consensus.cc:385] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.991683  1000 consensus_queue.cc:260] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.992403   998 raft_consensus.cc:740] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc7c8c387334b5c97a55dd98c7df969, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.993651   998 consensus_queue.cc:260] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:14:59.994179   999 ts_tablet_manager.cc:1434] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:14:59.996490   998 ts_tablet_manager.cc:1434] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 12:14:59.997149  1000 ts_tablet_manager.cc:1434] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.006s
I20260709 12:15:00.006388  1004 raft_consensus.cc:493] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.007138  1004 raft_consensus.cc:515] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.009617  1004 leader_election.cc:290] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193:43989), f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195:39585)
I20260709 12:15:00.010591   809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5" is_pre_election: true
I20260709 12:15:00.010951   958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" is_pre_election: true
I20260709 12:15:00.011287   809 raft_consensus.cc:2468] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 0.
I20260709 12:15:00.011831   958 raft_consensus.cc:2468] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 0.
I20260709 12:15:00.012629   850 leader_election.cc:304] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc7c8c387334b5c97a55dd98c7df969, dcb6dfaecd82416d8353d779b61b89e5; no voters: 
I20260709 12:15:00.013543  1004 raft_consensus.cc:2804] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:00.013963  1004 raft_consensus.cc:493] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:00.014256  1004 raft_consensus.cc:3060] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:00.021339  1004 raft_consensus.cc:515] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.023260  1004 leader_election.cc:290] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 election: Requested vote from peers dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193:43989), f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195:39585)
I20260709 12:15:00.024259   809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
I20260709 12:15:00.024673   958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57"
I20260709 12:15:00.024950   809 raft_consensus.cc:3060] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:00.025519   958 raft_consensus.cc:3060] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:00.032599   958 raft_consensus.cc:2468] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 1.
I20260709 12:15:00.032621   809 raft_consensus.cc:2468] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 1.
I20260709 12:15:00.033939   850 leader_election.cc:304] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc7c8c387334b5c97a55dd98c7df969, f4c69c1ded3749f0ad8dcbd90e996a57; no voters: 
I20260709 12:15:00.035349  1004 raft_consensus.cc:2804] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:00.035935  1004 raft_consensus.cc:697] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Becoming Leader. State: Replica: 3dc7c8c387334b5c97a55dd98c7df969, State: Running, Role: LEADER
I20260709 12:15:00.036762  1004 consensus_queue.cc:237] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.045361   707 catalog_manager.cc:5697] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "3dc7c8c387334b5c97a55dd98c7df969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.089255  1004 consensus_queue.cc:1048] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.108919  1011 consensus_queue.cc:1048] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:00.231048  1005 consensus_queue.cc:1048] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.244556  1035 consensus_queue.cc:1048] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:00.282371  1011 raft_consensus.cc:493] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.283102  1011 raft_consensus.cc:515] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.285132  1011 leader_election.cc:290] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193:43989), f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195:39585)
I20260709 12:15:00.286146   809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47689a25df3f4062a44795a2d76b56e8" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5" is_pre_election: true
I20260709 12:15:00.286475   958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47689a25df3f4062a44795a2d76b56e8" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" is_pre_election: true
I20260709 12:15:00.286964   809 raft_consensus.cc:2468] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 0.
I20260709 12:15:00.287505   958 raft_consensus.cc:2468] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 0.
I20260709 12:15:00.288223   850 leader_election.cc:304] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc7c8c387334b5c97a55dd98c7df969, dcb6dfaecd82416d8353d779b61b89e5; no voters: 
I20260709 12:15:00.289338  1011 raft_consensus.cc:2804] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:00.289706  1011 raft_consensus.cc:493] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:00.290059  1011 raft_consensus.cc:3060] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:00.297231  1011 raft_consensus.cc:515] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.299235  1011 leader_election.cc:290] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 election: Requested vote from peers dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193:43989), f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195:39585)
I20260709 12:15:00.300141   809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47689a25df3f4062a44795a2d76b56e8" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
I20260709 12:15:00.300488   958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47689a25df3f4062a44795a2d76b56e8" candidate_uuid: "3dc7c8c387334b5c97a55dd98c7df969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57"
I20260709 12:15:00.300855   809 raft_consensus.cc:3060] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:00.301249   958 raft_consensus.cc:3060] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:00.306747   809 raft_consensus.cc:2468] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 1.
I20260709 12:15:00.307336   958 raft_consensus.cc:2468] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dc7c8c387334b5c97a55dd98c7df969 in term 1.
I20260709 12:15:00.307914   850 leader_election.cc:304] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc7c8c387334b5c97a55dd98c7df969, dcb6dfaecd82416d8353d779b61b89e5; no voters: 
I20260709 12:15:00.308816  1011 raft_consensus.cc:2804] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:00.309276  1011 raft_consensus.cc:697] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Becoming Leader. State: Replica: 3dc7c8c387334b5c97a55dd98c7df969, State: Running, Role: LEADER
I20260709 12:15:00.309988  1011 consensus_queue.cc:237] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.318100   706 catalog_manager.cc:5697] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "3dc7c8c387334b5c97a55dd98c7df969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.391278   958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fbd67757b4845ca853b96af58779a35"
dest_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57"
mode: GRACEFUL
new_leader_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
 from {username='slave'} at 127.0.0.1:36038
I20260709 12:15:00.391916   958 raft_consensus.cc:606] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 LEADER]: Received request to transfer leadership to TS dcb6dfaecd82416d8353d779b61b89e5
I20260709 12:15:00.412106   884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c"
dest_uuid: "3dc7c8c387334b5c97a55dd98c7df969"
mode: GRACEFUL
new_leader_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
 from {username='slave'} at 127.0.0.1:54258
I20260709 12:15:00.412874   884 raft_consensus.cc:606] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Received request to transfer leadership to TS dcb6dfaecd82416d8353d779b61b89e5
I20260709 12:15:00.419116   884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47689a25df3f4062a44795a2d76b56e8"
dest_uuid: "3dc7c8c387334b5c97a55dd98c7df969"
mode: GRACEFUL
new_leader_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
 from {username='slave'} at 127.0.0.1:54258
I20260709 12:15:00.419690   884 raft_consensus.cc:606] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Received request to transfer leadership to TS dcb6dfaecd82416d8353d779b61b89e5
I20260709 12:15:00.636703  1041 consensus_queue.cc:1048] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.640913  1041 consensus_queue.cc:1048] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:00.653051  1041 raft_consensus.cc:993] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969: : Instructing follower dcb6dfaecd82416d8353d779b61b89e5 to start an election
I20260709 12:15:00.653681  1041 raft_consensus.cc:1081] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Signalling peer dcb6dfaecd82416d8353d779b61b89e5 to start an election
I20260709 12:15:00.656963   808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c"
dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
 from {username='slave'} at 127.0.0.1:51640
I20260709 12:15:00.657793   808 raft_consensus.cc:493] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:00.658226   808 raft_consensus.cc:3060] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.668313   808 raft_consensus.cc:515] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.674981   808 leader_election.cc:290] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [CANDIDATE]: Term 2 election: Requested vote from peers 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194:38119), f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195:39585)
I20260709 12:15:00.686481   884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c" candidate_uuid: "dcb6dfaecd82416d8353d779b61b89e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3dc7c8c387334b5c97a55dd98c7df969"
I20260709 12:15:00.687163   884 raft_consensus.cc:3055] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:00.687500   884 raft_consensus.cc:740] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dc7c8c387334b5c97a55dd98c7df969, State: Running, Role: LEADER
I20260709 12:15:00.688454   958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c" candidate_uuid: "dcb6dfaecd82416d8353d779b61b89e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57"
I20260709 12:15:00.688292   884 consensus_queue.cc:260] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.689097   958 raft_consensus.cc:3060] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.689661   884 raft_consensus.cc:3060] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.696710   884 raft_consensus.cc:2468] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcb6dfaecd82416d8353d779b61b89e5 in term 2.
I20260709 12:15:00.696710   958 raft_consensus.cc:2468] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcb6dfaecd82416d8353d779b61b89e5 in term 2.
I20260709 12:15:00.698259   773 leader_election.cc:304] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc7c8c387334b5c97a55dd98c7df969, dcb6dfaecd82416d8353d779b61b89e5; no voters: 
I20260709 12:15:00.699347  1008 raft_consensus.cc:2804] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.700682  1008 raft_consensus.cc:697] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 2 LEADER]: Becoming Leader. State: Replica: dcb6dfaecd82416d8353d779b61b89e5, State: Running, Role: LEADER
I20260709 12:15:00.701864  1008 consensus_queue.cc:237] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.709375   704 catalog_manager.cc:5697] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 reported cstate change: term changed from 1 to 2, leader changed from 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194) to dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "dcb6dfaecd82416d8353d779b61b89e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.751716  1011 consensus_queue.cc:1048] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.764979  1041 consensus_queue.cc:1048] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.774362  1041 raft_consensus.cc:993] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969: : Instructing follower dcb6dfaecd82416d8353d779b61b89e5 to start an election
I20260709 12:15:00.774921  1011 raft_consensus.cc:1081] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Signalling peer dcb6dfaecd82416d8353d779b61b89e5 to start an election
I20260709 12:15:00.776937   808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47689a25df3f4062a44795a2d76b56e8"
dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
 from {username='slave'} at 127.0.0.1:51640
I20260709 12:15:00.777523   808 raft_consensus.cc:493] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:00.777999   808 raft_consensus.cc:3060] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.783151   808 raft_consensus.cc:515] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.785312   808 leader_election.cc:290] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [CANDIDATE]: Term 2 election: Requested vote from peers 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194:38119), f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195:39585)
I20260709 12:15:00.786901   884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47689a25df3f4062a44795a2d76b56e8" candidate_uuid: "dcb6dfaecd82416d8353d779b61b89e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3dc7c8c387334b5c97a55dd98c7df969"
I20260709 12:15:00.787381   958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47689a25df3f4062a44795a2d76b56e8" candidate_uuid: "dcb6dfaecd82416d8353d779b61b89e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57"
I20260709 12:15:00.787539   884 raft_consensus.cc:3055] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:00.789309   884 raft_consensus.cc:740] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dc7c8c387334b5c97a55dd98c7df969, State: Running, Role: LEADER
I20260709 12:15:00.789417   958 raft_consensus.cc:3060] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.790932   884 consensus_queue.cc:260] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.793402   884 raft_consensus.cc:3060] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.801249   958 raft_consensus.cc:2468] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcb6dfaecd82416d8353d779b61b89e5 in term 2.
I20260709 12:15:00.803169  1049 raft_consensus.cc:993] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57: : Instructing follower dcb6dfaecd82416d8353d779b61b89e5 to start an election
I20260709 12:15:00.803795  1049 raft_consensus.cc:1081] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 LEADER]: Signalling peer dcb6dfaecd82416d8353d779b61b89e5 to start an election
I20260709 12:15:00.805647   808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fbd67757b4845ca853b96af58779a35"
dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
 from {username='slave'} at 127.0.0.1:51642
I20260709 12:15:00.806255   808 raft_consensus.cc:493] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:00.806640   808 raft_consensus.cc:3060] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.806511   775 leader_election.cc:304] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcb6dfaecd82416d8353d779b61b89e5, f4c69c1ded3749f0ad8dcbd90e996a57; no voters: 
I20260709 12:15:00.807723  1008 raft_consensus.cc:2804] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.808223  1008 raft_consensus.cc:697] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 LEADER]: Becoming Leader. State: Replica: dcb6dfaecd82416d8353d779b61b89e5, State: Running, Role: LEADER
I20260709 12:15:00.809078  1008 consensus_queue.cc:237] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:00.809454   884 raft_consensus.cc:2468] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcb6dfaecd82416d8353d779b61b89e5 in term 2.
I20260709 12:15:00.814604   808 raft_consensus.cc:515] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:15:00.817031   808 leader_election.cc:290] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [CANDIDATE]: Term 2 election: Requested vote from peers 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194:38119), f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195:39585)
I20260709 12:15:00.817505   707 catalog_manager.cc:5697] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 reported cstate change: term changed from 1 to 2, leader changed from 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194) to dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "dcb6dfaecd82416d8353d779b61b89e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.818512   958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbd67757b4845ca853b96af58779a35" candidate_uuid: "dcb6dfaecd82416d8353d779b61b89e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57"
I20260709 12:15:00.818512   884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbd67757b4845ca853b96af58779a35" candidate_uuid: "dcb6dfaecd82416d8353d779b61b89e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3dc7c8c387334b5c97a55dd98c7df969"
I20260709 12:15:00.819514   958 raft_consensus.cc:3055] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:00.819553   884 raft_consensus.cc:3060] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.820171   958 raft_consensus.cc:740] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4c69c1ded3749f0ad8dcbd90e996a57, State: Running, Role: LEADER
I20260709 12:15:00.821715   958 consensus_queue.cc:260] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:15:00.823235   958 raft_consensus.cc:3060] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.828060   884 raft_consensus.cc:2468] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcb6dfaecd82416d8353d779b61b89e5 in term 2.
I20260709 12:15:00.829547   773 leader_election.cc:304] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc7c8c387334b5c97a55dd98c7df969, dcb6dfaecd82416d8353d779b61b89e5; no voters: 
I20260709 12:15:00.830731  1008 raft_consensus.cc:2804] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.831171  1008 raft_consensus.cc:697] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 LEADER]: Becoming Leader. State: Replica: dcb6dfaecd82416d8353d779b61b89e5, State: Running, Role: LEADER
I20260709 12:15:00.831297   958 raft_consensus.cc:2468] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcb6dfaecd82416d8353d779b61b89e5 in term 2.
I20260709 12:15:00.831928  1008 consensus_queue.cc:237] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } }
I20260709 12:15:00.839378   707 catalog_manager.cc:5697] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 reported cstate change: term changed from 1 to 2, leader changed from f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195) to dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "dcb6dfaecd82416d8353d779b61b89e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.917798 20891 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:15:00.919435 20891 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:15:00.919844 20891 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:15:00.933527   808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c"
dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
mode: GRACEFUL
new_leader_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57"
 from {username='slave'} at 127.0.0.1:51656
I20260709 12:15:00.934134   808 raft_consensus.cc:606] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 2 LEADER]: Received request to transfer leadership to TS f4c69c1ded3749f0ad8dcbd90e996a57
I20260709 12:15:00.935650 20891 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:15:01.082109   884 raft_consensus.cc:1275] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 2 FOLLOWER]: Refusing update from remote peer dcb6dfaecd82416d8353d779b61b89e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.083582  1008 consensus_queue.cc:1048] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:01.096194   958 raft_consensus.cc:1275] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: Refusing update from remote peer dcb6dfaecd82416d8353d779b61b89e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.098178  1053 consensus_queue.cc:1048] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:01.106976  1008 raft_consensus.cc:993] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5: : Instructing follower f4c69c1ded3749f0ad8dcbd90e996a57 to start an election
I20260709 12:15:01.107606  1008 raft_consensus.cc:1081] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 2 LEADER]: Signalling peer f4c69c1ded3749f0ad8dcbd90e996a57 to start an election
I20260709 12:15:01.109660   958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c"
dest_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:15:01.110249   958 raft_consensus.cc:493] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:01.110596   958 raft_consensus.cc:3060] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:01.118026   958 raft_consensus.cc:515] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:01.120675   958 leader_election.cc:290] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [CANDIDATE]: Term 3 election: Requested vote from peers dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193:43989), 3dc7c8c387334b5c97a55dd98c7df969 (127.20.102.194:38119)
I20260709 12:15:01.121752   808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c" candidate_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dcb6dfaecd82416d8353d779b61b89e5"
I20260709 12:15:01.121870   884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b91b65f4d44e8935e4dc1afccdd7c" candidate_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3dc7c8c387334b5c97a55dd98c7df969"
I20260709 12:15:01.122743   808 raft_consensus.cc:3055] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:01.123003   884 raft_consensus.cc:3060] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:01.123275   808 raft_consensus.cc:740] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcb6dfaecd82416d8353d779b61b89e5, State: Running, Role: LEADER
I20260709 12:15:01.124421   808 consensus_queue.cc:260] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:01.126092   808 raft_consensus.cc:3060] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:01.129444   884 raft_consensus.cc:2468] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4c69c1ded3749f0ad8dcbd90e996a57 in term 3.
I20260709 12:15:01.130730   922 leader_election.cc:304] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dc7c8c387334b5c97a55dd98c7df969, f4c69c1ded3749f0ad8dcbd90e996a57; no voters: 
I20260709 12:15:01.131496  1049 raft_consensus.cc:2804] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:01.131965  1049 raft_consensus.cc:697] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 3 LEADER]: Becoming Leader. State: Replica: f4c69c1ded3749f0ad8dcbd90e996a57, State: Running, Role: LEADER
I20260709 12:15:01.133009  1049 consensus_queue.cc:237] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } }
I20260709 12:15:01.133577   808 raft_consensus.cc:2468] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4c69c1ded3749f0ad8dcbd90e996a57 in term 3.
I20260709 12:15:01.140674   707 catalog_manager.cc:5697] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 reported cstate change: term changed from 2 to 3, leader changed from dcb6dfaecd82416d8353d779b61b89e5 (127.20.102.193) to f4c69c1ded3749f0ad8dcbd90e996a57 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcb6dfaecd82416d8353d779b61b89e5" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 43989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dc7c8c387334b5c97a55dd98c7df969" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:01.175999 20891 tablet_server.cc:179] TabletServer@127.20.102.193:0 shutting down...
I20260709 12:15:01.215107 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:01.216084 20891 tablet_replica.cc:333] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5: stopping tablet replica
I20260709 12:15:01.216866 20891 raft_consensus.cc:2243] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:01.217346 20891 raft_consensus.cc:2272] T 53dcdf10ca094970b32ec33e1fe2ce85 P dcb6dfaecd82416d8353d779b61b89e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.219565 20891 tablet_replica.cc:333] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5: stopping tablet replica
I20260709 12:15:01.220237 20891 raft_consensus.cc:2243] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:01.221088 20891 pending_rounds.cc:70] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5: Trying to abort 1 pending ops.
I20260709 12:15:01.221370 20891 pending_rounds.cc:77] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622736125202432 op_type: NO_OP noop_request { }
I20260709 12:15:01.221956 20891 raft_consensus.cc:2889] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:15:01.222234 20891 raft_consensus.cc:2272] T 47689a25df3f4062a44795a2d76b56e8 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.225718 20891 tablet_replica.cc:333] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5: stopping tablet replica
I20260709 12:15:01.226693 20891 raft_consensus.cc:2243] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:01.227348 20891 raft_consensus.cc:2272] T 138b91b65f4d44e8935e4dc1afccdd7c P dcb6dfaecd82416d8353d779b61b89e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.228322   958 raft_consensus.cc:1275] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: Refusing update from remote peer dcb6dfaecd82416d8353d779b61b89e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.230366 20891 tablet_replica.cc:333] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5: stopping tablet replica
I20260709 12:15:01.230129  1053 consensus_queue.cc:1048] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4c69c1ded3749f0ad8dcbd90e996a57" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:01.231194 20891 raft_consensus.cc:2243] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:01.231915 20891 pending_rounds.cc:70] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5: Trying to abort 1 pending ops.
I20260709 12:15:01.232090 20891 pending_rounds.cc:77] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622736216854528 op_type: NO_OP noop_request { }
I20260709 12:15:01.232388 20891 raft_consensus.cc:2889] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:15:01.232812 20891 raft_consensus.cc:2272] T 2fbd67757b4845ca853b96af58779a35 P dcb6dfaecd82416d8353d779b61b89e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.264146 20891 tablet_server.cc:196] TabletServer@127.20.102.193:0 shutdown complete.
I20260709 12:15:01.280936 20891 tablet_server.cc:179] TabletServer@127.20.102.194:0 shutting down...
I20260709 12:15:01.316510 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:01.317445 20891 tablet_replica.cc:333] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969: stopping tablet replica
I20260709 12:15:01.318038 20891 raft_consensus.cc:2243] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:01.318470 20891 raft_consensus.cc:2272] T 47689a25df3f4062a44795a2d76b56e8 P 3dc7c8c387334b5c97a55dd98c7df969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.320746 20891 tablet_replica.cc:333] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969: stopping tablet replica
I20260709 12:15:01.321311 20891 raft_consensus.cc:2243] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:01.321686 20891 raft_consensus.cc:2272] T 138b91b65f4d44e8935e4dc1afccdd7c P 3dc7c8c387334b5c97a55dd98c7df969 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.324080 20891 tablet_replica.cc:333] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969: stopping tablet replica
I20260709 12:15:01.324592 20891 raft_consensus.cc:2243] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:01.325094 20891 raft_consensus.cc:2272] T 2fbd67757b4845ca853b96af58779a35 P 3dc7c8c387334b5c97a55dd98c7df969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.327183 20891 tablet_replica.cc:333] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969: stopping tablet replica
I20260709 12:15:01.327616 20891 raft_consensus.cc:2243] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:01.328339 20891 raft_consensus.cc:2272] T 53dcdf10ca094970b32ec33e1fe2ce85 P 3dc7c8c387334b5c97a55dd98c7df969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.352397 20891 tablet_server.cc:196] TabletServer@127.20.102.194:0 shutdown complete.
I20260709 12:15:01.369407 20891 tablet_server.cc:179] TabletServer@127.20.102.195:0 shutting down...
I20260709 12:15:01.399011 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:01.399817 20891 tablet_replica.cc:333] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57: stopping tablet replica
I20260709 12:15:01.400400 20891 raft_consensus.cc:2243] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:01.400914 20891 raft_consensus.cc:2272] T 53dcdf10ca094970b32ec33e1fe2ce85 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.403008 20891 tablet_replica.cc:333] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57: stopping tablet replica
I20260709 12:15:01.403496 20891 raft_consensus.cc:2243] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:01.403873 20891 raft_consensus.cc:2272] T 47689a25df3f4062a44795a2d76b56e8 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.406399 20891 tablet_replica.cc:333] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57: stopping tablet replica
I20260709 12:15:01.406883 20891 raft_consensus.cc:2243] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:01.407460 20891 pending_rounds.cc:70] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57: Trying to abort 1 pending ops.
I20260709 12:15:01.407615 20891 pending_rounds.cc:77] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305622737449086976 op_type: NO_OP noop_request { }
I20260709 12:15:01.407862 20891 raft_consensus.cc:2889] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:15:01.408093 20891 raft_consensus.cc:2272] T 138b91b65f4d44e8935e4dc1afccdd7c P f4c69c1ded3749f0ad8dcbd90e996a57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.410530 20891 tablet_replica.cc:333] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57: stopping tablet replica
I20260709 12:15:01.411052 20891 raft_consensus.cc:2243] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:01.411375 20891 pending_rounds.cc:70] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57: Trying to abort 1 pending ops.
I20260709 12:15:01.411515 20891 pending_rounds.cc:77] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622736216854528 op_type: NO_OP noop_request { }
I20260709 12:15:01.411731 20891 raft_consensus.cc:2889] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:15:01.411954 20891 raft_consensus.cc:2272] T 2fbd67757b4845ca853b96af58779a35 P f4c69c1ded3749f0ad8dcbd90e996a57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.426613 20891 tablet_server.cc:196] TabletServer@127.20.102.195:0 shutdown complete.
I20260709 12:15:01.442240 20891 master.cc:562] Master@127.20.102.254:33201 shutting down...
I20260709 12:15:01.466099 20891 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:01.466840 20891 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:01.467235 20891 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5358718033024682986705c0bfe78c48: stopping tablet replica
I20260709 12:15:01.488656 20891 master.cc:584] Master@127.20.102.254:33201 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2794 ms)
[----------] 6 tests from LeaderRebalancerTest (406326 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:15:01.532106 20891 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.102.254:39127
I20260709 12:15:01.533419 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:01.539870  1055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:01.540025  1054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:01.540977  1057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:01.541730 20891 server_base.cc:1061] running on GCE node
I20260709 12:15:01.542716 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:01.542948 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:01.543143 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599301543128 us; error 0 us; skew 500 ppm
I20260709 12:15:01.543766 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:01.546542 20891 webserver.cc:533] Webserver started at http://127.20.102.254:38107/ using document root <none> and password file <none>
I20260709 12:15:01.547084 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:01.547286 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:01.547591 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:01.548720 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/master-0-root/instance:
uuid: "e650a36b445644ea83b1ae57f0ea24a1"
format_stamp: "Formatted at 2026-07-09 12:15:01 on dist-test-slave-296p"
I20260709 12:15:01.553880 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:15:01.558640  1062 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:01.559677 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:15:01.560097 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/master-0-root
uuid: "e650a36b445644ea83b1ae57f0ea24a1"
format_stamp: "Formatted at 2026-07-09 12:15:01 on dist-test-slave-296p"
I20260709 12:15:01.560422 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:01.573845 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:01.575094 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:01.621057 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.254:39127
I20260709 12:15:01.621148  1113 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.254:39127 every 8 connection(s)
I20260709 12:15:01.625937  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:01.641290  1114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1: Bootstrap starting.
I20260709 12:15:01.647562  1114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:01.652989  1114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1: No bootstrap required, opened a new log
I20260709 12:15:01.655678  1114 raft_consensus.cc:359] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e650a36b445644ea83b1ae57f0ea24a1" member_type: VOTER }
I20260709 12:15:01.656216  1114 raft_consensus.cc:385] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:01.656530  1114 raft_consensus.cc:740] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e650a36b445644ea83b1ae57f0ea24a1, State: Initialized, Role: FOLLOWER
I20260709 12:15:01.657290  1114 consensus_queue.cc:260] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e650a36b445644ea83b1ae57f0ea24a1" member_type: VOTER }
I20260709 12:15:01.657829  1114 raft_consensus.cc:399] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:01.658041  1114 raft_consensus.cc:493] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:01.658339  1114 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:01.664487  1114 raft_consensus.cc:515] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e650a36b445644ea83b1ae57f0ea24a1" member_type: VOTER }
I20260709 12:15:01.665186  1114 leader_election.cc:304] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e650a36b445644ea83b1ae57f0ea24a1; no voters: 
I20260709 12:15:01.666575  1114 leader_election.cc:290] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:01.667035  1117 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:01.668741  1117 raft_consensus.cc:697] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [term 1 LEADER]: Becoming Leader. State: Replica: e650a36b445644ea83b1ae57f0ea24a1, State: Running, Role: LEADER
I20260709 12:15:01.669566  1117 consensus_queue.cc:237] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e650a36b445644ea83b1ae57f0ea24a1" member_type: VOTER }
I20260709 12:15:01.669951  1114 sys_catalog.cc:565] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:01.673079  1119 sys_catalog.cc:455] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e650a36b445644ea83b1ae57f0ea24a1. Latest consensus state: current_term: 1 leader_uuid: "e650a36b445644ea83b1ae57f0ea24a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e650a36b445644ea83b1ae57f0ea24a1" member_type: VOTER } }
I20260709 12:15:01.673031  1118 sys_catalog.cc:455] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e650a36b445644ea83b1ae57f0ea24a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e650a36b445644ea83b1ae57f0ea24a1" member_type: VOTER } }
I20260709 12:15:01.673954  1119 sys_catalog.cc:458] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:01.673991  1118 sys_catalog.cc:458] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:01.679093  1122 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:01.684528  1122 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:01.689182 20891 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:01.695152  1122 catalog_manager.cc:1383] Generated new cluster ID: 46dcb4354c8240e783372f7ce8212ef1
I20260709 12:15:01.695513  1122 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:01.736094  1122 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:01.737653  1122 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:01.754921  1122 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1: Generated new TSK 0
I20260709 12:15:01.755705  1122 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:01.820747 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:01.827389  1135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:01.828500  1136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:01.830863  1138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:01.830992 20891 server_base.cc:1061] running on GCE node
I20260709 12:15:01.832248 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:01.832504 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:01.832690 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599301832669 us; error 0 us; skew 500 ppm
I20260709 12:15:01.833391 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:01.836196 20891 webserver.cc:533] Webserver started at http://127.20.102.193:41635/ using document root <none> and password file <none>
I20260709 12:15:01.836869 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:01.837116 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:01.837431 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:01.838747 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-0-root/instance:
uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
format_stamp: "Formatted at 2026-07-09 12:15:01 on dist-test-slave-296p"
I20260709 12:15:01.843928 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:15:01.848305  1143 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:01.849395 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:01.849669 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-0-root
uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
format_stamp: "Formatted at 2026-07-09 12:15:01 on dist-test-slave-296p"
I20260709 12:15:01.849944 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:01.864491 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:01.865803 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:01.867389 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:01.870096 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:01.870288 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:01.870579 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:01.870769 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:01.916409 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.193:39923
I20260709 12:15:01.916617  1205 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.193:39923 every 8 connection(s)
I20260709 12:15:01.921859 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:01.929757  1210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:01.933558  1211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:01.934664  1213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:01.935935 20891 server_base.cc:1061] running on GCE node
I20260709 12:15:01.937608  1206 heartbeater.cc:344] Connected to a master server at 127.20.102.254:39127
I20260709 12:15:01.938081 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:15:01.938093  1206 heartbeater.cc:461] Registering TS with master...
W20260709 12:15:01.938416 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:01.938872 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599301938850 us; error 0 us; skew 500 ppm
I20260709 12:15:01.939512 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:01.939528  1206 heartbeater.cc:507] Master 127.20.102.254:39127 requested a full tablet report, sending...
I20260709 12:15:01.942636  1079 ts_manager.cc:194] Registered new tserver with Master: f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923)
I20260709 12:15:01.942732 20891 webserver.cc:533] Webserver started at http://127.20.102.194:41049/ using document root <none> and password file <none>
I20260709 12:15:01.943442 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:01.943691 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:01.944026 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:01.945173  1079 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52526
I20260709 12:15:01.945549 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-1-root/instance:
uuid: "567b3ab021414d40a11f2335766ef697"
format_stamp: "Formatted at 2026-07-09 12:15:01 on dist-test-slave-296p"
I20260709 12:15:01.950665 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:15:01.954687  1218 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:01.955651 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:15:01.956050 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-1-root
uuid: "567b3ab021414d40a11f2335766ef697"
format_stamp: "Formatted at 2026-07-09 12:15:01 on dist-test-slave-296p"
I20260709 12:15:01.956348 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:01.981777 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:01.983122 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:01.984753 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:01.987273 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:01.987522 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:01.987798 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:01.987974 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:02.034051 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.194:38935
I20260709 12:15:02.034281  1280 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.194:38935 every 8 connection(s)
I20260709 12:15:02.039182 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:02.048897  1284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:02.050233  1285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:02.054545  1281 heartbeater.cc:344] Connected to a master server at 127.20.102.254:39127
I20260709 12:15:02.054833 20891 server_base.cc:1061] running on GCE node
I20260709 12:15:02.055270  1281 heartbeater.cc:461] Registering TS with master...
W20260709 12:15:02.055758  1287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:02.056252  1281 heartbeater.cc:507] Master 127.20.102.254:39127 requested a full tablet report, sending...
I20260709 12:15:02.057164 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:02.057544 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:02.057869 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599302057844 us; error 0 us; skew 500 ppm
I20260709 12:15:02.058820 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:02.059099  1079 ts_manager.cc:194] Registered new tserver with Master: 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:02.061028  1079 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52530
I20260709 12:15:02.062155 20891 webserver.cc:533] Webserver started at http://127.20.102.195:41623/ using document root <none> and password file <none>
I20260709 12:15:02.062855 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:02.063077 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:02.063355 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:02.064518 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-2-root/instance:
uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
format_stamp: "Formatted at 2026-07-09 12:15:02 on dist-test-slave-296p"
I20260709 12:15:02.069131 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:15:02.072826  1292 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:02.073833 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:15:02.074272 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-2-root
uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
format_stamp: "Formatted at 2026-07-09 12:15:02 on dist-test-slave-296p"
I20260709 12:15:02.074584 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895025208-20891-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:02.093374 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:02.094543 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:02.096130 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:02.099205 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:02.099448 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:02.099718 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:02.099902 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:02.143481 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.195:34771
I20260709 12:15:02.143632  1354 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.195:34771 every 8 connection(s)
I20260709 12:15:02.159014  1355 heartbeater.cc:344] Connected to a master server at 127.20.102.254:39127
I20260709 12:15:02.159560  1355 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:02.160374  1355 heartbeater.cc:507] Master 127.20.102.254:39127 requested a full tablet report, sending...
I20260709 12:15:02.162496  1079 ts_manager.cc:194] Registered new tserver with Master: 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:02.163069 20891 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016327986s
I20260709 12:15:02.164535  1079 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52544
I20260709 12:15:02.192910  1079 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52552:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:02.195887  1079 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:02.282979  1246 tablet_service.cc:1511] Processing CreateTablet for tablet 717bb99c0ce249efa42d301b8de100fa (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:02.287006  1320 tablet_service.cc:1511] Processing CreateTablet for tablet 717bb99c0ce249efa42d301b8de100fa (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:02.287638  1318 tablet_service.cc:1511] Processing CreateTablet for tablet f2a11cb3a10944eb8a6998df9073c95a (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:02.288674  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717bb99c0ce249efa42d301b8de100fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.289733  1318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a11cb3a10944eb8a6998df9073c95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.290024  1319 tablet_service.cc:1511] Processing CreateTablet for tablet a9db7b42f8bd4126a260b045a9ade1f9 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:02.291453  1319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9db7b42f8bd4126a260b045a9ade1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.292848  1171 tablet_service.cc:1511] Processing CreateTablet for tablet 717bb99c0ce249efa42d301b8de100fa (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:02.293458  1243 tablet_service.cc:1511] Processing CreateTablet for tablet 6ca350a9e24f462d908bd22c056f20ab (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:02.294484  1171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717bb99c0ce249efa42d301b8de100fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.298110  1170 tablet_service.cc:1511] Processing CreateTablet for tablet a9db7b42f8bd4126a260b045a9ade1f9 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:02.299691  1170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9db7b42f8bd4126a260b045a9ade1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.302251  1169 tablet_service.cc:1511] Processing CreateTablet for tablet f2a11cb3a10944eb8a6998df9073c95a (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:02.304972  1168 tablet_service.cc:1511] Processing CreateTablet for tablet 6ca350a9e24f462d908bd22c056f20ab (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:02.286841  1245 tablet_service.cc:1511] Processing CreateTablet for tablet a9db7b42f8bd4126a260b045a9ade1f9 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:02.284663  1246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717bb99c0ce249efa42d301b8de100fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.309012  1317 tablet_service.cc:1511] Processing CreateTablet for tablet 6ca350a9e24f462d908bd22c056f20ab (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:02.310606  1317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ca350a9e24f462d908bd22c056f20ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.313295  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ca350a9e24f462d908bd22c056f20ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.317348  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9db7b42f8bd4126a260b045a9ade1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.322795  1167 tablet_service.cc:1511] Processing CreateTablet for tablet 0789a7d9e74942bcb0ba16bb0e23971b (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:02.325177  1242 tablet_service.cc:1511] Processing CreateTablet for tablet 0789a7d9e74942bcb0ba16bb0e23971b (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:02.326449  1169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a11cb3a10944eb8a6998df9073c95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.326821  1242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0789a7d9e74942bcb0ba16bb0e23971b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.288826  1244 tablet_service.cc:1511] Processing CreateTablet for tablet f2a11cb3a10944eb8a6998df9073c95a (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:02.332433  1241 tablet_service.cc:1511] Processing CreateTablet for tablet afc36569b2714f7f8876619bcd4b68f7 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:02.335095  1167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0789a7d9e74942bcb0ba16bb0e23971b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.336362  1316 tablet_service.cc:1511] Processing CreateTablet for tablet afc36569b2714f7f8876619bcd4b68f7 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:02.338732  1316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc36569b2714f7f8876619bcd4b68f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.332536  1244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a11cb3a10944eb8a6998df9073c95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.341780  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc36569b2714f7f8876619bcd4b68f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.342579  1168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ca350a9e24f462d908bd22c056f20ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.346576  1166 tablet_service.cc:1511] Processing CreateTablet for tablet afc36569b2714f7f8876619bcd4b68f7 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:02.348309  1166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc36569b2714f7f8876619bcd4b68f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.357410  1240 tablet_service.cc:1511] Processing CreateTablet for tablet 6436eba65441457b99ce713e85078a61 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:02.358174  1165 tablet_service.cc:1511] Processing CreateTablet for tablet 6436eba65441457b99ce713e85078a61 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:02.359787  1240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6436eba65441457b99ce713e85078a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.359851  1165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6436eba65441457b99ce713e85078a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.378835  1164 tablet_service.cc:1511] Processing CreateTablet for tablet b419223e89524e338b9d20ba52f89e02 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:02.381911  1319 tablet_service.cc:1511] Processing CreateTablet for tablet 0789a7d9e74942bcb0ba16bb0e23971b (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:02.382727  1164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b419223e89524e338b9d20ba52f89e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.383448  1319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0789a7d9e74942bcb0ba16bb0e23971b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.380941  1239 tablet_service.cc:1511] Processing CreateTablet for tablet b419223e89524e338b9d20ba52f89e02 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:02.376737  1320 tablet_service.cc:1511] Processing CreateTablet for tablet 6436eba65441457b99ce713e85078a61 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:02.392277  1315 tablet_service.cc:1511] Processing CreateTablet for tablet b419223e89524e338b9d20ba52f89e02 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:02.398916  1163 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4c21e7be2741f1bc802fff60713945 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:02.400614  1163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4c21e7be2741f1bc802fff60713945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.402266  1238 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4c21e7be2741f1bc802fff60713945 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:02.408918  1314 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4c21e7be2741f1bc802fff60713945 (DEFAULT_TABLE table=test-workload [id=7d9e7007f3e2468caf3eeb9038f92d8a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:02.421662  1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4c21e7be2741f1bc802fff60713945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.423636  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6436eba65441457b99ce713e85078a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.425405  1315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b419223e89524e338b9d20ba52f89e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.446905  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4c21e7be2741f1bc802fff60713945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.456627  1239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b419223e89524e338b9d20ba52f89e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:02.530355  1371 tablet_bootstrap.cc:492] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:02.537755  1370 tablet_bootstrap.cc:492] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:02.541347  1371 tablet_bootstrap.cc:654] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.545585  1370 tablet_bootstrap.cc:654] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.554446  1372 tablet_bootstrap.cc:492] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:02.564093  1372 tablet_bootstrap.cc:654] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.574174  1371 tablet_bootstrap.cc:492] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:02.574647  1371 ts_tablet_manager.cc:1403] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.016s
I20260709 12:15:02.577291  1372 tablet_bootstrap.cc:492] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:02.577230  1371 raft_consensus.cc:359] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:02.577997  1372 ts_tablet_manager.cc:1403] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 12:15:02.578055  1371 raft_consensus.cc:385] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.578510  1371 raft_consensus.cc:740] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.579273  1371 consensus_queue.cc:260] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:02.580675  1372 raft_consensus.cc:359] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.581295  1206 heartbeater.cc:499] Master 127.20.102.254:39127 was elected leader, sending a full tablet report...
I20260709 12:15:02.584137  1371 ts_tablet_manager.cc:1434] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:15:02.581598  1372 raft_consensus.cc:385] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.585062  1372 raft_consensus.cc:740] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.586014  1372 consensus_queue.cc:260] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.585242  1371 tablet_bootstrap.cc:492] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:02.587839  1370 tablet_bootstrap.cc:492] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:02.588380  1370 ts_tablet_manager.cc:1403] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.005s
I20260709 12:15:02.588737  1281 heartbeater.cc:499] Master 127.20.102.254:39127 was elected leader, sending a full tablet report...
I20260709 12:15:02.591552  1370 raft_consensus.cc:359] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.592342  1370 raft_consensus.cc:385] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.592624  1370 raft_consensus.cc:740] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.593768  1372 ts_tablet_manager.cc:1434] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:15:02.593425  1370 consensus_queue.cc:260] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.594975  1372 tablet_bootstrap.cc:492] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:02.596576  1370 ts_tablet_manager.cc:1434] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.005s
I20260709 12:15:02.597034  1355 heartbeater.cc:499] Master 127.20.102.254:39127 was elected leader, sending a full tablet report...
I20260709 12:15:02.597710  1370 tablet_bootstrap.cc:492] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:02.599308  1371 tablet_bootstrap.cc:654] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.602232  1372 tablet_bootstrap.cc:654] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.604328  1370 tablet_bootstrap.cc:654] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.676553  1371 tablet_bootstrap.cc:492] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:02.677258  1371 ts_tablet_manager.cc:1403] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.092s	user 0.039s	sys 0.039s
I20260709 12:15:02.677801  1372 tablet_bootstrap.cc:492] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:02.678325  1370 tablet_bootstrap.cc:492] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:02.678470  1372 ts_tablet_manager.cc:1403] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.084s	user 0.031s	sys 0.049s
I20260709 12:15:02.678870  1370 ts_tablet_manager.cc:1403] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.081s	user 0.026s	sys 0.053s
I20260709 12:15:02.680001  1371 raft_consensus.cc:359] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.680681  1371 raft_consensus.cc:385] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.681010  1371 raft_consensus.cc:740] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.681743  1372 raft_consensus.cc:359] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.681962  1370 raft_consensus.cc:359] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.682854  1372 raft_consensus.cc:385] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.683169  1370 raft_consensus.cc:385] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.683223  1372 raft_consensus.cc:740] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.683674  1370 raft_consensus.cc:740] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
W20260709 12:15:02.683890  1127 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:02.681772  1371 consensus_queue.cc:260] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.684427  1372 consensus_queue.cc:260] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.684638  1370 consensus_queue.cc:260] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.686782  1370 ts_tablet_manager.cc:1434] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:15:02.686782  1372 ts_tablet_manager.cc:1434] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:15:02.687053  1371 ts_tablet_manager.cc:1434] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:02.687969  1372 tablet_bootstrap.cc:492] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:02.687969  1370 tablet_bootstrap.cc:492] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:02.688225  1371 tablet_bootstrap.cc:492] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:02.695178  1370 tablet_bootstrap.cc:654] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.695178  1372 tablet_bootstrap.cc:654] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.696089  1371 tablet_bootstrap.cc:654] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.707978  1371 tablet_bootstrap.cc:492] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:02.708549  1370 tablet_bootstrap.cc:492] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:02.708545  1372 tablet_bootstrap.cc:492] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:02.709398  1370 ts_tablet_manager.cc:1403] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.009s
I20260709 12:15:02.709438  1372 ts_tablet_manager.cc:1403] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 12:15:02.712589  1370 raft_consensus.cc:359] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:02.708633  1371 ts_tablet_manager.cc:1403] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:15:02.713392  1370 raft_consensus.cc:385] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.712736  1372 raft_consensus.cc:359] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.713783  1370 raft_consensus.cc:740] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.713892  1372 raft_consensus.cc:385] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.714408  1372 raft_consensus.cc:740] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.714720  1370 consensus_queue.cc:260] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:02.715478  1372 consensus_queue.cc:260] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.717079  1370 ts_tablet_manager.cc:1434] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:15:02.718160  1370 tablet_bootstrap.cc:492] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:02.717970  1371 raft_consensus.cc:359] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.718868  1371 raft_consensus.cc:385] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.719201  1371 raft_consensus.cc:740] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.720183  1372 ts_tablet_manager.cc:1434] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:15:02.720011  1371 consensus_queue.cc:260] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.721372  1372 tablet_bootstrap.cc:492] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:02.722479  1371 ts_tablet_manager.cc:1434] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:15:02.723629  1371 tablet_bootstrap.cc:492] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:02.725082  1370 tablet_bootstrap.cc:654] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.727983  1372 tablet_bootstrap.cc:654] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.730762  1371 tablet_bootstrap.cc:654] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.737748  1370 tablet_bootstrap.cc:492] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:02.738647  1370 ts_tablet_manager.cc:1403] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 12:15:02.744684  1370 raft_consensus.cc:359] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.745464  1370 raft_consensus.cc:385] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.746259  1370 raft_consensus.cc:740] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.747184  1370 consensus_queue.cc:260] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.748251  1372 tablet_bootstrap.cc:492] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:02.748901  1372 ts_tablet_manager.cc:1403] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.008s
I20260709 12:15:02.749461  1370 ts_tablet_manager.cc:1434] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:15:02.750490  1370 tablet_bootstrap.cc:492] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:02.751935  1372 raft_consensus.cc:359] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.752813  1372 raft_consensus.cc:385] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.753114  1372 raft_consensus.cc:740] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.754029  1372 consensus_queue.cc:260] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.755327  1377 raft_consensus.cc:493] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.755813  1377 raft_consensus.cc:515] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.757589  1370 tablet_bootstrap.cc:654] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.769222  1377 leader_election.cc:290] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:02.781558  1378 raft_consensus.cc:493] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.782475  1378 raft_consensus.cc:515] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:02.784880  1372 ts_tablet_manager.cc:1434] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:15:02.786537  1372 tablet_bootstrap.cc:492] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:02.796988  1378 leader_election.cc:290] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923)
I20260709 12:15:02.808142  1378 raft_consensus.cc:493] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.808880  1378 raft_consensus.cc:515] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.809418  1371 tablet_bootstrap.cc:492] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:02.810253  1371 ts_tablet_manager.cc:1403] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.087s	user 0.044s	sys 0.039s
I20260709 12:15:02.811798  1378 leader_election.cc:290] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:02.814087  1371 raft_consensus.cc:359] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.815017  1371 raft_consensus.cc:385] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.815339  1371 raft_consensus.cc:740] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.816336  1371 consensus_queue.cc:260] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.822130  1371 ts_tablet_manager.cc:1434] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:15:02.823359  1371 tablet_bootstrap.cc:492] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:02.830756  1371 tablet_bootstrap.cc:654] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.846661  1378 raft_consensus.cc:493] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.847609  1378 raft_consensus.cc:515] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.850963  1378 leader_election.cc:290] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:02.863929  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:02.865164  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:02.865856  1254 raft_consensus.cc:2468] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 0.
I20260709 12:15:02.866328  1377 raft_consensus.cc:493] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.864543  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
W20260709 12:15:02.867377  1295 leader_election.cc:343] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:02.867935  1372 tablet_bootstrap.cc:654] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:02.868614  1370 tablet_bootstrap.cc:492] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:02.868933  1295 leader_election.cc:304] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:02.869236  1370 ts_tablet_manager.cc:1403] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.119s	user 0.046s	sys 0.061s
W20260709 12:15:02.869947  1295 leader_election.cc:343] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:02.870121  1371 tablet_bootstrap.cc:492] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:02.870596  1378 raft_consensus.cc:2804] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:02.870918  1371 ts_tablet_manager.cc:1403] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.048s	user 0.025s	sys 0.019s
I20260709 12:15:02.871064  1378 raft_consensus.cc:493] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.871800  1378 raft_consensus.cc:3060] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:02.866832  1377 raft_consensus.cc:515] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.876160  1371 raft_consensus.cc:359] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.877411  1371 raft_consensus.cc:385] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.877920  1371 raft_consensus.cc:740] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.877682  1370 raft_consensus.cc:359] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.878758  1370 raft_consensus.cc:385] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:02.879271  1370 raft_consensus.cc:740] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.879685  1371 consensus_queue.cc:260] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.880232  1370 consensus_queue.cc:260] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.881865  1377 leader_election.cc:290] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:02.889762  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:02.891323  1376 raft_consensus.cc:493] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.892194  1376 raft_consensus.cc:515] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.893421  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:02.895578  1377 raft_consensus.cc:493] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.896281  1377 raft_consensus.cc:515] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.899859  1377 leader_election.cc:290] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
W20260709 12:15:02.895059  1222 leader_election.cc:343] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:02.902954  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:02.904181  1329 raft_consensus.cc:2468] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 0.
I20260709 12:15:02.906345  1222 leader_election.cc:304] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:02.908033  1376 leader_election.cc:290] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:02.913033  1377 raft_consensus.cc:2804] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:02.913599  1377 raft_consensus.cc:493] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.914019  1377 raft_consensus.cc:3060] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:02.919226  1371 ts_tablet_manager.cc:1434] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 12:15:02.912199  1378 raft_consensus.cc:515] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.926064  1330 raft_consensus.cc:2393] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 567b3ab021414d40a11f2335766ef697 in current term 1: Already voted for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in this term.
I20260709 12:15:02.926901  1400 raft_consensus.cc:493] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.927513  1400 raft_consensus.cc:515] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.931455  1400 leader_election.cc:290] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:02.932889  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:02.942126  1255 raft_consensus.cc:2468] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 0.
I20260709 12:15:02.942520  1371 tablet_bootstrap.cc:492] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:02.943832  1181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:02.943948  1295 leader_election.cc:304] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:02.945003  1181 raft_consensus.cc:2468] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 0.
I20260709 12:15:02.945284  1400 raft_consensus.cc:2804] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:02.945748  1400 raft_consensus.cc:493] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.946091  1400 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:02.949929  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:02.950093  1181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:02.950680  1255 raft_consensus.cc:3060] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:02.952160  1378 leader_election.cc:290] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:02.955693  1400 raft_consensus.cc:515] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:02.958128  1400 leader_election.cc:290] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:02.959638  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:02.960609  1254 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:02.962222  1181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:02.967075  1376 raft_consensus.cc:493] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.967773  1220 leader_election.cc:304] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:02.967816  1376 raft_consensus.cc:515] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:02.973042  1376 leader_election.cc:290] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:02.980851  1255 raft_consensus.cc:2468] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
I20260709 12:15:02.985216  1181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:02.991704  1181 raft_consensus.cc:2468] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 0.
I20260709 12:15:02.985355  1180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:02.993250  1180 raft_consensus.cc:2468] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 0.
I20260709 12:15:02.986759  1179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:02.987874  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:02.989157  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:03.000432  1294 leader_election.cc:304] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 567b3ab021414d40a11f2335766ef697
I20260709 12:15:03.001730  1400 raft_consensus.cc:2804] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:03.002243  1400 raft_consensus.cc:493] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.990377  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:02.986047  1371 tablet_bootstrap.cc:654] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.005630  1295 leader_election.cc:304] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:03.002303  1294 leader_election.cc:304] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 567b3ab021414d40a11f2335766ef697
I20260709 12:15:02.997949  1254 raft_consensus.cc:2468] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
I20260709 12:15:02.998436  1178 raft_consensus.cc:2468] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 0.
I20260709 12:15:03.002817  1400 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.009807  1397 raft_consensus.cc:2804] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:03.002381  1377 raft_consensus.cc:515] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.011090  1378 raft_consensus.cc:2804] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:03.019120  1295 leader_election.cc:304] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
W20260709 12:15:03.019737  1294 leader_election.cc:343] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:03.019348  1402 raft_consensus.cc:2804] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:03.013089  1397 raft_consensus.cc:493] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.019960  1370 ts_tablet_manager.cc:1434] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.150s	user 0.031s	sys 0.062s
I20260709 12:15:03.024566  1400 raft_consensus.cc:515] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:03.022960  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
W20260709 12:15:03.018538  1220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39923, user_credentials={real_user=slave}} blocked reactor thread for 51059.4us
I20260709 12:15:03.023530  1377 leader_election.cc:290] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.026678  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
W20260709 12:15:03.029752  1220 leader_election.cc:343] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:03.030589  1370 tablet_bootstrap.cc:492] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:03.028479  1330 raft_consensus.cc:3060] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.031057  1220 leader_election.cc:304] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:03.024749  1372 tablet_bootstrap.cc:492] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:03.033529  1372 ts_tablet_manager.cc:1403] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.247s	user 0.039s	sys 0.079s
I20260709 12:15:03.025310  1397 raft_consensus.cc:3060] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.036917  1372 raft_consensus.cc:359] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:03.027026  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:03.037663  1372 raft_consensus.cc:385] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:03.037199  1146 leader_election.cc:343] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:03.038012  1372 raft_consensus.cc:740] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
W20260709 12:15:03.028990  1294 leader_election.cc:343] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:03.038928  1372 consensus_queue.cc:260] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:03.025238  1402 raft_consensus.cc:493] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.040126  1402 raft_consensus.cc:3060] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.041563  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:03.043154  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:03.043658  1372 ts_tablet_manager.cc:1434] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:15:03.044116  1328 raft_consensus.cc:2393] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in current term 1: Already voted for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in this term.
I20260709 12:15:03.044790  1372 tablet_bootstrap.cc:492] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:03.028863  1400 leader_election.cc:290] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923)
W20260709 12:15:03.045962  1147 leader_election.cc:343] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:03.046569  1147 leader_election.cc:304] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:03.048075  1376 raft_consensus.cc:2749] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:03.049718  1255 raft_consensus.cc:2468] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 0.
I20260709 12:15:03.053550  1372 tablet_bootstrap.cc:654] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.053611  1146 leader_election.cc:304] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:03.054304  1330 raft_consensus.cc:2468] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 1.
I20260709 12:15:03.055238  1376 raft_consensus.cc:2804] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:03.055724  1376 raft_consensus.cc:493] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.055850  1222 leader_election.cc:304] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:03.056180  1376 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.032725  1377 raft_consensus.cc:2749] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:03.060638  1371 tablet_bootstrap.cc:492] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:03.061319  1371 ts_tablet_manager.cc:1403] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.119s	user 0.014s	sys 0.010s
I20260709 12:15:03.061357  1377 raft_consensus.cc:2804] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:03.063042  1377 raft_consensus.cc:697] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:03.064625  1377 consensus_queue.cc:237] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.065662  1371 raft_consensus.cc:359] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.066521  1371 raft_consensus.cc:385] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.066825  1371 raft_consensus.cc:740] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.067651  1371 consensus_queue.cc:260] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.067651  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:03.045962  1400 raft_consensus.cc:2804] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:03.070078  1255 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.074615  1376 raft_consensus.cc:515] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:03.078142  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:03.078492  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:03.079748  1330 raft_consensus.cc:2393] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in current term 1: Already voted for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in this term.
I20260709 12:15:03.079985  1376 leader_election.cc:290] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.084358  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:03.086009  1178 raft_consensus.cc:2393] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in current term 1: Already voted for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in this term.
I20260709 12:15:03.087677  1147 leader_election.cc:304] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:03.079546  1400 raft_consensus.cc:697] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:03.089785  1376 raft_consensus.cc:2749] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:03.089833  1400 consensus_queue.cc:237] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.079365  1378 raft_consensus.cc:697] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:03.093384  1370 tablet_bootstrap.cc:654] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.098148  1378 consensus_queue.cc:237] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.098423  1402 raft_consensus.cc:515] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.099421  1397 raft_consensus.cc:515] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.107798  1371 ts_tablet_manager.cc:1434] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.046s	user 0.019s	sys 0.001s
I20260709 12:15:03.110790  1402 leader_election.cc:290] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.112147  1371 tablet_bootstrap.cc:492] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:03.112530  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
W20260709 12:15:03.114194  1222 leader_election.cc:343] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:03.118661  1397 leader_election.cc:290] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:03.121203  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
W20260709 12:15:03.123498  1220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:39923, user_credentials={real_user=slave}} blocked reactor thread for 93805.5us
I20260709 12:15:03.124965  1178 raft_consensus.cc:3060] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.125257  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:03.126972  1370 tablet_bootstrap.cc:492] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
W20260709 12:15:03.127019  1295 leader_election.cc:343] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:03.128129  1370 ts_tablet_manager.cc:1403] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.098s	user 0.008s	sys 0.012s
I20260709 12:15:03.132326  1255 raft_consensus.cc:2468] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
I20260709 12:15:03.133895  1295 leader_election.cc:304] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:03.135582  1370 raft_consensus.cc:359] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.136400  1370 raft_consensus.cc:385] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.134266  1371 tablet_bootstrap.cc:654] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.136693  1370 raft_consensus.cc:740] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
W20260709 12:15:03.138715  1220 leader_election.cc:343] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:03.139585  1370 consensus_queue.cc:260] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.141033  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:03.141917  1077 catalog_manager.cc:5697] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:03.143802  1370 ts_tablet_manager.cc:1434] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 12:15:03.138073  1400 raft_consensus.cc:2804] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:03.145696  1370 tablet_bootstrap.cc:492] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:03.146162  1400 raft_consensus.cc:697] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:03.147228  1400 consensus_queue.cc:237] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:03.151917  1372 tablet_bootstrap.cc:492] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:03.155148  1372 ts_tablet_manager.cc:1403] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.003s
W20260709 12:15:03.156942  1220 leader_election.cc:343] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:03.157457  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:03.158244  1176 raft_consensus.cc:3060] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.157997  1075 catalog_manager.cc:5697] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:03.162139  1178 raft_consensus.cc:2468] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
I20260709 12:15:03.163932  1294 leader_election.cc:304] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 567b3ab021414d40a11f2335766ef697
I20260709 12:15:03.166405  1370 tablet_bootstrap.cc:654] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.169040  1378 raft_consensus.cc:2804] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:03.170338  1378 raft_consensus.cc:697] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:03.176548  1372 raft_consensus.cc:359] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.171739  1378 consensus_queue.cc:237] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.178560  1372 raft_consensus.cc:385] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.179836  1372 raft_consensus.cc:740] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.191550  1176 raft_consensus.cc:2468] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 1.
I20260709 12:15:03.193604  1220 leader_election.cc:304] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:03.195137  1371 tablet_bootstrap.cc:492] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:03.195621  1412 raft_consensus.cc:2804] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:03.196012  1371 ts_tablet_manager.cc:1403] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.004s
I20260709 12:15:03.196573  1412 raft_consensus.cc:697] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:03.198160  1412 consensus_queue.cc:237] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.201190  1372 consensus_queue.cc:260] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.208984  1372 ts_tablet_manager.cc:1434] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 12:15:03.215512  1372 tablet_bootstrap.cc:492] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:03.211472  1371 raft_consensus.cc:359] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.217183  1371 raft_consensus.cc:385] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.217561  1371 raft_consensus.cc:740] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.218591  1371 consensus_queue.cc:260] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.219288  1370 tablet_bootstrap.cc:492] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:03.220372  1370 ts_tablet_manager.cc:1403] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.028s
I20260709 12:15:03.225112  1370 raft_consensus.cc:359] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.226008  1372 tablet_bootstrap.cc:654] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.225930  1371 ts_tablet_manager.cc:1434] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.004s
I20260709 12:15:03.226502  1370 raft_consensus.cc:385] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.227093  1370 raft_consensus.cc:740] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.227537  1371 tablet_bootstrap.cc:492] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:03.228470  1370 consensus_queue.cc:260] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.231031  1370 ts_tablet_manager.cc:1434] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:15:03.232156  1370 tablet_bootstrap.cc:492] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:03.240679  1370 tablet_bootstrap.cc:654] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.242558  1371 tablet_bootstrap.cc:654] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.248260  1079 catalog_manager.cc:5697] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:03.252230  1372 tablet_bootstrap.cc:492] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:03.256758  1372 ts_tablet_manager.cc:1403] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.000s
I20260709 12:15:03.261632  1372 raft_consensus.cc:359] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.262964  1372 raft_consensus.cc:385] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.263425  1372 raft_consensus.cc:740] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.264736  1372 consensus_queue.cc:260] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.268980  1372 ts_tablet_manager.cc:1434] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:15:03.270548  1372 tablet_bootstrap.cc:492] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:03.275619  1371 tablet_bootstrap.cc:492] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:03.275738  1370 tablet_bootstrap.cc:492] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:03.276559  1371 ts_tablet_manager.cc:1403] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.022s
I20260709 12:15:03.276718  1370 ts_tablet_manager.cc:1403] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.045s	user 0.030s	sys 0.011s
I20260709 12:15:03.279634  1371 raft_consensus.cc:359] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.280385  1371 raft_consensus.cc:385] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.280100  1370 raft_consensus.cc:359] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.280714  1371 raft_consensus.cc:740] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.281001  1372 tablet_bootstrap.cc:654] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.280967  1370 raft_consensus.cc:385] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.281571  1370 raft_consensus.cc:740] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.281659  1371 consensus_queue.cc:260] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.282618  1370 consensus_queue.cc:260] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.285235  1370 ts_tablet_manager.cc:1434] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:03.286397  1370 tablet_bootstrap.cc:492] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:03.287175  1371 ts_tablet_manager.cc:1434] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:15:03.288285  1371 tablet_bootstrap.cc:492] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:03.287226  1075 catalog_manager.cc:5697] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:03.289377  1075 catalog_manager.cc:5697] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:03.291416  1075 catalog_manager.cc:5697] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:03.293109  1370 tablet_bootstrap.cc:654] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.298059  1371 tablet_bootstrap.cc:654] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.303481  1372 tablet_bootstrap.cc:492] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:03.304216  1372 ts_tablet_manager.cc:1403] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.011s
I20260709 12:15:03.305783  1370 tablet_bootstrap.cc:492] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:03.306380  1370 ts_tablet_manager.cc:1403] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:15:03.309185  1372 raft_consensus.cc:359] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.309590  1370 raft_consensus.cc:359] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.310098  1372 raft_consensus.cc:385] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.310266  1370 raft_consensus.cc:385] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.310529  1371 tablet_bootstrap.cc:492] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:03.310554  1372 raft_consensus.cc:740] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.310564  1370 raft_consensus.cc:740] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.311384  1371 ts_tablet_manager.cc:1403] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 12:15:03.312196  1370 consensus_queue.cc:260] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.312196  1372 consensus_queue.cc:260] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.314687  1370 ts_tablet_manager.cc:1434] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:03.314435  1371 raft_consensus.cc:359] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.315251  1371 raft_consensus.cc:385] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.315528  1371 raft_consensus.cc:740] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.316323  1371 consensus_queue.cc:260] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.318377  1371 ts_tablet_manager.cc:1434] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:03.320987  1372 ts_tablet_manager.cc:1434] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:15:03.321594  1407 raft_consensus.cc:493] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.322400  1372 tablet_bootstrap.cc:492] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:03.322172  1407 raft_consensus.cc:515] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.325380  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:03.325814  1407 leader_election.cc:290] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.326027  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:03.326267  1255 raft_consensus.cc:2393] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in current term 1: Already voted for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in this term.
I20260709 12:15:03.328019  1147 leader_election.cc:304] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:03.328962  1407 raft_consensus.cc:3060] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.332267  1372 tablet_bootstrap.cc:654] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.338112  1372 tablet_bootstrap.cc:492] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:03.338676  1372 ts_tablet_manager.cc:1403] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.001s
I20260709 12:15:03.339087  1407 raft_consensus.cc:2749] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:03.340518  1407 raft_consensus.cc:493] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.340983  1407 raft_consensus.cc:515] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.341704  1372 raft_consensus.cc:359] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.342429  1372 raft_consensus.cc:385] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.342710  1372 raft_consensus.cc:740] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.343750  1407 leader_election.cc:290] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.344252  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:03.344372  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:03.343431  1372 consensus_queue.cc:260] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.345327  1330 raft_consensus.cc:2393] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in current term 1: Already voted for candidate 567b3ab021414d40a11f2335766ef697 in this term.
I20260709 12:15:03.346804  1372 ts_tablet_manager.cc:1434] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:15:03.347594  1147 leader_election.cc:304] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:03.348537  1407 raft_consensus.cc:3060] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.351135  1376 raft_consensus.cc:493] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.351728  1376 raft_consensus.cc:515] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.354104  1376 leader_election.cc:290] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.355662  1407 raft_consensus.cc:2749] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:03.354580  1376 raft_consensus.cc:493] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.357780  1376 raft_consensus.cc:515] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.358466  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:03.359539  1255 raft_consensus.cc:2468] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 0.
I20260709 12:15:03.360368  1376 leader_election.cc:290] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.361166  1146 leader_election.cc:304] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:03.362327  1429 raft_consensus.cc:2804] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:03.362720  1429 raft_consensus.cc:493] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.363255  1429 raft_consensus.cc:3060] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.362756  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:03.362859  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:03.363391  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:03.364280  1330 raft_consensus.cc:2468] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 0.
I20260709 12:15:03.364616  1328 raft_consensus.cc:2468] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 0.
I20260709 12:15:03.364183  1255 raft_consensus.cc:2468] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 0.
I20260709 12:15:03.366478  1146 leader_election.cc:304] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:03.367771  1376 raft_consensus.cc:2804] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:03.368175  1376 raft_consensus.cc:493] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.368496  1376 raft_consensus.cc:3060] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.370298  1429 raft_consensus.cc:515] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.372301  1429 leader_election.cc:290] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.373456  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:03.374069  1255 raft_consensus.cc:3060] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.374207  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:03.374886  1330 raft_consensus.cc:3060] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.375376  1376 raft_consensus.cc:515] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.378520  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:03.379133  1254 raft_consensus.cc:3060] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.380155  1255 raft_consensus.cc:2468] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 1.
I20260709 12:15:03.381265  1146 leader_election.cc:304] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:03.381944  1429 raft_consensus.cc:2804] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:03.382375  1429 raft_consensus.cc:697] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:03.383075  1330 raft_consensus.cc:2468] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 1.
I20260709 12:15:03.383471  1400 raft_consensus.cc:493] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.383272  1429 consensus_queue.cc:237] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.384256  1400 raft_consensus.cc:515] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.386427  1400 leader_election.cc:290] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:03.386724  1254 raft_consensus.cc:2468] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 1.
I20260709 12:15:03.387391  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:03.387972  1376 leader_election.cc:290] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.388159  1176 raft_consensus.cc:2468] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 0.
I20260709 12:15:03.388230  1146 leader_election.cc:304] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:03.389601  1376 raft_consensus.cc:2804] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:03.389791  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:03.390179  1376 raft_consensus.cc:697] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:03.390540  1254 raft_consensus.cc:2468] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 0.
I20260709 12:15:03.391225  1376 consensus_queue.cc:237] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.392011  1295 leader_election.cc:304] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:03.393318  1400 raft_consensus.cc:2804] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:03.393344  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:03.394207  1400 raft_consensus.cc:493] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.394505  1330 raft_consensus.cc:3060] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.394659  1400 raft_consensus.cc:3060] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.396014  1075 catalog_manager.cc:5697] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 0 to 1, leader changed from <none> to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 1 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:03.402406  1400 raft_consensus.cc:515] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.405689  1400 leader_election.cc:290] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:03.405743  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:03.406498  1176 raft_consensus.cc:3060] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.411885  1075 catalog_manager.cc:5697] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 0 to 1, leader changed from <none> to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 1 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:03.413239  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:03.413483  1330 raft_consensus.cc:2468] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 1.
I20260709 12:15:03.413968  1254 raft_consensus.cc:3060] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.414664  1176 raft_consensus.cc:2468] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
I20260709 12:15:03.415928  1294 leader_election.cc:304] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:03.416824  1400 raft_consensus.cc:2804] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:03.417397  1400 raft_consensus.cc:697] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:03.418213  1400 consensus_queue.cc:237] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.421186  1254 raft_consensus.cc:2468] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
I20260709 12:15:03.430691  1075 catalog_manager.cc:5697] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:03.474313  1176 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.482533  1400 consensus_queue.cc:1048] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:03.496836  1412 raft_consensus.cc:493] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.497545  1412 raft_consensus.cc:515] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.496897  1400 consensus_queue.cc:1048] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:03.501554  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:03.502460  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:03.503376  1176 raft_consensus.cc:2393] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 567b3ab021414d40a11f2335766ef697 in current term 1: Already voted for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in this term.
I20260709 12:15:03.504281  1412 leader_election.cc:290] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.504496  1220 leader_election.cc:304] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:03.505877  1412 raft_consensus.cc:3060] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.514066  1412 raft_consensus.cc:2749] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:03.532083  1400 consensus_queue.cc:1048] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:03.544512  1378 consensus_queue.cc:1048] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:03.564229  1378 consensus_queue.cc:1048] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:03.579308  1397 consensus_queue.cc:1048] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:03.596081  1397 consensus_queue.cc:1048] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:03.608659  1400 consensus_queue.cc:1048] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:03.612839  1412 consensus_queue.cc:1048] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:03.622025  1412 consensus_queue.cc:1048] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:03.632257  1412 consensus_queue.cc:1048] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:03.636255  1330 raft_consensus.cc:3060] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.651450  1445 consensus_queue.cc:1048] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:03.715080  1330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
mode: GRACEFUL
new_leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:15:03.715819  1330 raft_consensus.cc:606] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Received request to transfer leadership to TS f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:03.722224  1330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
mode: GRACEFUL
new_leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:15:03.722934  1330 raft_consensus.cc:606] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Received request to transfer leadership to TS f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:03.738337  1254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
mode: GRACEFUL
new_leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:57072
I20260709 12:15:03.739030  1254 raft_consensus.cc:606] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Received request to transfer leadership to TS f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:03.745201  1330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
mode: GRACEFUL
new_leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:15:03.745836  1330 raft_consensus.cc:606] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Received request to transfer leadership to TS f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:03.761233  1177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
mode: GRACEFUL
new_leader_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:59868
I20260709 12:15:03.761844  1177 raft_consensus.cc:606] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Received request to transfer leadership to TS 567b3ab021414d40a11f2335766ef697
I20260709 12:15:03.767935  1177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
mode: GRACEFUL
new_leader_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:59868
I20260709 12:15:03.768488  1177 raft_consensus.cc:606] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Received request to transfer leadership to TS 567b3ab021414d40a11f2335766ef697
I20260709 12:15:03.775297  1330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6436eba65441457b99ce713e85078a61"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
mode: GRACEFUL
new_leader_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:15:03.775876  1330 raft_consensus.cc:606] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Received request to transfer leadership to TS 567b3ab021414d40a11f2335766ef697
I20260709 12:15:03.776827  1429 consensus_queue.cc:1048] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:03.782243  1330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
mode: GRACEFUL
new_leader_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:15:03.782797  1330 raft_consensus.cc:606] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Received request to transfer leadership to TS 567b3ab021414d40a11f2335766ef697
I20260709 12:15:03.785061  1376 raft_consensus.cc:993] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b: : Instructing follower 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:03.785552  1376 raft_consensus.cc:1081] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Signalling peer 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:03.790388  1254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:57066
I20260709 12:15:03.798020  1254 raft_consensus.cc:493] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:03.798517  1254 raft_consensus.cc:3060] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.799947  1255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
mode: GRACEFUL
new_leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:57072
I20260709 12:15:03.800639  1255 raft_consensus.cc:606] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Received request to transfer leadership to TS 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:03.802043  1454 consensus_queue.cc:1048] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:03.806711  1254 raft_consensus.cc:515] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.807562  1454 consensus_queue.cc:1048] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:03.813025  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:03.813061  1254 leader_election.cc:290] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.813025  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:03.815598  1177 raft_consensus.cc:3055] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:03.815976  1177 raft_consensus.cc:740] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:03.817152  1177 consensus_queue.cc:260] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.819331  1177 raft_consensus.cc:3060] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.826894  1429 consensus_queue.cc:1048] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:03.828557  1177 raft_consensus.cc:2468] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:03.829728  1220 leader_election.cc:304] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:03.831053  1445 raft_consensus.cc:2804] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:03.831594  1445 raft_consensus.cc:697] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:03.833175  1445 consensus_queue.cc:237] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.837461  1407 raft_consensus.cc:993] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b: : Instructing follower 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:03.838020  1407 raft_consensus.cc:1081] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Signalling peer 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:03.839782  1255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:57066
I20260709 12:15:03.840420  1255 raft_consensus.cc:493] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:03.840847  1255 raft_consensus.cc:3060] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.847494  1255 raft_consensus.cc:515] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.849488  1255 leader_election.cc:290] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.850688  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:03.850917  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:03.851442  1330 raft_consensus.cc:3060] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.851852  1177 raft_consensus.cc:3055] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:03.852273  1177 raft_consensus.cc:740] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:03.853379  1177 consensus_queue.cc:260] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.854933  1177 raft_consensus.cc:3060] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.855006  1075 catalog_manager.cc:5697] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 1 to 2, leader changed from f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193) to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:03.857610  1330 raft_consensus.cc:2468] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:03.858954  1222 leader_election.cc:304] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:03.860025  1445 raft_consensus.cc:2804] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:03.860551  1445 raft_consensus.cc:697] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:03.861522  1445 consensus_queue.cc:237] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.863802  1177 raft_consensus.cc:2468] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:03.870316  1075 catalog_manager.cc:5697] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 1 to 2, leader changed from f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193) to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:03.944585  1378 raft_consensus.cc:993] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9: : Instructing follower 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:03.945196  1400 raft_consensus.cc:1081] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Signalling peer 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:03.946866  1255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:57054
I20260709 12:15:03.947371  1255 raft_consensus.cc:493] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:03.947700  1255 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.953054  1255 raft_consensus.cc:515] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.954732  1255 leader_election.cc:290] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:03.955802  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:03.956414  1177 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.956211  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:03.957041  1330 raft_consensus.cc:3055] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:03.957373  1330 raft_consensus.cc:740] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:03.958340  1330 consensus_queue.cc:260] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.959599  1330 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.961982  1177 raft_consensus.cc:2468] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:03.963476  1220 leader_election.cc:304] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:03.964498  1445 raft_consensus.cc:2804] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:03.965106  1445 raft_consensus.cc:697] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:03.965873  1445 consensus_queue.cc:237] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:03.966988  1330 raft_consensus.cc:2468] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:03.972723  1075 catalog_manager.cc:5697] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 1 to 2, leader changed from 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195) to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:04.014292  1400 consensus_queue.cc:1048] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:04.022608  1404 raft_consensus.cc:993] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9: : Instructing follower 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:04.023197  1404 raft_consensus.cc:1081] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Signalling peer 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:04.025781  1254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6436eba65441457b99ce713e85078a61"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:57054
I20260709 12:15:04.026473  1254 raft_consensus.cc:493] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:04.026928  1254 raft_consensus.cc:3060] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.029855  1397 consensus_queue.cc:1048] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:04.029922  1404 raft_consensus.cc:993] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: : Instructing follower f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:04.033097  1397 raft_consensus.cc:1081] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Signalling peer f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:04.034976  1178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:59854
I20260709 12:15:04.035597  1178 raft_consensus.cc:493] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:04.036026  1178 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.037150  1254 raft_consensus.cc:515] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.045469  1178 raft_consensus.cc:515] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:04.045969  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:04.046769  1330 raft_consensus.cc:3055] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:04.047145  1330 raft_consensus.cc:740] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:04.045537  1254 leader_election.cc:290] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:04.049309  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:04.048805  1178 leader_election.cc:290] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:04.049561  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:04.048211  1330 consensus_queue.cc:260] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.050076  1255 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.050920  1330 raft_consensus.cc:3060] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.050450  1177 raft_consensus.cc:3060] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.051330  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:04.052525  1328 raft_consensus.cc:3055] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:04.052973  1328 raft_consensus.cc:740] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:04.053965  1328 consensus_queue.cc:260] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:04.055538  1328 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.059532  1177 raft_consensus.cc:2468] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:04.059402  1330 raft_consensus.cc:2468] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:04.061444  1220 leader_election.cc:304] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:04.062604  1445 raft_consensus.cc:2804] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:04.063194  1445 raft_consensus.cc:697] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:04.064150  1255 raft_consensus.cc:2468] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:04.064180  1445 consensus_queue.cc:237] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.066697  1146 leader_election.cc:304] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:04.067764  1404 raft_consensus.cc:993] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9: : Instructing follower f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:04.067786  1429 raft_consensus.cc:2804] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:04.068384  1404 raft_consensus.cc:1081] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Signalling peer f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:04.068548  1429 raft_consensus.cc:697] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:04.069641  1429 consensus_queue.cc:237] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:04.070783  1328 raft_consensus.cc:2468] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:04.072489  1177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:59854
I20260709 12:15:04.073176  1177 raft_consensus.cc:493] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:04.073619  1177 raft_consensus.cc:3060] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.078215  1075 catalog_manager.cc:5697] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 1 to 2, leader changed from 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195) to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:04.079639  1078 catalog_manager.cc:5697] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 1 to 2, leader changed from 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195) to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 2 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:04.080742  1177 raft_consensus.cc:515] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.082998  1177 leader_election.cc:290] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:04.084004  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:04.084270  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:04.084642  1255 raft_consensus.cc:3060] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.085127  1328 raft_consensus.cc:3055] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:04.085518  1328 raft_consensus.cc:740] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:04.086477  1328 consensus_queue.cc:260] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.088014  1328 raft_consensus.cc:3060] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.093640  1255 raft_consensus.cc:2468] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:04.095278  1146 leader_election.cc:304] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:04.096253  1429 raft_consensus.cc:2804] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:04.096729  1429 raft_consensus.cc:697] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:04.097549  1429 consensus_queue.cc:237] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.098024  1328 raft_consensus.cc:2468] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:04.102428  1412 raft_consensus.cc:993] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697: : Instructing follower f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:04.103032  1445 raft_consensus.cc:1081] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Signalling peer f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:04.105062  1177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:59848
I20260709 12:15:04.105679  1177 raft_consensus.cc:493] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:04.106015  1177 raft_consensus.cc:3060] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.106606  1075 catalog_manager.cc:5697] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 1 to 2, leader changed from 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195) to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 2 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:04.111199  1177 raft_consensus.cc:515] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.113461  1177 leader_election.cc:290] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:04.115362  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:04.116211  1328 raft_consensus.cc:3060] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.117558  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:04.118177  1255 raft_consensus.cc:3055] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:04.118507  1255 raft_consensus.cc:740] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:04.119300  1255 consensus_queue.cc:260] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.120541  1255 raft_consensus.cc:3060] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.122833  1397 raft_consensus.cc:993] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: : Instructing follower f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:04.123356  1397 raft_consensus.cc:1081] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Signalling peer f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:04.126895  1328 raft_consensus.cc:2468] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:04.127930  1177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:59854
I20260709 12:15:04.128566  1177 raft_consensus.cc:493] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:04.128969  1177 raft_consensus.cc:3060] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.129307  1255 raft_consensus.cc:2468] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:04.130139  1147 leader_election.cc:304] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:04.131238  1429 raft_consensus.cc:2804] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:04.131824  1429 raft_consensus.cc:697] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:04.132838  1429 consensus_queue.cc:237] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.136447  1177 raft_consensus.cc:515] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.138971  1177 leader_election.cc:290] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:04.139611  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:04.140403  1328 raft_consensus.cc:3055] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:04.139503  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:04.140916  1328 raft_consensus.cc:740] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:04.141301  1255 raft_consensus.cc:3060] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.141920  1328 consensus_queue.cc:260] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.143535  1328 raft_consensus.cc:3060] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.142921  1078 catalog_manager.cc:5697] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 1 to 2, leader changed from 567b3ab021414d40a11f2335766ef697 (127.20.102.194) to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 2 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:04.152443  1255 raft_consensus.cc:2468] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:04.152474  1328 raft_consensus.cc:2468] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:04.154335  1377 raft_consensus.cc:993] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697: : Instructing follower 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:04.154994  1377 raft_consensus.cc:1081] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Signalling peer 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:04.154286  1146 leader_election.cc:304] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:04.156669  1429 raft_consensus.cc:2804] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:04.157199  1429 raft_consensus.cc:697] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:04.157333  1328 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:60352
I20260709 12:15:04.158223  1328 raft_consensus.cc:493] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:04.158082  1429 consensus_queue.cc:237] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.158694  1328 raft_consensus.cc:3060] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.166409  1328 raft_consensus.cc:515] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.167689  1078 catalog_manager.cc:5697] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 1 to 2, leader changed from 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195) to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 2 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:04.169709  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:04.170435  1177 raft_consensus.cc:3060] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.170816  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:04.171650  1255 raft_consensus.cc:3055] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:04.172051  1255 raft_consensus.cc:740] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:04.170413  1328 leader_election.cc:290] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:04.174232  1255 consensus_queue.cc:260] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.176191  1255 raft_consensus.cc:3060] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.179339  1177 raft_consensus.cc:2468] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:04.180554  1294 leader_election.cc:304] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:04.181438  1400 raft_consensus.cc:2804] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:04.181996  1400 raft_consensus.cc:697] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:04.182888  1400 consensus_queue.cc:237] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:04.184149  1255 raft_consensus.cc:2468] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:04.190737  1078 catalog_manager.cc:5697] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 1 to 2, leader changed from 567b3ab021414d40a11f2335766ef697 (127.20.102.194) to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:04.301630  1177 raft_consensus.cc:1275] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.303498  1445 consensus_queue.cc:1048] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.305215  1177 raft_consensus.cc:1275] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.306986  1445 consensus_queue.cc:1048] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:04.313885  1328 raft_consensus.cc:1275] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.315856  1445 consensus_queue.cc:1048] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:04.323115  1330 raft_consensus.cc:3060] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:04.331919  1330 raft_consensus.cc:1275] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.333863  1377 consensus_queue.cc:1048] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.349874  1330 raft_consensus.cc:1275] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.351501  1377 consensus_queue.cc:1048] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.360671  1178 raft_consensus.cc:1275] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.362263  1445 consensus_queue.cc:1048] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.467265  1330 raft_consensus.cc:1275] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.469017  1445 consensus_queue.cc:1048] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.478834  1178 raft_consensus.cc:1275] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.480666  1377 consensus_queue.cc:1048] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.506973  1330 raft_consensus.cc:1275] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.508400  1429 consensus_queue.cc:1048] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.517535  1255 raft_consensus.cc:1275] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.519305  1462 consensus_queue.cc:1048] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.537922  1330 raft_consensus.cc:1275] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.539356  1462 consensus_queue.cc:1048] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.546048  1255 raft_consensus.cc:1275] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.549176  1462 consensus_queue.cc:1048] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:04.549868  1255 raft_consensus.cc:1275] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.551889  1462 consensus_queue.cc:1048] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.561592  1330 raft_consensus.cc:1275] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.563185  1462 consensus_queue.cc:1048] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.657498  1255 raft_consensus.cc:1275] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.659257  1178 raft_consensus.cc:1275] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.659593  1462 consensus_queue.cc:1048] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:04.660988  1255 raft_consensus.cc:1275] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.661154  1400 consensus_queue.cc:1048] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.662818  1400 consensus_queue.cc:1048] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.693089  1330 raft_consensus.cc:1275] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.700660  1454 consensus_queue.cc:1048] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:06.835600  1078 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52558:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:06.838167  1078 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:06.897331  1169 tablet_service.cc:1511] Processing CreateTablet for tablet a78228434e6a4e5ba34c365405f52ae9 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:06.898242  1241 tablet_service.cc:1511] Processing CreateTablet for tablet a78228434e6a4e5ba34c365405f52ae9 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:06.898849  1169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78228434e6a4e5ba34c365405f52ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.899655  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78228434e6a4e5ba34c365405f52ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.900633  1168 tablet_service.cc:1511] Processing CreateTablet for tablet f558375c464040b1ab3d898565a2190e (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:06.901957  1168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f558375c464040b1ab3d898565a2190e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.905891  1320 tablet_service.cc:1511] Processing CreateTablet for tablet a78228434e6a4e5ba34c365405f52ae9 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:06.907366  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78228434e6a4e5ba34c365405f52ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.911114  1245 tablet_service.cc:1511] Processing CreateTablet for tablet f558375c464040b1ab3d898565a2190e (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:06.912576  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f558375c464040b1ab3d898565a2190e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.912688  1314 tablet_service.cc:1511] Processing CreateTablet for tablet f558375c464040b1ab3d898565a2190e (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:06.913975  1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f558375c464040b1ab3d898565a2190e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.930246  1166 tablet_service.cc:1511] Processing CreateTablet for tablet 7c7b632cf7f349bd8aa202f48c793a5b (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:06.931962  1166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c7b632cf7f349bd8aa202f48c793a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.932475  1240 tablet_service.cc:1511] Processing CreateTablet for tablet 7c7b632cf7f349bd8aa202f48c793a5b (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:06.933928  1240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c7b632cf7f349bd8aa202f48c793a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.935015  1163 tablet_service.cc:1511] Processing CreateTablet for tablet a896862e9a0b44ff8d3fa4b2bb964963 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:06.936385  1163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a896862e9a0b44ff8d3fa4b2bb964963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.944651  1480 tablet_bootstrap.cc:492] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:06.946895  1319 tablet_service.cc:1511] Processing CreateTablet for tablet 7c7b632cf7f349bd8aa202f48c793a5b (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:06.948424  1319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c7b632cf7f349bd8aa202f48c793a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.957985  1241 tablet_service.cc:1511] Processing CreateTablet for tablet a896862e9a0b44ff8d3fa4b2bb964963 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:06.959808  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a896862e9a0b44ff8d3fa4b2bb964963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.962204  1164 tablet_service.cc:1511] Processing CreateTablet for tablet 979d2968adb84948a04dddbfd06254ac (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:06.962509  1318 tablet_service.cc:1511] Processing CreateTablet for tablet a896862e9a0b44ff8d3fa4b2bb964963 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:06.966540  1242 tablet_service.cc:1511] Processing CreateTablet for tablet 979d2968adb84948a04dddbfd06254ac (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:06.966957  1318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a896862e9a0b44ff8d3fa4b2bb964963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.968443  1480 tablet_bootstrap.cc:654] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:06.966898  1164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979d2968adb84948a04dddbfd06254ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.982092  1314 tablet_service.cc:1511] Processing CreateTablet for tablet 979d2968adb84948a04dddbfd06254ac (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:06.983186  1480 tablet_bootstrap.cc:492] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:06.983918  1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979d2968adb84948a04dddbfd06254ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.985375  1242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979d2968adb84948a04dddbfd06254ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:06.985167  1480 ts_tablet_manager.cc:1403] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.009s
I20260709 12:15:06.989009  1480 raft_consensus.cc:359] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:06.993558  1168 tablet_service.cc:1511] Processing CreateTablet for tablet f77ba639d67a401fba2e19f66e001490 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:06.995505  1168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77ba639d67a401fba2e19f66e001490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.001019  1246 tablet_service.cc:1511] Processing CreateTablet for tablet f77ba639d67a401fba2e19f66e001490 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:07.002677  1246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77ba639d67a401fba2e19f66e001490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.008754  1320 tablet_service.cc:1511] Processing CreateTablet for tablet f77ba639d67a401fba2e19f66e001490 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:07.010604  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77ba639d67a401fba2e19f66e001490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.010758  1171 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5b3b1001ed4e6fba7805e7fcdfdf87 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:06.993599  1480 raft_consensus.cc:385] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.013827  1171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5b3b1001ed4e6fba7805e7fcdfdf87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.014886  1481 tablet_bootstrap.cc:492] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:07.020978  1480 raft_consensus.cc:740] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.022058  1480 consensus_queue.cc:260] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.023983  1245 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5b3b1001ed4e6fba7805e7fcdfdf87 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:07.024485  1480 ts_tablet_manager.cc:1434] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.038s	user 0.001s	sys 0.004s
I20260709 12:15:07.025429  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5b3b1001ed4e6fba7805e7fcdfdf87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.025815  1480 tablet_bootstrap.cc:492] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:07.038808  1315 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5b3b1001ed4e6fba7805e7fcdfdf87 (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:07.040426  1315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5b3b1001ed4e6fba7805e7fcdfdf87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.041280  1480 tablet_bootstrap.cc:654] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.044039  1167 tablet_service.cc:1511] Processing CreateTablet for tablet f1979d71c86a46f99fed559c0860552a (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:07.046731  1167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1979d71c86a46f99fed559c0860552a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.045084  1238 tablet_service.cc:1511] Processing CreateTablet for tablet f1979d71c86a46f99fed559c0860552a (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:07.049760  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1979d71c86a46f99fed559c0860552a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.060248  1316 tablet_service.cc:1511] Processing CreateTablet for tablet f1979d71c86a46f99fed559c0860552a (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:07.061846  1316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1979d71c86a46f99fed559c0860552a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.067073  1481 tablet_bootstrap.cc:654] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.077296  1164 tablet_service.cc:1511] Processing CreateTablet for tablet b425916a27b1431d89f493bea6c130fa (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:07.078755  1164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b425916a27b1431d89f493bea6c130fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.095568  1482 tablet_bootstrap.cc:492] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:07.096869  1242 tablet_service.cc:1511] Processing CreateTablet for tablet b425916a27b1431d89f493bea6c130fa (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:07.098242  1242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b425916a27b1431d89f493bea6c130fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.107741  1320 tablet_service.cc:1511] Processing CreateTablet for tablet b425916a27b1431d89f493bea6c130fa (DEFAULT_TABLE table=soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:07.116348  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b425916a27b1431d89f493bea6c130fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:07.118723  1400 raft_consensus.cc:493] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.119571  1400 raft_consensus.cc:515] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.123108  1481 tablet_bootstrap.cc:492] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:07.123706  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:07.126255  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:07.126715  1482 tablet_bootstrap.cc:654] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:07.126953  1294 leader_election.cc:343] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:07.127902  1481 ts_tablet_manager.cc:1403] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.016s
W20260709 12:15:07.128216  1295 leader_election.cc:343] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:07.131471  1295 leader_election.cc:304] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:07.129058  1400 leader_election.cc:290] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:07.132800  1400 raft_consensus.cc:2749] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:07.147176  1481 raft_consensus.cc:359] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.148433  1481 raft_consensus.cc:385] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.148969  1481 raft_consensus.cc:740] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.149050  1480 tablet_bootstrap.cc:492] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:07.150578  1480 ts_tablet_manager.cc:1403] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.125s	user 0.012s	sys 0.006s
I20260709 12:15:07.154521  1480 raft_consensus.cc:359] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.155032  1482 tablet_bootstrap.cc:492] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:07.155320  1480 raft_consensus.cc:385] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.155627  1482 ts_tablet_manager.cc:1403] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.060s	user 0.000s	sys 0.023s
I20260709 12:15:07.158368  1481 consensus_queue.cc:260] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.159111  1482 raft_consensus.cc:359] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.160192  1482 raft_consensus.cc:385] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.160586  1482 raft_consensus.cc:740] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.155617  1480 raft_consensus.cc:740] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.161844  1482 consensus_queue.cc:260] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.162019  1480 consensus_queue.cc:260] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.165051  1480 ts_tablet_manager.cc:1434] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 12:15:07.166016  1480 tablet_bootstrap.cc:492] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:07.160894  1481 ts_tablet_manager.cc:1434] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.005s
I20260709 12:15:07.173041  1482 ts_tablet_manager.cc:1434] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:15:07.174590  1482 tablet_bootstrap.cc:492] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:07.180569  1481 tablet_bootstrap.cc:492] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:07.182101  1489 raft_consensus.cc:493] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.182986  1482 tablet_bootstrap.cc:654] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.187129  1489 raft_consensus.cc:515] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.189291  1481 tablet_bootstrap.cc:654] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.191421  1489 leader_election.cc:290] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.191480  1482 tablet_bootstrap.cc:492] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:07.193883  1480 tablet_bootstrap.cc:654] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.194404  1482 ts_tablet_manager.cc:1403] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 12:15:07.197916  1469 raft_consensus.cc:493] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.198468  1469 raft_consensus.cc:515] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.198657  1482 raft_consensus.cc:359] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.199602  1482 raft_consensus.cc:385] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.199983  1482 raft_consensus.cc:740] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.200901  1482 consensus_queue.cc:260] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.202667  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
W20260709 12:15:07.204944  1146 leader_election.cc:343] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:07.207756  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:07.208622  1328 raft_consensus.cc:2468] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 0.
I20260709 12:15:07.217221  1147 leader_election.cc:304] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 567b3ab021414d40a11f2335766ef697
I20260709 12:15:07.219000  1469 leader_election.cc:290] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.220175  1469 raft_consensus.cc:2804] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:07.220700  1469 raft_consensus.cc:493] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.221212  1469 raft_consensus.cc:3060] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.235980  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
W20260709 12:15:07.236086  1220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39923, user_credentials={real_user=slave}} blocked reactor thread for 77401.9us
I20260709 12:15:07.237262  1328 raft_consensus.cc:2468] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 0.
I20260709 12:15:07.238993  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:07.240166  1178 raft_consensus.cc:2468] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 0.
I20260709 12:15:07.240039  1222 leader_election.cc:304] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:07.244807  1412 raft_consensus.cc:2804] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:07.245329  1412 raft_consensus.cc:493] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.245725  1412 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.265671  1412 raft_consensus.cc:515] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.270641  1412 leader_election.cc:290] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.273200  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:07.273847  1328 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.274624  1481 tablet_bootstrap.cc:492] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:07.275040  1480 tablet_bootstrap.cc:492] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:07.275211  1481 ts_tablet_manager.cc:1403] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.095s	user 0.036s	sys 0.018s
I20260709 12:15:07.267525  1469 raft_consensus.cc:515] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.276136  1480 ts_tablet_manager.cc:1403] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.110s	user 0.031s	sys 0.022s
I20260709 12:15:07.271539  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:07.277077  1178 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.278064  1469 leader_election.cc:290] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.275118  1482 ts_tablet_manager.cc:1434] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.080s	user 0.019s	sys 0.052s
I20260709 12:15:07.280674  1482 tablet_bootstrap.cc:492] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:07.279788  1480 raft_consensus.cc:359] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.280973  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:07.281250  1480 raft_consensus.cc:385] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.281627  1480 raft_consensus.cc:740] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.281684  1330 raft_consensus.cc:3060] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.282676  1480 consensus_queue.cc:260] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.279047  1481 raft_consensus.cc:359] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.284984  1481 raft_consensus.cc:385] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.285348  1481 raft_consensus.cc:740] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.285761  1480 ts_tablet_manager.cc:1434] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:15:07.286195  1481 consensus_queue.cc:260] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.288724  1481 ts_tablet_manager.cc:1434] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:15:07.289196  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:07.289937  1254 raft_consensus.cc:3060] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.287002  1480 tablet_bootstrap.cc:492] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:07.291790  1328 raft_consensus.cc:2468] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 1.
I20260709 12:15:07.293426  1482 tablet_bootstrap.cc:654] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.288745  1330 raft_consensus.cc:2468] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 1.
I20260709 12:15:07.298050  1178 raft_consensus.cc:2468] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 1.
I20260709 12:15:07.299921  1222 leader_election.cc:304] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:07.294509  1481 tablet_bootstrap.cc:492] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:07.300441  1254 raft_consensus.cc:2468] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 1.
I20260709 12:15:07.306124  1412 raft_consensus.cc:2804] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:07.306892  1412 raft_consensus.cc:697] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:07.311182  1146 leader_election.cc:304] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:07.312026  1481 tablet_bootstrap.cc:654] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.312207  1469 raft_consensus.cc:2804] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:07.312700  1469 raft_consensus.cc:697] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:07.313621  1469 consensus_queue.cc:237] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.308080  1412 consensus_queue.cc:237] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.326304  1480 tablet_bootstrap.cc:654] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.338877  1075 catalog_manager.cc:5697] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.363030  1481 tablet_bootstrap.cc:492] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:07.363566  1481 ts_tablet_manager.cc:1403] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.069s	user 0.033s	sys 0.023s
I20260709 12:15:07.361025  1078 catalog_manager.cc:5697] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 0 to 1, leader changed from <none> to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 1 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.366533  1481 raft_consensus.cc:359] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.367319  1481 raft_consensus.cc:385] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.367626  1481 raft_consensus.cc:740] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.368368  1481 consensus_queue.cc:260] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.375424  1481 ts_tablet_manager.cc:1434] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:15:07.376543  1481 tablet_bootstrap.cc:492] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:07.378428  1480 tablet_bootstrap.cc:492] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:07.380231  1480 ts_tablet_manager.cc:1403] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.004s
I20260709 12:15:07.381812  1482 tablet_bootstrap.cc:492] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:07.382532  1482 ts_tablet_manager.cc:1403] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.102s	user 0.051s	sys 0.035s
I20260709 12:15:07.383301  1481 tablet_bootstrap.cc:654] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.383541  1480 raft_consensus.cc:359] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.384377  1480 raft_consensus.cc:385] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.384757  1480 raft_consensus.cc:740] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.385784  1480 consensus_queue.cc:260] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.386065  1482 raft_consensus.cc:359] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.386960  1482 raft_consensus.cc:385] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.387301  1482 raft_consensus.cc:740] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.388170  1482 consensus_queue.cc:260] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.388866  1480 ts_tablet_manager.cc:1434] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:07.391391  1480 tablet_bootstrap.cc:492] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:07.396662  1482 ts_tablet_manager.cc:1434] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:15:07.397931  1482 tablet_bootstrap.cc:492] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:07.399214  1480 tablet_bootstrap.cc:654] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.405308  1482 tablet_bootstrap.cc:654] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.407065  1481 tablet_bootstrap.cc:492] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:07.407907  1481 ts_tablet_manager.cc:1403] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.008s
I20260709 12:15:07.411818  1481 raft_consensus.cc:359] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.412545  1481 raft_consensus.cc:385] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.412887  1481 raft_consensus.cc:740] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.412904  1482 tablet_bootstrap.cc:492] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:07.413004  1480 tablet_bootstrap.cc:492] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:07.413812  1482 ts_tablet_manager.cc:1403] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 12:15:07.413842  1480 ts_tablet_manager.cc:1403] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 12:15:07.413762  1481 consensus_queue.cc:260] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.416386  1481 ts_tablet_manager.cc:1434] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:15:07.417649  1481 tablet_bootstrap.cc:492] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:07.417337  1482 raft_consensus.cc:359] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.418133  1482 raft_consensus.cc:385] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.418511  1482 raft_consensus.cc:740] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.418358  1480 raft_consensus.cc:359] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.419602  1480 raft_consensus.cc:385] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.420022  1480 raft_consensus.cc:740] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.419696  1482 consensus_queue.cc:260] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.420996  1480 consensus_queue.cc:260] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.423583  1480 ts_tablet_manager.cc:1434] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:15:07.424824  1480 tablet_bootstrap.cc:492] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:07.423056  1482 ts_tablet_manager.cc:1434] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:15:07.428292  1481 tablet_bootstrap.cc:654] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.429054  1482 tablet_bootstrap.cc:492] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:07.432379  1480 tablet_bootstrap.cc:654] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.439031  1482 tablet_bootstrap.cc:654] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.441718  1481 tablet_bootstrap.cc:492] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:07.442415  1481 ts_tablet_manager.cc:1403] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.002s
I20260709 12:15:07.450372  1480 tablet_bootstrap.cc:492] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:07.452955  1480 ts_tablet_manager.cc:1403] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.006s
I20260709 12:15:07.456421  1480 raft_consensus.cc:359] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.456483  1481 raft_consensus.cc:359] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.458001  1481 raft_consensus.cc:385] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.458598  1481 raft_consensus.cc:740] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.457505  1480 raft_consensus.cc:385] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.459311  1480 raft_consensus.cc:740] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.459728  1481 consensus_queue.cc:260] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.460415  1480 consensus_queue.cc:260] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.461706  1482 tablet_bootstrap.cc:492] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:07.462388  1482 ts_tablet_manager.cc:1403] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.009s
I20260709 12:15:07.462805  1481 ts_tablet_manager.cc:1434] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:15:07.464033  1481 tablet_bootstrap.cc:492] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:07.465798  1482 raft_consensus.cc:359] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.466727  1482 raft_consensus.cc:385] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.466849  1480 ts_tablet_manager.cc:1434] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:15:07.467095  1482 raft_consensus.cc:740] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.468545  1480 tablet_bootstrap.cc:492] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:07.468101  1482 consensus_queue.cc:260] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.472343  1481 tablet_bootstrap.cc:654] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.474256  1482 ts_tablet_manager.cc:1434] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:15:07.475505  1482 tablet_bootstrap.cc:492] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:07.483022  1480 tablet_bootstrap.cc:654] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.497658  1482 tablet_bootstrap.cc:654] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.497735  1480 tablet_bootstrap.cc:492] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:07.498627  1480 ts_tablet_manager.cc:1403] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.010s
I20260709 12:15:07.498767  1469 raft_consensus.cc:493] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.499425  1469 raft_consensus.cc:515] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.501747  1469 leader_election.cc:290] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.502595  1481 tablet_bootstrap.cc:492] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:07.503176  1481 ts_tablet_manager.cc:1403] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.039s	user 0.003s	sys 0.023s
I20260709 12:15:07.502946  1480 raft_consensus.cc:359] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.503683  1480 raft_consensus.cc:385] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.503723  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:07.503710  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:07.504079  1480 raft_consensus.cc:740] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.504791  1330 raft_consensus.cc:2468] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 0.
I20260709 12:15:07.505173  1480 consensus_queue.cc:260] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
W20260709 12:15:07.505944  1146 leader_election.cc:343] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:07.506274  1481 raft_consensus.cc:359] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.507086  1481 raft_consensus.cc:385] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.507381  1481 raft_consensus.cc:740] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.508173  1480 ts_tablet_manager.cc:1434] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:15:07.508157  1481 consensus_queue.cc:260] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.509608  1480 tablet_bootstrap.cc:492] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:07.510437  1147 leader_election.cc:304] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 567b3ab021414d40a11f2335766ef697
I20260709 12:15:07.511333  1481 ts_tablet_manager.cc:1434] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:15:07.511799  1469 raft_consensus.cc:2804] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:07.512461  1481 tablet_bootstrap.cc:492] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:07.512255  1469 raft_consensus.cc:493] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.515381  1469 raft_consensus.cc:3060] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.516971  1480 tablet_bootstrap.cc:654] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.519131  1482 tablet_bootstrap.cc:492] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:07.519686  1482 ts_tablet_manager.cc:1403] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.004s
I20260709 12:15:07.523586  1469 raft_consensus.cc:515] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.523847  1482 raft_consensus.cc:359] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.524994  1482 raft_consensus.cc:385] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.525405  1482 raft_consensus.cc:740] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.526293  1482 consensus_queue.cc:260] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.531476  1481 tablet_bootstrap.cc:654] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.533425  1480 tablet_bootstrap.cc:492] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:07.533967  1480 ts_tablet_manager.cc:1403] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 12:15:07.528648  1482 ts_tablet_manager.cc:1434] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:15:07.535511  1482 tablet_bootstrap.cc:492] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:07.538228  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:07.538331  1480 raft_consensus.cc:359] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.539388  1480 raft_consensus.cc:385] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.539682  1480 raft_consensus.cc:740] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.540380  1480 consensus_queue.cc:260] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.542701  1482 tablet_bootstrap.cc:654] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.545472  1480 ts_tablet_manager.cc:1434] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:15:07.546701  1480 tablet_bootstrap.cc:492] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: Bootstrap starting.
I20260709 12:15:07.548321  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:07.549039  1330 raft_consensus.cc:3060] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:07.557046  1146 leader_election.cc:343] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:07.559183  1330 raft_consensus.cc:2468] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 1.
I20260709 12:15:07.559587  1481 tablet_bootstrap.cc:492] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:07.560056  1469 leader_election.cc:290] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.560220  1481 ts_tablet_manager.cc:1403] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.003s
I20260709 12:15:07.561378  1147 leader_election.cc:304] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 567b3ab021414d40a11f2335766ef697
I20260709 12:15:07.562970  1469 raft_consensus.cc:2804] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:07.563161  1480 tablet_bootstrap.cc:654] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.563506  1481 raft_consensus.cc:359] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.564293  1469 raft_consensus.cc:697] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:07.564307  1481 raft_consensus.cc:385] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.565081  1481 raft_consensus.cc:740] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.565544  1469 consensus_queue.cc:237] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.566020  1481 consensus_queue.cc:260] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.569010  1481 ts_tablet_manager.cc:1434] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.008s	user 0.011s	sys 0.000s
I20260709 12:15:07.570129  1481 tablet_bootstrap.cc:492] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:07.571496  1480 tablet_bootstrap.cc:492] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: No bootstrap required, opened a new log
I20260709 12:15:07.572013  1480 ts_tablet_manager.cc:1403] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.002s
I20260709 12:15:07.574923  1480 raft_consensus.cc:359] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.575618  1480 raft_consensus.cc:385] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.575873  1480 raft_consensus.cc:740] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.576586  1481 tablet_bootstrap.cc:654] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.576829  1480 consensus_queue.cc:260] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.578799  1482 tablet_bootstrap.cc:492] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:07.579293  1482 ts_tablet_manager.cc:1403] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.011s
I20260709 12:15:07.582283  1482 raft_consensus.cc:359] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.583089  1482 raft_consensus.cc:385] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.583113  1480 ts_tablet_manager.cc:1434] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:15:07.583541  1482 raft_consensus.cc:740] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.584303  1482 consensus_queue.cc:260] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.586824  1482 ts_tablet_manager.cc:1434] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:07.589646  1482 tablet_bootstrap.cc:492] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:07.595857  1075 catalog_manager.cc:5697] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 0 to 1, leader changed from <none> to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 1 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.597899  1481 tablet_bootstrap.cc:492] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:07.598532  1481 ts_tablet_manager.cc:1403] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.003s
I20260709 12:15:07.598626  1482 tablet_bootstrap.cc:654] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.601604  1481 raft_consensus.cc:359] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.602173  1481 raft_consensus.cc:385] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.602422  1481 raft_consensus.cc:740] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.603034  1481 consensus_queue.cc:260] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.604614  1481 ts_tablet_manager.cc:1434] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:07.606233  1481 tablet_bootstrap.cc:492] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697: Bootstrap starting.
I20260709 12:15:07.614658  1481 tablet_bootstrap.cc:654] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.621158  1482 tablet_bootstrap.cc:492] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:07.621371  1486 raft_consensus.cc:493] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.621655  1482 ts_tablet_manager.cc:1403] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.013s
I20260709 12:15:07.622005  1486 raft_consensus.cc:515] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.622532  1481 tablet_bootstrap.cc:492] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697: No bootstrap required, opened a new log
I20260709 12:15:07.623068  1481 ts_tablet_manager.cc:1403] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:15:07.624701  1482 raft_consensus.cc:359] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.625306  1486 leader_election.cc:290] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:07.625504  1482 raft_consensus.cc:385] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.626094  1482 raft_consensus.cc:740] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.626468  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:07.626103  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:07.627288  1178 raft_consensus.cc:2468] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 0.
I20260709 12:15:07.627080  1482 consensus_queue.cc:260] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.627801  1254 raft_consensus.cc:2468] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 0.
I20260709 12:15:07.628669  1294 leader_election.cc:304] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:07.630111  1482 ts_tablet_manager.cc:1434] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:15:07.630076  1486 raft_consensus.cc:2804] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:07.630031  1481 raft_consensus.cc:359] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.631449  1481 raft_consensus.cc:385] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.631639  1412 raft_consensus.cc:493] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.631768  1481 raft_consensus.cc:740] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.632330  1482 tablet_bootstrap.cc:492] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b: Bootstrap starting.
I20260709 12:15:07.632193  1412 raft_consensus.cc:515] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.632519  1481 consensus_queue.cc:260] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.634467  1412 leader_election.cc:290] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.634856  1481 ts_tablet_manager.cc:1434] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:15:07.631466  1486 raft_consensus.cc:493] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.636723  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:07.637378  1330 raft_consensus.cc:2468] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 0.
I20260709 12:15:07.638531  1222 leader_election.cc:304] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:07.639384  1412 raft_consensus.cc:2804] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:07.639792  1412 raft_consensus.cc:493] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.640185  1412 raft_consensus.cc:3060] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.641937  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:07.636747  1486 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.642602  1178 raft_consensus.cc:2468] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 0.
I20260709 12:15:07.643697  1482 tablet_bootstrap.cc:654] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:07.649690  1486 raft_consensus.cc:515] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.651721  1486 leader_election.cc:290] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:07.652745  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:07.653456  1178 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.653251  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:07.654095  1254 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.655646  1482 tablet_bootstrap.cc:492] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b: No bootstrap required, opened a new log
I20260709 12:15:07.656229  1482 ts_tablet_manager.cc:1403] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.009s
I20260709 12:15:07.657771  1412 raft_consensus.cc:515] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.659546  1482 raft_consensus.cc:359] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.660359  1482 raft_consensus.cc:385] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:07.660671  1482 raft_consensus.cc:740] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Initialized, Role: FOLLOWER
I20260709 12:15:07.660703  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:07.661453  1482 consensus_queue.cc:260] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.662384  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:07.663094  1330 raft_consensus.cc:3060] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.663761  1254 raft_consensus.cc:2468] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
I20260709 12:15:07.664603  1482 ts_tablet_manager.cc:1434] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:15:07.664999  1295 leader_election.cc:304] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:07.665889  1486 raft_consensus.cc:2804] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:07.661535  1177 raft_consensus.cc:3060] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.666247  1178 raft_consensus.cc:2468] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
I20260709 12:15:07.659885  1412 leader_election.cc:290] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.671167  1330 raft_consensus.cc:2468] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 1.
I20260709 12:15:07.671615  1469 raft_consensus.cc:493] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.672152  1469 raft_consensus.cc:515] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.672748  1222 leader_election.cc:304] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:07.674571  1469 leader_election.cc:290] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.675606  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:07.676323  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:07.676599  1254 raft_consensus.cc:2468] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 0.
I20260709 12:15:07.677122  1330 raft_consensus.cc:2468] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 0.
I20260709 12:15:07.677529  1412 raft_consensus.cc:2804] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:07.679162  1147 leader_election.cc:304] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:07.680672  1412 raft_consensus.cc:697] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:07.680981  1469 raft_consensus.cc:2804] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:07.681118  1486 raft_consensus.cc:697] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:07.681603  1469 raft_consensus.cc:493] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.682060  1469 raft_consensus.cc:3060] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.682405  1486 consensus_queue.cc:237] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.685479  1412 consensus_queue.cc:237] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.689150  1177 raft_consensus.cc:2468] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 1.
I20260709 12:15:07.693949  1469 raft_consensus.cc:515] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.694329  1078 catalog_manager.cc:5697] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.697116  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:07.697736  1254 raft_consensus.cc:3060] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.698271  1469 leader_election.cc:290] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.700414  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:07.701120  1330 raft_consensus.cc:3060] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.705245  1254 raft_consensus.cc:2468] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 1.
I20260709 12:15:07.706430  1146 leader_election.cc:304] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:07.707314  1469 raft_consensus.cc:2804] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:07.707906  1469 raft_consensus.cc:697] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:07.707348  1077 catalog_manager.cc:5697] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.708689  1469 consensus_queue.cc:237] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.709720  1330 raft_consensus.cc:2468] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 1.
I20260709 12:15:07.718186  1078 catalog_manager.cc:5697] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 0 to 1, leader changed from <none> to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 1 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.739069  1486 raft_consensus.cc:493] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.739758  1486 raft_consensus.cc:515] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.742179  1486 leader_election.cc:290] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:07.743175  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:07.743543  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:07.743952  1177 raft_consensus.cc:2468] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 0.
I20260709 12:15:07.744472  1254 raft_consensus.cc:2468] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 0.
I20260709 12:15:07.745172  1294 leader_election.cc:304] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:07.746438  1486 raft_consensus.cc:2804] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:07.746882  1486 raft_consensus.cc:493] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.747301  1486 raft_consensus.cc:3060] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:07.752369  1127 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:07.754390  1486 raft_consensus.cc:515] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.756121  1486 leader_election.cc:290] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:07.757189  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:07.757380  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:07.757761  1177 raft_consensus.cc:3060] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.758214  1254 raft_consensus.cc:3060] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.763067  1177 raft_consensus.cc:2468] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
I20260709 12:15:07.764410  1254 raft_consensus.cc:2468] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
I20260709 12:15:07.764328  1294 leader_election.cc:304] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:07.765439  1486 raft_consensus.cc:2804] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:07.765967  1486 raft_consensus.cc:697] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:07.766776  1486 consensus_queue.cc:237] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.775317  1412 consensus_queue.cc:1048] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:07.775117  1078 catalog_manager.cc:5697] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.790688  1488 consensus_queue.cc:1048] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:07.858273  1526 raft_consensus.cc:493] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.858933  1526 raft_consensus.cc:515] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.861464  1526 leader_election.cc:290] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.862042  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:07.862697  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:07.863199  1177 raft_consensus.cc:2468] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 0.
I20260709 12:15:07.863360  1330 raft_consensus.cc:2468] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 0.
I20260709 12:15:07.864499  1220 leader_election.cc:304] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:07.865267  1526 raft_consensus.cc:2804] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:07.865615  1526 raft_consensus.cc:493] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.865953  1526 raft_consensus.cc:3060] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.871778  1526 raft_consensus.cc:515] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.873534  1526 leader_election.cc:290] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.874435  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:07.874617  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:07.875181  1177 raft_consensus.cc:3060] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.875181  1330 raft_consensus.cc:3060] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.882215  1330 raft_consensus.cc:2468] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 1.
I20260709 12:15:07.882215  1177 raft_consensus.cc:2468] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 1.
I20260709 12:15:07.883796  1222 leader_election.cc:304] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:07.884922  1526 raft_consensus.cc:2804] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:07.886473  1526 raft_consensus.cc:697] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:07.887480  1526 consensus_queue.cc:237] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.895694  1078 catalog_manager.cc:5697] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.904011  1526 raft_consensus.cc:493] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.904860  1526 raft_consensus.cc:515] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.906868  1526 leader_election.cc:290] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.907723  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:07.907960  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:07.908460  1177 raft_consensus.cc:2468] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 0.
I20260709 12:15:07.908761  1328 raft_consensus.cc:2468] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 0.
I20260709 12:15:07.909693  1220 leader_election.cc:304] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:07.910581  1526 raft_consensus.cc:2804] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:07.911013  1526 raft_consensus.cc:493] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.911321  1526 raft_consensus.cc:3060] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.916409  1526 raft_consensus.cc:515] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.918306  1526 leader_election.cc:290] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.919787  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:07.919974  1469 consensus_queue.cc:1048] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:07.920714  1177 raft_consensus.cc:3060] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.921456  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:07.922008  1469 consensus_queue.cc:1048] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:07.924049  1330 raft_consensus.cc:3060] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.932112  1177 raft_consensus.cc:2468] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 1.
I20260709 12:15:07.934363  1220 leader_election.cc:304] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:07.936403  1526 raft_consensus.cc:2804] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:07.937181  1526 raft_consensus.cc:697] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:07.938532  1526 consensus_queue.cc:237] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.954905  1330 raft_consensus.cc:2468] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 1.
I20260709 12:15:07.963394  1075 catalog_manager.cc:5697] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.968678  1526 raft_consensus.cc:493] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.969259  1526 raft_consensus.cc:515] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:07.971318  1526 leader_election.cc:290] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:07.972338  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:07.972606  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:07.973656  1330 raft_consensus.cc:2393] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 567b3ab021414d40a11f2335766ef697 in current term 1: Already voted for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in this term.
I20260709 12:15:07.974613  1222 leader_election.cc:304] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:07.975322  1526 raft_consensus.cc:3060] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:07.980593  1526 raft_consensus.cc:2749] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:08.022152  1495 consensus_queue.cc:1048] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:08.034025  1469 consensus_queue.cc:1048] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:08.084537  1254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f558375c464040b1ab3d898565a2190e"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
mode: GRACEFUL
new_leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:57072
I20260709 12:15:08.085337  1254 raft_consensus.cc:606] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Received request to transfer leadership to TS f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:08.091164  1330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
mode: GRACEFUL
new_leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:15:08.091809  1330 raft_consensus.cc:606] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Received request to transfer leadership to TS f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:08.100337  1177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
mode: GRACEFUL
new_leader_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:59868
I20260709 12:15:08.100935  1177 raft_consensus.cc:606] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Received request to transfer leadership to TS 567b3ab021414d40a11f2335766ef697
I20260709 12:15:08.110934  1328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
mode: GRACEFUL
new_leader_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:60358
I20260709 12:15:08.111639  1328 raft_consensus.cc:606] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Received request to transfer leadership to TS 567b3ab021414d40a11f2335766ef697
I20260709 12:15:08.120411  1254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
mode: GRACEFUL
new_leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:57072
I20260709 12:15:08.121137  1254 raft_consensus.cc:606] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Received request to transfer leadership to TS 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:08.237417  1495 consensus_queue.cc:1048] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:08.245029  1495 consensus_queue.cc:1048] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:08.246300  1494 raft_consensus.cc:993] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b: : Instructing follower 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:08.246913  1469 raft_consensus.cc:1081] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Signalling peer 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:08.251628  1256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:57066
I20260709 12:15:08.252889  1256 raft_consensus.cc:493] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:08.253486  1256 raft_consensus.cc:3060] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.257763  1486 consensus_queue.cc:1048] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:08.265058  1526 consensus_queue.cc:1048] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:08.268167  1256 raft_consensus.cc:515] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.270920  1256 leader_election.cc:290] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:08.273144  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:08.273792  1176 raft_consensus.cc:3055] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:08.274109  1176 raft_consensus.cc:740] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:08.274978  1176 consensus_queue.cc:260] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.276067  1176 raft_consensus.cc:3060] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.281119  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:08.282925  1488 consensus_queue.cc:1048] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:08.284332  1486 consensus_queue.cc:1048] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:08.289125  1176 raft_consensus.cc:2468] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:08.290776  1220 leader_election.cc:304] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:08.292193  1526 raft_consensus.cc:2804] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:08.292744  1526 raft_consensus.cc:697] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:08.293815  1526 consensus_queue.cc:237] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.316936  1519 raft_consensus.cc:993] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9: : Instructing follower f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:08.317425  1519 raft_consensus.cc:1081] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Signalling peer f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:08.326051  1177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:59854
I20260709 12:15:08.326596  1177 raft_consensus.cc:493] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:08.326934  1177 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.328541  1519 consensus_queue.cc:1048] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:08.329659  1075 catalog_manager.cc:5697] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 1 to 2, leader changed from f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193) to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:08.333503  1177 raft_consensus.cc:515] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.337152  1178 raft_consensus.cc:1240] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Rejecting Update request from peer 0e0756a5326d4bbc8fd151f0ab60f9d9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:08.339669  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:08.340417  1256 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.341020  1177 leader_election.cc:290] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:08.342001  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:08.342626  1330 raft_consensus.cc:3055] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:08.342943  1330 raft_consensus.cc:740] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:08.343683  1330 consensus_queue.cc:260] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.344728  1330 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.348220  1256 raft_consensus.cc:2468] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:08.349759  1146 leader_election.cc:304] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:08.355159  1537 raft_consensus.cc:2804] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:08.355787  1537 raft_consensus.cc:697] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:08.357034  1537 consensus_queue.cc:237] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.358408  1526 consensus_queue.cc:1048] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:08.359853  1486 consensus_queue.cc:1048] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:08.362828  1330 raft_consensus.cc:2468] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:08.368445  1079 catalog_manager.cc:5697] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 1 to 2, leader changed from 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195) to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 2 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:08.377099  1526 raft_consensus.cc:993] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697: : Instructing follower f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:08.377737  1488 raft_consensus.cc:1081] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Signalling peer f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:08.380462  1176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f558375c464040b1ab3d898565a2190e"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:59848
I20260709 12:15:08.381323  1176 raft_consensus.cc:493] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:08.381716  1176 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.384610  1519 raft_consensus.cc:993] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9: : Instructing follower 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:08.385354  1519 raft_consensus.cc:1081] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Signalling peer 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:08.391152  1176 raft_consensus.cc:515] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.393906  1176 leader_election.cc:290] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:08.394269  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:08.394935  1256 raft_consensus.cc:3055] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:08.395267  1256 raft_consensus.cc:740] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:08.395159  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:08.396370  1330 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.396512  1256 consensus_queue.cc:260] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.398033  1256 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.398598  1254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:57054
I20260709 12:15:08.407328  1254 raft_consensus.cc:493] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:08.407769  1254 raft_consensus.cc:3060] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.404259  1488 consensus_queue.cc:1048] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:08.405086  1330 raft_consensus.cc:2468] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:08.414470  1147 leader_election.cc:304] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:08.415063  1256 raft_consensus.cc:2468] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:08.415472  1537 raft_consensus.cc:2804] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:08.416325  1537 raft_consensus.cc:697] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:08.417574  1537 consensus_queue.cc:237] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.420200  1254 raft_consensus.cc:515] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.426236  1254 leader_election.cc:290] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:08.427340  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:08.428390  1176 raft_consensus.cc:3060] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.429447  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:08.430187  1330 raft_consensus.cc:3055] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:08.430529  1330 raft_consensus.cc:740] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:08.431571  1330 consensus_queue.cc:260] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.433014  1330 raft_consensus.cc:3060] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.436825  1176 raft_consensus.cc:2468] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:08.438381  1220 leader_election.cc:304] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:08.438356  1079 catalog_manager.cc:5697] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 1 to 2, leader changed from 567b3ab021414d40a11f2335766ef697 (127.20.102.194) to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 2 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:08.439453  1488 raft_consensus.cc:2804] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:08.439889  1330 raft_consensus.cc:2468] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:08.440156  1488 raft_consensus.cc:697] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:08.441231  1488 consensus_queue.cc:237] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.449848  1079 catalog_manager.cc:5697] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 1 to 2, leader changed from 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195) to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:08.521906  1488 consensus_queue.cc:1048] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:08.530432  1541 raft_consensus.cc:993] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697: : Instructing follower 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:08.531134  1526 raft_consensus.cc:1081] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Signalling peer 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:08.535233  1329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:60352
I20260709 12:15:08.536710  1329 raft_consensus.cc:493] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:08.537218  1329 raft_consensus.cc:3060] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.539054  1541 consensus_queue.cc:1048] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:08.548676  1329 raft_consensus.cc:515] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.551321  1329 leader_election.cc:290] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:08.551923  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:08.552431  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:08.552816  1254 raft_consensus.cc:3055] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:08.553207  1176 raft_consensus.cc:3060] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.553226  1254 raft_consensus.cc:740] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:08.554358  1254 consensus_queue.cc:260] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.555846  1254 raft_consensus.cc:3060] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.560653  1176 raft_consensus.cc:2468] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:08.562065  1294 leader_election.cc:304] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:08.562762  1254 raft_consensus.cc:2468] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:08.562953  1519 raft_consensus.cc:2804] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:08.563616  1519 raft_consensus.cc:697] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:08.564533  1519 consensus_queue.cc:237] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:08.571890  1077 catalog_manager.cc:5697] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 1 to 2, leader changed from 567b3ab021414d40a11f2335766ef697 (127.20.102.194) to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:08.779693  1329 raft_consensus.cc:3060] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:08.787458  1329 raft_consensus.cc:1275] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:08.789175  1541 consensus_queue.cc:1048] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:08.791195  1176 raft_consensus.cc:1275] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:08.793172  1541 consensus_queue.cc:1048] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:08.816933  1329 raft_consensus.cc:1275] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:08.818161  1537 consensus_queue.cc:1048] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:08.827670  1254 raft_consensus.cc:1275] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:08.832433  1495 consensus_queue.cc:1048] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:08.887035  1254 raft_consensus.cc:1275] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:08.888489  1552 consensus_queue.cc:1048] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:08.897995  1329 raft_consensus.cc:1275] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:08.899587  1552 consensus_queue.cc:1048] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:08.913812  1329 raft_consensus.cc:1275] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:08.915128  1543 consensus_queue.cc:1048] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:08.923573  1177 raft_consensus.cc:1275] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:08.925573  1526 consensus_queue.cc:1048] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:09.067102  1177 raft_consensus.cc:1275] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:09.068440  1519 consensus_queue.cc:1048] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:09.083685  1254 raft_consensus.cc:1275] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:09.085457  1556 consensus_queue.cc:1048] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:11.125964  1079 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52558:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:15:11.155267  1079 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52558:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:15:11.264364 20891 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:15:11.452203  1583 log.cc:927] Time spent T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
W20260709 12:15:11.472951  1220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39923, user_credentials={real_user=slave}} blocked reactor thread for 52111.7us
W20260709 12:15:11.539932  1602 log.cc:927] Time spent T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:15:11.546742  1603 log.cc:927] Time spent T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
I20260709 12:15:11.556492  1608 tablet.cc:1724] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.567314  1612 tablet.cc:1724] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.577309  1610 tablet.cc:1724] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:11.613480  1207 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:a78228434e6a4e5ba34c365405f52ae9)
W20260709 12:15:11.615945  1600 log.cc:927] Time spent T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260709 12:15:11.621757  1615 tablet.cc:1724] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:11.632302  1207 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:a78228434e6a4e5ba34c365405f52ae9)
W20260709 12:15:11.636693  1207 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:a78228434e6a4e5ba34c365405f52ae9)
I20260709 12:15:11.647151  1618 tablet.cc:1724] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:11.648382  1146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.194:38935, user_credentials={real_user=slave}} blocked reactor thread for 67585.3us
I20260709 12:15:11.640130  1620 tablet.cc:1724] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.685748  1179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
mode: GRACEFUL
new_leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:42638
I20260709 12:15:11.693611  1622 tablet.cc:1724] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.707248  1625 tablet.cc:1724] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.710556  1628 tablet.cc:1724] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.716967  1179 raft_consensus.cc:606] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Received request to transfer leadership to TS 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:11.738684  1624 tablet.cc:1724] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.810896  1632 tablet.cc:1724] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:11.798779  1147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:34771, user_credentials={real_user=slave}} blocked reactor thread for 134289us
I20260709 12:15:11.798236  1630 tablet.cc:1724] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.869050  1615 tablet.cc:1724] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.842628  1608 tablet.cc:1724] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.829731  1624 tablet.cc:1724] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.876089  1628 tablet.cc:1724] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.885687  1620 tablet.cc:1724] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.823630  1610 tablet.cc:1724] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.892894  1253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
mode: GRACEFUL
new_leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:44284
I20260709 12:15:11.872349  1625 tablet.cc:1724] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.808905  1612 tablet.cc:1724] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.917903  1618 tablet.cc:1724] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.934238  1626 raft_consensus.cc:993] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b: : Instructing follower 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:11.935073  1626 raft_consensus.cc:1081] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Signalling peer 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:11.915032  1253 raft_consensus.cc:606] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Received request to transfer leadership to TS 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:11.938748 20891 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:15:11.940727 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:11.954787  1632 tablet.cc:1724] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.962924  1620 tablet.cc:1724] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.976745  1610 tablet.cc:1724] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.981504  1618 tablet.cc:1724] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.987627  1622 tablet.cc:1724] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:11.988754  1179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
mode: GRACEFUL
new_leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:42638
I20260709 12:15:11.989610  1179 raft_consensus.cc:606] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Received request to transfer leadership to TS 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:12.013953  1253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
mode: GRACEFUL
new_leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:44284
I20260709 12:15:12.014721  1253 raft_consensus.cc:606] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Received request to transfer leadership to TS 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:12.019081 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:12.019886 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:12.025202  1327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:60356
I20260709 12:15:12.026091  1327 raft_consensus.cc:493] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:12.026562  1327 raft_consensus.cc:3060] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.029258  1610 tablet.cc:1724] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:12.052749  1558 raft_consensus.cc:993] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697: : Instructing follower 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:12.053506  1558 raft_consensus.cc:1081] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Signalling peer 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:12.053470  1327 raft_consensus.cc:515] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.056010  1329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:60352
I20260709 12:15:12.056555  1327 leader_election.cc:290] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:12.056677  1329 raft_consensus.cc:493] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:12.057377  1329 raft_consensus.cc:3060] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.059486  1179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:12.059554  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:12.060631  1253 raft_consensus.cc:3060] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.060545  1179 raft_consensus.cc:3055] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:12.062493  1179 raft_consensus.cc:740] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:12.063917  1179 consensus_queue.cc:260] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.065112  1179 raft_consensus.cc:3060] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.068648  1329 raft_consensus.cc:515] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.073323  1329 leader_election.cc:290] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:12.074921  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:12.075491  1177 raft_consensus.cc:3060] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.078727  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:12.079624  1252 raft_consensus.cc:3055] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:12.080075  1252 raft_consensus.cc:740] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:12.081386  1252 consensus_queue.cc:260] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.083195  1252 raft_consensus.cc:3060] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.083762  1179 raft_consensus.cc:2468] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:12.085525  1294 leader_election.cc:304] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:12.087247  1253 raft_consensus.cc:2468] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:12.087317  1519 raft_consensus.cc:2804] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:12.091488  1177 raft_consensus.cc:2468] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:12.093904  1294 leader_election.cc:304] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:12.095438  1596 raft_consensus.cc:2804] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:12.096048  1596 raft_consensus.cc:697] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:12.097398  1596 consensus_queue.cc:237] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.100214  1519 raft_consensus.cc:697] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:12.101289  1519 consensus_queue.cc:237] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.107630  1252 raft_consensus.cc:2468] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:12.107748  1079 catalog_manager.cc:6242] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1: soft_deleted_table [id=01b4ce7c8ef04ed5808cd456666a23ea] alter complete (version 1)
I20260709 12:15:12.123343  1075 catalog_manager.cc:5697] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 1 to 2, leader changed from f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193) to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:12.124828  1075 catalog_manager.cc:5697] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 1 to 2, leader changed from 567b3ab021414d40a11f2335766ef697 (127.20.102.194) to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:12.369963  1629 raft_consensus.cc:993] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b: : Instructing follower 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:12.370599  1626 raft_consensus.cc:1081] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Signalling peer 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:12.372294  1329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:60356
I20260709 12:15:12.372906  1329 raft_consensus.cc:493] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:12.373189  1329 raft_consensus.cc:3060] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.378898  1329 raft_consensus.cc:515] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.380776  1329 leader_election.cc:290] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:12.382136  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:12.382884  1252 raft_consensus.cc:3060] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.383865  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:12.385645  1177 raft_consensus.cc:3055] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:12.386061  1177 raft_consensus.cc:740] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:12.387063  1177 consensus_queue.cc:260] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.388195  1177 raft_consensus.cc:3060] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.389411  1252 raft_consensus.cc:2468] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 3.
I20260709 12:15:12.391224  1295 leader_election.cc:304] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:12.392138  1637 raft_consensus.cc:2804] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:12.392601  1637 raft_consensus.cc:697] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:12.393599  1637 consensus_queue.cc:237] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.395020  1177 raft_consensus.cc:2468] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 3.
I20260709 12:15:12.404119  1079 catalog_manager.cc:5697] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 2 to 3, leader changed from f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193) to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:12.467439  1558 raft_consensus.cc:993] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697: : Instructing follower 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:12.468212  1595 raft_consensus.cc:1081] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Signalling peer 0e0756a5326d4bbc8fd151f0ab60f9d9 to start an election
I20260709 12:15:12.470122  1329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
 from {username='slave'} at 127.0.0.1:60352
I20260709 12:15:12.470798  1329 raft_consensus.cc:493] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:12.471222  1329 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.478349  1329 raft_consensus.cc:515] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.480753  1329 leader_election.cc:290] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:12.482035  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:12.482414  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:12.482803  1252 raft_consensus.cc:3055] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:12.482986  1177 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.483273  1252 raft_consensus.cc:740] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:12.484169  1252 consensus_queue.cc:260] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.485391  1252 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.490990  1177 raft_consensus.cc:2468] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 3.
I20260709 12:15:12.491752  1179 raft_consensus.cc:1240] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Rejecting Update request from peer 567b3ab021414d40a11f2335766ef697 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:12.492578  1252 raft_consensus.cc:2468] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 3.
I20260709 12:15:12.492985  1294 leader_election.cc:304] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:12.494046  1637 raft_consensus.cc:2804] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:12.494526  1637 raft_consensus.cc:697] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:12.495481  1637 consensus_queue.cc:237] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:12.503708  1079 catalog_manager.cc:5697] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 2 to 3, leader changed from 567b3ab021414d40a11f2335766ef697 (127.20.102.194) to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:12.517004  1179 raft_consensus.cc:1275] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:15:12.518311  1637 consensus_queue.cc:1048] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.529471  1252 raft_consensus.cc:1275] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:15:12.531965  1519 consensus_queue.cc:1048] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:12.680737  1179 raft_consensus.cc:1275] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:15:12.682297  1519 consensus_queue.cc:1048] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.691104  1253 raft_consensus.cc:1275] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:15:12.693312  1519 consensus_queue.cc:1048] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.845528  1179 raft_consensus.cc:1275] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:12.847152  1519 consensus_queue.cc:1048] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.861508  1253 raft_consensus.cc:1275] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:12.863147  1519 consensus_queue.cc:1048] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.954336  1179 raft_consensus.cc:1275] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:12.955857  1519 consensus_queue.cc:1048] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.968552  1252 raft_consensus.cc:1275] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:12.971266  1596 consensus_queue.cc:1048] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:13.024569 20891 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:13.029603 20891 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:13.029989 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:13.035912 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:13.036463 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:14.037859 20891 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:14.044147 20891 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:14.044744 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:14.049611 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:14.050077 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:15.051203 20891 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:15.056380 20891 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:15.056799 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:15.062649 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:15.063117 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:16.177569 20891 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:16.448097 20891 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:16.449096 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:16.708006  1662 raft_consensus.cc:493] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0e0756a5326d4bbc8fd151f0ab60f9d9)
I20260709 12:15:16.708976  1662 raft_consensus.cc:515] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.712316  1662 leader_election.cc:290] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:16.843647  1667 raft_consensus.cc:493] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0e0756a5326d4bbc8fd151f0ab60f9d9)
I20260709 12:15:16.844736  1667 raft_consensus.cc:515] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.849776 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:16.853204 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:16.857494  1664 raft_consensus.cc:493] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0e0756a5326d4bbc8fd151f0ab60f9d9)
I20260709 12:15:16.858387  1664 raft_consensus.cc:515] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.868178  1666 raft_consensus.cc:493] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:16.874020  1662 raft_consensus.cc:493] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:16.874670  1662 raft_consensus.cc:515] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.876643  1662 leader_election.cc:290] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:16.854311  1665 raft_consensus.cc:493] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:16.894490  1179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59854 (request call id 116) took 1605 ms. Trace:
I20260709 12:15:16.895212  1179 rpcz_store.cc:276] 0709 12:15:16.892342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.893314 (+   972us) service_pool.cc:224] Handling call
0709 12:15:16.893780 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.894031 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:16.894065 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:16.894113 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:16.894147 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.894215 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.894398 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:16.911789  1674 raft_consensus.cc:493] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:16.912191  1673 raft_consensus.cc:493] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0e0756a5326d4bbc8fd151f0ab60f9d9)
I20260709 12:15:16.912623  1674 raft_consensus.cc:515] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.924115  1663 raft_consensus.cc:493] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:16.906924  1665 raft_consensus.cc:515] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.924495  1670 raft_consensus.cc:493] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0e0756a5326d4bbc8fd151f0ab60f9d9)
I20260709 12:15:16.889914  1666 raft_consensus.cc:515] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.937033  1665 leader_election.cc:290] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:16.943017  1667 leader_election.cc:290] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:16.952808  1676 raft_consensus.cc:493] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:16.948995  1663 raft_consensus.cc:515] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:16.955308  1676 raft_consensus.cc:515] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.957237  1663 leader_election.cc:290] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771), f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923)
I20260709 12:15:16.957490  1676 leader_election.cc:290] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:16.957998  1676 raft_consensus.cc:493] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:16.958171  1669 raft_consensus.cc:493] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:16.958740  1669 raft_consensus.cc:515] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.952988  1664 leader_election.cc:290] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:16.952977  1670 raft_consensus.cc:515] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.962033  1674 leader_election.cc:290] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:16.962296  1666 leader_election.cc:290] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:16.963321  1670 leader_election.cc:290] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:16.963038  1666 raft_consensus.cc:493] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:16.949147  1668 raft_consensus.cc:493] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:16.958508  1676 raft_consensus.cc:515] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:16.938205  1672 raft_consensus.cc:493] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:16.929783  1673 raft_consensus.cc:515] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
W20260709 12:15:16.977239  1110 debug-util.cc:398] Leaking SignalData structure 0x7b080010a060 after lost signal to thread 20894
I20260709 12:15:16.976711  1672 raft_consensus.cc:515] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.970260  1665 raft_consensus.cc:493] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:16.976202  1662 raft_consensus.cc:493] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:16.964178  1666 raft_consensus.cc:515] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:16.995077  1664 raft_consensus.cc:493] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
W20260709 12:15:17.011948  1110 debug-util.cc:398] Leaking SignalData structure 0x7b0800039cc0 after lost signal to thread 1113
I20260709 12:15:17.017640  1678 raft_consensus.cc:493] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:17.043517  1664 raft_consensus.cc:515] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.010823  1672 leader_election.cc:290] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.017863  1674 raft_consensus.cc:493] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0e0756a5326d4bbc8fd151f0ab60f9d9)
I20260709 12:15:17.050972  1674 raft_consensus.cc:515] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.051952  1682 raft_consensus.cc:493] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:17.052641  1682 raft_consensus.cc:515] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.053730  1666 leader_election.cc:290] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.004865  1662 raft_consensus.cc:515] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.010267  1669 leader_election.cc:290] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:16.994110  1668 raft_consensus.cc:515] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.059338  1676 leader_election.cc:290] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923)
I20260709 12:15:17.059722  1680 raft_consensus.cc:493] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0e0756a5326d4bbc8fd151f0ab60f9d9)
I20260709 12:15:17.016988  1683 raft_consensus.cc:493] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0e0756a5326d4bbc8fd151f0ab60f9d9)
I20260709 12:15:17.060609  1680 raft_consensus.cc:515] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.061028  1683 raft_consensus.cc:515] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.061676  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.062857  1180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.063656  1180 raft_consensus.cc:2468] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:17.011247  1665 raft_consensus.cc:515] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.064500  1680 leader_election.cc:290] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.065425  1684 raft_consensus.cc:493] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:17.065953  1679 raft_consensus.cc:493] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.066350  1665 leader_election.cc:290] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.066605  1679 raft_consensus.cc:515] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.067466  1662 leader_election.cc:290] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.063730  1683 leader_election.cc:290] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.066172  1684 raft_consensus.cc:515] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.027487  1667 raft_consensus.cc:493] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0e0756a5326d4bbc8fd151f0ab60f9d9)
I20260709 12:15:17.032431  1670 raft_consensus.cc:493] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.055548  1682 leader_election.cc:290] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.065346  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.076248  1668 leader_election.cc:290] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.073642  1672 raft_consensus.cc:493] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.077657  1672 raft_consensus.cc:515] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.080025  1672 leader_election.cc:290] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.074558  1666 raft_consensus.cc:493] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:17.074637  1667 raft_consensus.cc:515] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.081727  1666 raft_consensus.cc:515] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.080892  1676 raft_consensus.cc:493] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:17.085319  1676 raft_consensus.cc:515] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.086463  1674 leader_election.cc:290] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.084646  1667 leader_election.cc:290] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.092541  1670 raft_consensus.cc:515] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.105999  1673 leader_election.cc:290] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.107769  1670 leader_election.cc:290] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.111479  1684 leader_election.cc:290] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.113941  1679 leader_election.cc:290] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.068138  1678 raft_consensus.cc:515] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
W20260709 12:15:17.114807  1110 debug-util.cc:398] Leaking SignalData structure 0x7b080027e360 after lost signal to thread 1205
I20260709 12:15:17.117357  1678 leader_election.cc:290] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.118192  1664 leader_election.cc:290] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.119024  1177 raft_consensus.cc:2468] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
W20260709 12:15:17.121320  1110 debug-util.cc:398] Leaking SignalData structure 0x7b080027aae0 after lost signal to thread 1280
I20260709 12:15:17.126842  1667 raft_consensus.cc:493] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0e0756a5326d4bbc8fd151f0ab60f9d9)
W20260709 12:15:17.127642  1110 debug-util.cc:398] Leaking SignalData structure 0x7b0800342ac0 after lost signal to thread 1354
W20260709 12:15:17.129658  1110 debug-util.cc:398] Leaking SignalData structure 0x7b08003b8560 after lost signal to thread 1654
I20260709 12:15:17.128248  1667 raft_consensus.cc:515] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.094012  1682 raft_consensus.cc:493] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.133464  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.133857  1682 raft_consensus.cc:515] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.126677  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.128763  1666 leader_election.cc:290] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.126717  1676 leader_election.cc:290] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.138509  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.139369  1329 raft_consensus.cc:2468] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 1.
I20260709 12:15:17.139117  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.141474  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.149423  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.149655  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.150763  1327 raft_consensus.cc:2468] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:17.153666  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.141891  1682 leader_election.cc:290] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.155650  1682 raft_consensus.cc:493] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.154644  1329 raft_consensus.cc:2468] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:17.157647  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.158233  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.156733  1682 raft_consensus.cc:515] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.158960  1253 raft_consensus.cc:2468] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:17.157577  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.154084  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.160912  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.169929  1295 leader_election.cc:304] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:17.170336  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.171074  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.171288  1679 raft_consensus.cc:2804] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:17.171860  1679 raft_consensus.cc:493] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.172434  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.172542  1679 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.161846  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.162617  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.174182  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.174388  1253 raft_consensus.cc:2468] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:17.174750  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.165869  1250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.176573  1326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.177350  1325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.177677  1326 raft_consensus.cc:2468] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:17.177811  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.178125  1325 raft_consensus.cc:2468] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 2.
I20260709 12:15:17.179280  1323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.180066  1321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.166484  1248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.181444  1295 leader_election.cc:304] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:17.182147  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.163791  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.182529  1688 raft_consensus.cc:2804] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:17.165030  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.183243  1688 raft_consensus.cc:493] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.169204  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.182308  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.166379  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.182369  1326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.167289  1247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:17.165445  1324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.162482  1667 leader_election.cc:290] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.167114  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.183641  1688 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.160753  1682 leader_election.cc:290] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.173312  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
W20260709 12:15:17.191541  1294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:39923, user_credentials={real_user=slave}} blocked reactor thread for 94903us
I20260709 12:15:17.192456  1294 leader_election.cc:304] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.193456  1672 raft_consensus.cc:2804] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:17.193856  1672 raft_consensus.cc:493] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:17.194223  1672 raft_consensus.cc:3060] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.194406  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.197077  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.197110  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.197439  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.199694  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a896862e9a0b44ff8d3fa4b2bb964963" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.201210  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.202077  1180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.204031  1180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca350a9e24f462d908bd22c056f20ab" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.204645  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.205523  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.205892  1179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.206447  1180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.208104  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.208254  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4c21e7be2741f1bc802fff60713945" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.209424  1324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77ba639d67a401fba2e19f66e001490" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.209517  1672 raft_consensus.cc:515] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.210587  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.211971  1672 leader_election.cc:290] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.212260  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.213203  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:17.213332  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:17.213958  1294 leader_election.cc:304] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.215469  1222 leader_election.cc:304] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.206399  1688 raft_consensus.cc:515] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:17.216676  1679 raft_consensus.cc:515] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.219254  1222 leader_election.cc:304] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.219363  1667 raft_consensus.cc:2804] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:17.220058  1323 raft_consensus.cc:1240] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Rejecting Update request from peer f9eb9edd0a764ac8aa8d9b262a5ede1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:17.220187  1687 raft_consensus.cc:2749] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.221163  1667 raft_consensus.cc:493] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.221661  1667 raft_consensus.cc:3060] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.222978  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:17.225183  1222 leader_election.cc:304] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.226555  1222 leader_election.cc:304] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.226892  1679 leader_election.cc:290] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.227183  1687 raft_consensus.cc:2804] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:17.227165  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:17.229558  1687 raft_consensus.cc:493] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.229687  1670 raft_consensus.cc:2804] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:17.230054  1687 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.230134  1670 raft_consensus.cc:493] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.228497  1146 leader_election.cc:304] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.230647  1670 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.231792  1146 leader_election.cc:304] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.232667  1664 raft_consensus.cc:2749] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.233400  1685 raft_consensus.cc:2749] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:17.237933  1222 leader_election.cc:304] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.234022  1146 leader_election.cc:304] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.234211  1664 consensus_queue.cc:1059] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:17.238739  1668 raft_consensus.cc:2749] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.239225  1664 raft_consensus.cc:3055] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:17.238850  1667 raft_consensus.cc:515] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.239629  1664 raft_consensus.cc:740] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:17.239711  1222 leader_election.cc:304] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:17.240630  1668 raft_consensus.cc:2804] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:17.241142  1668 raft_consensus.cc:493] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.241643  1668 raft_consensus.cc:3060] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.241842  1667 leader_election.cc:290] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.240545  1664 consensus_queue.cc:260] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.225128  1688 leader_election.cc:290] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923)
I20260709 12:15:17.241174  1682 raft_consensus.cc:2804] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:17.245242  1682 raft_consensus.cc:493] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:17.245486  1664 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.245685  1682 raft_consensus.cc:3060] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.247560  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0789a7d9e74942bcb0ba16bb0e23971b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.248557  1222 leader_election.cc:304] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:17.248888  1684 raft_consensus.cc:2749] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.250304  1222 leader_election.cc:304] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.251227  1669 raft_consensus.cc:2804] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:17.251598  1669 raft_consensus.cc:493] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:17.251678  1222 leader_election.cc:304] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.251734  1146 leader_election.cc:304] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.252038  1669 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.252446  1683 raft_consensus.cc:2749] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:17.253132  1683 raft_consensus.cc:2749] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.254366  1323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:17.255419  1181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6436eba65441457b99ce713e85078a61" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.256008  1180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.256233  1179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.256753  1684 raft_consensus.cc:2749] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.257674  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.259135  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a11cb3a10944eb8a6998df9073c95a" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.260653  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:17.261642  1682 raft_consensus.cc:515] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.262774  1178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc36569b2714f7f8876619bcd4b68f7" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.264166  1176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.265496  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:17.265990  1670 raft_consensus.cc:515] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.265533  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:17.269243  1294 leader_election.cc:304] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.270196  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:17.271955  1323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:17.271998  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:17.272956  1323 raft_consensus.cc:2393] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 567b3ab021414d40a11f2335766ef697 in current term 3: Already voted for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in this term.
I20260709 12:15:17.259816  1146 leader_election.cc:304] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.273963  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5b3b1001ed4e6fba7805e7fcdfdf87" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:17.277030  1685 raft_consensus.cc:2749] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:17.270129  1682 leader_election.cc:290] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:17.275198  1672 raft_consensus.cc:2749] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.275754  1294 leader_election.cc:304] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.278517  1146 leader_election.cc:304] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.279268  1685 raft_consensus.cc:2749] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.279449  1294 leader_election.cc:304] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.276654  1669 raft_consensus.cc:515] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.274581  1670 leader_election.cc:290] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.280998  1146 leader_election.cc:304] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.281507  1672 raft_consensus.cc:2749] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.281047  1687 raft_consensus.cc:515] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:17.284595  1685 raft_consensus.cc:2749] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.285892  1146 leader_election.cc:304] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.281977  1682 raft_consensus.cc:2749] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.286361  1687 leader_election.cc:290] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 election: Requested vote from peers 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771), f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923)
I20260709 12:15:17.282670  1294 leader_election.cc:304] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.283828  1669 leader_election.cc:290] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.287689  1294 leader_election.cc:304] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.288178  1323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:17.289113  1672 raft_consensus.cc:2749] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.288383  1682 raft_consensus.cc:2749] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:17.290200  1294 leader_election.cc:304] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.291320  1294 leader_election.cc:304] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.291488  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:17.291989  1672 raft_consensus.cc:2749] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.292440  1294 leader_election.cc:304] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.292760  1672 raft_consensus.cc:2749] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.293447  1672 raft_consensus.cc:2749] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.294312  1294 leader_election.cc:304] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.295024  1679 raft_consensus.cc:2749] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.295480  1294 leader_election.cc:304] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.281930  1668 raft_consensus.cc:515] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.296188  1685 raft_consensus.cc:2749] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.300029  1668 leader_election.cc:290] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:17.297533  1146 leader_election.cc:304] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.300925  1685 raft_consensus.cc:2749] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.302191  1146 leader_election.cc:304] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.303053  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:17.303443  1685 raft_consensus.cc:2749] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.303649  1174 raft_consensus.cc:2468] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 3.
I20260709 12:15:17.306102  1220 leader_election.cc:304] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.306810  1668 raft_consensus.cc:2749] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.307466  1679 raft_consensus.cc:2749] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:17.306597  1294 leader_election.cc:304] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.308395  1177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:17.309211  1177 raft_consensus.cc:2393] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 567b3ab021414d40a11f2335766ef697 in current term 3: Already voted for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in this term.
I20260709 12:15:17.309446  1294 leader_election.cc:304] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 567b3ab021414d40a11f2335766ef697
I20260709 12:15:17.309922  1180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:17.311647  1682 raft_consensus.cc:2804] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:17.310146  1173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:17.312464  1682 raft_consensus.cc:697] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:17.312588  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:17.313575  1682 consensus_queue.cc:237] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.310117  1679 raft_consensus.cc:2749] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.307727  1220 leader_election.cc:304] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.319720  1668 raft_consensus.cc:2749] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:17.319195  1220 leader_election.cc:304] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.321568  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:17.323071  1687 raft_consensus.cc:2749] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.321667  1220 leader_election.cc:304] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.325387  1220 leader_election.cc:304] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.325613  1687 raft_consensus.cc:2749] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.326467  1687 raft_consensus.cc:2749] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.327659  1220 leader_election.cc:304] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.328428  1668 raft_consensus.cc:2749] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.329382  1220 leader_election.cc:304] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.329981  1668 raft_consensus.cc:2749] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:17.330400  1220 leader_election.cc:304] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567b3ab021414d40a11f2335766ef697; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.331132  1668 raft_consensus.cc:2749] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:17.333295  1079 catalog_manager.cc:5697] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 2 to 3, leader changed from f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193) to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:17.415287  1323 raft_consensus.cc:1240] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Rejecting Update request from peer 567b3ab021414d40a11f2335766ef697 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:17.417075  1668 consensus_queue.cc:1059] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:17.417958  1687 raft_consensus.cc:3055] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:17.418293  1687 raft_consensus.cc:740] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:17.419173  1687 consensus_queue.cc:260] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.420511  1687 raft_consensus.cc:3060] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.434101  1323 raft_consensus.cc:1240] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Rejecting Update request from peer f9eb9edd0a764ac8aa8d9b262a5ede1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:17.435940  1684 consensus_queue.cc:1059] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:17.436988  1684 raft_consensus.cc:3055] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:17.437345  1684 raft_consensus.cc:740] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:17.438297  1684 consensus_queue.cc:260] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:17.439667  1684 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.451601  1256 raft_consensus.cc:1240] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Rejecting Update request from peer f9eb9edd0a764ac8aa8d9b262a5ede1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:17.453181  1684 consensus_queue.cc:1059] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:17.454150  1678 raft_consensus.cc:3055] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:17.454660  1678 raft_consensus.cc:740] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:17.455796  1678 consensus_queue.cc:260] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.457522  1678 raft_consensus.cc:3060] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.500293  1256 raft_consensus.cc:1240] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Rejecting Update request from peer f9eb9edd0a764ac8aa8d9b262a5ede1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:17.502269  1664 consensus_queue.cc:1059] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:17.503571  1678 raft_consensus.cc:3055] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:17.504065  1678 raft_consensus.cc:740] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:17.505591  1254 raft_consensus.cc:1240] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Rejecting Update request from peer f9eb9edd0a764ac8aa8d9b262a5ede1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:17.505097  1678 consensus_queue.cc:260] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.507283  1678 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.507293  1684 consensus_queue.cc:1059] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:17.508628  1664 raft_consensus.cc:3055] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:17.509019  1664 raft_consensus.cc:740] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:17.509876  1664 consensus_queue.cc:260] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.511058  1664 raft_consensus.cc:3060] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.577538  1327 raft_consensus.cc:1240] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Rejecting Update request from peer 567b3ab021414d40a11f2335766ef697 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:17.579090  1687 consensus_queue.cc:1059] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:17.580430  1668 raft_consensus.cc:3055] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:17.580837  1668 raft_consensus.cc:740] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:17.581640  1668 consensus_queue.cc:260] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:17.582682  1668 raft_consensus.cc:3060] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.711964  1254 raft_consensus.cc:1275] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:17.713372  1682 consensus_queue.cc:1048] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:17.727658  1174 raft_consensus.cc:1275] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:17.729598  1682 consensus_queue.cc:1048] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:17.857895 20891 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:17.885555  1327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f558375c464040b1ab3d898565a2190e"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
mode: GRACEFUL
new_leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:43668
I20260709 12:15:17.886185  1327 raft_consensus.cc:606] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Received request to transfer leadership to TS f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:17.887707 20891 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 1
I20260709 12:15:17.888208 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:17.893268 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:17.893647 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:18.289880  1679 raft_consensus.cc:993] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9: : Instructing follower f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:18.290545  1682 raft_consensus.cc:1081] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Signalling peer f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:18.292601  1175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f558375c464040b1ab3d898565a2190e"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:59854
I20260709 12:15:18.293340  1175 raft_consensus.cc:493] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:18.293716  1175 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:18.302304  1175 raft_consensus.cc:515] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.305321  1175 leader_election.cc:290] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 4 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:18.306061  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:18.306833  1254 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:18.307839  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f558375c464040b1ab3d898565a2190e" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:18.308619  1327 raft_consensus.cc:3055] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:18.309028  1327 raft_consensus.cc:740] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:18.310098  1327 consensus_queue.cc:260] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.311584  1327 raft_consensus.cc:3060] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:18.313865  1254 raft_consensus.cc:2468] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 4.
I20260709 12:15:18.315223  1146 leader_election.cc:304] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:18.315941  1664 raft_consensus.cc:2804] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:18.317178  1664 raft_consensus.cc:697] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:18.318068  1664 consensus_queue.cc:237] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.321635  1327 raft_consensus.cc:2468] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 4.
I20260709 12:15:18.325985  1079 catalog_manager.cc:5697] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 3 to 4, leader changed from 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195) to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 4 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.713508  1254 raft_consensus.cc:1275] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:15:18.714855  1664 consensus_queue.cc:1048] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:18.727066  1327 raft_consensus.cc:1275] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:15:18.732734  1664 consensus_queue.cc:1048] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:18.767987  1664 raft_consensus.cc:493] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.768647  1664 raft_consensus.cc:515] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.772703  1664 leader_election.cc:290] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:18.773291  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:18.773620  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:18.774478  1254 raft_consensus.cc:2468] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 2.
I20260709 12:15:18.775904  1146 leader_election.cc:304] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:18.777173  1664 raft_consensus.cc:2804] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:18.777635  1664 raft_consensus.cc:493] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.778045  1664 raft_consensus.cc:3060] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:18.785408  1664 raft_consensus.cc:515] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.787608  1664 leader_election.cc:290] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:18.788432  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:18.788921  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:18.789310  1254 raft_consensus.cc:3060] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:18.797256  1254 raft_consensus.cc:2468] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 3.
I20260709 12:15:18.798898  1146 leader_election.cc:304] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:18.799785  1664 raft_consensus.cc:2804] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:18.800280  1679 raft_consensus.cc:493] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:18.800944  1679 raft_consensus.cc:515] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.801290  1664 raft_consensus.cc:697] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:18.802421  1664 consensus_queue.cc:237] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.803920  1679 leader_election.cc:290] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:18.804746  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:18.805675  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78228434e6a4e5ba34c365405f52ae9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:18.806385  1254 raft_consensus.cc:2368] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 for earlier term 2. Current term is 3.
I20260709 12:15:18.807657  1295 leader_election.cc:400] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935) with higher term. Message: Invalid argument: T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 for earlier term 2. Current term is 3.
I20260709 12:15:18.808123  1295 leader_election.cc:403] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:18.808745  1679 raft_consensus.cc:3060] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:18.813966  1079 catalog_manager.cc:5697] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.816854  1679 raft_consensus.cc:2749] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935) with higher term. Message: Invalid argument: T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 for earlier term 2. Current term is 3.
I20260709 12:15:18.856082  1664 raft_consensus.cc:493] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.856880  1664 raft_consensus.cc:515] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.859277  1664 leader_election.cc:290] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:18.860180  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:18.860891  1254 raft_consensus.cc:2468] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 3.
I20260709 12:15:18.860551  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:18.862212  1146 leader_election.cc:304] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:18.863159  1664 raft_consensus.cc:2804] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:18.863510  1664 raft_consensus.cc:493] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.863798  1664 raft_consensus.cc:3060] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:18.869935  1664 raft_consensus.cc:515] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.871833  1664 leader_election.cc:290] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 4 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:18.872903  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:18.873196  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:18.873687  1254 raft_consensus.cc:3060] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:18.881510  1254 raft_consensus.cc:2468] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 4.
I20260709 12:15:18.882827  1146 leader_election.cc:304] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:18.884197  1664 raft_consensus.cc:2804] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:18.884985  1664 raft_consensus.cc:697] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:18.885931  1664 consensus_queue.cc:237] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.893121  1679 raft_consensus.cc:493] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.893826  1679 raft_consensus.cc:515] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:18.894973 20891 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:18.896979  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:18.896387  1079 catalog_manager.cc:5697] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.897631  1254 raft_consensus.cc:2468] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 3.
I20260709 12:15:18.898783  1295 leader_election.cc:304] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, 567b3ab021414d40a11f2335766ef697; no voters: 
I20260709 12:15:18.900337  1679 leader_election.cc:290] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923)
I20260709 12:15:18.901414  1682 raft_consensus.cc:2804] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:18.903240  1682 raft_consensus.cc:493] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.903910  1682 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:18.905856  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:18.906657  1174 raft_consensus.cc:2468] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 3.
I20260709 12:15:18.907932 20891 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:18.908747 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:18.911157  1664 raft_consensus.cc:493] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:18.913498  1682 raft_consensus.cc:515] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:18.912047  1664 raft_consensus.cc:515] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.915894  1682 leader_election.cc:290] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 4 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923)
I20260709 12:15:18.916806  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:18.917449  1254 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:18.917549  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717bb99c0ce249efa42d301b8de100fa" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:18.918159  1174 raft_consensus.cc:3060] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:18.919013  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:18.920076  1327 raft_consensus.cc:2393] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in current term 3: Already voted for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in this term.
I20260709 12:15:18.921131  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:18.921465  1664 leader_election.cc:290] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:18.921886  1256 raft_consensus.cc:2468] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 3.
I20260709 12:15:18.923125  1146 leader_election.cc:304] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:18.925767  1174 raft_consensus.cc:2468] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 4.
I20260709 12:15:18.927188  1294 leader_election.cc:304] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:18.928210  1711 raft_consensus.cc:2804] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:18.928683  1711 raft_consensus.cc:493] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 567b3ab021414d40a11f2335766ef697)
I20260709 12:15:18.929075  1711 raft_consensus.cc:3060] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:18.930161  1682 raft_consensus.cc:2804] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:18.930946  1682 raft_consensus.cc:697] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:18.932184 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:18.931923  1682 consensus_queue.cc:237] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } }
I20260709 12:15:18.932870 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:18.935554  1679 raft_consensus.cc:493] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:18.936184  1679 raft_consensus.cc:515] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.938408  1679 leader_election.cc:290] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:18.938915  1679 raft_consensus.cc:493] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:18.939368  1679 raft_consensus.cc:515] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.942116  1254 raft_consensus.cc:2468] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 4.
I20260709 12:15:18.944294  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:18.947949  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:18.948721  1174 raft_consensus.cc:2468] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 3.
I20260709 12:15:18.950007  1294 leader_election.cc:304] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:18.951333  1679 leader_election.cc:290] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:18.956843  1679 raft_consensus.cc:2804] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:18.957320  1679 raft_consensus.cc:493] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f9eb9edd0a764ac8aa8d9b262a5ede1b)
I20260709 12:15:18.957767  1679 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:18.955721  1711 raft_consensus.cc:515] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.967783  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:18.969105  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:18.970196  1327 raft_consensus.cc:2393] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in current term 3: Already voted for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in this term.
I20260709 12:15:18.971894  1711 leader_election.cc:290] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:18.976024  1679 raft_consensus.cc:515] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.981858  1717 raft_consensus.cc:493] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.982856  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:18.983287  1256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9db7b42f8bd4126a260b045a9ade1f9" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:18.984207  1256 raft_consensus.cc:2368] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 for earlier term 3. Current term is 4.
I20260709 12:15:18.984040  1247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:18.984886  1247 raft_consensus.cc:2393] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in current term 3: Already voted for candidate 567b3ab021414d40a11f2335766ef697 in this term.
I20260709 12:15:18.982582  1717 raft_consensus.cc:515] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:18.987845  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:18.988587  1175 raft_consensus.cc:2468] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 1.
I20260709 12:15:18.989928  1294 leader_election.cc:304] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:18.993240  1174 raft_consensus.cc:2468] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 3.
I20260709 12:15:18.992599  1079 catalog_manager.cc:5697] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 2 to 4, leader changed from f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193) to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 4 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.988009  1295 leader_election.cc:400] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935) with higher term. Message: Invalid argument: T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 for earlier term 3. Current term is 4.
I20260709 12:15:18.995139  1295 leader_election.cc:403] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:18.995517  1682 raft_consensus.cc:2804] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:18.996061  1682 raft_consensus.cc:493] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.996433  1682 raft_consensus.cc:3060] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:19.001191  1679 leader_election.cc:290] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:19.002066  1679 raft_consensus.cc:3060] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:15:19.009280  1717 leader_election.cc:290] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:18.988835  1254 raft_consensus.cc:2468] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 3.
I20260709 12:15:19.009888  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:19.010967  1249 raft_consensus.cc:2393] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in current term 3: Already voted for candidate 567b3ab021414d40a11f2335766ef697 in this term.
I20260709 12:15:19.012300  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:19.012993  1249 raft_consensus.cc:2468] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 2.
I20260709 12:15:19.018604  1679 raft_consensus.cc:2749] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935) with higher term. Message: Invalid argument: T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 for earlier term 3. Current term is 4.
I20260709 12:15:19.020743  1146 leader_election.cc:304] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 0e0756a5326d4bbc8fd151f0ab60f9d9
I20260709 12:15:19.020965  1682 raft_consensus.cc:515] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:19.022349  1711 raft_consensus.cc:2804] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:19.022935  1711 raft_consensus.cc:697] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:19.023835  1711 consensus_queue.cc:237] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:19.025816  1682 leader_election.cc:290] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:19.028817  1249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:19.029507  1249 raft_consensus.cc:3060] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:19.032902  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1979d71c86a46f99fed559c0860552a" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:19.033615  1174 raft_consensus.cc:3060] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:19.043514  1174 raft_consensus.cc:2468] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 3.
I20260709 12:15:19.044991  1294 leader_election.cc:304] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 567b3ab021414d40a11f2335766ef697
I20260709 12:15:19.048098  1719 raft_consensus.cc:2804] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:19.049173  1294 leader_election.cc:304] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:19.049678  1719 raft_consensus.cc:697] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:19.050868  1718 raft_consensus.cc:2804] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:19.051508  1718 raft_consensus.cc:697] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Becoming Leader. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:19.055546  1718 consensus_queue.cc:237] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:19.051340  1719 consensus_queue.cc:237] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:19.059008  1249 raft_consensus.cc:2468] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0756a5326d4bbc8fd151f0ab60f9d9 in term 3.
I20260709 12:15:19.076131  1079 catalog_manager.cc:5697] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 2 to 3, leader changed from 567b3ab021414d40a11f2335766ef697 (127.20.102.194) to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 3 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:19.078771  1075 catalog_manager.cc:5697] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 2 to 3, leader changed from f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193) to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:19.096103  1075 catalog_manager.cc:5697] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 reported cstate change: term changed from 1 to 3, leader changed from 567b3ab021414d40a11f2335766ef697 (127.20.102.194) to 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:19.243009  1249 raft_consensus.cc:1275] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:19.244511  1711 consensus_queue.cc:1048] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:19.247742  1723 raft_consensus.cc:493] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.248724  1723 raft_consensus.cc:515] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:19.252893  1723 leader_election.cc:290] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:19.253588  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:19.254259  1174 raft_consensus.cc:2468] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 3.
I20260709 12:15:19.254539  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" is_pre_election: true
I20260709 12:15:19.256309  1220 leader_election.cc:304] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:19.261813  1327 raft_consensus.cc:1275] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:19.262461  1702 raft_consensus.cc:2804] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:19.263072  1702 raft_consensus.cc:493] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.263603  1702 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:19.263859  1711 consensus_queue.cc:1048] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:19.284230  1327 raft_consensus.cc:1275] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:19.287441  1729 consensus_queue.cc:1048] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:19.311769  1702 raft_consensus.cc:515] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:19.332319  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:19.333065  1174 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:19.335784  1249 raft_consensus.cc:1275] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:19.337560  1729 consensus_queue.cc:1048] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:19.340332  1175 raft_consensus.cc:1275] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:19.342160  1719 consensus_queue.cc:1048] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:19.353899  1174 raft_consensus.cc:2468] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 4.
I20260709 12:15:19.362296  1702 leader_election.cc:290] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 4 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:19.373446  1220 leader_election.cc:304] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:19.377234  1702 raft_consensus.cc:2804] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:19.377790  1702 raft_consensus.cc:697] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 4 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:19.378743  1702 consensus_queue.cc:237] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:19.363449  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7b632cf7f349bd8aa202f48c793a5b" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:19.368944  1254 raft_consensus.cc:1275] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:19.384089  1719 consensus_queue.cc:1048] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:19.411469  1079 catalog_manager.cc:5697] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 3 to 4, leader changed from 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195) to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 4 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:19.475556  1174 raft_consensus.cc:1240] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Rejecting Update request from peer 0e0756a5326d4bbc8fd151f0ab60f9d9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:19.477414  1718 consensus_queue.cc:1059] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:19.478379  1719 raft_consensus.cc:3055] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:19.478865  1719 raft_consensus.cc:740] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:19.479878  1719 consensus_queue.cc:260] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:19.481389  1719 raft_consensus.cc:3060] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:19.535341  1174 raft_consensus.cc:1275] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:19.538086  1249 raft_consensus.cc:1275] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:19.539036  1718 consensus_queue.cc:1048] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:19.539717  1719 raft_consensus.cc:493] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.539764  1729 consensus_queue.cc:1048] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:19.540365  1719 raft_consensus.cc:515] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:19.543836  1719 leader_election.cc:290] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935)
I20260709 12:15:19.543890  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "567b3ab021414d40a11f2335766ef697" is_pre_election: true
I20260709 12:15:19.545941  1175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979d2968adb84948a04dddbfd06254ac" candidate_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" is_pre_election: true
I20260709 12:15:19.548564  1294 leader_election.cc:304] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0756a5326d4bbc8fd151f0ab60f9d9; no voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:19.554886  1718 raft_consensus.cc:2749] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:19.565495  1254 raft_consensus.cc:1275] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Refusing update from remote peer 0e0756a5326d4bbc8fd151f0ab60f9d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:19.568153  1330 raft_consensus.cc:1275] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:19.570699  1664 consensus_queue.cc:1048] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:19.571422  1718 consensus_queue.cc:1048] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:19.918098  1330 raft_consensus.cc:1275] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:15:19.919171  1330 pending_rounds.cc:85] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Aborting all ops after (but not including) 3
I20260709 12:15:19.919507  1330 pending_rounds.cc:107] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:15:19.919945  1330 raft_consensus.cc:2889] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:19.922513  1702 consensus_queue.cc:1048] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:19.934638 20891 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:19.948289  1174 raft_consensus.cc:1275] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:19.954455  1742 consensus_queue.cc:1048] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:19.959151  1330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
mode: GRACEFUL
new_leader_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:43668
I20260709 12:15:19.960959  1330 raft_consensus.cc:606] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 LEADER]: Received request to transfer leadership to TS 567b3ab021414d40a11f2335766ef697
I20260709 12:15:19.963932 20891 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 1
I20260709 12:15:19.965142 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:19.986488  1330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02"
dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
mode: GRACEFUL
new_leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:43668
I20260709 12:15:19.987181  1330 raft_consensus.cc:606] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Received request to transfer leadership to TS f9eb9edd0a764ac8aa8d9b262a5ede1b
I20260709 12:15:19.992340 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:15:19.993103 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:20.129577  1719 raft_consensus.cc:993] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: : Instructing follower 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:20.130293  1719 raft_consensus.cc:1081] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 LEADER]: Signalling peer 567b3ab021414d40a11f2335766ef697 to start an election
I20260709 12:15:20.133064  1254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa"
dest_uuid: "567b3ab021414d40a11f2335766ef697"
 from {username='slave'} at 127.0.0.1:57054
I20260709 12:15:20.133831  1254 raft_consensus.cc:493] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:20.134276  1254 raft_consensus.cc:3060] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:20.146486  1254 raft_consensus.cc:515] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:20.149410  1254 leader_election.cc:290] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 election: Requested vote from peers f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:20.150213  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:20.150283  1174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b425916a27b1431d89f493bea6c130fa" candidate_uuid: "567b3ab021414d40a11f2335766ef697" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
I20260709 12:15:20.151223  1330 raft_consensus.cc:3055] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:20.151319  1174 raft_consensus.cc:3060] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:20.151741  1330 raft_consensus.cc:740] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:20.153164  1330 consensus_queue.cc:260] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:20.154933  1330 raft_consensus.cc:3060] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:20.164605  1174 raft_consensus.cc:2468] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 3.
I20260709 12:15:20.166554  1220 leader_election.cc:304] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:20.167708  1741 raft_consensus.cc:2804] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:20.168306  1741 raft_consensus.cc:697] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 3 LEADER]: Becoming Leader. State: Replica: 567b3ab021414d40a11f2335766ef697, State: Running, Role: LEADER
I20260709 12:15:20.170006  1330 raft_consensus.cc:2468] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567b3ab021414d40a11f2335766ef697 in term 3.
I20260709 12:15:20.169560  1741 consensus_queue.cc:237] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:20.181365  1075 catalog_manager.cc:5697] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 reported cstate change: term changed from 2 to 3, leader changed from 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195) to 567b3ab021414d40a11f2335766ef697 (127.20.102.194). New cstate: current_term: 3 leader_uuid: "567b3ab021414d40a11f2335766ef697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.376428  1717 raft_consensus.cc:993] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9: : Instructing follower f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:20.376976  1717 raft_consensus.cc:1081] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Signalling peer f9eb9edd0a764ac8aa8d9b262a5ede1b to start an election
I20260709 12:15:20.378994  1174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02"
dest_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b"
 from {username='slave'} at 127.0.0.1:59854
I20260709 12:15:20.379676  1174 raft_consensus.cc:493] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:20.380105  1174 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:20.390169  1174 raft_consensus.cc:515] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:20.392550  1174 leader_election.cc:290] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 4 election: Requested vote from peers 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935), 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195:34771)
I20260709 12:15:20.393442  1247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "567b3ab021414d40a11f2335766ef697"
I20260709 12:15:20.394229  1247 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:20.394791  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b419223e89524e338b9d20ba52f89e02" candidate_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9"
I20260709 12:15:20.395588  1330 raft_consensus.cc:3055] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:20.395900  1330 raft_consensus.cc:740] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0e0756a5326d4bbc8fd151f0ab60f9d9, State: Running, Role: LEADER
I20260709 12:15:20.396970  1330 consensus_queue.cc:260] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:20.398424  1330 raft_consensus.cc:3060] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:20.402693  1247 raft_consensus.cc:2468] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 4.
I20260709 12:15:20.404537  1146 leader_election.cc:304] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567b3ab021414d40a11f2335766ef697, f9eb9edd0a764ac8aa8d9b262a5ede1b; no voters: 
I20260709 12:15:20.405898  1711 raft_consensus.cc:2804] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:20.406441  1711 raft_consensus.cc:697] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 LEADER]: Becoming Leader. State: Replica: f9eb9edd0a764ac8aa8d9b262a5ede1b, State: Running, Role: LEADER
I20260709 12:15:20.407559  1711 consensus_queue.cc:237] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } }
I20260709 12:15:20.407855  1330 raft_consensus.cc:2468] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9eb9edd0a764ac8aa8d9b262a5ede1b in term 4.
I20260709 12:15:20.418749  1075 catalog_manager.cc:5697] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b reported cstate change: term changed from 3 to 4, leader changed from 0e0756a5326d4bbc8fd151f0ab60f9d9 (127.20.102.195) to f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193). New cstate: current_term: 4 leader_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.729336  1174 raft_consensus.cc:1275] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:20.730983  1702 consensus_queue.cc:1048] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9eb9edd0a764ac8aa8d9b262a5ede1b" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:20.747280  1327 raft_consensus.cc:1275] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Refusing update from remote peer 567b3ab021414d40a11f2335766ef697: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:20.749114  1702 consensus_queue.cc:1048] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:20.968158  1327 raft_consensus.cc:1275] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:20.969740  1711 consensus_queue.cc:1048] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0756a5326d4bbc8fd151f0ab60f9d9" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:20.981768  1247 raft_consensus.cc:1275] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Refusing update from remote peer f9eb9edd0a764ac8aa8d9b262a5ede1b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:20.983722  1711 consensus_queue.cc:1048] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567b3ab021414d40a11f2335766ef697" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:20.994881 20891 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:21.002038 20891 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:21.002624 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:21.008165 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:21.008710 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:22.009764 20891 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:22.015043 20891 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:22.015504 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:22.020339 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:22.020759 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:23.091292 20891 tablet_server.cc:179] TabletServer@127.20.102.193:0 shutting down...
W20260709 12:15:23.112088  1294 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 12:15:23.117123  1294 consensus_peers.cc:597] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 -> Peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Couldn't send request to peer f9eb9edd0a764ac8aa8d9b262a5ede1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:23.117405  1220 consensus_peers.cc:597] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 -> Peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Couldn't send request to peer f9eb9edd0a764ac8aa8d9b262a5ede1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:23.131170  1220 consensus_peers.cc:597] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 -> Peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Couldn't send request to peer f9eb9edd0a764ac8aa8d9b262a5ede1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.140086 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:23.141044 20891 tablet_replica.cc:333] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.142171 20891 raft_consensus.cc:2243] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.142818 20891 raft_consensus.cc:2272] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.145394 20891 tablet_replica.cc:333] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.146095 20891 raft_consensus.cc:2243] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.146744 20891 raft_consensus.cc:2272] T f77ba639d67a401fba2e19f66e001490 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.150086 20891 tablet_replica.cc:333] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.150810 20891 raft_consensus.cc:2243] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.151301 20891 raft_consensus.cc:2272] T 7c7b632cf7f349bd8aa202f48c793a5b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.154361 20891 tablet_replica.cc:333] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.155251 20891 raft_consensus.cc:2243] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.156477 20891 raft_consensus.cc:2272] T 979d2968adb84948a04dddbfd06254ac P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:23.160216  1294 consensus_peers.cc:597] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 -> Peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Couldn't send request to peer f9eb9edd0a764ac8aa8d9b262a5ede1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.160377 20891 tablet_replica.cc:333] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.161579 20891 raft_consensus.cc:2243] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:15:23.162371  1220 consensus_peers.cc:597] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 -> Peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Couldn't send request to peer f9eb9edd0a764ac8aa8d9b262a5ede1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.162992 20891 raft_consensus.cc:2272] T a78228434e6a4e5ba34c365405f52ae9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.166172 20891 tablet_replica.cc:333] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.166991 20891 raft_consensus.cc:2243] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.167621 20891 raft_consensus.cc:2272] T 6ca350a9e24f462d908bd22c056f20ab P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.171110 20891 tablet_replica.cc:333] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.171916 20891 raft_consensus.cc:2243] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.172608 20891 raft_consensus.cc:2272] T afc36569b2714f7f8876619bcd4b68f7 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.176797 20891 tablet_replica.cc:333] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.177825 20891 raft_consensus.cc:2243] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.178591 20891 raft_consensus.cc:2272] T 6436eba65441457b99ce713e85078a61 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.181890 20891 tablet_replica.cc:333] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.182591 20891 raft_consensus.cc:2243] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.183576 20891 raft_consensus.cc:2272] T a9db7b42f8bd4126a260b045a9ade1f9 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.187076 20891 tablet_replica.cc:333] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.188014 20891 raft_consensus.cc:2243] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.189024 20891 raft_consensus.cc:2272] T f558375c464040b1ab3d898565a2190e P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.191730 20891 tablet_replica.cc:333] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.192489 20891 raft_consensus.cc:2243] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.193154 20891 raft_consensus.cc:2272] T a896862e9a0b44ff8d3fa4b2bb964963 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.195641 20891 tablet_replica.cc:333] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.196307 20891 raft_consensus.cc:2243] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.196907 20891 raft_consensus.cc:2272] T 0789a7d9e74942bcb0ba16bb0e23971b P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.199714 20891 tablet_replica.cc:333] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.200393 20891 raft_consensus.cc:2243] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.201077 20891 raft_consensus.cc:2272] T f1979d71c86a46f99fed559c0860552a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.203641 20891 tablet_replica.cc:333] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.204326 20891 raft_consensus.cc:2243] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.205438 20891 raft_consensus.cc:2272] T f2a11cb3a10944eb8a6998df9073c95a P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.208142 20891 tablet_replica.cc:333] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.208814 20891 raft_consensus.cc:2243] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.209710 20891 raft_consensus.cc:2272] T b419223e89524e338b9d20ba52f89e02 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.212420 20891 tablet_replica.cc:333] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.213093 20891 raft_consensus.cc:2243] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.213691 20891 raft_consensus.cc:2272] T b425916a27b1431d89f493bea6c130fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.217128 20891 tablet_replica.cc:333] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.217757 20891 raft_consensus.cc:2243] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.218351 20891 raft_consensus.cc:2272] T 0e4c21e7be2741f1bc802fff60713945 P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.220906 20891 tablet_replica.cc:333] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b: stopping tablet replica
I20260709 12:15:23.221477 20891 raft_consensus.cc:2243] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.221982 20891 raft_consensus.cc:2272] T 717bb99c0ce249efa42d301b8de100fa P f9eb9edd0a764ac8aa8d9b262a5ede1b [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:23.235404  1294 consensus_peers.cc:597] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 -> Peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Couldn't send request to peer f9eb9edd0a764ac8aa8d9b262a5ede1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.277971 20891 tablet_server.cc:196] TabletServer@127.20.102.193:0 shutdown complete.
W20260709 12:15:23.325052  1220 consensus_peers.cc:597] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 -> Peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Couldn't send request to peer f9eb9edd0a764ac8aa8d9b262a5ede1b. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.335582 20891 tablet_server.cc:179] TabletServer@127.20.102.194:0 shutting down...
I20260709 12:15:23.381855 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:23.382822 20891 tablet_replica.cc:333] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
W20260709 12:15:23.383617  1294 consensus_peers.cc:597] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 -> Peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Couldn't send request to peer f9eb9edd0a764ac8aa8d9b262a5ede1b. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.384012 20891 raft_consensus.cc:2243] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.384955 20891 raft_consensus.cc:2272] T f77ba639d67a401fba2e19f66e001490 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.387449 20891 tablet_replica.cc:333] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.388096 20891 raft_consensus.cc:2243] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.389052 20891 raft_consensus.cc:2272] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.391909 20891 tablet_replica.cc:333] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.392745 20891 raft_consensus.cc:2243] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.393774 20891 raft_consensus.cc:2272] T 7c7b632cf7f349bd8aa202f48c793a5b P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:23.394464  1295 consensus_peers.cc:597] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 -> Peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935): Couldn't send request to peer 567b3ab021414d40a11f2335766ef697. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.396183 20891 tablet_replica.cc:333] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.396963 20891 raft_consensus.cc:2243] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.397496 20891 raft_consensus.cc:2272] T 979d2968adb84948a04dddbfd06254ac P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.400707 20891 tablet_replica.cc:333] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.401314 20891 raft_consensus.cc:2243] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.402477 20891 raft_consensus.cc:2272] T 6436eba65441457b99ce713e85078a61 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:23.403286  1294 consensus_peers.cc:597] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 -> Peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Couldn't send request to peer f9eb9edd0a764ac8aa8d9b262a5ede1b. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.405159 20891 tablet_replica.cc:333] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.405779 20891 raft_consensus.cc:2243] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.406260 20891 raft_consensus.cc:2272] T a9db7b42f8bd4126a260b045a9ade1f9 P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.408339 20891 tablet_replica.cc:333] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.408905 20891 raft_consensus.cc:2243] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.409704 20891 raft_consensus.cc:2272] T afc36569b2714f7f8876619bcd4b68f7 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.411674 20891 tablet_replica.cc:333] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.412379 20891 raft_consensus.cc:2243] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.412974 20891 raft_consensus.cc:2272] T f558375c464040b1ab3d898565a2190e P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.415208 20891 tablet_replica.cc:333] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.415824 20891 raft_consensus.cc:2243] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.416222 20891 raft_consensus.cc:2272] T f1979d71c86a46f99fed559c0860552a P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.418390 20891 tablet_replica.cc:333] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.418893 20891 raft_consensus.cc:2243] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.419287 20891 raft_consensus.cc:2272] T b419223e89524e338b9d20ba52f89e02 P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.421520 20891 tablet_replica.cc:333] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.422055 20891 raft_consensus.cc:2243] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.422508 20891 raft_consensus.cc:2272] T f2a11cb3a10944eb8a6998df9073c95a P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.425021 20891 tablet_replica.cc:333] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.425721 20891 raft_consensus.cc:2243] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.426223 20891 raft_consensus.cc:2272] T 717bb99c0ce249efa42d301b8de100fa P 567b3ab021414d40a11f2335766ef697 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.428649 20891 tablet_replica.cc:333] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.429373 20891 raft_consensus.cc:2243] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.430157 20891 raft_consensus.cc:2272] T b425916a27b1431d89f493bea6c130fa P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:23.430253  1294 consensus_peers.cc:597] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 -> Peer f9eb9edd0a764ac8aa8d9b262a5ede1b (127.20.102.193:39923): Couldn't send request to peer f9eb9edd0a764ac8aa8d9b262a5ede1b. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:39923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.432366 20891 tablet_replica.cc:333] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.433101 20891 raft_consensus.cc:2243] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.433593 20891 raft_consensus.cc:2272] T 0e4c21e7be2741f1bc802fff60713945 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.435676 20891 tablet_replica.cc:333] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.436229 20891 raft_consensus.cc:2243] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.436666 20891 raft_consensus.cc:2272] T a896862e9a0b44ff8d3fa4b2bb964963 P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.439229 20891 tablet_replica.cc:333] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.439744 20891 raft_consensus.cc:2243] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.440593 20891 raft_consensus.cc:2272] T 0789a7d9e74942bcb0ba16bb0e23971b P 567b3ab021414d40a11f2335766ef697 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.442924 20891 tablet_replica.cc:333] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.443451 20891 raft_consensus.cc:2243] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.443907 20891 raft_consensus.cc:2272] T a78228434e6a4e5ba34c365405f52ae9 P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.446085 20891 tablet_replica.cc:333] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697: stopping tablet replica
I20260709 12:15:23.446581 20891 raft_consensus.cc:2243] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.447048 20891 raft_consensus.cc:2272] T 6ca350a9e24f462d908bd22c056f20ab P 567b3ab021414d40a11f2335766ef697 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.492719 20891 tablet_server.cc:196] TabletServer@127.20.102.194:0 shutdown complete.
I20260709 12:15:23.552492 20891 tablet_server.cc:179] TabletServer@127.20.102.195:0 shutting down...
W20260709 12:15:23.558473  1295 consensus_peers.cc:597] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 -> Peer 567b3ab021414d40a11f2335766ef697 (127.20.102.194:38935): Couldn't send request to peer 567b3ab021414d40a11f2335766ef697. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.194:38935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.594826 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:23.595865 20891 tablet_replica.cc:333] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.596850 20891 raft_consensus.cc:2243] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.597553 20891 raft_consensus.cc:2272] T 979d2968adb84948a04dddbfd06254ac P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.600241 20891 tablet_replica.cc:333] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.601013 20891 raft_consensus.cc:2243] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.602066 20891 raft_consensus.cc:2272] T f77ba639d67a401fba2e19f66e001490 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.604540 20891 tablet_replica.cc:333] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.605283 20891 raft_consensus.cc:2243] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.605878 20891 raft_consensus.cc:2272] T 4f5b3b1001ed4e6fba7805e7fcdfdf87 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.608363 20891 tablet_replica.cc:333] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.609095 20891 raft_consensus.cc:2243] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.609728 20891 raft_consensus.cc:2272] T 7c7b632cf7f349bd8aa202f48c793a5b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.612162 20891 tablet_replica.cc:333] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.612859 20891 raft_consensus.cc:2243] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.613443 20891 raft_consensus.cc:2272] T f558375c464040b1ab3d898565a2190e P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.615995 20891 tablet_replica.cc:333] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.616652 20891 raft_consensus.cc:2243] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.617198 20891 raft_consensus.cc:2272] T a9db7b42f8bd4126a260b045a9ade1f9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.619634 20891 tablet_replica.cc:333] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.620271 20891 raft_consensus.cc:2243] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.620903 20891 raft_consensus.cc:2272] T 6436eba65441457b99ce713e85078a61 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.623580 20891 tablet_replica.cc:333] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.624245 20891 raft_consensus.cc:2243] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.624728 20891 raft_consensus.cc:2272] T b425916a27b1431d89f493bea6c130fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.627043 20891 tablet_replica.cc:333] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.627650 20891 raft_consensus.cc:2243] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.628671 20891 raft_consensus.cc:2272] T 0e4c21e7be2741f1bc802fff60713945 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.631229 20891 tablet_replica.cc:333] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.631850 20891 raft_consensus.cc:2243] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.632395 20891 raft_consensus.cc:2272] T afc36569b2714f7f8876619bcd4b68f7 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.634763 20891 tablet_replica.cc:333] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.635385 20891 raft_consensus.cc:2243] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.636368 20891 raft_consensus.cc:2272] T a896862e9a0b44ff8d3fa4b2bb964963 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.638975 20891 tablet_replica.cc:333] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.639612 20891 raft_consensus.cc:2243] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.640177 20891 raft_consensus.cc:2272] T 0789a7d9e74942bcb0ba16bb0e23971b P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.642554 20891 tablet_replica.cc:333] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.643213 20891 raft_consensus.cc:2243] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.644234 20891 raft_consensus.cc:2272] T f1979d71c86a46f99fed559c0860552a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.646842 20891 tablet_replica.cc:333] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.647502 20891 raft_consensus.cc:2243] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.648079 20891 raft_consensus.cc:2272] T f2a11cb3a10944eb8a6998df9073c95a P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.650707 20891 tablet_replica.cc:333] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.651296 20891 raft_consensus.cc:2243] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.651793 20891 raft_consensus.cc:2272] T b419223e89524e338b9d20ba52f89e02 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.654312 20891 tablet_replica.cc:333] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.654902 20891 raft_consensus.cc:2243] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.655455 20891 raft_consensus.cc:2272] T a78228434e6a4e5ba34c365405f52ae9 P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.657982 20891 tablet_replica.cc:333] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.658610 20891 raft_consensus.cc:2243] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.659554 20891 raft_consensus.cc:2272] T 6ca350a9e24f462d908bd22c056f20ab P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.662300 20891 tablet_replica.cc:333] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9: stopping tablet replica
I20260709 12:15:23.662940 20891 raft_consensus.cc:2243] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.663935 20891 raft_consensus.cc:2272] T 717bb99c0ce249efa42d301b8de100fa P 0e0756a5326d4bbc8fd151f0ab60f9d9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.714461 20891 tablet_server.cc:196] TabletServer@127.20.102.195:0 shutdown complete.
I20260709 12:15:23.754817 20891 master.cc:562] Master@127.20.102.254:39127 shutting down...
I20260709 12:15:23.782825 20891 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.783393 20891 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.783685 20891 tablet_replica.cc:333] T 00000000000000000000000000000000 P e650a36b445644ea83b1ae57f0ea24a1: stopping tablet replica
I20260709 12:15:23.824016 20891 master.cc:584] Master@127.20.102.254:39127 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (22361 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:15:23.894459 20891 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.102.254:33247
I20260709 12:15:23.895800 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:23.902442  1771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:23.902462  1770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:23.904218 20891 server_base.cc:1061] running on GCE node
W20260709 12:15:23.904883  1773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:23.906030 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:23.906297 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:23.906502 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599323906469 us; error 0 us; skew 500 ppm
I20260709 12:15:23.907069 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:23.909926 20891 webserver.cc:533] Webserver started at http://127.20.102.254:38425/ using document root <none> and password file <none>
I20260709 12:15:23.910504 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:23.910682 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:23.911055 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:23.912364 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/master-0-root/instance:
uuid: "ff9d51f7069245e7bb47ca72189c3e26"
format_stamp: "Formatted at 2026-07-09 12:15:23 on dist-test-slave-296p"
I20260709 12:15:23.917475 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:15:23.921511  1778 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:23.922477 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:15:23.922963 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/master-0-root
uuid: "ff9d51f7069245e7bb47ca72189c3e26"
format_stamp: "Formatted at 2026-07-09 12:15:23 on dist-test-slave-296p"
I20260709 12:15:23.923399 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:23.935601 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:23.937140 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:23.987329 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.254:33247
I20260709 12:15:23.987478  1829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.254:33247 every 8 connection(s)
I20260709 12:15:23.991919  1830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.003834  1830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26: Bootstrap starting.
I20260709 12:15:24.009128  1830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.014364  1830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26: No bootstrap required, opened a new log
I20260709 12:15:24.016902  1830 raft_consensus.cc:359] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d51f7069245e7bb47ca72189c3e26" member_type: VOTER }
I20260709 12:15:24.017334  1830 raft_consensus.cc:385] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.017632  1830 raft_consensus.cc:740] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff9d51f7069245e7bb47ca72189c3e26, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.018354  1830 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d51f7069245e7bb47ca72189c3e26" member_type: VOTER }
I20260709 12:15:24.018899  1830 raft_consensus.cc:399] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:24.019132  1830 raft_consensus.cc:493] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:24.019491  1830 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.025077  1830 raft_consensus.cc:515] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d51f7069245e7bb47ca72189c3e26" member_type: VOTER }
I20260709 12:15:24.025768  1830 leader_election.cc:304] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff9d51f7069245e7bb47ca72189c3e26; no voters: 
I20260709 12:15:24.027176  1830 leader_election.cc:290] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:24.027817  1833 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.029749  1833 raft_consensus.cc:697] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [term 1 LEADER]: Becoming Leader. State: Replica: ff9d51f7069245e7bb47ca72189c3e26, State: Running, Role: LEADER
I20260709 12:15:24.030684  1830 sys_catalog.cc:565] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:24.030592  1833 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d51f7069245e7bb47ca72189c3e26" member_type: VOTER }
I20260709 12:15:24.036710  1834 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff9d51f7069245e7bb47ca72189c3e26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d51f7069245e7bb47ca72189c3e26" member_type: VOTER } }
I20260709 12:15:24.036849  1835 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff9d51f7069245e7bb47ca72189c3e26. Latest consensus state: current_term: 1 leader_uuid: "ff9d51f7069245e7bb47ca72189c3e26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d51f7069245e7bb47ca72189c3e26" member_type: VOTER } }
I20260709 12:15:24.037631  1834 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:24.037659  1835 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:24.043130  1842 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:24.050542  1842 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:24.051800 20891 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:24.061726  1842 catalog_manager.cc:1383] Generated new cluster ID: cf8402aeeca249a5b583e86b8ce3a0e4
I20260709 12:15:24.062096  1842 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:24.114308  1842 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:24.116098  1842 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:24.141779  1842 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26: Generated new TSK 0
I20260709 12:15:24.142735  1842 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:24.183656 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:24.191126  1851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:24.192222  1852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:24.195676 20891 server_base.cc:1061] running on GCE node
W20260709 12:15:24.195602  1854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:24.197345 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:24.197556 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:24.197683 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599324197671 us; error 0 us; skew 500 ppm
I20260709 12:15:24.198232 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:24.200913 20891 webserver.cc:533] Webserver started at http://127.20.102.193:45881/ using document root <none> and password file <none>
I20260709 12:15:24.201460 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:24.201639 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:24.201877 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:24.202999 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-0-root/instance:
uuid: "9ba5ba0aeb514c019743af20c0968a00"
format_stamp: "Formatted at 2026-07-09 12:15:24 on dist-test-slave-296p"
I20260709 12:15:24.207912 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:15:24.211632  1859 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:24.212893 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:24.213351 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-0-root
uuid: "9ba5ba0aeb514c019743af20c0968a00"
format_stamp: "Formatted at 2026-07-09 12:15:24 on dist-test-slave-296p"
I20260709 12:15:24.213711 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:24.233743 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:24.235141 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:24.236874 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:24.239471 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:24.239657 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:24.239984 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:24.240190 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:24.289354 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.193:33655
I20260709 12:15:24.289513  1921 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.193:33655 every 8 connection(s)
I20260709 12:15:24.295413 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:24.303364  1926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:24.305241  1927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:24.308625  1930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:24.311487 20891 server_base.cc:1061] running on GCE node
I20260709 12:15:24.313298 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:24.313594 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:24.313832 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599324313810 us; error 0 us; skew 500 ppm
I20260709 12:15:24.314025  1922 heartbeater.cc:344] Connected to a master server at 127.20.102.254:33247
I20260709 12:15:24.314514  1922 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:24.314563 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:24.315502  1922 heartbeater.cc:507] Master 127.20.102.254:33247 requested a full tablet report, sending...
I20260709 12:15:24.318154  1795 ts_manager.cc:194] Registered new tserver with Master: 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655)
I20260709 12:15:24.318259 20891 webserver.cc:533] Webserver started at http://127.20.102.194:38441/ using document root <none> and password file <none>
I20260709 12:15:24.319031 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:24.319249 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:24.319563 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:24.320257  1795 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60736
I20260709 12:15:24.321079 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-1-root/instance:
uuid: "45281c12ca694ae1bbd01c89f0cf5899"
format_stamp: "Formatted at 2026-07-09 12:15:24 on dist-test-slave-296p"
I20260709 12:15:24.326730 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:15:24.330937  1934 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:24.331976 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:24.332449 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-1-root
uuid: "45281c12ca694ae1bbd01c89f0cf5899"
format_stamp: "Formatted at 2026-07-09 12:15:24 on dist-test-slave-296p"
I20260709 12:15:24.332912 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:24.354931 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:24.356389 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:24.358318 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:24.361171 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:24.361584 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:24.361912 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:24.362074 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:24.411641 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.194:37375
I20260709 12:15:24.411747  1996 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.194:37375 every 8 connection(s)
I20260709 12:15:24.417407 20891 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:24.425781  2000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:24.429875  2001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:24.430794  2003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:24.431474 20891 server_base.cc:1061] running on GCE node
I20260709 12:15:24.432837  1997 heartbeater.cc:344] Connected to a master server at 127.20.102.254:33247
I20260709 12:15:24.432912 20891 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:24.433380 20891 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:24.433451  1997 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:24.433632 20891 hybrid_clock.cc:648] HybridClock initialized: now 1783599324433611 us; error 0 us; skew 500 ppm
I20260709 12:15:24.434419  1997 heartbeater.cc:507] Master 127.20.102.254:33247 requested a full tablet report, sending...
I20260709 12:15:24.434520 20891 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:24.437420  1795 ts_manager.cc:194] Registered new tserver with Master: 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:24.437832 20891 webserver.cc:533] Webserver started at http://127.20.102.195:40065/ using document root <none> and password file <none>
I20260709 12:15:24.438454 20891 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:24.438657 20891 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:24.439092 20891 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:24.439338  1795 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60744
I20260709 12:15:24.440362 20891 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-2-root/instance:
uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
format_stamp: "Formatted at 2026-07-09 12:15:24 on dist-test-slave-296p"
I20260709 12:15:24.446023 20891 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:24.449949  2008 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:24.450987 20891 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:15:24.451365 20891 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-2-root
uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
format_stamp: "Formatted at 2026-07-09 12:15:24 on dist-test-slave-296p"
I20260709 12:15:24.451646 20891 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:24.470274 20891 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:24.471640 20891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:24.473436 20891 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:24.476016 20891 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:24.476218 20891 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:24.476536 20891 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:24.476683 20891 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:24.524839 20891 rpc_server.cc:307] RPC server started. Bound to: 127.20.102.195:45777
I20260709 12:15:24.524950  2070 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.102.195:45777 every 8 connection(s)
I20260709 12:15:24.541075  2071 heartbeater.cc:344] Connected to a master server at 127.20.102.254:33247
I20260709 12:15:24.541594  2071 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:24.542471  2071 heartbeater.cc:507] Master 127.20.102.254:33247 requested a full tablet report, sending...
I20260709 12:15:24.544828  1795 ts_manager.cc:194] Registered new tserver with Master: 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:24.545387 20891 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016600726s
I20260709 12:15:24.546552  1795 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60748
I20260709 12:15:24.576829  1795 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60752:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:24.579563  1795 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:24.660384  1887 tablet_service.cc:1511] Processing CreateTablet for tablet 059d1f08e080485bb07140f9857e075f (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:24.662238  1887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059d1f08e080485bb07140f9857e075f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.663290  1885 tablet_service.cc:1511] Processing CreateTablet for tablet 4d05e54ae17940119053ca939f60840b (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:24.664949  1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d05e54ae17940119053ca939f60840b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.665164  1884 tablet_service.cc:1511] Processing CreateTablet for tablet 8aaa3a7477434db49c6ee38cd3eb7d36 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:24.667117  1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aaa3a7477434db49c6ee38cd3eb7d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.663293  1886 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1da1a1ab8e44cd98f3f0a7e2cf3114 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:24.668933  1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1da1a1ab8e44cd98f3f0a7e2cf3114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.669384  1961 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1da1a1ab8e44cd98f3f0a7e2cf3114 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:24.670861  1961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1da1a1ab8e44cd98f3f0a7e2cf3114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.673974  1962 tablet_service.cc:1511] Processing CreateTablet for tablet 059d1f08e080485bb07140f9857e075f (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:24.675400  1962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059d1f08e080485bb07140f9857e075f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.683737  1960 tablet_service.cc:1511] Processing CreateTablet for tablet 4d05e54ae17940119053ca939f60840b (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:24.685346  1960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d05e54ae17940119053ca939f60840b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.688524  1883 tablet_service.cc:1511] Processing CreateTablet for tablet d05a48b0dcf947b2b67e88dce20540fb (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:24.690510  1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05a48b0dcf947b2b67e88dce20540fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.695150  1959 tablet_service.cc:1511] Processing CreateTablet for tablet 8aaa3a7477434db49c6ee38cd3eb7d36 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:24.696642  1959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aaa3a7477434db49c6ee38cd3eb7d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.706110  1882 tablet_service.cc:1511] Processing CreateTablet for tablet c4b44039da6645f2825cc5bbeb92dcbd (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:24.707633  1882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b44039da6645f2825cc5bbeb92dcbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.719107  1958 tablet_service.cc:1511] Processing CreateTablet for tablet d05a48b0dcf947b2b67e88dce20540fb (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:24.720655  1958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05a48b0dcf947b2b67e88dce20540fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.738483  2036 tablet_service.cc:1511] Processing CreateTablet for tablet 059d1f08e080485bb07140f9857e075f (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:24.738907  1957 tablet_service.cc:1511] Processing CreateTablet for tablet c4b44039da6645f2825cc5bbeb92dcbd (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:24.741032  1957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b44039da6645f2825cc5bbeb92dcbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.742466  2035 tablet_service.cc:1511] Processing CreateTablet for tablet 6b1da1a1ab8e44cd98f3f0a7e2cf3114 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:24.740595  2036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059d1f08e080485bb07140f9857e075f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.745740  2035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1da1a1ab8e44cd98f3f0a7e2cf3114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.754359  1885 tablet_service.cc:1511] Processing CreateTablet for tablet 16e439d066c549529b6382b34a74aa00 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:24.768961  1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e439d066c549529b6382b34a74aa00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.770788  2034 tablet_service.cc:1511] Processing CreateTablet for tablet 4d05e54ae17940119053ca939f60840b (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:24.780789  2034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d05e54ae17940119053ca939f60840b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.782413  2031 tablet_service.cc:1511] Processing CreateTablet for tablet c4b44039da6645f2825cc5bbeb92dcbd (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:24.783926  2031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b44039da6645f2825cc5bbeb92dcbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.772624  2033 tablet_service.cc:1511] Processing CreateTablet for tablet 8aaa3a7477434db49c6ee38cd3eb7d36 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:24.789758  2033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aaa3a7477434db49c6ee38cd3eb7d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.789316  1884 tablet_service.cc:1511] Processing CreateTablet for tablet 3016eb3ea9c04be4bbd0c00f2ffda7a5 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:24.791070  1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3016eb3ea9c04be4bbd0c00f2ffda7a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.778237  2032 tablet_service.cc:1511] Processing CreateTablet for tablet d05a48b0dcf947b2b67e88dce20540fb (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:24.794788  2030 tablet_service.cc:1511] Processing CreateTablet for tablet 16e439d066c549529b6382b34a74aa00 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:24.797909  1886 tablet_service.cc:1511] Processing CreateTablet for tablet 0e37b9d2157f4472b9b94ff50988687d (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:24.798000  2032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05a48b0dcf947b2b67e88dce20540fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.799443  1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e37b9d2157f4472b9b94ff50988687d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.801179  2030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e439d066c549529b6382b34a74aa00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.802879  1956 tablet_service.cc:1511] Processing CreateTablet for tablet 3016eb3ea9c04be4bbd0c00f2ffda7a5 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:24.804322  1956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3016eb3ea9c04be4bbd0c00f2ffda7a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.776947  2086 tablet_bootstrap.cc:492] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:24.809877  1961 tablet_service.cc:1511] Processing CreateTablet for tablet 16e439d066c549529b6382b34a74aa00 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:24.811297  1961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e439d066c549529b6382b34a74aa00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.823660  1955 tablet_service.cc:1511] Processing CreateTablet for tablet 0e37b9d2157f4472b9b94ff50988687d (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:24.825233  1955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e37b9d2157f4472b9b94ff50988687d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.826339  2029 tablet_service.cc:1511] Processing CreateTablet for tablet 3016eb3ea9c04be4bbd0c00f2ffda7a5 (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:24.827976  2029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3016eb3ea9c04be4bbd0c00f2ffda7a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.833031  2086 tablet_bootstrap.cc:654] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.846896  2028 tablet_service.cc:1511] Processing CreateTablet for tablet 0e37b9d2157f4472b9b94ff50988687d (DEFAULT_TABLE table=test-workload [id=88b4feabc0404f6493918bdc39e10e4a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:24.848938  2028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e37b9d2157f4472b9b94ff50988687d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.866304  2086 tablet_bootstrap.cc:492] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:24.866925  2086 ts_tablet_manager.cc:1403] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.090s	user 0.006s	sys 0.008s
I20260709 12:15:24.870256  2086 raft_consensus.cc:359] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:24.871024  2086 raft_consensus.cc:385] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.871348  2086 raft_consensus.cc:740] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.872118  2086 consensus_queue.cc:260] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:24.889642  2089 tablet_bootstrap.cc:492] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:24.894891  2087 tablet_bootstrap.cc:492] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:24.907294  1922 heartbeater.cc:499] Master 127.20.102.254:33247 was elected leader, sending a full tablet report...
I20260709 12:15:24.908631  2087 tablet_bootstrap.cc:654] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.909113  2089 tablet_bootstrap.cc:654] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.910122  2086 ts_tablet_manager.cc:1434] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 12:15:24.911543  2086 tablet_bootstrap.cc:492] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:24.920902  2086 tablet_bootstrap.cc:654] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.955893  2087 tablet_bootstrap.cc:492] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:24.956390  2089 tablet_bootstrap.cc:492] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:24.956557  2087 ts_tablet_manager.cc:1403] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.033s
I20260709 12:15:24.957012  2089 ts_tablet_manager.cc:1403] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.029s
I20260709 12:15:24.958003  2086 tablet_bootstrap.cc:492] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:24.958678  2086 ts_tablet_manager.cc:1403] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.047s	user 0.026s	sys 0.017s
I20260709 12:15:24.959609  2089 raft_consensus.cc:359] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:24.960283  2089 raft_consensus.cc:385] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.960181  2087 raft_consensus.cc:359] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:24.961002  2089 raft_consensus.cc:740] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.961153  2087 raft_consensus.cc:385] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.961560  2087 raft_consensus.cc:740] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.961997  2089 consensus_queue.cc:260] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:24.962291  2086 raft_consensus.cc:359] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:24.962393  2087 consensus_queue.cc:260] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:24.963325  2086 raft_consensus.cc:385] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.963734  2086 raft_consensus.cc:740] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.964262  2071 heartbeater.cc:499] Master 127.20.102.254:33247 was elected leader, sending a full tablet report...
I20260709 12:15:24.965250  1997 heartbeater.cc:499] Master 127.20.102.254:33247 was elected leader, sending a full tablet report...
I20260709 12:15:24.965838  2087 ts_tablet_manager.cc:1434] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:15:24.965924  2089 ts_tablet_manager.cc:1434] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:15:24.967053  2087 tablet_bootstrap.cc:492] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:24.967175  2089 tablet_bootstrap.cc:492] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:24.974689  2087 tablet_bootstrap.cc:654] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.976294  2089 tablet_bootstrap.cc:654] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.976747  2086 consensus_queue.cc:260] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:24.985368  2086 ts_tablet_manager.cc:1434] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:15:24.986649  2086 tablet_bootstrap.cc:492] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:24.987337  2087 tablet_bootstrap.cc:492] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:24.988003  2087 ts_tablet_manager.cc:1403] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 12:15:24.991499  2087 raft_consensus.cc:359] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:24.992363  2087 raft_consensus.cc:385] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.992698  2087 raft_consensus.cc:740] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.993784  2087 consensus_queue.cc:260] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:24.996604  2087 ts_tablet_manager.cc:1434] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:15:24.994415  2086 tablet_bootstrap.cc:654] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.997766  2089 tablet_bootstrap.cc:492] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:24.997799  2087 tablet_bootstrap.cc:492] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:24.998672  2089 ts_tablet_manager.cc:1403] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.009s
I20260709 12:15:25.002316  2089 raft_consensus.cc:359] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.003254  2089 raft_consensus.cc:385] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.003628  2089 raft_consensus.cc:740] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.004506  2089 consensus_queue.cc:260] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.006315  2087 tablet_bootstrap.cc:654] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.007087  2089 ts_tablet_manager.cc:1434] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:25.011400  2086 tablet_bootstrap.cc:492] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:25.012048  2086 ts_tablet_manager.cc:1403] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.002s
I20260709 12:15:25.012163  2087 tablet_bootstrap.cc:492] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:25.012828  2087 ts_tablet_manager.cc:1403] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:15:25.015569  2086 raft_consensus.cc:359] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.016425  2087 raft_consensus.cc:359] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.017274  2086 raft_consensus.cc:385] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.017400  2087 raft_consensus.cc:385] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.017751  2086 raft_consensus.cc:740] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.017890  2087 raft_consensus.cc:740] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.018929  2089 tablet_bootstrap.cc:492] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:25.019486  2087 consensus_queue.cc:260] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.022271  2087 ts_tablet_manager.cc:1434] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:15:25.023432  2087 tablet_bootstrap.cc:492] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:25.026055  2089 tablet_bootstrap.cc:654] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.018931  2086 consensus_queue.cc:260] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
W20260709 12:15:25.029834  2072 tablet.cc:2406] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:25.034332  2087 tablet_bootstrap.cc:654] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.031577  2086 ts_tablet_manager.cc:1434] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.006s
I20260709 12:15:25.036062  2086 tablet_bootstrap.cc:492] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:25.038772  2089 tablet_bootstrap.cc:492] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:25.039383  2089 ts_tablet_manager.cc:1403] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
W20260709 12:15:25.043383  1843 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:25.047325  2089 raft_consensus.cc:359] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.048184  2089 raft_consensus.cc:385] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.048491  2089 raft_consensus.cc:740] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.049388  2086 tablet_bootstrap.cc:654] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.049614  2089 consensus_queue.cc:260] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.053373  2087 tablet_bootstrap.cc:492] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:25.053525  2090 raft_consensus.cc:493] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.053948  2087 ts_tablet_manager.cc:1403] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.012s
I20260709 12:15:25.054137  2089 ts_tablet_manager.cc:1434] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:15:25.054244  2090 raft_consensus.cc:515] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.055394  2089 tablet_bootstrap.cc:492] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:25.057237  2087 raft_consensus.cc:359] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.057993  2087 raft_consensus.cc:385] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.058276  2087 raft_consensus.cc:740] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.058606  2090 leader_election.cc:290] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.059026  2087 consensus_queue.cc:260] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.061506  2087 ts_tablet_manager.cc:1434] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:15:25.062726  2087 tablet_bootstrap.cc:492] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:25.064431  2089 tablet_bootstrap.cc:654] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.069955  2087 tablet_bootstrap.cc:654] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.086246  1972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:25.087082  1972 raft_consensus.cc:2468] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 0.
I20260709 12:15:25.088177  2086 tablet_bootstrap.cc:492] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:25.088203  2089 tablet_bootstrap.cc:492] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:25.088588  1861 leader_election.cc:304] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:25.089169  2089 ts_tablet_manager.cc:1403] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.000s
I20260709 12:15:25.089322  2086 ts_tablet_manager.cc:1403] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.012s
I20260709 12:15:25.089901  2090 raft_consensus.cc:2804] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.090250  2094 raft_consensus.cc:493] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.090325  2090 raft_consensus.cc:493] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.091022  2094 raft_consensus.cc:515] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.092410  2089 raft_consensus.cc:359] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.093251  2089 raft_consensus.cc:385] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.093014  2086 raft_consensus.cc:359] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.093662  2089 raft_consensus.cc:740] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.093918  2094 leader_election.cc:290] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:25.093894  2086 raft_consensus.cc:385] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.094897  2086 raft_consensus.cc:740] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.091038  2090 raft_consensus.cc:3060] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.095952  2086 consensus_queue.cc:260] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.096979  2089 consensus_queue.cc:260] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.099647  2089 ts_tablet_manager.cc:1434] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:15:25.100831  2089 tablet_bootstrap.cc:492] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:25.108422  2089 tablet_bootstrap.cc:654] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.110375  2086 ts_tablet_manager.cc:1434] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.003s
I20260709 12:15:25.110737  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:25.111879  2086 tablet_bootstrap.cc:492] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
W20260709 12:15:25.112370  1861 leader_election.cc:343] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.114068  2090 raft_consensus.cc:515] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.117111  2087 tablet_bootstrap.cc:492] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:25.117746  2087 ts_tablet_manager.cc:1403] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.016s
I20260709 12:15:25.120582  2086 tablet_bootstrap.cc:654] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.121316  2095 raft_consensus.cc:493] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.121889  2095 raft_consensus.cc:515] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.122517  1972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:25.123138  1972 raft_consensus.cc:3060] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.127475  2095 leader_election.cc:290] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.135923  2086 tablet_bootstrap.cc:492] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:25.136816  2086 ts_tablet_manager.cc:1403] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 12:15:25.136672  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
W20260709 12:15:25.138609  2010 leader_election.cc:343] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.142318  2095 raft_consensus.cc:493] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.143069  2095 raft_consensus.cc:515] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.142982  2086 raft_consensus.cc:359] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.144317  2086 raft_consensus.cc:385] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.144713  2086 raft_consensus.cc:740] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.145681  2095 leader_election.cc:290] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.145717  2086 consensus_queue.cc:260] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.146539  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:25.147271  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
W20260709 12:15:25.148511  1861 leader_election.cc:343] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.150123  2090 leader_election.cc:290] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.150907  2086 ts_tablet_manager.cc:1434] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:15:25.144479  1972 raft_consensus.cc:2468] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 1.
W20260709 12:15:25.152364  2009 leader_election.cc:343] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.152923  2009 leader_election.cc:304] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:25.153422  1861 leader_election.cc:304] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:25.153786  2094 raft_consensus.cc:2749] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:25.155236  2086 tablet_bootstrap.cc:492] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:25.157948  2087 raft_consensus.cc:359] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.155822  2090 raft_consensus.cc:2804] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.159029  2087 raft_consensus.cc:385] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.162791  2095 raft_consensus.cc:493] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.163381  2095 raft_consensus.cc:515] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.162218  2087 raft_consensus.cc:740] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.160948  2090 raft_consensus.cc:697] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:25.166625  2087 consensus_queue.cc:260] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.166698  2090 consensus_queue.cc:237] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.173264  2095 leader_election.cc:290] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.180738  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:25.181841  1897 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 0.
I20260709 12:15:25.183135  2086 tablet_bootstrap.cc:654] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.183470  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:25.184485  1896 raft_consensus.cc:2468] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 0.
I20260709 12:15:25.186390  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:25.187456  1895 raft_consensus.cc:2468] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 0.
I20260709 12:15:25.187638  2089 tablet_bootstrap.cc:492] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:25.188851  2089 ts_tablet_manager.cc:1403] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.088s	user 0.026s	sys 0.004s
I20260709 12:15:25.191849  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:25.192914  2046 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 0.
I20260709 12:15:25.194548  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:25.196617  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:25.199150  2089 raft_consensus.cc:359] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.199740  1935 leader_election.cc:304] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:25.206538  2089 raft_consensus.cc:385] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.207008  2089 raft_consensus.cc:740] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.207134  1935 leader_election.cc:304] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:25.207724  2086 tablet_bootstrap.cc:492] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:25.208222  1935 leader_election.cc:304] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:25.208377  2086 ts_tablet_manager.cc:1403] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.017s
I20260709 12:15:25.208273  2089 consensus_queue.cc:260] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.209851  2095 raft_consensus.cc:2804] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.210275  2095 raft_consensus.cc:493] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.210713  2095 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.204377  2087 ts_tablet_manager.cc:1434] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.086s	user 0.023s	sys 0.020s
I20260709 12:15:25.212335  2087 tablet_bootstrap.cc:492] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:25.212375  2086 raft_consensus.cc:359] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.215462  2086 raft_consensus.cc:385] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.215852  2086 raft_consensus.cc:740] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.210318  1794 catalog_manager.cc:5697] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:25.216895  2086 consensus_queue.cc:260] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.217458  2089 ts_tablet_manager.cc:1434] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.001s
W20260709 12:15:25.217890  1936 leader_election.cc:343] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.218894  2089 tablet_bootstrap.cc:492] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
W20260709 12:15:25.218976  1936 leader_election.cc:343] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.221522  2086 ts_tablet_manager.cc:1434] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:15:25.223119  2086 tablet_bootstrap.cc:492] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:25.223791  2115 raft_consensus.cc:2804] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.224126  2087 tablet_bootstrap.cc:654] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.224326  2115 raft_consensus.cc:493] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.224748  2115 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.213869  2118 raft_consensus.cc:2804] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.225745  2118 raft_consensus.cc:493] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.226207  2118 raft_consensus.cc:3060] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.227399  2095 raft_consensus.cc:515] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.230618  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:25.231300  2044 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.236706  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:25.237577  1895 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.233390  2095 leader_election.cc:290] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.251718  2118 raft_consensus.cc:515] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.255708  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:25.256397  2118 leader_election.cc:290] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.256875  2115 raft_consensus.cc:515] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.256467  1896 raft_consensus.cc:3060] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.257943  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:25.258879  2045 raft_consensus.cc:3060] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.260888  2087 tablet_bootstrap.cc:492] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:25.261520  2087 ts_tablet_manager.cc:1403] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.012s
I20260709 12:15:25.262794  2089 tablet_bootstrap.cc:654] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.265110  2087 raft_consensus.cc:359] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.267557  1896 raft_consensus.cc:2468] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:25.268110  2087 raft_consensus.cc:385] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.268630  2087 raft_consensus.cc:740] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.269718  2087 consensus_queue.cc:260] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.270324  1935 leader_election.cc:304] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:25.271203  2118 raft_consensus.cc:493] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.271410  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:25.271831  2118 raft_consensus.cc:515] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.272639  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
W20260709 12:15:25.273182  1936 leader_election.cc:343] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.273890  1897 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.273912  2115 leader_election.cc:290] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.279350  2087 ts_tablet_manager.cc:1434] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:15:25.274605  2118 leader_election.cc:290] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.267375  2044 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:25.282222  2115 raft_consensus.cc:2804] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.275820  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:25.285084  2086 tablet_bootstrap.cc:654] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.285158  1936 leader_election.cc:304] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:25.286350  1895 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:25.287524  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:25.283581  2087 tablet_bootstrap.cc:492] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
W20260709 12:15:25.289161  1936 leader_election.cc:343] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.289803  2118 raft_consensus.cc:2804] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.290246  2115 raft_consensus.cc:697] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
W20260709 12:15:25.291332  1935 leader_election.cc:343] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.291538  2118 raft_consensus.cc:697] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:25.292467  2115 consensus_queue.cc:237] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.293205  1935 leader_election.cc:304] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:25.293325  2118 consensus_queue.cc:237] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.294665  2095 raft_consensus.cc:2749] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:25.293406  2045 raft_consensus.cc:2468] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:25.298082  2089 tablet_bootstrap.cc:492] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:25.298686  2089 ts_tablet_manager.cc:1403] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.013s
I20260709 12:15:25.301440  2089 raft_consensus.cc:359] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.302430  2089 raft_consensus.cc:385] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.303076  2089 raft_consensus.cc:740] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.304153  2089 consensus_queue.cc:260] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.307329  2089 ts_tablet_manager.cc:1434] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:25.302585  1897 raft_consensus.cc:2468] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:25.309625  1935 leader_election.cc:304] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:25.311098  2095 raft_consensus.cc:2804] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.311762  2086 tablet_bootstrap.cc:492] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:25.312435  2086 ts_tablet_manager.cc:1403] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.004s
I20260709 12:15:25.314047  2087 tablet_bootstrap.cc:654] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.316217  2086 raft_consensus.cc:359] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.317098  2086 raft_consensus.cc:385] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.317148  2089 tablet_bootstrap.cc:492] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:25.317484  2086 raft_consensus.cc:740] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.318641  2086 consensus_queue.cc:260] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.322284  2086 ts_tablet_manager.cc:1434] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.005s
I20260709 12:15:25.323778  2086 tablet_bootstrap.cc:492] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:25.327004  2089 tablet_bootstrap.cc:654] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.334401  2086 tablet_bootstrap.cc:654] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.345861  2089 tablet_bootstrap.cc:492] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:25.346477  2089 ts_tablet_manager.cc:1403] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.004s
I20260709 12:15:25.349843  2095 raft_consensus.cc:697] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:25.351454  2089 raft_consensus.cc:359] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.351600  2095 consensus_queue.cc:237] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.352321  2089 raft_consensus.cc:385] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.352634  2089 raft_consensus.cc:740] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.353480  2089 consensus_queue.cc:260] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.356419  1794 catalog_manager.cc:5697] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:25.362591  2087 tablet_bootstrap.cc:492] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:25.360478  2090 raft_consensus.cc:493] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.363415  2090 raft_consensus.cc:515] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.372062  2086 tablet_bootstrap.cc:492] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:25.372972  2086 ts_tablet_manager.cc:1403] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.014s
I20260709 12:15:25.375677  2087 ts_tablet_manager.cc:1403] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.030s
I20260709 12:15:25.359268  1794 catalog_manager.cc:5697] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:25.378952  2087 raft_consensus.cc:359] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.379575  2087 raft_consensus.cc:385] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.379863  2087 raft_consensus.cc:740] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.381065  2089 ts_tablet_manager.cc:1434] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.034s	user 0.014s	sys 0.003s
I20260709 12:15:25.382431  2089 tablet_bootstrap.cc:492] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:25.383033  2090 leader_election.cc:290] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.383214  2086 raft_consensus.cc:359] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.380544  2087 consensus_queue.cc:260] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.383926  1972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:25.384159  2086 raft_consensus.cc:385] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.384586  2086 raft_consensus.cc:740] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.385946  2087 ts_tablet_manager.cc:1434] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:15:25.385802  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:25.385617  2086 consensus_queue.cc:260] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.386559  2045 raft_consensus.cc:2468] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 0.
W20260709 12:15:25.387567  1861 leader_election.cc:343] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.388370  1861 leader_election.cc:304] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:25.389014  2087 tablet_bootstrap.cc:492] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:25.392256  2090 raft_consensus.cc:2804] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.392688  2090 raft_consensus.cc:493] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.392858  2089 tablet_bootstrap.cc:654] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.393069  2090 raft_consensus.cc:3060] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.394454  2086 ts_tablet_manager.cc:1434] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:15:25.395620  2086 tablet_bootstrap.cc:492] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:25.401686  2090 raft_consensus.cc:515] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.404827  1972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:25.406064  2086 tablet_bootstrap.cc:654] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:25.406356  1861 leader_election.cc:343] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.408705  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:25.409457  2045 raft_consensus.cc:3060] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.417402  2045 raft_consensus.cc:2468] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 1.
I20260709 12:15:25.418269  2090 leader_election.cc:290] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.419602  1861 leader_election.cc:304] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:25.420468  1793 catalog_manager.cc:5697] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:25.424052  2086 tablet_bootstrap.cc:492] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:25.425613  2086 ts_tablet_manager.cc:1403] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.008s
I20260709 12:15:25.426524  2087 tablet_bootstrap.cc:654] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.424662  2090 raft_consensus.cc:2804] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.427733  2090 raft_consensus.cc:697] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:25.429368  2090 consensus_queue.cc:237] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.439277  2086 raft_consensus.cc:359] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.440728  2086 raft_consensus.cc:385] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.441237  2086 raft_consensus.cc:740] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.442555  2086 consensus_queue.cc:260] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.445775  2086 ts_tablet_manager.cc:1434] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 12:15:25.450444  2089 tablet_bootstrap.cc:492] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:25.450675  2087 tablet_bootstrap.cc:492] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:25.451066  2089 ts_tablet_manager.cc:1403] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.069s	user 0.024s	sys 0.031s
I20260709 12:15:25.451123  2087 ts_tablet_manager.cc:1403] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.011s
I20260709 12:15:25.453189  1793 catalog_manager.cc:5697] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:25.454202  2087 raft_consensus.cc:359] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.454087  2089 raft_consensus.cc:359] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.455039  2087 raft_consensus.cc:385] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.455422  2089 raft_consensus.cc:385] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.455519  2087 raft_consensus.cc:740] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.455768  2089 raft_consensus.cc:740] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.456296  2087 consensus_queue.cc:260] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.456521  2089 consensus_queue.cc:260] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.458454  2087 ts_tablet_manager.cc:1434] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:15:25.460850  2089 ts_tablet_manager.cc:1434] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:15:25.461073  2087 tablet_bootstrap.cc:492] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:25.461807  2089 tablet_bootstrap.cc:492] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:25.471807  2089 tablet_bootstrap.cc:654] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.479624  2087 tablet_bootstrap.cc:654] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.483395  2089 tablet_bootstrap.cc:492] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:25.483911  2089 ts_tablet_manager.cc:1403] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.006s
I20260709 12:15:25.484753  2087 tablet_bootstrap.cc:492] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:25.485291  2087 ts_tablet_manager.cc:1403] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.002s
I20260709 12:15:25.486678  2089 raft_consensus.cc:359] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.487495  2089 raft_consensus.cc:385] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.487771  2089 raft_consensus.cc:740] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.488040  2087 raft_consensus.cc:359] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.488818  2087 raft_consensus.cc:385] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.488526  2089 consensus_queue.cc:260] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.489127  2087 raft_consensus.cc:740] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.489835  2087 consensus_queue.cc:260] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.492030  2087 ts_tablet_manager.cc:1434] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:25.493119  2089 ts_tablet_manager.cc:1434] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:15:25.500624  2094 raft_consensus.cc:493] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.501319  2094 raft_consensus.cc:515] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.504629  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:25.505033  2094 leader_election.cc:290] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:25.505266  1972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:25.505370  1897 raft_consensus.cc:2468] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 0.
I20260709 12:15:25.506150  1972 raft_consensus.cc:2468] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 0.
I20260709 12:15:25.507022  2009 leader_election.cc:304] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:25.507863  2094 raft_consensus.cc:2804] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.508221  2094 raft_consensus.cc:493] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.508457  2094 raft_consensus.cc:3060] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.513700  2094 raft_consensus.cc:515] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.515421  2094 leader_election.cc:290] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:25.516326  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:25.516578  1972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:25.517163  1897 raft_consensus.cc:3060] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.517259  1972 raft_consensus.cc:3060] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.518949  2090 raft_consensus.cc:493] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.518968  2094 raft_consensus.cc:493] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.519703  2090 raft_consensus.cc:515] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.519837  2094 raft_consensus.cc:515] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.522142  2090 leader_election.cc:290] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.523806  2094 leader_election.cc:290] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:25.524328  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:25.524791  1972 raft_consensus.cc:2468] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 1.
I20260709 12:15:25.524968  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:25.525163  1971 raft_consensus.cc:2468] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 0.
I20260709 12:15:25.525446  1897 raft_consensus.cc:2468] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 1.
I20260709 12:15:25.525655  1970 raft_consensus.cc:2468] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 0.
I20260709 12:15:25.526623  2010 leader_election.cc:304] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:25.526983  1861 leader_election.cc:304] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:25.527711  2010 leader_election.cc:304] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:25.528002  2090 raft_consensus.cc:2804] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.528404  2090 raft_consensus.cc:493] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.528469  2094 raft_consensus.cc:2804] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.528987  2090 raft_consensus.cc:3060] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.529798  2138 raft_consensus.cc:2804] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.530109  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:25.530453  2138 raft_consensus.cc:493] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.530944  2045 raft_consensus.cc:2468] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 0.
I20260709 12:15:25.531068  2138 raft_consensus.cc:3060] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.527694  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:25.533610  1897 raft_consensus.cc:2468] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 0.
I20260709 12:15:25.535920  2094 raft_consensus.cc:697] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:25.537084  2094 consensus_queue.cc:237] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.537784  2090 raft_consensus.cc:515] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.539803  2090 leader_election.cc:290] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.541244  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:25.541122  2138 raft_consensus.cc:515] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.542415  2045 raft_consensus.cc:3060] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.544236  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:25.545295  1970 raft_consensus.cc:3060] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.545461  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:25.546460  1897 raft_consensus.cc:3060] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.547019  1972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:25.547817  1972 raft_consensus.cc:3060] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.553581  2138 leader_election.cc:290] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:25.558887  1970 raft_consensus.cc:2468] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 1.
I20260709 12:15:25.560672  1972 raft_consensus.cc:2468] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 1.
I20260709 12:15:25.561726  2045 raft_consensus.cc:2468] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 1.
I20260709 12:15:25.562321  2010 leader_election.cc:304] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:25.563716  1897 raft_consensus.cc:2468] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 1.
I20260709 12:15:25.564128  2138 raft_consensus.cc:2804] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.564138  1861 leader_election.cc:304] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:25.564889  2138 raft_consensus.cc:697] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:25.563759  1793 catalog_manager.cc:5697] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.565970  2138 consensus_queue.cc:237] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.568576  2090 raft_consensus.cc:2804] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.569159  2090 raft_consensus.cc:697] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:25.569919  2090 consensus_queue.cc:237] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.579861  2090 consensus_queue.cc:1048] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.579890  1794 catalog_manager.cc:5697] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:25.584596  1793 catalog_manager.cc:5697] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.601625  2045 raft_consensus.cc:3060] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.603356  2095 raft_consensus.cc:493] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.604055  2095 raft_consensus.cc:515] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.607831  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:25.609148  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:25.610642  2044 raft_consensus.cc:2393] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45281c12ca694ae1bbd01c89f0cf5899 in current term 1: Already voted for candidate 9ba5ba0aeb514c019743af20c0968a00 in this term.
I20260709 12:15:25.612142  1936 leader_election.cc:304] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:25.612289  2095 leader_election.cc:290] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.612422  2145 consensus_queue.cc:1048] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.613094  2127 raft_consensus.cc:3060] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.619977  2127 raft_consensus.cc:2749] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:25.700006  2127 consensus_queue.cc:1048] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:25.711833  2118 consensus_queue.cc:1048] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:25.723693  2138 raft_consensus.cc:493] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.724220  2138 raft_consensus.cc:515] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.726490  2138 leader_election.cc:290] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:25.727312  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:25.728137  1897 raft_consensus.cc:2393] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in current term 1: Already voted for candidate 45281c12ca694ae1bbd01c89f0cf5899 in this term.
I20260709 12:15:25.727749  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:25.729657  2010 leader_election.cc:304] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:25.730715  2138 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.737835  2138 raft_consensus.cc:2749] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:25.779562  2145 raft_consensus.cc:493] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.780325  2145 raft_consensus.cc:515] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.781724  2118 consensus_queue.cc:1048] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.782310  2145 leader_election.cc:290] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.783346  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:25.783607  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:25.784111  1970 raft_consensus.cc:2468] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 0.
I20260709 12:15:25.784246  2044 raft_consensus.cc:2468] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 0.
I20260709 12:15:25.785583  1861 leader_election.cc:304] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:25.786486  2145 raft_consensus.cc:2804] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.787194  2145 raft_consensus.cc:493] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.787545  2145 raft_consensus.cc:3060] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.796489  2145 raft_consensus.cc:515] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.799005  2145 leader_election.cc:290] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:25.798786  2127 consensus_queue.cc:1048] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.802227  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:25.803037  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:25.803049  1970 raft_consensus.cc:3060] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.803970  2044 raft_consensus.cc:3060] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.809758  2127 consensus_queue.cc:1048] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.812176  2044 raft_consensus.cc:2468] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 1.
I20260709 12:15:25.813534  1861 leader_election.cc:304] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:25.813653  1970 raft_consensus.cc:2468] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 1.
I20260709 12:15:25.814496  2145 raft_consensus.cc:2804] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.815080  2145 raft_consensus.cc:697] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:25.816052  2145 consensus_queue.cc:237] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:25.826815  2115 consensus_queue.cc:1048] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.839336  1795 catalog_manager.cc:5697] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:25.839811  2145 consensus_queue.cc:1048] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:25.852679  2157 consensus_queue.cc:1048] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.908735  1970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
mode: GRACEFUL
new_leader_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:42036
I20260709 12:15:25.909456  1970 raft_consensus.cc:606] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Received request to transfer leadership to TS 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:25.915210  1970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d05e54ae17940119053ca939f60840b"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
mode: GRACEFUL
new_leader_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:42036
I20260709 12:15:25.915756  1970 raft_consensus.cc:606] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Received request to transfer leadership to TS 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:25.937644  2045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd"
dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
mode: GRACEFUL
new_leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
 from {username='slave'} at 127.0.0.1:53446
I20260709 12:15:25.938202  2045 raft_consensus.cc:606] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Received request to transfer leadership to TS 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:25.954030  1896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16e439d066c549529b6382b34a74aa00"
dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
mode: GRACEFUL
new_leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
 from {username='slave'} at 127.0.0.1:48400
I20260709 12:15:25.954581  1896 raft_consensus.cc:606] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Received request to transfer leadership to TS 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:25.959889  2045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5"
dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
mode: GRACEFUL
new_leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
 from {username='slave'} at 127.0.0.1:53446
I20260709 12:15:25.960377  2045 raft_consensus.cc:606] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Received request to transfer leadership to TS 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:25.965862  1896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d"
dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
mode: GRACEFUL
new_leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
 from {username='slave'} at 127.0.0.1:48400
I20260709 12:15:25.966341  1896 raft_consensus.cc:606] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Received request to transfer leadership to TS 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:26.052420  2138 consensus_queue.cc:1048] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:26.058656  2138 consensus_queue.cc:1048] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:26.067684  2094 consensus_queue.cc:1048] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:26.079254  2145 consensus_queue.cc:1048] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:26.082142  2094 consensus_queue.cc:1048] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:26.095391  2094 raft_consensus.cc:993] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3: : Instructing follower 45281c12ca694ae1bbd01c89f0cf5899 to start an election
I20260709 12:15:26.096019  2094 raft_consensus.cc:1081] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Signalling peer 45281c12ca694ae1bbd01c89f0cf5899 to start an election
I20260709 12:15:26.099696  1972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
 from {username='slave'} at 127.0.0.1:42034
I20260709 12:15:26.100343  1972 raft_consensus.cc:493] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:26.100750  1972 raft_consensus.cc:3060] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.103649  2138 raft_consensus.cc:993] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3: : Instructing follower 45281c12ca694ae1bbd01c89f0cf5899 to start an election
I20260709 12:15:26.104318  2138 raft_consensus.cc:1081] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Signalling peer 45281c12ca694ae1bbd01c89f0cf5899 to start an election
I20260709 12:15:26.105808  2145 consensus_queue.cc:1048] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:26.108587  1972 raft_consensus.cc:515] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.110047  1971 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
 from {username='slave'} at 127.0.0.1:42034
I20260709 12:15:26.110761  1971 raft_consensus.cc:493] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:26.111202  1971 raft_consensus.cc:3060] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.111816  1972 leader_election.cc:290] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:26.113545  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:26.114254  2045 raft_consensus.cc:3055] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:26.114566  2045 raft_consensus.cc:740] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:26.115414  2045 consensus_queue.cc:260] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.116701  2045 raft_consensus.cc:3060] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.117244  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:26.117992  1897 raft_consensus.cc:3060] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.124927  1971 raft_consensus.cc:515] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.127244  1897 raft_consensus.cc:2468] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:26.127406  2045 raft_consensus.cc:2468] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:26.129310  1936 leader_election.cc:304] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:26.128383  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:26.130163  1896 raft_consensus.cc:3060] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.130753  2095 raft_consensus.cc:2804] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:26.131358  2095 raft_consensus.cc:697] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:26.131974  1971 leader_election.cc:290] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:26.132212  2095 consensus_queue.cc:237] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.134066  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:26.134716  2045 raft_consensus.cc:3055] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:26.135063  2045 raft_consensus.cc:740] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:26.135892  2045 consensus_queue.cc:260] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.137198  2045 raft_consensus.cc:3060] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.141116  1896 raft_consensus.cc:2468] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:26.142773  1935 leader_election.cc:304] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:26.143744  2095 raft_consensus.cc:2804] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:26.144521  2045 raft_consensus.cc:2468] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:26.144598  2095 raft_consensus.cc:697] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:26.145280  1794 catalog_manager.cc:5697] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 1 to 2, leader changed from 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195) to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.145795  2095 consensus_queue.cc:237] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.162484  1794 catalog_manager.cc:5697] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 1 to 2, leader changed from 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195) to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.260035  2145 consensus_queue.cc:1048] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:26.272111  2145 consensus_queue.cc:1048] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:26.280268  2157 raft_consensus.cc:993] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00: : Instructing follower 2f70dae7dc1c43b08d2c65022d53e6e3 to start an election
I20260709 12:15:26.280877  2145 raft_consensus.cc:1081] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Signalling peer 2f70dae7dc1c43b08d2c65022d53e6e3 to start an election
I20260709 12:15:26.282475  2045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d"
dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
 from {username='slave'} at 127.0.0.1:53418
I20260709 12:15:26.282982  2045 raft_consensus.cc:493] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:26.283279  2045 raft_consensus.cc:3060] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.288447  2045 raft_consensus.cc:515] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.290215  2045 leader_election.cc:290] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:26.291392  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:26.291532  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:26.292104  1896 raft_consensus.cc:3055] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:26.292369  1971 raft_consensus.cc:3060] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.292614  1896 raft_consensus.cc:740] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:26.293633  1896 consensus_queue.cc:260] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.294641  1896 raft_consensus.cc:3060] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.299608  1971 raft_consensus.cc:2468] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:26.300261  1896 raft_consensus.cc:2468] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:26.301115  2010 leader_election.cc:304] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:26.302050  2138 raft_consensus.cc:2804] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:26.302520  2138 raft_consensus.cc:697] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:26.303282  2138 consensus_queue.cc:237] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.307878  2118 raft_consensus.cc:993] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899: : Instructing follower 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:26.308594  2095 raft_consensus.cc:1081] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Signalling peer 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:26.310523  1896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114"
dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:48394
I20260709 12:15:26.312011  1896 raft_consensus.cc:493] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:26.312631  1896 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.311959  1795 catalog_manager.cc:5697] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 1 to 2, leader changed from 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193) to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.319346  1896 raft_consensus.cc:515] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.321341  1896 leader_election.cc:290] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:26.322441  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:26.322429  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:26.323107  2045 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.323441  1971 raft_consensus.cc:3055] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:26.323802  1971 raft_consensus.cc:740] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:26.324666  1971 consensus_queue.cc:260] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.325831  1971 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.328931  2045 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:26.330204  1861 leader_election.cc:304] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:26.330935  2145 raft_consensus.cc:2804] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:26.331379  2145 raft_consensus.cc:697] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:26.332086  2145 consensus_queue.cc:237] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.332346  1971 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:26.339461  1795 catalog_manager.cc:5697] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 1 to 2, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.400113  2127 raft_consensus.cc:993] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899: : Instructing follower 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:26.400702  2095 raft_consensus.cc:1081] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Signalling peer 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:26.402506  1896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d05e54ae17940119053ca939f60840b"
dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:48394
I20260709 12:15:26.403090  1896 raft_consensus.cc:493] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:26.403478  1896 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.409682  1896 raft_consensus.cc:515] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.411501  1896 leader_election.cc:290] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:26.412478  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:26.412837  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:26.413319  1971 raft_consensus.cc:3055] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:26.413648  2045 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.413751  1971 raft_consensus.cc:740] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:26.414743  1971 consensus_queue.cc:260] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.415764  1971 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.420660  2045 raft_consensus.cc:2468] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:26.422120  1861 leader_election.cc:304] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:26.422184  1971 raft_consensus.cc:2468] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:26.422937  2145 raft_consensus.cc:2804] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:26.423465  2145 raft_consensus.cc:697] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:26.424320  2145 consensus_queue.cc:237] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.431474  1795 catalog_manager.cc:5697] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 1 to 2, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.468248  2157 raft_consensus.cc:993] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00: : Instructing follower 45281c12ca694ae1bbd01c89f0cf5899 to start an election
I20260709 12:15:26.468858  2145 raft_consensus.cc:1081] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Signalling peer 45281c12ca694ae1bbd01c89f0cf5899 to start an election
I20260709 12:15:26.470588  1971 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16e439d066c549529b6382b34a74aa00"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
 from {username='slave'} at 127.0.0.1:42028
I20260709 12:15:26.471187  1971 raft_consensus.cc:493] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:26.471505  1971 raft_consensus.cc:3060] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.476702  1971 raft_consensus.cc:515] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.478502  1971 leader_election.cc:290] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:26.479539  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:26.479760  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:26.480252  1896 raft_consensus.cc:3055] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:26.480286  2045 raft_consensus.cc:3060] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.480823  1896 raft_consensus.cc:740] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:26.481737  1896 consensus_queue.cc:260] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.483011  1896 raft_consensus.cc:3060] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:26.488075  2045 raft_consensus.cc:2468] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:26.489640  1936 leader_election.cc:304] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:26.490031  1896 raft_consensus.cc:2468] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:26.490485  2095 raft_consensus.cc:2804] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:26.491124  2095 raft_consensus.cc:697] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:26.492079  2095 consensus_queue.cc:237] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:26.498960  1795 catalog_manager.cc:5697] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 1 to 2, leader changed from 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193) to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.519500  2045 raft_consensus.cc:1275] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.521121  2095 consensus_queue.cc:1048] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:26.529865  1896 raft_consensus.cc:1275] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.531957  2118 consensus_queue.cc:1048] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:26.545008  1896 raft_consensus.cc:1275] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.546432  2118 consensus_queue.cc:1048] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:26.555545  2045 raft_consensus.cc:1275] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.557430  2095 consensus_queue.cc:1048] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:26.760299  2045 raft_consensus.cc:1275] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.761765  2145 consensus_queue.cc:1048] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:26.770596  1971 raft_consensus.cc:1275] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.772356  2145 consensus_queue.cc:1048] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:26.809085  1971 raft_consensus.cc:1275] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.810457  2094 consensus_queue.cc:1048] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:26.818161  1896 raft_consensus.cc:1275] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.820832  2094 consensus_queue.cc:1048] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:26.922197  1971 raft_consensus.cc:1275] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.923916  2145 consensus_queue.cc:1048] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:26.933019  2045 raft_consensus.cc:1275] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.935073  2145 consensus_queue.cc:1048] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:26.978828  2045 raft_consensus.cc:1275] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.980196  2095 consensus_queue.cc:1048] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:26.983528  1896 raft_consensus.cc:1275] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:26.985054  2095 consensus_queue.cc:1048] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:28.998227  1795 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60756:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:29.000663  1795 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:29.054041  1886 tablet_service.cc:1511] Processing CreateTablet for tablet d0b2c458d716469db89797427f5cc78b (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:29.054914  1962 tablet_service.cc:1511] Processing CreateTablet for tablet d0b2c458d716469db89797427f5cc78b (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:29.055637  1886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b2c458d716469db89797427f5cc78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.056175  1962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b2c458d716469db89797427f5cc78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.058545  2028 tablet_service.cc:1511] Processing CreateTablet for tablet d0b2c458d716469db89797427f5cc78b (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:29.059837  2028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b2c458d716469db89797427f5cc78b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.059357  1882 tablet_service.cc:1511] Processing CreateTablet for tablet 20e51bd2a7da491ebb970d30afb8dc6f (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:29.062458  1961 tablet_service.cc:1511] Processing CreateTablet for tablet 20e51bd2a7da491ebb970d30afb8dc6f (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:29.064589  1961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e51bd2a7da491ebb970d30afb8dc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.065688  1882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e51bd2a7da491ebb970d30afb8dc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.072700  2034 tablet_service.cc:1511] Processing CreateTablet for tablet 20e51bd2a7da491ebb970d30afb8dc6f (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:29.074991  2034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e51bd2a7da491ebb970d30afb8dc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.087453  1884 tablet_service.cc:1511] Processing CreateTablet for tablet 3095ee628fdb41808c568effe5711f80 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:29.089273  1884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3095ee628fdb41808c568effe5711f80. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:29.097630  1843 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:29.100157  1957 tablet_service.cc:1511] Processing CreateTablet for tablet 3095ee628fdb41808c568effe5711f80 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:29.101729  1957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3095ee628fdb41808c568effe5711f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.102749  2033 tablet_service.cc:1511] Processing CreateTablet for tablet 3095ee628fdb41808c568effe5711f80 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:29.104125  2033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3095ee628fdb41808c568effe5711f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.114081  1885 tablet_service.cc:1511] Processing CreateTablet for tablet e8f7b70ca9f74046a805b8e76a18d9b8 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:29.115825  1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f7b70ca9f74046a805b8e76a18d9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.122033  1961 tablet_service.cc:1511] Processing CreateTablet for tablet e8f7b70ca9f74046a805b8e76a18d9b8 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:29.123775  1961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f7b70ca9f74046a805b8e76a18d9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.123656  1883 tablet_service.cc:1511] Processing CreateTablet for tablet c63c053187f74f838cea1bfee35cffd5 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:29.125309  1883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63c053187f74f838cea1bfee35cffd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.122071  2036 tablet_service.cc:1511] Processing CreateTablet for tablet e8f7b70ca9f74046a805b8e76a18d9b8 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:29.129081  2036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f7b70ca9f74046a805b8e76a18d9b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.135033  2032 tablet_service.cc:1511] Processing CreateTablet for tablet c63c053187f74f838cea1bfee35cffd5 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:29.144230  2032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63c053187f74f838cea1bfee35cffd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.136809  1887 tablet_service.cc:1511] Processing CreateTablet for tablet faf40fa603ea47c9ade85bbe75cdbd0c (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:29.145733  1887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf40fa603ea47c9ade85bbe75cdbd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.145505  1956 tablet_service.cc:1511] Processing CreateTablet for tablet faf40fa603ea47c9ade85bbe75cdbd0c (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:29.147053  1956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf40fa603ea47c9ade85bbe75cdbd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.150077  2030 tablet_service.cc:1511] Processing CreateTablet for tablet faf40fa603ea47c9ade85bbe75cdbd0c (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:29.138240  1962 tablet_service.cc:1511] Processing CreateTablet for tablet c63c053187f74f838cea1bfee35cffd5 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:29.151703  2030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf40fa603ea47c9ade85bbe75cdbd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.152432  1962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63c053187f74f838cea1bfee35cffd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.154775  1881 tablet_service.cc:1511] Processing CreateTablet for tablet 9e4963adbf934f07addde68878a1db8d (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:29.156186  1881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e4963adbf934f07addde68878a1db8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.104102  2189 tablet_bootstrap.cc:492] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:29.174928  2189 tablet_bootstrap.cc:654] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.182037  1957 tablet_service.cc:1511] Processing CreateTablet for tablet 9e4963adbf934f07addde68878a1db8d (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:29.183770  1957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e4963adbf934f07addde68878a1db8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.191025  2028 tablet_service.cc:1511] Processing CreateTablet for tablet 9e4963adbf934f07addde68878a1db8d (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:29.191911  2034 tablet_service.cc:1511] Processing CreateTablet for tablet 2a140ff30e17479c95f93e2348c6bdb5 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:29.194491  1955 tablet_service.cc:1511] Processing CreateTablet for tablet 2a140ff30e17479c95f93e2348c6bdb5 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:29.196056  1955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a140ff30e17479c95f93e2348c6bdb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.192538  2028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e4963adbf934f07addde68878a1db8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.197602  2190 tablet_bootstrap.cc:492] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:29.201144  2034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a140ff30e17479c95f93e2348c6bdb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.201468  2191 tablet_bootstrap.cc:492] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:29.207554  1885 tablet_service.cc:1511] Processing CreateTablet for tablet 2a140ff30e17479c95f93e2348c6bdb5 (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:29.208981  1885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a140ff30e17479c95f93e2348c6bdb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.221184  2191 tablet_bootstrap.cc:654] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.229993  1959 tablet_service.cc:1511] Processing CreateTablet for tablet de5fd01b22d24de7b0ebd16e3bf4276e (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:29.231195  1887 tablet_service.cc:1511] Processing CreateTablet for tablet de5fd01b22d24de7b0ebd16e3bf4276e (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:29.231662  1959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5fd01b22d24de7b0ebd16e3bf4276e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.233737  2190 tablet_bootstrap.cc:654] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.236280  1887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5fd01b22d24de7b0ebd16e3bf4276e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.231616  2036 tablet_service.cc:1511] Processing CreateTablet for tablet de5fd01b22d24de7b0ebd16e3bf4276e (DEFAULT_TABLE table=soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:29.242370  2036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5fd01b22d24de7b0ebd16e3bf4276e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:29.269600  2189 tablet_bootstrap.cc:492] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:29.270205  2189 ts_tablet_manager.cc:1403] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.166s	user 0.009s	sys 0.004s
I20260709 12:15:29.273317  2190 tablet_bootstrap.cc:492] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:29.274029  2190 ts_tablet_manager.cc:1403] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.009s
I20260709 12:15:29.278803  2191 tablet_bootstrap.cc:492] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:29.279481  2191 ts_tablet_manager.cc:1403] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.006s
I20260709 12:15:29.281600  2189 raft_consensus.cc:359] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.282558  2189 raft_consensus.cc:385] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.282817  2191 raft_consensus.cc:359] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.283390  2189 raft_consensus.cc:740] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.283917  2191 raft_consensus.cc:385] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.284415  2191 raft_consensus.cc:740] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.285000  2190 raft_consensus.cc:359] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.285831  2190 raft_consensus.cc:385] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.285377  2191 consensus_queue.cc:260] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.286207  2190 raft_consensus.cc:740] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.287093  2190 consensus_queue.cc:260] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.288235  2189 consensus_queue.cc:260] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.288761  2191 ts_tablet_manager.cc:1434] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:15:29.289764  2190 ts_tablet_manager.cc:1434] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:15:29.290499  2191 tablet_bootstrap.cc:492] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:29.291028  2190 tablet_bootstrap.cc:492] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:29.293848  2189 ts_tablet_manager.cc:1434] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.005s
I20260709 12:15:29.295115  2189 tablet_bootstrap.cc:492] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:29.298200  2191 tablet_bootstrap.cc:654] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.299023  2190 tablet_bootstrap.cc:654] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.308929  2190 tablet_bootstrap.cc:492] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:29.309589  2190 ts_tablet_manager.cc:1403] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:15:29.312460  2189 tablet_bootstrap.cc:654] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.313078  2190 raft_consensus.cc:359] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.314014  2190 raft_consensus.cc:385] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.314320  2190 raft_consensus.cc:740] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.315207  2190 consensus_queue.cc:260] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.320088  2191 tablet_bootstrap.cc:492] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:29.320145  2190 ts_tablet_manager.cc:1434] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:15:29.320835  2191 ts_tablet_manager.cc:1403] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.014s
I20260709 12:15:29.322233  2190 tablet_bootstrap.cc:492] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:29.323215  2189 tablet_bootstrap.cc:492] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:29.323848  2189 ts_tablet_manager.cc:1403] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 12:15:29.324594  2191 raft_consensus.cc:359] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.325542  2191 raft_consensus.cc:385] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.325903  2191 raft_consensus.cc:740] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.326936  2191 consensus_queue.cc:260] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.327628  2189 raft_consensus.cc:359] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.328497  2189 raft_consensus.cc:385] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.328866  2189 raft_consensus.cc:740] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.329555  2191 ts_tablet_manager.cc:1434] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:15:29.329721  2189 consensus_queue.cc:260] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.330756  2191 tablet_bootstrap.cc:492] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:29.330747  2190 tablet_bootstrap.cc:654] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.332283  2189 ts_tablet_manager.cc:1434] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:15:29.333592  2189 tablet_bootstrap.cc:492] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:29.340641  2191 tablet_bootstrap.cc:654] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.342411  2189 tablet_bootstrap.cc:654] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.348935  2177 raft_consensus.cc:493] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.349686  2177 raft_consensus.cc:515] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.351084  2190 tablet_bootstrap.cc:492] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:29.351781  2190 ts_tablet_manager.cc:1403] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.010s
I20260709 12:15:29.353368  2189 tablet_bootstrap.cc:492] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:29.353986  2189 ts_tablet_manager.cc:1403] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:15:29.354188  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:29.355289  1896 raft_consensus.cc:2468] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 0.
I20260709 12:15:29.357573  2189 raft_consensus.cc:359] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.358475  2189 raft_consensus.cc:385] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.359239  2189 raft_consensus.cc:740] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.359622  2009 leader_election.cc:304] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:29.360100  2189 consensus_queue.cc:260] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.361116  2190 raft_consensus.cc:359] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.361915  2190 raft_consensus.cc:385] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.362226  2190 raft_consensus.cc:740] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.362761  2189 ts_tablet_manager.cc:1434] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:15:29.363063  2190 consensus_queue.cc:260] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.363941  2189 tablet_bootstrap.cc:492] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:29.374964  2189 tablet_bootstrap.cc:654] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.389066  2189 tablet_bootstrap.cc:492] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:29.389684  2189 ts_tablet_manager.cc:1403] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.011s
I20260709 12:15:29.390307  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:29.391510  1971 raft_consensus.cc:2468] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 0.
I20260709 12:15:29.393764  2177 leader_election.cc:290] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:29.393532  2189 raft_consensus.cc:359] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.394802  2177 raft_consensus.cc:2804] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.394918  2189 raft_consensus.cc:385] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.395390  2177 raft_consensus.cc:493] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.395610  2189 raft_consensus.cc:740] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.396654  2189 consensus_queue.cc:260] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.399878  2189 ts_tablet_manager.cc:1434] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:15:29.401324  2189 tablet_bootstrap.cc:492] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:29.396029  2177 raft_consensus.cc:3060] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.411099  2189 tablet_bootstrap.cc:654] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:29.413475  2009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.193:33655, user_credentials={real_user=slave}} blocked reactor thread for 53961.8us
I20260709 12:15:29.453138  2190 ts_tablet_manager.cc:1434] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.101s	user 0.047s	sys 0.051s
I20260709 12:15:29.454367  2190 tablet_bootstrap.cc:492] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:29.461663  2190 tablet_bootstrap.cc:654] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.462106  2191 tablet_bootstrap.cc:492] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:29.462931  2191 ts_tablet_manager.cc:1403] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.132s	user 0.028s	sys 0.041s
I20260709 12:15:29.470806  2177 raft_consensus.cc:515] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.471801  2189 tablet_bootstrap.cc:492] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:29.472419  2189 ts_tablet_manager.cc:1403] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.054s
I20260709 12:15:29.467231  2191 raft_consensus.cc:359] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.474015  2191 raft_consensus.cc:385] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.474232  2190 tablet_bootstrap.cc:492] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:29.474429  2177 leader_election.cc:290] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:29.474591  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:29.474956  2190 ts_tablet_manager.cc:1403] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:15:29.474334  2191 raft_consensus.cc:740] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.475401  1896 raft_consensus.cc:3060] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.475934  2189 raft_consensus.cc:359] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.476154  2191 consensus_queue.cc:260] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.476737  2189 raft_consensus.cc:385] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.477088  2189 raft_consensus.cc:740] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.477522  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:29.478193  1971 raft_consensus.cc:3060] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.478606  2190 raft_consensus.cc:359] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.478825  2189 consensus_queue.cc:260] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.479414  2190 raft_consensus.cc:385] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.479758  2190 raft_consensus.cc:740] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.480736  2190 consensus_queue.cc:260] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.481902  2189 ts_tablet_manager.cc:1434] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:15:29.483024  2189 tablet_bootstrap.cc:492] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:29.483256  2190 ts_tablet_manager.cc:1434] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:15:29.484398  2190 tablet_bootstrap.cc:492] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:29.479785  2191 ts_tablet_manager.cc:1434] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:15:29.485702  2191 tablet_bootstrap.cc:492] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:29.490114  2189 tablet_bootstrap.cc:654] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.509495  2190 tablet_bootstrap.cc:654] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.513026  1896 raft_consensus.cc:2468] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 1.
I20260709 12:15:29.515197  1971 raft_consensus.cc:2468] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 1.
I20260709 12:15:29.515858  2191 tablet_bootstrap.cc:654] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.517738  2010 leader_election.cc:304] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:29.518885  2177 raft_consensus.cc:2804] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.519505  2177 raft_consensus.cc:697] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:29.520459  2177 consensus_queue.cc:237] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.520090  2189 tablet_bootstrap.cc:492] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:29.521003  2190 tablet_bootstrap.cc:492] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:29.521842  2189 ts_tablet_manager.cc:1403] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.016s
I20260709 12:15:29.522281  2190 ts_tablet_manager.cc:1403] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.002s
I20260709 12:15:29.525930  2189 raft_consensus.cc:359] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.527122  2189 raft_consensus.cc:385] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.527519  2189 raft_consensus.cc:740] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.527664  2190 raft_consensus.cc:359] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.528743  2189 consensus_queue.cc:260] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.529830  2190 raft_consensus.cc:385] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.532660  2190 raft_consensus.cc:740] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.533356  2189 ts_tablet_manager.cc:1434] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.004s
I20260709 12:15:29.533646  2190 consensus_queue.cc:260] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.536484  2190 ts_tablet_manager.cc:1434] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:15:29.537045  2189 tablet_bootstrap.cc:492] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:29.537829  2190 tablet_bootstrap.cc:492] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:29.530529  2191 tablet_bootstrap.cc:492] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:29.531291  2202 raft_consensus.cc:493] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.540989  2202 raft_consensus.cc:515] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.543377  2202 leader_election.cc:290] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:29.544142  2178 raft_consensus.cc:493] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.545111  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:29.545470  2189 tablet_bootstrap.cc:654] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.545272  2178 raft_consensus.cc:515] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.544612  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:29.546739  1896 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 0.
I20260709 12:15:29.547567  2178 leader_election.cc:290] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.548309  2009 leader_election.cc:304] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:29.549741  1971 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 0.
I20260709 12:15:29.551007  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:29.551780  2045 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 0.
I20260709 12:15:29.553233  2190 tablet_bootstrap.cc:654] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.553447  1936 leader_election.cc:304] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:29.554600  2178 raft_consensus.cc:2804] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.555115  2178 raft_consensus.cc:493] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.555438  2178 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.544212  1794 catalog_manager.cc:5697] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.556088  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:29.556816  1897 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 0.
I20260709 12:15:29.558656  2127 raft_consensus.cc:493] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.559139  2127 raft_consensus.cc:515] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.561329  2127 leader_election.cc:290] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.562820  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:29.563506  2045 raft_consensus.cc:2468] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 0.
I20260709 12:15:29.563354  2178 raft_consensus.cc:515] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.566335  1936 leader_election.cc:304] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:29.568902  2178 leader_election.cc:290] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.569546  2178 raft_consensus.cc:2804] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.569962  2178 raft_consensus.cc:493] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.570361  2178 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.571177  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:29.572618  2202 raft_consensus.cc:2804] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.573861  2202 raft_consensus.cc:493] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.574301  2202 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.573328  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:29.540961  2191 ts_tablet_manager.cc:1403] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.011s
I20260709 12:15:29.581837  2190 tablet_bootstrap.cc:492] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:29.582474  2190 ts_tablet_manager.cc:1403] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.006s
I20260709 12:15:29.585769  2190 raft_consensus.cc:359] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.590050  2189 tablet_bootstrap.cc:492] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:29.590238  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:29.591012  2190 raft_consensus.cc:385] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.591137  2189 ts_tablet_manager.cc:1403] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.028s
I20260709 12:15:29.591208  1896 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.594533  2190 raft_consensus.cc:740] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.594614  2189 raft_consensus.cc:359] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.595517  2189 raft_consensus.cc:385] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.595875  2189 raft_consensus.cc:740] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.595607  2190 consensus_queue.cc:260] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.597473  2189 consensus_queue.cc:260] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.589931  2178 raft_consensus.cc:515] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.593629  2202 raft_consensus.cc:515] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.600916  2189 ts_tablet_manager.cc:1434] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.001s
I20260709 12:15:29.601408  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:29.601874  2045 raft_consensus.cc:2393] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45281c12ca694ae1bbd01c89f0cf5899 in current term 1: Already voted for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in this term.
I20260709 12:15:29.602147  2044 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.602240  2189 tablet_bootstrap.cc:492] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:29.604386  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:29.606985  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:29.608006  1971 raft_consensus.cc:2393] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in current term 1: Already voted for candidate 45281c12ca694ae1bbd01c89f0cf5899 in this term.
W20260709 12:15:29.608480  1935 leader_election.cc:343] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.609452  2010 leader_election.cc:304] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:29.610356  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:29.610460  2202 leader_election.cc:290] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:29.612725  2044 raft_consensus.cc:2468] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:29.598269  2190 ts_tablet_manager.cc:1434] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:15:29.612969  2202 raft_consensus.cc:2749] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:29.614475  2190 tablet_bootstrap.cc:492] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:29.614838  1936 leader_election.cc:304] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:29.616189  2127 raft_consensus.cc:2804] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.617971  2189 tablet_bootstrap.cc:654] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.622296  2190 tablet_bootstrap.cc:654] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.624920  2178 leader_election.cc:290] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.625859  2178 raft_consensus.cc:493] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.626384  2178 raft_consensus.cc:515] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.628669  2178 leader_election.cc:290] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.636719  2189 tablet_bootstrap.cc:492] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:29.637267  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63c053187f74f838cea1bfee35cffd5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:29.637872  2189 ts_tablet_manager.cc:1403] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.009s
I20260709 12:15:29.640342  1896 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:29.588009  2214 raft_consensus.cc:493] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.642495  2214 raft_consensus.cc:515] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.643201  2189 raft_consensus.cc:359] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.644168  2214 leader_election.cc:290] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.644357  2189 raft_consensus.cc:385] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.644910  2189 raft_consensus.cc:740] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.584189  2191 raft_consensus.cc:359] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.646325  2191 raft_consensus.cc:385] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.645886  2189 consensus_queue.cc:260] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.647109  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:29.647951  2202 raft_consensus.cc:493] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.648542  2202 raft_consensus.cc:515] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.646647  2191 raft_consensus.cc:740] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.648734  2189 ts_tablet_manager.cc:1434] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:15:29.651230  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63c053187f74f838cea1bfee35cffd5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:29.654781  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:29.654963  2044 raft_consensus.cc:2468] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 0.
I20260709 12:15:29.655275  2189 tablet_bootstrap.cc:492] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899: Bootstrap starting.
I20260709 12:15:29.651522  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
W20260709 12:15:29.656157  2009 leader_election.cc:343] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.656486  2045 raft_consensus.cc:2468] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 0.
I20260709 12:15:29.654314  2202 leader_election.cc:290] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:29.653518  2127 raft_consensus.cc:697] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:29.656193  2190 tablet_bootstrap.cc:492] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:29.658102  2190 ts_tablet_manager.cc:1403] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.005s
I20260709 12:15:29.657358  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:29.658133  2127 consensus_queue.cc:237] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.658816  1971 raft_consensus.cc:2468] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 0.
W20260709 12:15:29.645893  1935 leader_election.cc:343] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.660195  1936 leader_election.cc:304] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:29.660457  2010 leader_election.cc:304] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:29.661545  1936 leader_election.cc:304] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:29.652575  2191 consensus_queue.cc:260] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.662384  1897 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.663105  2189 tablet_bootstrap.cc:654] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.663811  2191 ts_tablet_manager.cc:1434] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.000s
I20260709 12:15:29.664978  2191 tablet_bootstrap.cc:492] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:29.668339  2216 raft_consensus.cc:2804] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.668963  2202 raft_consensus.cc:2804] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.668972  2214 raft_consensus.cc:2804] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.669448  2202 raft_consensus.cc:493] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.670389  2190 raft_consensus.cc:359] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.673813  2190 raft_consensus.cc:385] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.670861  1935 leader_election.cc:304] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:29.674127  2190 raft_consensus.cc:740] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.669123  2216 raft_consensus.cc:493] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.673048  2202 raft_consensus.cc:3060] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.674686  2216 raft_consensus.cc:3060] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.676023  2205 raft_consensus.cc:493] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.676854  2217 raft_consensus.cc:2804] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.677449  2217 raft_consensus.cc:697] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:29.678398  2217 consensus_queue.cc:237] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.676911  2205 raft_consensus.cc:515] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.681200  2190 consensus_queue.cc:260] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.683127  2205 leader_election.cc:290] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.683683  2190 ts_tablet_manager.cc:1434] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:15:29.684757  2190 tablet_bootstrap.cc:492] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:29.685617  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:29.686694  1971 raft_consensus.cc:2468] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 0.
I20260709 12:15:29.689213  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:29.690083  2045 raft_consensus.cc:2468] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 0.
I20260709 12:15:29.673028  2214 raft_consensus.cc:493] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.692162  1861 leader_election.cc:304] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:29.699182  2214 raft_consensus.cc:3060] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.700264  2190 tablet_bootstrap.cc:654] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.700408  2189 tablet_bootstrap.cc:492] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899: No bootstrap required, opened a new log
I20260709 12:15:29.700430  2205 raft_consensus.cc:2804] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.701228  2189 ts_tablet_manager.cc:1403] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.023s
I20260709 12:15:29.701228  2205 raft_consensus.cc:493] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:29.701532  1935 leader_election.cc:343] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.702132  2205 raft_consensus.cc:3060] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.703800  1897 raft_consensus.cc:2468] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:29.704602  2202 raft_consensus.cc:515] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.704635  2189 raft_consensus.cc:359] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.705611  2189 raft_consensus.cc:385] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.705904  2189 raft_consensus.cc:740] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.706894  2202 leader_election.cc:290] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:29.706642  2189 consensus_queue.cc:260] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.708277  2191 tablet_bootstrap.cc:654] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.709154  2189 ts_tablet_manager.cc:1434] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:29.706223  1793 catalog_manager.cc:5697] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.708257  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:29.723866  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
W20260709 12:15:29.730636  2009 leader_election.cc:343] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.737342  2216 raft_consensus.cc:515] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.738757  2205 raft_consensus.cc:515] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.740047  2216 leader_election.cc:290] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.739899  2214 raft_consensus.cc:515] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.741364  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63c053187f74f838cea1bfee35cffd5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:29.741993  2045 raft_consensus.cc:3060] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.742750  2214 leader_election.cc:290] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.744156  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:29.745978  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:29.746654  2044 raft_consensus.cc:2393] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45281c12ca694ae1bbd01c89f0cf5899 in current term 1: Already voted for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in this term.
I20260709 12:15:29.747319  1971 raft_consensus.cc:2393] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in current term 1: Already voted for candidate 45281c12ca694ae1bbd01c89f0cf5899 in this term.
I20260709 12:15:29.749394  2010 leader_election.cc:304] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:29.750892  2190 tablet_bootstrap.cc:492] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:29.751506  2190 ts_tablet_manager.cc:1403] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.005s
W20260709 12:15:29.751650  1935 leader_election.cc:343] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.752147  1935 leader_election.cc:304] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:29.753284  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:29.753690  2202 raft_consensus.cc:2749] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:29.753976  1971 raft_consensus.cc:3060] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.755060  2190 raft_consensus.cc:359] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.755787  2190 raft_consensus.cc:385] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.756071  2190 raft_consensus.cc:740] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.757180  2190 consensus_queue.cc:260] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.758476  2191 tablet_bootstrap.cc:492] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:29.759076  2191 ts_tablet_manager.cc:1403] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.094s	user 0.024s	sys 0.001s
I20260709 12:15:29.759667  2190 ts_tablet_manager.cc:1434] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:15:29.759060  1795 catalog_manager.cc:5697] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.760033  2205 leader_election.cc:290] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.764137  1971 raft_consensus.cc:2468] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 1.
I20260709 12:15:29.750792  2045 raft_consensus.cc:2468] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:29.760738  2190 tablet_bootstrap.cc:492] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Bootstrap starting.
I20260709 12:15:29.765362  1861 leader_election.cc:304] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:29.761170  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:29.766592  1936 leader_election.cc:304] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:29.766826  2044 raft_consensus.cc:3060] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.767470  2216 raft_consensus.cc:2749] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:29.768168  2216 raft_consensus.cc:2804] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.768621  2216 raft_consensus.cc:697] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:29.769488  2216 consensus_queue.cc:237] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.769852  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63c053187f74f838cea1bfee35cffd5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:29.772537  2190 tablet_bootstrap.cc:654] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.773002  2205 raft_consensus.cc:2804] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.773624  2205 raft_consensus.cc:697] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:29.774432  2205 consensus_queue.cc:237] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.762570  2191 raft_consensus.cc:359] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.776175  2191 raft_consensus.cc:385] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.776525  2191 raft_consensus.cc:740] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.777453  2191 consensus_queue.cc:260] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.778071  2044 raft_consensus.cc:2468] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 1.
I20260709 12:15:29.779980  2191 ts_tablet_manager.cc:1434] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:15:29.780444  1897 raft_consensus.cc:3060] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.785818  2191 tablet_bootstrap.cc:492] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:29.786556  2216 raft_consensus.cc:493] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.787667  2216 raft_consensus.cc:515] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.789559  2190 tablet_bootstrap.cc:492] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3: No bootstrap required, opened a new log
I20260709 12:15:29.790169  2190 ts_tablet_manager.cc:1403] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.011s
I20260709 12:15:29.791083  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
W20260709 12:15:29.793246  1935 leader_election.cc:343] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.793347  2190 raft_consensus.cc:359] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.794184  2190 raft_consensus.cc:385] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.794453  2190 raft_consensus.cc:740] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.795325  2190 consensus_queue.cc:260] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.796205  2191 tablet_bootstrap.cc:654] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.797487  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:29.797971  2190 ts_tablet_manager.cc:1434] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:29.798230  2044 raft_consensus.cc:2468] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 0.
I20260709 12:15:29.795830  1795 catalog_manager.cc:5697] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.799317  2216 leader_election.cc:290] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.800258  1936 leader_election.cc:304] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:29.803774  2216 raft_consensus.cc:2804] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.804173  2216 raft_consensus.cc:493] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.804534  2216 raft_consensus.cc:3060] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.806736  1793 catalog_manager.cc:5697] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 1 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.809335  1897 raft_consensus.cc:2468] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:29.815909  2216 raft_consensus.cc:515] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.818205  2216 leader_election.cc:290] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.819018  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
W20260709 12:15:29.820580  1935 leader_election.cc:343] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.822759  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:29.823112  2191 tablet_bootstrap.cc:492] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:29.823544  2044 raft_consensus.cc:3060] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.823776  2191 ts_tablet_manager.cc:1403] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.012s
I20260709 12:15:29.827381  2191 raft_consensus.cc:359] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.828138  2191 raft_consensus.cc:385] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.828426  2191 raft_consensus.cc:740] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.829226  2191 consensus_queue.cc:260] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.831760  2191 ts_tablet_manager.cc:1434] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:15:29.832933  2191 tablet_bootstrap.cc:492] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:29.833305  2044 raft_consensus.cc:2468] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:29.834851  1936 leader_election.cc:304] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:29.836498  2214 raft_consensus.cc:493] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.837112  2214 raft_consensus.cc:515] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.839653  2214 leader_election.cc:290] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.840457  2191 tablet_bootstrap.cc:654] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.841025  2216 raft_consensus.cc:2804] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.841740  2216 raft_consensus.cc:697] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:29.842039  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
W20260709 12:15:29.843981  1935 leader_election.cc:343] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.842605  2216 consensus_queue.cc:237] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.847599  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:29.848706  2044 raft_consensus.cc:2468] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 0.
I20260709 12:15:29.850302  1936 leader_election.cc:304] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:29.856774  2216 raft_consensus.cc:2804] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.857220  2216 raft_consensus.cc:493] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.857553  2216 raft_consensus.cc:3060] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.865036  1793 catalog_manager.cc:5697] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.868333  2216 raft_consensus.cc:515] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.874209  2191 tablet_bootstrap.cc:492] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:29.874910  2191 ts_tablet_manager.cc:1403] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.015s
I20260709 12:15:29.877239  2216 leader_election.cc:290] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.878576  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:29.878696  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:29.878561  2191 raft_consensus.cc:359] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.879841  2044 raft_consensus.cc:3060] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.879871  2191 raft_consensus.cc:385] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.880487  2191 raft_consensus.cc:740] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
W20260709 12:15:29.880990  1935 leader_election.cc:343] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.881402  2191 consensus_queue.cc:260] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.884033  2191 ts_tablet_manager.cc:1434] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 12:15:29.885429  2191 tablet_bootstrap.cc:492] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:29.888511  2044 raft_consensus.cc:2468] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:29.889784  1936 leader_election.cc:304] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:29.890501  2216 raft_consensus.cc:2804] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.890974  2216 raft_consensus.cc:697] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:29.891613  2216 consensus_queue.cc:237] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.892762  2191 tablet_bootstrap.cc:654] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.898510  2191 tablet_bootstrap.cc:492] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:29.899111  2191 ts_tablet_manager.cc:1403] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:15:29.902539  2191 raft_consensus.cc:359] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.903364  2191 raft_consensus.cc:385] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.903654  2191 raft_consensus.cc:740] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.948201  2205 raft_consensus.cc:493] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.945029  2191 consensus_queue.cc:260] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.953715  2205 raft_consensus.cc:515] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:29.959753  2202 consensus_queue.cc:1048] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.959820  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:29.961831  1970 raft_consensus.cc:2393] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba5ba0aeb514c019743af20c0968a00 in current term 1: Already voted for candidate 45281c12ca694ae1bbd01c89f0cf5899 in this term.
I20260709 12:15:29.963080  2191 ts_tablet_manager.cc:1434] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.064s	user 0.011s	sys 0.006s
I20260709 12:15:29.966264  2191 tablet_bootstrap.cc:492] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00: Bootstrap starting.
I20260709 12:15:29.971263  2205 leader_election.cc:290] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:29.974472  1793 catalog_manager.cc:5697] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 1 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.982138  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:29.983464  2044 raft_consensus.cc:2393] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba5ba0aeb514c019743af20c0968a00 in current term 1: Already voted for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in this term.
I20260709 12:15:29.984315  2191 tablet_bootstrap.cc:654] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.987390  1861 leader_election.cc:304] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:29.988827  2145 raft_consensus.cc:3060] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.012854  2145 raft_consensus.cc:2749] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.015940  2191 tablet_bootstrap.cc:492] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00: No bootstrap required, opened a new log
I20260709 12:15:30.017472  2191 ts_tablet_manager.cc:1403] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00: Time spent bootstrapping tablet: real 0.052s	user 0.028s	sys 0.014s
I20260709 12:15:30.029354  2191 raft_consensus.cc:359] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:30.030694  2191 raft_consensus.cc:385] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.031240  2191 raft_consensus.cc:740] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.032639  2191 consensus_queue.cc:260] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:30.034618  2177 consensus_queue.cc:1048] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.037700  2191 ts_tablet_manager.cc:1434] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 12:15:30.073871  2202 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.074529  2202 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:30.076689  2202 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:30.077571  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:30.078022  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:30.078363  1896 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 0.
I20260709 12:15:30.078866  1971 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 0.
I20260709 12:15:30.080099  2009 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:30.081172  2202 raft_consensus.cc:2804] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:30.081565  2202 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.081889  2202 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.090732  2202 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:30.092676  2202 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:30.095013  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:30.096647  1971 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.095336  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:30.098367  1896 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.099139  2217 consensus_queue.cc:1048] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.100095  2214 consensus_queue.cc:1048] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:30.107803  1843 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:30.109004  1896 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 1.
I20260709 12:15:30.110492  2216 consensus_queue.cc:1048] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.126456  2009 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:30.127800  1971 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 1.
I20260709 12:15:30.130071  2202 raft_consensus.cc:2804] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.130753  2202 raft_consensus.cc:697] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:30.132107  2202 consensus_queue.cc:237] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:30.148792  2214 consensus_queue.cc:1048] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:15:30.162305  2145 raft_consensus.cc:493] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.163086  2145 raft_consensus.cc:515] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:30.162583  1793 catalog_manager.cc:5697] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 1 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.165315  2145 leader_election.cc:290] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:30.165959  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:30.167155  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:30.168166  2044 raft_consensus.cc:2393] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba5ba0aeb514c019743af20c0968a00 in current term 1: Already voted for candidate 45281c12ca694ae1bbd01c89f0cf5899 in this term.
I20260709 12:15:30.169801  1861 leader_election.cc:304] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:30.171142  2145 raft_consensus.cc:3060] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.181181  2145 raft_consensus.cc:2749] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.306553  2145 consensus_queue.cc:1048] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:30.320019  2205 consensus_queue.cc:1048] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:30.321883  2127 consensus_queue.cc:1048] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.342330  2178 consensus_queue.cc:1048] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.431483  1896 raft_consensus.cc:3060] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.434803  2178 consensus_queue.cc:1048] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.441073  2205 raft_consensus.cc:493] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.441912  2205 raft_consensus.cc:515] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:30.442662  2178 consensus_queue.cc:1048] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:30.452658  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:30.453061  2178 consensus_queue.cc:1048] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.455515  2205 leader_election.cc:290] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:30.458755  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:30.459625  2045 raft_consensus.cc:2468] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 1.
I20260709 12:15:30.465142  1861 leader_election.cc:304] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:30.467034  2205 raft_consensus.cc:2804] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:30.467512  2205 raft_consensus.cc:493] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:30.467993  2205 raft_consensus.cc:3060] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:30.471954  2217 consensus_queue.cc:1048] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.484467  2205 raft_consensus.cc:515] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:30.485807  1896 raft_consensus.cc:1240] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Rejecting Update request from peer 45281c12ca694ae1bbd01c89f0cf5899 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:30.487100  2205 leader_election.cc:290] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:30.487820  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:30.489089  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:30.490583  2217 consensus_queue.cc:1059] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:30.491416  2178 raft_consensus.cc:3055] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:30.491606  1861 leader_election.cc:304] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:30.491933  2178 raft_consensus.cc:740] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:30.492615  2205 raft_consensus.cc:2749] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:30.493165  2178 consensus_queue.cc:260] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:30.494869  2178 raft_consensus.cc:3060] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:30.674412  2201 consensus_queue.cc:1048] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.686795  2177 consensus_queue.cc:1048] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:31.127179  1843 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:31.522688  2178 raft_consensus.cc:493] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.523522  2178 raft_consensus.cc:515] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:31.525867  2178 leader_election.cc:290] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:31.526937  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:31.527053  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:31.527642  1896 raft_consensus.cc:2468] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:31.527837  2044 raft_consensus.cc:2468] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:31.529047  1935 leader_election.cc:304] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:31.530020  2178 raft_consensus.cc:2804] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:31.530398  2178 raft_consensus.cc:493] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.530632  2178 raft_consensus.cc:3060] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:31.538075  2178 raft_consensus.cc:515] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:31.540335  2178 leader_election.cc:290] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:31.541944  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:31.541987  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:31.542840  1896 raft_consensus.cc:3060] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:31.543038  2045 raft_consensus.cc:3060] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:31.548547  1896 raft_consensus.cc:2468] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:31.549893  1935 leader_election.cc:304] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:31.550504  2045 raft_consensus.cc:2468] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:31.551025  2216 raft_consensus.cc:2804] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:31.551641  2216 raft_consensus.cc:697] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:31.552561  2216 consensus_queue.cc:237] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:31.561743  1793 catalog_manager.cc:5697] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 0 to 2, leader changed from <none> to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.764564  2045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b"
dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
mode: GRACEFUL
new_leader_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:53446
I20260709 12:15:31.765266  2045 raft_consensus.cc:606] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Received request to transfer leadership to TS 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:31.774669  1971 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3095ee628fdb41808c568effe5711f80"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
mode: GRACEFUL
new_leader_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:42036
I20260709 12:15:31.775578  1971 raft_consensus.cc:606] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Received request to transfer leadership to TS 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:31.781582  1971 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
mode: GRACEFUL
new_leader_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:42036
I20260709 12:15:31.782091  1971 raft_consensus.cc:606] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Received request to transfer leadership to TS 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:31.797505  2045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5"
dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
mode: GRACEFUL
new_leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
 from {username='slave'} at 127.0.0.1:53446
I20260709 12:15:31.798121  2045 raft_consensus.cc:606] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Received request to transfer leadership to TS 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:31.804013  1971 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
mode: GRACEFUL
new_leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
 from {username='slave'} at 127.0.0.1:42036
I20260709 12:15:31.804572  1971 raft_consensus.cc:606] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:31.804908  1971 raft_consensus.cc:614] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:31.945541  2044 raft_consensus.cc:1275] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:31.947135  2216 consensus_queue.cc:1048] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:31.964648  1896 raft_consensus.cc:1275] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:31.967203  2178 consensus_queue.cc:1048] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:31.976061  2258 raft_consensus.cc:493] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:31.976794  2258 raft_consensus.cc:515] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:31.979920  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:31.979950  2258 leader_election.cc:290] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:31.980672  1896 raft_consensus.cc:2393] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in current term 2: Already voted for candidate 9ba5ba0aeb514c019743af20c0968a00 in this term.
I20260709 12:15:31.980593  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:31.981371  1971 raft_consensus.cc:2468] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:31.982631  2010 leader_election.cc:304] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:31.983505  2258 raft_consensus.cc:2804] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:31.983861  2258 raft_consensus.cc:493] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:31.984194  2258 raft_consensus.cc:3060] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:31.992144  2258 raft_consensus.cc:515] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:31.995188  2258 leader_election.cc:290] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:31.995348  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:31.996516  1897 raft_consensus.cc:2393] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in current term 2: Already voted for candidate 9ba5ba0aeb514c019743af20c0968a00 in this term.
I20260709 12:15:31.996708  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:32.003096  1971 raft_consensus.cc:2468] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:32.004210  2010 leader_election.cc:304] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:32.005026  2258 raft_consensus.cc:2804] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:32.006294  2258 raft_consensus.cc:697] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:32.007164  2258 consensus_queue.cc:237] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.016038  1794 catalog_manager.cc:5697] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 1 to 2, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:32.158778  2272 raft_consensus.cc:993] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3: : Instructing follower 45281c12ca694ae1bbd01c89f0cf5899 to start an election
I20260709 12:15:32.159371  2270 raft_consensus.cc:1081] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Signalling peer 45281c12ca694ae1bbd01c89f0cf5899 to start an election
I20260709 12:15:32.161597  1971 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
 from {username='slave'} at 127.0.0.1:42034
I20260709 12:15:32.162289  1971 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.162626  1971 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.168591  1971 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.170428  1971 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:32.171255  1897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:32.171774  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:32.172114  1897 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.172437  2045 raft_consensus.cc:3055] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:32.172842  2045 raft_consensus.cc:740] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:32.173478  2045 consensus_queue.cc:260] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.174449  2045 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.179517  2045 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:32.179415  1897 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:32.181025  1936 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:32.181830  2178 raft_consensus.cc:2804] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:32.182296  2178 raft_consensus.cc:697] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:32.183200  2178 consensus_queue.cc:237] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.192718  2217 raft_consensus.cc:993] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899: : Instructing follower 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:32.192111  1794 catalog_manager.cc:5697] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 1 to 2, leader changed from 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195) to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.193363  2178 raft_consensus.cc:1081] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Signalling peer 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:32.195582  1897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8"
dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:48394
I20260709 12:15:32.196261  1897 raft_consensus.cc:493] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.196594  1897 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.202972  1897 raft_consensus.cc:515] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.204666  1897 leader_election.cc:290] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:32.205504  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:32.205703  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:32.206149  1971 raft_consensus.cc:3055] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:32.206434  2045 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.206544  1971 raft_consensus.cc:740] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:32.207391  1971 consensus_queue.cc:260] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.208271  1971 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.212566  2045 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:32.214730  1861 leader_election.cc:304] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:32.214780  1971 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:32.215986  2256 raft_consensus.cc:2804] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:32.216830  2256 raft_consensus.cc:697] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:32.218392  2256 consensus_queue.cc:237] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.223450  2258 raft_consensus.cc:993] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3: : Instructing follower 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:32.224180  2270 raft_consensus.cc:1081] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Signalling peer 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:32.229683  1897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b"
dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:48386
I20260709 12:15:32.230635  1897 raft_consensus.cc:493] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.231305  1897 raft_consensus.cc:3060] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.238983  1794 catalog_manager.cc:5697] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 1 to 2, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.240108  1897 raft_consensus.cc:515] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.242223  1897 leader_election.cc:290] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:32.243040  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:32.243805  1971 raft_consensus.cc:3060] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.243714  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:32.244935  2045 raft_consensus.cc:3055] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:32.245260  2045 raft_consensus.cc:740] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:32.246088  2045 consensus_queue.cc:260] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.248574  2045 raft_consensus.cc:3060] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.254501  1971 raft_consensus.cc:2468] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:32.255415  2045 raft_consensus.cc:2468] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:32.256433  1861 leader_election.cc:304] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:32.257239  2269 raft_consensus.cc:2804] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:32.258543  2269 raft_consensus.cc:697] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:32.259487  2269 consensus_queue.cc:237] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.267777  1794 catalog_manager.cc:5697] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 1 to 2, leader changed from 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195) to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.336508  2178 raft_consensus.cc:993] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899: : Instructing follower 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:32.337144  2217 raft_consensus.cc:1081] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Signalling peer 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:32.338891  1897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3095ee628fdb41808c568effe5711f80"
dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:48394
I20260709 12:15:32.339458  1897 raft_consensus.cc:493] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.339824  1897 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.346810  1897 raft_consensus.cc:515] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.348963  1897 leader_election.cc:290] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:32.349861  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:32.350204  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:32.350716  1971 raft_consensus.cc:3055] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:32.350986  2045 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.351213  1971 raft_consensus.cc:740] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:32.352437  1971 consensus_queue.cc:260] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.354315  1971 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.358489  2045 raft_consensus.cc:2468] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:32.359953  1861 leader_election.cc:304] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:32.360863  2269 raft_consensus.cc:2804] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:32.361398  2269 raft_consensus.cc:697] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:32.362457  2269 consensus_queue.cc:237] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:32.363567  1971 raft_consensus.cc:2468] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:32.371568  1794 catalog_manager.cc:5697] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 1 to 2, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.529204  1897 raft_consensus.cc:1275] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.530880  2272 consensus_queue.cc:1048] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:32.544591  1971 raft_consensus.cc:1275] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.546682  2272 consensus_queue.cc:1048] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:32.630895  2046 raft_consensus.cc:1275] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.632422  2278 consensus_queue.cc:1048] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:32.642786  1896 raft_consensus.cc:1275] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.644333  2178 consensus_queue.cc:1048] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:32.646668  1971 raft_consensus.cc:1275] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.648586  2275 consensus_queue.cc:1048] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:32.664397  2046 raft_consensus.cc:1275] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.666230  2287 consensus_queue.cc:1048] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:32.674607  1972 raft_consensus.cc:1275] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.675865  2287 consensus_queue.cc:1048] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:32.692193  2046 raft_consensus.cc:1275] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.693882  2269 consensus_queue.cc:1048] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:32.770731  2045 raft_consensus.cc:1275] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.772238  2256 consensus_queue.cc:1048] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:32.784080  1972 raft_consensus.cc:1275] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.785964  2269 consensus_queue.cc:1048] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:34.808728  1794 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60756:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:15:34.830139  1794 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60756:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:15:34.886327 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:35.143309  1794 catalog_manager.cc:5789] TS 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777) does not have the latest schema for tablet de5fd01b22d24de7b0ebd16e3bf4276e (table soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]). Expected version 1 got 0
W20260709 12:15:35.204427  1936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:45777, user_credentials={real_user=slave}} blocked reactor thread for 78166.8us
W20260709 12:15:35.259865  2321 log.cc:927] Time spent T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899: Append to log took a long time: real 0.135s	user 0.005s	sys 0.001s
I20260709 12:15:35.261025  2340 tablet.cc:1724] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.181434  2333 tablet.cc:1724] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.308502  2343 tablet.cc:1724] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:35.338306  2341 log.cc:927] Time spent T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 12:15:35.352375  1794 catalog_manager.cc:5789] TS 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375) does not have the latest schema for tablet 9e4963adbf934f07addde68878a1db8d (table soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]). Expected version 1 got 0
I20260709 12:15:35.353456  1794 catalog_manager.cc:5789] TS 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375) does not have the latest schema for tablet c63c053187f74f838cea1bfee35cffd5 (table soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]). Expected version 1 got 0
I20260709 12:15:35.354108  1794 catalog_manager.cc:5789] TS 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375) does not have the latest schema for tablet faf40fa603ea47c9ade85bbe75cdbd0c (table soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]). Expected version 1 got 0
I20260709 12:15:35.354631  1794 catalog_manager.cc:5789] TS 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375) does not have the latest schema for tablet 2a140ff30e17479c95f93e2348c6bdb5 (table soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6]). Expected version 1 got 0
W20260709 12:15:35.400830  2349 log.cc:927] Time spent T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:15:35.417335  2351 tablet.cc:1724] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:35.439307  2345 log.cc:927] Time spent T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
W20260709 12:15:35.447197  2329 log.cc:927] Time spent T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899: Append to log took a long time: real 0.291s	user 0.004s	sys 0.000s
I20260709 12:15:35.449462  2348 tablet.cc:1724] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.454483  2354 tablet.cc:1724] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.363158  2346 tablet.cc:1724] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.516268  1972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
mode: GRACEFUL
new_leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
 from {username='slave'} at 127.0.0.1:38924
I20260709 12:15:35.517205  1972 raft_consensus.cc:606] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Received request to transfer leadership to TS 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:35.503314  2359 tablet.cc:1724] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.546016  2361 tablet.cc:1724] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.548725  2363 tablet.cc:1724] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.565732  2348 tablet.cc:1724] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.504935  2340 tablet.cc:1724] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.586900  2217 raft_consensus.cc:993] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899: : Instructing follower 2f70dae7dc1c43b08d2c65022d53e6e3 to start an election
I20260709 12:15:35.589166  2361 tablet.cc:1724] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.590253  2342 raft_consensus.cc:1081] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Signalling peer 2f70dae7dc1c43b08d2c65022d53e6e3 to start an election
I20260709 12:15:35.591928  2333 tablet.cc:1724] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.593232  2354 tablet.cc:1724] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.605425  2365 tablet.cc:1724] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.617158  2348 tablet.cc:1724] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.620430  2354 tablet.cc:1724] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.623798  2044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5"
dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
 from {username='slave'} at 127.0.0.1:53434
I20260709 12:15:35.624605  2044 raft_consensus.cc:493] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.625187  2044 raft_consensus.cc:3060] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:35.630865  2364 tablet.cc:1724] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.632856  2333 tablet.cc:1724] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.636245  2343 tablet.cc:1724] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.649335  2340 tablet.cc:1724] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.576272  2351 tablet.cc:1724] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.658552  2044 raft_consensus.cc:515] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:35.649215  2359 tablet.cc:1724] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.670243  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:35.670982  1895 raft_consensus.cc:3060] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:35.686981  1895 raft_consensus.cc:2468] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 3.
I20260709 12:15:35.688687  2009 leader_election.cc:304] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:35.689941  2272 raft_consensus.cc:2804] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:35.690464  2272 raft_consensus.cc:697] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:35.691584  2272 consensus_queue.cc:237] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:35.694085  2044 leader_election.cc:290] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:35.701162  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:35.702044  1970 raft_consensus.cc:3055] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:35.702380  1970 raft_consensus.cc:740] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:35.703744  1970 consensus_queue.cc:260] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:35.706035  1970 raft_consensus.cc:3060] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:35.698009  2363 tablet.cc:1724] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.693638  2346 tablet.cc:1724] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.705655  2343 tablet.cc:1724] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:35.728323  1795 catalog_manager.cc:5697] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 2 to 3, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:35.737251  1895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36"
dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
mode: GRACEFUL
new_leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
 from {username='slave'} at 127.0.0.1:39238
I20260709 12:15:35.738037  1895 raft_consensus.cc:606] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Received request to transfer leadership to TS 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:35.730463  1970 raft_consensus.cc:2468] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 3.
I20260709 12:15:35.739661 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:35.740374 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:35.754382  1794 catalog_manager.cc:6242] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26: soft_deleted_table [id=f05aaf88fd544b40a911068d9fb1cbc6] alter complete (version 1)
I20260709 12:15:35.965270  2325 raft_consensus.cc:993] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00: : Instructing follower 2f70dae7dc1c43b08d2c65022d53e6e3 to start an election
I20260709 12:15:35.965768  2325 raft_consensus.cc:1081] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Signalling peer 2f70dae7dc1c43b08d2c65022d53e6e3 to start an election
I20260709 12:15:35.967396  2044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36"
dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
 from {username='slave'} at 127.0.0.1:53418
I20260709 12:15:35.967990  2044 raft_consensus.cc:493] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.968317  2044 raft_consensus.cc:3060] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.975620  2044 raft_consensus.cc:515] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:35.977892  2044 leader_election.cc:290] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:35.978998  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:35.979719  1895 raft_consensus.cc:3055] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.979969  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:35.980096  1895 raft_consensus.cc:740] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:35.980701  1970 raft_consensus.cc:3060] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.981309  1895 consensus_queue.cc:260] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:35.982827  1895 raft_consensus.cc:3060] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.989279  1970 raft_consensus.cc:2468] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:35.990691  2010 leader_election.cc:304] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:35.990810  1895 raft_consensus.cc:2468] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:35.991866  2272 raft_consensus.cc:2804] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:35.992375  2272 raft_consensus.cc:697] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:35.993484  2272 consensus_queue.cc:237] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:36.003053  1792 catalog_manager.cc:5697] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 1 to 2, leader changed from 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193) to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:36.103907  1896 raft_consensus.cc:1275] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:36.105546  2272 consensus_queue.cc:1048] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:36.117722  1970 raft_consensus.cc:1275] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:36.119905  2272 consensus_queue.cc:1048] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:36.515684  1970 raft_consensus.cc:1275] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:36.517046  2272 consensus_queue.cc:1048] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:36.527714  1896 raft_consensus.cc:1275] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:36.530009  2314 consensus_queue.cc:1048] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:36.741520 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:36.747290 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:36.747870 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:37.748952 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:37.754753 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:37.755303 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:38.756351 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:38.761861 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:38.762485 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:41.397879  2389 raft_consensus.cc:493] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.400597  2389 raft_consensus.cc:515] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.557718  2389 leader_election.cc:290] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.558506  2389 raft_consensus.cc:493] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.559376  2389 raft_consensus.cc:515] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.563150  2389 leader_election.cc:290] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.565660  2389 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.568219  2389 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.570709  2390 raft_consensus.cc:493] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.570914  2391 raft_consensus.cc:493] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.572259  2390 raft_consensus.cc:515] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.572960  2389 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.572636  2391 raft_consensus.cc:515] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.573668  2389 raft_consensus.cc:493] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.574781  2389 raft_consensus.cc:515] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.575565  2390 leader_election.cc:290] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.577634  2389 leader_election.cc:290] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
W20260709 12:15:41.573657  1935 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.369s	user 0.004s	sys 0.053s
W20260709 12:15:41.580742  1935 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.377s	user 0.005s	sys 0.054s
I20260709 12:15:41.582547  2391 leader_election.cc:290] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.596917  2394 raft_consensus.cc:493] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f70dae7dc1c43b08d2c65022d53e6e3)
I20260709 12:15:41.597958  2393 raft_consensus.cc:493] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f70dae7dc1c43b08d2c65022d53e6e3)
I20260709 12:15:41.599176  2393 raft_consensus.cc:515] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.599206  2394 raft_consensus.cc:515] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.602254  2393 leader_election.cc:290] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.602782  2394 leader_election.cc:290] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
W20260709 12:15:41.637274  1936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.471s	user 0.043s	sys 0.109s
W20260709 12:15:41.638100  1936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.472s	user 0.043s	sys 0.109s
W20260709 12:15:41.638572  1936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.195:45777, user_credentials={real_user=slave}} blocked reactor thread for 2.47248e+06us
I20260709 12:15:41.642589  2393 raft_consensus.cc:493] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.643733  2393 raft_consensus.cc:515] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.646613  2393 leader_election.cc:290] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.649277  2393 raft_consensus.cc:493] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.651202  2393 raft_consensus.cc:515] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.652563  2390 raft_consensus.cc:493] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.654624  2390 raft_consensus.cc:515] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.655040  2389 raft_consensus.cc:493] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.659660  2389 raft_consensus.cc:515] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.657382  2390 leader_election.cc:290] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.653095  2395 raft_consensus.cc:493] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f70dae7dc1c43b08d2c65022d53e6e3)
I20260709 12:15:41.658671  2392 raft_consensus.cc:493] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.662468  2396 raft_consensus.cc:493] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.666493  2041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.672286  2396 raft_consensus.cc:515] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.655177  2391 raft_consensus.cc:493] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.673866  2389 leader_election.cc:290] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.674597  2391 raft_consensus.cc:515] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.675197  2396 leader_election.cc:290] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.675985  2396 raft_consensus.cc:493] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.670112  2395 raft_consensus.cc:515] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.680140  2395 leader_election.cc:290] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.680905  2395 raft_consensus.cc:493] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.681568  2391 leader_election.cc:290] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.683001  2395 raft_consensus.cc:515] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.686174  2395 leader_election.cc:290] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.658684  2393 leader_election.cc:290] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.688217  2392 raft_consensus.cc:515] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.676692  2396 raft_consensus.cc:515] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.689793  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.697516  2041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.694269  2044 raft_consensus.cc:2468] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:41.698573  2041 raft_consensus.cc:2468] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:41.701277  2041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.701370  2396 leader_election.cc:290] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.707055  2041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.708348  2041 raft_consensus.cc:2468] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:41.709086  2398 raft_consensus.cc:493] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.709604  2395 raft_consensus.cc:493] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.710237  2398 raft_consensus.cc:515] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.711077  2395 raft_consensus.cc:515] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.715003  2392 leader_election.cc:290] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.726434  2398 leader_election.cc:290] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.719763  1936 leader_election.cc:304] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:41.745868  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.746925  1970 raft_consensus.cc:2468] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 1.
I20260709 12:15:41.748481  2390 raft_consensus.cc:493] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.751799  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.752131  1936 leader_election.cc:304] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:41.751996  2390 raft_consensus.cc:515] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.755698  2390 leader_election.cc:290] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.750432  2389 raft_consensus.cc:493] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.758859  2389 raft_consensus.cc:515] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.760536  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.762919  2389 leader_election.cc:290] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.763954  1970 raft_consensus.cc:2468] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:41.764432  2396 raft_consensus.cc:2804] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.765029  2396 raft_consensus.cc:493] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.765321  2399 raft_consensus.cc:2804] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.765419  2396 raft_consensus.cc:3060] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.766130  2399 raft_consensus.cc:493] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.765234  1936 leader_election.cc:304] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:41.766800  2399 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.772465  2398 raft_consensus.cc:2804] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.773260  2398 raft_consensus.cc:493] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.773839  2398 raft_consensus.cc:3060] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.769186  2395 leader_election.cc:290] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.793295  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.794013  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.796499  2046 raft_consensus.cc:2468] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:41.793450  2043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.797873  2043 raft_consensus.cc:2468] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 1.
I20260709 12:15:41.798727  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.799683  2042 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:41.802814  1972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.804008  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.804324  1966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.804410  1970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.805459  2401 raft_consensus.cc:493] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.806370  2401 raft_consensus.cc:515] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.806958  1969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.807241  2403 raft_consensus.cc:493] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.808027  2403 raft_consensus.cc:515] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.808802  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.809566  1971 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:41.811604  2400 raft_consensus.cc:493] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f70dae7dc1c43b08d2c65022d53e6e3)
I20260709 12:15:41.812412  2404 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.812582  2400 raft_consensus.cc:515] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.813392  2404 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.816548  2404 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.821062  2389 raft_consensus.cc:493] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.821777  2389 raft_consensus.cc:515] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.823923  2389 leader_election.cc:290] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.828115  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63c053187f74f838cea1bfee35cffd5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.831156  2400 leader_election.cc:290] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.831794  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.833832  2042 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:41.839095  2396 raft_consensus.cc:515] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.840049  2404 raft_consensus.cc:493] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f70dae7dc1c43b08d2c65022d53e6e3)
I20260709 12:15:41.841212  2406 raft_consensus.cc:493] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f70dae7dc1c43b08d2c65022d53e6e3)
I20260709 12:15:41.842383  2404 raft_consensus.cc:515] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.842594  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.844272  1967 raft_consensus.cc:2393] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in current term 2: Already voted for candidate 45281c12ca694ae1bbd01c89f0cf5899 in this term.
I20260709 12:15:41.843222  2406 raft_consensus.cc:515] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.847179  2403 leader_election.cc:290] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.849658  1936 leader_election.cc:304] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:41.850306  2404 leader_election.cc:290] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.851732  2402 raft_consensus.cc:2804] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.852129  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.854451  1971 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:41.854842  2396 leader_election.cc:290] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.853251  2398 raft_consensus.cc:515] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.864027  1891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.853613  2401 leader_election.cc:290] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.865242  1891 raft_consensus.cc:2468] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 1.
I20260709 12:15:41.865852  2401 raft_consensus.cc:493] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.866591  2401 raft_consensus.cc:515] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.867612  1967 raft_consensus.cc:1240] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Rejecting Update request from peer 9ba5ba0aeb514c019743af20c0968a00 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:41.868448  2406 leader_election.cc:290] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.868891  2401 leader_election.cc:290] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.869709  2398 leader_election.cc:290] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.852567  1936 leader_election.cc:304] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:41.855242  2402 raft_consensus.cc:493] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.870558  2402 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.871083  1965 raft_consensus.cc:1240] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Rejecting Update request from peer 9ba5ba0aeb514c019743af20c0968a00 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:41.873592  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.876312  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.856812  2399 raft_consensus.cc:515] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.857014  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.860086  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.860291  2010 leader_election.cc:304] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:41.860105  2400 raft_consensus.cc:493] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.861570  2408 raft_consensus.cc:493] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f70dae7dc1c43b08d2c65022d53e6e3)
I20260709 12:15:41.862622  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.879891  2399 leader_election.cc:290] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.880918  2400 raft_consensus.cc:515] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.863054  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.882545  2405 raft_consensus.cc:2804] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.883127  2405 raft_consensus.cc:493] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.883226  1896 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:41.883522  2405 raft_consensus.cc:3060] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.884126  2400 leader_election.cc:290] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.884501  2040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.864076  1892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.855811  2403 raft_consensus.cc:493] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.886175  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.886168  2403 raft_consensus.cc:515] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.887435  1892 raft_consensus.cc:2468] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:41.881301  2408 raft_consensus.cc:515] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.888808  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.889084  2403 leader_election.cc:290] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.890993  2408 leader_election.cc:290] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.891677  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.893098  2010 leader_election.cc:304] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:41.893249  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.900030  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.893867  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.895596  1971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.900825  1894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.896523  1965 raft_consensus.cc:1240] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Rejecting Update request from peer 9ba5ba0aeb514c019743af20c0968a00 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:41.898551  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.899187  1892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.902294  2389 raft_consensus.cc:2804] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.902768  2389 raft_consensus.cc:493] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.899847  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.903357  1894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.903551  2010 leader_election.cc:304] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:41.903267  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.902779  1892 raft_consensus.cc:2468] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:41.904987  2392 raft_consensus.cc:2804] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.906386  2392 raft_consensus.cc:493] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.906832  2392 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.908700  1892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
W20260709 12:15:41.909904  1936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.195:45777, user_credentials={real_user=slave}} blocked reactor thread for 57450.3us
I20260709 12:15:41.910538  1936 leader_election.cc:304] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:41.903223  2389 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.910795  1892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.912832  1892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.913055  2405 raft_consensus.cc:515] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.914320  2046 raft_consensus.cc:1240] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Rejecting Update request from peer 9ba5ba0aeb514c019743af20c0968a00 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:41.915438  2405 leader_election.cc:290] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.916501  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.917452  2010 leader_election.cc:304] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:41.918351  2390 raft_consensus.cc:2804] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.918792  2390 raft_consensus.cc:493] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.919183  2390 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.920759  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:41.921386  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3016eb3ea9c04be4bbd0c00f2ffda7a5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.922636  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.923132  1891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63c053187f74f838cea1bfee35cffd5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.923478  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.924003  2398 raft_consensus.cc:2804] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.924381  2398 raft_consensus.cc:493] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.924742  2398 raft_consensus.cc:3060] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.908578  2402 raft_consensus.cc:515] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.925336  1894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.925947  1967 raft_consensus.cc:1240] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Rejecting Update request from peer 9ba5ba0aeb514c019743af20c0968a00 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:41.927053  2402 leader_election.cc:290] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.927939  2402 raft_consensus.cc:2804] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.928294  2402 raft_consensus.cc:493] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.928673  2402 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.925340  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b44039da6645f2825cc5bbeb92dcbd" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.923293  2045 raft_consensus.cc:2468] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:41.931396  1892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.933068  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:41.933933  1891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:41.934866  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63c053187f74f838cea1bfee35cffd5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.935726  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.936815  1892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:41.937498  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:41.939097  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:41.939821  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.941638  2392 raft_consensus.cc:515] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.942862  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.944307  2392 leader_election.cc:290] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.944661  2009 leader_election.cc:304] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:41.945703  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:41.946122  2391 raft_consensus.cc:2804] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.946640  2391 raft_consensus.cc:493] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.947010  2391 raft_consensus.cc:3060] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.950366  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:41.951673  1935 leader_election.cc:304] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:41.955185  2390 raft_consensus.cc:515] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.956393  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5fd01b22d24de7b0ebd16e3bf4276e" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.957053  2396 raft_consensus.cc:2749] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:41.957865  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63c053187f74f838cea1bfee35cffd5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.955600  1935 leader_election.cc:304] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:41.960511  2390 leader_election.cc:290] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.961185  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.961202  2396 raft_consensus.cc:2749] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.962807  1935 leader_election.cc:304] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:41.963310  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.964552  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e37b9d2157f4472b9b94ff50988687d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:41.923134  1936 leader_election.cc:304] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:41.965366  2396 raft_consensus.cc:2804] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.965904  2396 raft_consensus.cc:493] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f70dae7dc1c43b08d2c65022d53e6e3)
I20260709 12:15:41.966988  2396 raft_consensus.cc:3060] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.967037  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:41.969981  2009 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:41.965622  2389 raft_consensus.cc:515] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.970844  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:41.971457  2392 raft_consensus.cc:2804] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.971910  2392 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.972312  2392 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.972828  2389 leader_election.cc:290] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:41.966470  2399 raft_consensus.cc:2804] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.974334  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:41.974408  2399 raft_consensus.cc:493] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:41.975376  2399 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.975414  1965 raft_consensus.cc:2393] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in current term 3: Already voted for candidate 45281c12ca694ae1bbd01c89f0cf5899 in this term.
I20260709 12:15:41.955266  2398 raft_consensus.cc:515] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.980553  2398 leader_election.cc:290] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:41.980697  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:41.984615  2408 consensus_queue.cc:1059] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:41.985122  1861 leader_election.cc:304] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:41.985169  2009 leader_election.cc:304] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:41.985826  2408 raft_consensus.cc:3055] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:41.986369  2408 raft_consensus.cc:740] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:41.986502  2403 raft_consensus.cc:2804] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.988039  2400 consensus_queue.cc:1059] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:41.987439  2408 consensus_queue.cc:260] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.989421  2408 raft_consensus.cc:3060] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.989432  2401 raft_consensus.cc:3055] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:41.990058  2401 raft_consensus.cc:740] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:41.991436  2391 raft_consensus.cc:515] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.991155  2401 consensus_queue.cc:260] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:41.992625  2401 raft_consensus.cc:3060] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.988566  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:41.994426  2400 consensus_queue.cc:1059] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:41.995440  2406 raft_consensus.cc:3055] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:41.995838  2406 raft_consensus.cc:740] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:41.995949  1861 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:41.988497  2403 raft_consensus.cc:493] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:41.996933  2400 raft_consensus.cc:2749] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.997576  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:41.997768  1891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:41.998123  1892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:41.997210  2403 raft_consensus.cc:3060] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.998991  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:41.999825  2044 raft_consensus.cc:2393] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 45281c12ca694ae1bbd01c89f0cf5899 in current term 2: Already voted for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in this term.
I20260709 12:15:41.987844  2009 leader_election.cc:304] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:41.999997  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:42.000590  2390 raft_consensus.cc:2804] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:42.001051  2390 raft_consensus.cc:493] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:42.000047  2391 leader_election.cc:290] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:42.001534  2390 raft_consensus.cc:3060] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.001890  2391 raft_consensus.cc:2749] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.999946  1861 leader_election.cc:304] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:42.004280  2409 raft_consensus.cc:2749] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.004576  1861 leader_election.cc:304] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:42.005820  2404 raft_consensus.cc:2749] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.003865  2009 leader_election.cc:304] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.008091  2009 leader_election.cc:304] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:41.996845  2406 consensus_queue.cc:260] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.009680  2410 raft_consensus.cc:2749] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.010634  2009 leader_election.cc:304] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.010797  2406 raft_consensus.cc:3060] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.011525  2410 raft_consensus.cc:2749] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.008752  2391 raft_consensus.cc:2749] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.012181  1861 leader_election.cc:304] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:42.013381  2409 raft_consensus.cc:2749] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.014438  1861 leader_election.cc:304] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:42.015588  2409 raft_consensus.cc:2749] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:42.016413  2409 consensus_queue.cc:1059] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:42.017246  2392 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.017747  2409 consensus_queue.cc:1059] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:42.018854  2409 raft_consensus.cc:3055] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.019169  2409 raft_consensus.cc:740] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:42.019448  2392 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:42.020260  2407 raft_consensus.cc:3055] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.020704  2407 raft_consensus.cc:740] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:42.021661  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:42.021814  2407 consensus_queue.cc:260] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.023571  2407 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.026376  2390 raft_consensus.cc:515] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.026479  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:42.026647  2409 consensus_queue.cc:260] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.031692  2396 raft_consensus.cc:515] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.030228  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:42.010911  2402 raft_consensus.cc:515] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.036433  1967 raft_consensus.cc:1240] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Rejecting Update request from peer 2f70dae7dc1c43b08d2c65022d53e6e3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:42.032116  2409 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.037972  2403 raft_consensus.cc:515] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.032987  2009 leader_election.cc:304] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.016435  1861 leader_election.cc:304] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:42.040144  2403 leader_election.cc:290] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:42.034952  2399 raft_consensus.cc:515] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.029155  2390 leader_election.cc:290] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:42.040457  2392 consensus_queue.cc:1059] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:42.041204  2407 raft_consensus.cc:2749] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.041836  2392 raft_consensus.cc:3055] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.042275  2392 raft_consensus.cc:740] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:42.042309  2399 leader_election.cc:290] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:42.040285  1861 leader_election.cc:304] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:42.043612  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:42.040285  2389 raft_consensus.cc:3060] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.044380  1861 leader_election.cc:304] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:42.040555  2009 leader_election.cc:304] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.045635  1861 leader_election.cc:304] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:42.046381  2390 raft_consensus.cc:2749] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.046705  2407 raft_consensus.cc:2749] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.048236  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:42.048539  2409 raft_consensus.cc:2749] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.048934  1935 leader_election.cc:304] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.043409  2392 consensus_queue.cc:260] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.050367  2398 raft_consensus.cc:2749] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.050539  2392 raft_consensus.cc:3060] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.050890  1935 leader_election.cc:304] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.051872  2398 raft_consensus.cc:2749] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.052731  2402 leader_election.cc:290] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:42.052881  1935 leader_election.cc:304] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.053306  2009 leader_election.cc:304] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.054018  2402 raft_consensus.cc:2749] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.054368  2390 raft_consensus.cc:2749] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.054690  2009 leader_election.cc:304] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.055778  2390 raft_consensus.cc:2749] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.056707  2009 leader_election.cc:304] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.057370  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:42.057906  2396 leader_election.cc:290] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:42.049292  2409 raft_consensus.cc:2749] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.058159  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf40fa603ea47c9ade85bbe75cdbd0c" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:42.058387  2390 raft_consensus.cc:2749] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.058830  2046 raft_consensus.cc:3060] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.060266  1892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:42.060530  1891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e51bd2a7da491ebb970d30afb8dc6f" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:42.060446  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:42.064070  2009 leader_election.cc:304] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.066460  1896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:42.066998  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:42.067625  2392 raft_consensus.cc:2749] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.068688  2009 leader_election.cc:304] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.069190  1895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:42.059578  2389 raft_consensus.cc:2749] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.069924  2009 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.071182  2009 leader_election.cc:304] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.071907  2405 raft_consensus.cc:2749] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.072204  2392 raft_consensus.cc:2749] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.072750  2405 raft_consensus.cc:2749] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.075109  1894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:42.075747  1891 raft_consensus.cc:2468] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 2.
I20260709 12:15:42.074090  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:42.072717  1892 raft_consensus.cc:2468] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 3.
I20260709 12:15:42.076889  2045 raft_consensus.cc:2468] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 3.
I20260709 12:15:42.077834  1893 raft_consensus.cc:1240] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Rejecting Update request from peer 45281c12ca694ae1bbd01c89f0cf5899 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:42.078343  1936 leader_election.cc:304] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 
I20260709 12:15:42.079085  1891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aaa3a7477434db49c6ee38cd3eb7d36" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:42.079332  2396 raft_consensus.cc:2804] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:42.079787  1935 leader_election.cc:304] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.080658  2046 raft_consensus.cc:2468] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 3.
I20260709 12:15:42.081507  2396 raft_consensus.cc:697] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:42.082412  1935 leader_election.cc:304] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:42.083317  2044 raft_consensus.cc:1240] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Rejecting Update request from peer 45281c12ca694ae1bbd01c89f0cf5899 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:42.083328  1861 leader_election.cc:304] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:42.083588  2396 consensus_queue.cc:237] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.084486  2409 raft_consensus.cc:2804] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:42.085050  2409 raft_consensus.cc:697] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 3 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:42.085273  1935 leader_election.cc:304] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.085459  2402 raft_consensus.cc:2804] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.085289  2399 raft_consensus.cc:2749] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.086107  2409 consensus_queue.cc:237] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.086635  2393 consensus_queue.cc:1059] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:42.086941  1935 leader_election.cc:304] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:42.087378  2402 raft_consensus.cc:697] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:42.087710  2394 raft_consensus.cc:2804] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:42.088315  2394 raft_consensus.cc:697] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:42.088536  2402 consensus_queue.cc:237] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.086134  2398 raft_consensus.cc:2749] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.089468  2394 consensus_queue.cc:237] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.090431  2393 raft_consensus.cc:3055] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.090938  2393 raft_consensus.cc:740] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:42.090613  2399 consensus_queue.cc:1059] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:42.097450  2393 consensus_queue.cc:260] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.101207  2393 raft_consensus.cc:3060] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.110229  1792 catalog_manager.cc:5697] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 2 to 3, leader changed from 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195) to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 3 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.111423  1795 catalog_manager.cc:5697] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 2 to 3, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.135994  1795 catalog_manager.cc:5697] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 1 to 2, leader changed from 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193) to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 2 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.137645  1795 catalog_manager.cc:5697] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 2 to 3, leader changed from 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193) to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 3 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.138530  2044 raft_consensus.cc:1240] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Rejecting Update request from peer 45281c12ca694ae1bbd01c89f0cf5899 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.140136  2396 consensus_queue.cc:1059] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:42.141093  2402 raft_consensus.cc:3055] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:42.141377  2402 raft_consensus.cc:740] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:42.142189  2402 consensus_queue.cc:260] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.143412  2402 raft_consensus.cc:3060] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.207312  2044 raft_consensus.cc:1240] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Rejecting Update request from peer 45281c12ca694ae1bbd01c89f0cf5899 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:42.208753  2402 consensus_queue.cc:1059] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:42.209772  2396 raft_consensus.cc:3055] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.210062  2396 raft_consensus.cc:740] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:42.210919  2396 consensus_queue.cc:260] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.212242  2396 raft_consensus.cc:3060] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.264729  2044 raft_consensus.cc:1240] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Rejecting Update request from peer 45281c12ca694ae1bbd01c89f0cf5899 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:42.266410  2396 consensus_queue.cc:1059] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:42.267421  2402 raft_consensus.cc:3055] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.267755  2402 raft_consensus.cc:740] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:42.268467  2402 consensus_queue.cc:260] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.269486  2402 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.319096  1967 raft_consensus.cc:1240] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Rejecting Update request from peer 9ba5ba0aeb514c019743af20c0968a00 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:42.320676  2409 consensus_queue.cc:1059] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:42.321798  2408 raft_consensus.cc:3055] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.322278  2408 raft_consensus.cc:740] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:42.323041  2408 consensus_queue.cc:260] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.324129  2408 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.337900  2044 raft_consensus.cc:1240] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Rejecting Update request from peer 9ba5ba0aeb514c019743af20c0968a00 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:42.339489  2408 consensus_queue.cc:1059] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:42.340633  2409 raft_consensus.cc:3055] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.341063  2409 raft_consensus.cc:740] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:42.342262  2409 consensus_queue.cc:260] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.343739  2409 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.393976 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:42.403105  1967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d05e54ae17940119053ca939f60840b"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
mode: GRACEFUL
new_leader_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:38924
I20260709 12:15:42.403745  1967 raft_consensus.cc:606] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 LEADER]: Received request to transfer leadership to TS 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:42.406652  1967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
mode: GRACEFUL
new_leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
 from {username='slave'} at 127.0.0.1:38924
I20260709 12:15:42.407191  1967 raft_consensus.cc:606] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Received request to transfer leadership to TS 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:42.408310 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:42.408928 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:42.492885  2044 raft_consensus.cc:1275] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:15:42.494643  2402 consensus_queue.cc:1048] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:42.496066  1967 raft_consensus.cc:1275] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:42.497686  2409 consensus_queue.cc:1048] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:42.511538  1891 raft_consensus.cc:1275] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:15:42.515530  2402 consensus_queue.cc:1048] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:15:42.537489  2044 raft_consensus.cc:1275] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:42.553781  2044 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.560320  2403 consensus_queue.cc:1048] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:15:42.565770  2044 raft_consensus.cc:1275] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:15:42.566890  2067 debug-util.cc:398] Leaking SignalData structure 0x7b08001a1620 after lost signal to thread 20894
W20260709 12:15:42.568446  2067 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0ea0 after lost signal to thread 1829
I20260709 12:15:42.568810  2402 consensus_queue.cc:1048] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:15:42.569785  2067 debug-util.cc:398] Leaking SignalData structure 0x7b0800096a40 after lost signal to thread 1921
W20260709 12:15:42.571178  2067 debug-util.cc:398] Leaking SignalData structure 0x7b08002a81c0 after lost signal to thread 1996
W20260709 12:15:42.572431  2067 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0860 after lost signal to thread 2070
I20260709 12:15:42.576655  1892 raft_consensus.cc:3060] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.581676  1893 raft_consensus.cc:1275] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:42.584129  2402 consensus_queue.cc:1048] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:42.599546  1892 raft_consensus.cc:1275] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:42.608915  2396 consensus_queue.cc:1048] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:42.613682  2044 raft_consensus.cc:1275] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:42.615201  2396 consensus_queue.cc:1048] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:42.616950  2402 raft_consensus.cc:993] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899: : Instructing follower 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:42.617496  2393 raft_consensus.cc:1081] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 LEADER]: Signalling peer 9ba5ba0aeb514c019743af20c0968a00 to start an election
I20260709 12:15:42.621572  1893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d05e54ae17940119053ca939f60840b"
dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
 from {username='slave'} at 127.0.0.1:48394
I20260709 12:15:42.622282  1893 raft_consensus.cc:493] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:42.622884  1893 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:42.652093  1893 raft_consensus.cc:515] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.658166  2402 raft_consensus.cc:993] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899: : Instructing follower 2f70dae7dc1c43b08d2c65022d53e6e3 to start an election
I20260709 12:15:42.659119  2393 raft_consensus.cc:1081] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Signalling peer 2f70dae7dc1c43b08d2c65022d53e6e3 to start an election
I20260709 12:15:42.660697  2044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb"
dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
 from {username='slave'} at 127.0.0.1:53434
I20260709 12:15:42.663726  1893 leader_election.cc:290] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:42.664223  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:42.664947  1967 raft_consensus.cc:3055] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:42.665071  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d05e54ae17940119053ca939f60840b" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:42.665337  1967 raft_consensus.cc:740] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:42.665959  2046 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:42.666411  1967 consensus_queue.cc:260] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.667826  1967 raft_consensus.cc:3060] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:42.668474  2044 raft_consensus.cc:493] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:42.669009  2044 raft_consensus.cc:3060] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.676608  1967 raft_consensus.cc:2468] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 4.
I20260709 12:15:42.677826  1861 leader_election.cc:304] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:42.679134  2409 raft_consensus.cc:2804] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:42.679595  2409 raft_consensus.cc:697] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 4 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:42.680086  2046 raft_consensus.cc:2468] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 4.
I20260709 12:15:42.680413  2409 consensus_queue.cc:237] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.677343  2044 raft_consensus.cc:515] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.684616  2044 leader_election.cc:290] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:42.685218  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:42.685863  1893 raft_consensus.cc:3060] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.688223  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:42.689064  1967 raft_consensus.cc:3055] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:42.690539  1967 raft_consensus.cc:740] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:42.691824  1967 consensus_queue.cc:260] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.697042  1967 raft_consensus.cc:3060] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.699064  1795 catalog_manager.cc:5697] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 3 to 4, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 4 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.697154  1893 raft_consensus.cc:2468] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:42.701005  2009 leader_election.cc:304] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:42.701939  2392 raft_consensus.cc:2804] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.702605  2392 raft_consensus.cc:697] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:42.703922  2392 consensus_queue.cc:237] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:42.706929  1967 raft_consensus.cc:2468] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:42.717242  1794 catalog_manager.cc:5697] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 1 to 2, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 2 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.211817  1967 raft_consensus.cc:1275] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.213394  2392 consensus_queue.cc:1048] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.226367  2437 raft_consensus.cc:493] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.227128  2437 raft_consensus.cc:515] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.256657  1893 raft_consensus.cc:1275] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.257170  2437 leader_election.cc:290] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.258029  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:43.256657  2044 raft_consensus.cc:1275] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:43.260756  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:43.264868  2392 consensus_queue.cc:1048] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:15:43.266390  1967 raft_consensus.cc:2468] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 3.
I20260709 12:15:43.268378  1861 leader_election.cc:304] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:43.260986  2437 consensus_queue.cc:1048] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:43.270149  2403 raft_consensus.cc:2804] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:43.270627  2403 raft_consensus.cc:493] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.271018  2403 raft_consensus.cc:3060] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.286201  2403 raft_consensus.cc:515] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.289235  2403 leader_election.cc:290] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.293919  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:43.293740  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:43.294729  1967 raft_consensus.cc:3060] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.301448  1965 raft_consensus.cc:1275] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:43.303539  2409 consensus_queue.cc:1048] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:43.306181  1967 raft_consensus.cc:2468] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 4.
I20260709 12:15:43.307812  1861 leader_election.cc:304] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:43.308941  2437 raft_consensus.cc:2804] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:43.309536  2437 raft_consensus.cc:697] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 4 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:43.310449  2437 consensus_queue.cc:237] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.332937  1795 catalog_manager.cc:5697] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.391340  2392 raft_consensus.cc:493] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:43.392127  2392 raft_consensus.cc:515] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.394796  2392 leader_election.cc:290] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:43.395733  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:43.396252  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b2c458d716469db89797427f5cc78b" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:43.397118  1965 raft_consensus.cc:2368] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f70dae7dc1c43b08d2c65022d53e6e3 for earlier term 3. Current term is 4.
I20260709 12:15:43.398367  2010 leader_election.cc:400] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375) with higher term. Message: Invalid argument: T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f70dae7dc1c43b08d2c65022d53e6e3 for earlier term 3. Current term is 4.
I20260709 12:15:43.398645  2010 leader_election.cc:403] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:43.399188  2392 raft_consensus.cc:3060] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.408202  2392 raft_consensus.cc:2749] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375) with higher term. Message: Invalid argument: T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f70dae7dc1c43b08d2c65022d53e6e3 for earlier term 3. Current term is 4.
I20260709 12:15:43.410127 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:43.417207 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:43.417822 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:43.418370  2437 raft_consensus.cc:493] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:43.419044  2437 raft_consensus.cc:515] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.420956  2437 leader_election.cc:290] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.422219  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:43.422060  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:43.423238  2044 raft_consensus.cc:2393] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba5ba0aeb514c019743af20c0968a00 in current term 2: Already voted for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in this term.
I20260709 12:15:43.423197  1965 raft_consensus.cc:2468] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:43.424811  1861 leader_election.cc:304] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:43.425526  2437 raft_consensus.cc:2804] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:43.425906  2437 raft_consensus.cc:493] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:43.426244  2437 raft_consensus.cc:3060] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.433233  2437 raft_consensus.cc:515] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.435555  2437 leader_election.cc:290] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.436404  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:43.438313  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:43.439437  2044 raft_consensus.cc:2393] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ba5ba0aeb514c019743af20c0968a00 in current term 2: Already voted for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in this term.
I20260709 12:15:43.444175  1967 raft_consensus.cc:2468] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:43.445452  1861 leader_election.cc:304] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:43.446560  2437 raft_consensus.cc:2804] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:43.447528  2437 raft_consensus.cc:697] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:43.448617  2437 consensus_queue.cc:237] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.459100  1795 catalog_manager.cc:5697] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 1 to 2, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 2 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.575791  2437 raft_consensus.cc:493] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:43.576476  2437 raft_consensus.cc:515] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.579100  2437 leader_election.cc:290] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.580389  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:43.581259  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:43.581548  1967 raft_consensus.cc:2468] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 3.
I20260709 12:15:43.582134  2044 raft_consensus.cc:2393] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba5ba0aeb514c019743af20c0968a00 in current term 3: Already voted for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in this term.
I20260709 12:15:43.582860  1861 leader_election.cc:304] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:43.583809  2437 raft_consensus.cc:2804] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.584316  2437 raft_consensus.cc:493] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:43.584740  2437 raft_consensus.cc:3060] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.594022  2437 raft_consensus.cc:515] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.596658  2437 leader_election.cc:290] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.597828  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:43.598347  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e439d066c549529b6382b34a74aa00" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:43.599359  2044 raft_consensus.cc:2393] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ba5ba0aeb514c019743af20c0968a00 in current term 3: Already voted for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in this term.
I20260709 12:15:43.604599  1967 raft_consensus.cc:2468] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 3.
I20260709 12:15:43.605914  1861 leader_election.cc:304] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:43.606938  2437 raft_consensus.cc:2804] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:43.607482  2437 raft_consensus.cc:697] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:43.608404  2437 consensus_queue.cc:237] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.618427  1795 catalog_manager.cc:5697] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 2 to 3, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.651486  2437 raft_consensus.cc:493] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.652247  2437 raft_consensus.cc:515] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.654693  2437 leader_election.cc:290] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.655396  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:43.656175  1967 raft_consensus.cc:2468] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:43.656967  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:43.657586  1861 leader_election.cc:304] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:43.658392  2044 raft_consensus.cc:2468] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 2.
I20260709 12:15:43.658756  2437 raft_consensus.cc:2804] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.659209  2437 raft_consensus.cc:493] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.659595  2437 raft_consensus.cc:3060] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.665833  2437 raft_consensus.cc:515] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.667064  2392 raft_consensus.cc:493] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.667982  2437 leader_election.cc:290] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.667826  2392 raft_consensus.cc:515] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.668838  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:43.669355  1967 raft_consensus.cc:3060] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.671420  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:43.670559  2392 leader_election.cc:290] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:43.673242  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059d1f08e080485bb07140f9857e075f" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:43.673947  2044 raft_consensus.cc:3060] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.674605  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:43.675453  1965 raft_consensus.cc:2468] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 2.
I20260709 12:15:43.678117  1967 raft_consensus.cc:2468] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 3.
I20260709 12:15:43.675383  2392 raft_consensus.cc:493] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.679265  2392 raft_consensus.cc:515] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.679893  1861 leader_election.cc:304] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:43.678066  2010 leader_election.cc:304] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:43.682824  2439 raft_consensus.cc:2804] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.683274  2439 raft_consensus.cc:493] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.683324  2044 raft_consensus.cc:2468] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 3.
I20260709 12:15:43.683817  2439 raft_consensus.cc:3060] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.682022  2437 raft_consensus.cc:2804] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:43.684672  2437 raft_consensus.cc:697] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 3 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:43.685844  2392 leader_election.cc:290] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:43.685631  2437 consensus_queue.cc:237] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.687445  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:43.688165  1893 raft_consensus.cc:2468] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 3.
I20260709 12:15:43.689428  2009 leader_election.cc:304] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:43.690474  2392 raft_consensus.cc:2804] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:43.690763  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:43.692956  1967 raft_consensus.cc:2468] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 3.
I20260709 12:15:43.691366  2445 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:43.694708  2445 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.697696  2445 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.697556  2439 raft_consensus.cc:515] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.701859  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:43.702808  1965 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 3.
I20260709 12:15:43.702921  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:43.703788  1968 raft_consensus.cc:3060] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.704941  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e4963adbf934f07addde68878a1db8d" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:43.708681  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:43.709455  2044 raft_consensus.cc:2393] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba5ba0aeb514c019743af20c0968a00 in current term 3: Already voted for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in this term.
I20260709 12:15:43.712186  1861 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 2f70dae7dc1c43b08d2c65022d53e6e3
I20260709 12:15:43.715844  2445 raft_consensus.cc:2804] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.716454  2445 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45281c12ca694ae1bbd01c89f0cf5899)
I20260709 12:15:43.717025  2445 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.718739  2439 leader_election.cc:290] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:43.690925  2392 raft_consensus.cc:493] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.720747  1968 raft_consensus.cc:2468] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 3.
I20260709 12:15:43.721174  2392 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.722381  2010 leader_election.cc:304] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:43.723716  2439 raft_consensus.cc:2804] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:43.725327  2439 raft_consensus.cc:697] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:43.726553  2439 consensus_queue.cc:237] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.735869  1795 catalog_manager.cc:5697] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.738793  2392 raft_consensus.cc:515] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.742156  2392 leader_election.cc:290] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:43.743110  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:43.743861  1893 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.745496  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3095ee628fdb41808c568effe5711f80" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:43.746414  1968 raft_consensus.cc:3060] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.750862  1794 catalog_manager.cc:5697] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 2 to 3, leader changed from 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193) to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 3 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.757130  1893 raft_consensus.cc:2468] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 4.
I20260709 12:15:43.758756  2009 leader_election.cc:304] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:43.759322  1968 raft_consensus.cc:2468] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 4.
I20260709 12:15:43.761562  2439 raft_consensus.cc:2804] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:43.762478  2439 raft_consensus.cc:697] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:43.762432  2445 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.763886  2439 consensus_queue.cc:237] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.765072  2445 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.767458  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:43.768095  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:43.769062  2046 raft_consensus.cc:2393] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ba5ba0aeb514c019743af20c0968a00 in current term 3: Already voted for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in this term.
I20260709 12:15:43.776849  1968 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 3.
I20260709 12:15:43.782869  1861 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:43.783823  2445 raft_consensus.cc:2804] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:43.784430  2445 raft_consensus.cc:697] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:43.786082  2445 consensus_queue.cc:237] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.786383  2437 raft_consensus.cc:493] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.787132  2437 raft_consensus.cc:515] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.787343  1794 catalog_manager.cc:5697] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 2 to 4, leader changed from 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193) to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 4 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.789458  2437 leader_election.cc:290] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.791914  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:43.792744  1965 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 3.
I20260709 12:15:43.795758  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:43.796656  2046 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 3.
I20260709 12:15:43.798460  1861 leader_election.cc:304] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:43.800469  2437 raft_consensus.cc:2804] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:43.800871  2437 raft_consensus.cc:493] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.801211  2437 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.813357  2437 raft_consensus.cc:515] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.817597  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:43.818136  2439 raft_consensus.cc:493] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.818410  1968 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.818928  2439 raft_consensus.cc:515] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.822592  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:43.823130  2439 leader_election.cc:290] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:43.823335  1893 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 3.
I20260709 12:15:43.825963  1965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:43.826839  1965 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 3.
I20260709 12:15:43.826972  2437 leader_election.cc:290] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:43.828191  2009 leader_election.cc:304] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:43.829263  2439 raft_consensus.cc:2804] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:43.829725  2439 raft_consensus.cc:493] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.830127  2439 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.831449  1968 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 4.
I20260709 12:15:43.832679  1861 leader_election.cc:304] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:43.834115  2409 raft_consensus.cc:2804] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:43.834652  2409 raft_consensus.cc:697] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:43.835512  2409 consensus_queue.cc:237] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.837330  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f7b70ca9f74046a805b8e76a18d9b8" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:43.838038  2046 raft_consensus.cc:3060] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.839752  2439 raft_consensus.cc:515] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.842999  2439 leader_election.cc:290] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:43.843463  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:43.844408  1893 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.851266  2046 raft_consensus.cc:2468] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 4.
I20260709 12:15:43.852643  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b1da1a1ab8e44cd98f3f0a7e2cf3114" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:43.853972  1893 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 4.
I20260709 12:15:43.854630  1968 raft_consensus.cc:3060] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.855479  2009 leader_election.cc:304] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:43.855594  1794 catalog_manager.cc:5697] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 2 to 3, leader changed from 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194) to 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193). New cstate: current_term: 3 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.856564  2439 raft_consensus.cc:2804] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:43.857900  2439 raft_consensus.cc:697] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 LEADER]: Becoming Leader. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:43.858955  2439 consensus_queue.cc:237] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.864574  1968 raft_consensus.cc:2468] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 4.
I20260709 12:15:43.874572  1794 catalog_manager.cc:5697] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 reported cstate change: term changed from 2 to 4, leader changed from 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193) to 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195). New cstate: current_term: 4 leader_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.878103  1795 catalog_manager.cc:5697] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.903064  2046 raft_consensus.cc:1240] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 LEADER]: Rejecting Update request from peer 9ba5ba0aeb514c019743af20c0968a00 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:43.905421  2445 consensus_queue.cc:1059] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:43.905790  2046 raft_consensus.cc:1275] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:43.906992  2445 consensus_queue.cc:1243] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Peer 2f70dae7dc1c43b08d2c65022d53e6e3 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:15:43.907624  2445 raft_consensus.cc:3055] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:43.907960  2445 raft_consensus.cc:740] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:43.908044  2437 consensus_queue.cc:1048] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:43.909135  2445 consensus_queue.cc:260] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:43.910468  2445 raft_consensus.cc:3060] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.913210  1968 raft_consensus.cc:1275] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:43.916637  2437 consensus_queue.cc:1048] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:44.057570  2046 raft_consensus.cc:1275] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:44.059026  2445 consensus_queue.cc:1048] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:44.077888  1968 raft_consensus.cc:1275] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:44.079393  2445 consensus_queue.cc:1048] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:44.136507  1968 raft_consensus.cc:1275] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:44.138058  2445 consensus_queue.cc:1048] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:44.152742  2046 raft_consensus.cc:1275] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:44.154597  2462 consensus_queue.cc:1048] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:44.231525  2439 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.231633  2046 raft_consensus.cc:1275] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:44.232180  2439 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:44.233212  2409 consensus_queue.cc:1048] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:44.234648  2439 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:44.235491  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:44.237427  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:44.238171  1968 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f70dae7dc1c43b08d2c65022d53e6e3 in term 3.
I20260709 12:15:44.239449  2010 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 45281c12ca694ae1bbd01c89f0cf5899; no voters: 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:44.241313  2439 raft_consensus.cc:2804] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:44.241717  2439 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.242015  2439 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:44.250015  1893 raft_consensus.cc:1275] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:15:44.250502  1968 raft_consensus.cc:1275] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:44.250571  1893 pending_rounds.cc:85] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00: Aborting all ops after (but not including) 2
I20260709 12:15:44.252061  1893 pending_rounds.cc:107] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 12:15:44.252341  2462 consensus_queue.cc:1048] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:44.254654  2439 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:44.256942  2439 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375)
I20260709 12:15:44.252369  1893 raft_consensus.cc:2889] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:44.259855  1965 raft_consensus.cc:1275] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:44.261236  1891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:44.262362  2462 consensus_queue.cc:1048] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:44.263942  2443 consensus_queue.cc:1048] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:44.270308  1967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:44.282899  2010 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3; no voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00
I20260709 12:15:44.289438  2439 raft_consensus.cc:2749] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:15:44.324569  2470 log.cc:927] Time spent T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:15:44.331923  2009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.102.193:33655, user_credentials={real_user=slave}} blocked reactor thread for 48737us
W20260709 12:15:44.338914  2471 log.cc:927] Time spent T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899: Append to log took a long time: real 0.064s	user 0.007s	sys 0.024s
W20260709 12:15:44.339323  2451 log.cc:927] Time spent T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00: Append to log took a long time: real 0.060s	user 0.007s	sys 0.015s
W20260709 12:15:44.342109  2454 log.cc:927] Time spent T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3: Append to log took a long time: real 0.064s	user 0.005s	sys 0.004s
W20260709 12:15:44.342439  2010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.102.194:37375, user_credentials={real_user=slave}} blocked reactor thread for 59667.3us
I20260709 12:15:44.344763  1968 raft_consensus.cc:1275] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:44.354272  1965 raft_consensus.cc:1275] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:44.355844  1968 raft_consensus.cc:1275] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:44.366495  1891 raft_consensus.cc:1275] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:44.369798  1891 raft_consensus.cc:1275] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Refusing update from remote peer 2f70dae7dc1c43b08d2c65022d53e6e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:44.371013  2046 raft_consensus.cc:1240] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Rejecting Update request from peer 9ba5ba0aeb514c019743af20c0968a00 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:44.371888  2443 consensus_queue.cc:1048] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:44.372608  2473 consensus_queue.cc:1048] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:44.376886  2445 consensus_queue.cc:1059] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:44.378492  2445 raft_consensus.cc:3055] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:44.378988  2445 raft_consensus.cc:740] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:44.381271  2445 consensus_queue.cc:260] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:44.383249  2445 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:44.399403  2474 consensus_queue.cc:1048] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:44.401192  2473 consensus_queue.cc:1048] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:44.402304  2475 consensus_queue.cc:1048] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:44.422653 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:44.472604  2046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb"
dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
mode: GRACEFUL
new_leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
 from {username='slave'} at 127.0.0.1:53670
I20260709 12:15:44.473353  2046 raft_consensus.cc:606] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Received request to transfer leadership to TS 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:44.474927 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:15:44.475641 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:44.648535  2474 raft_consensus.cc:993] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3: : Instructing follower 45281c12ca694ae1bbd01c89f0cf5899 to start an election
I20260709 12:15:44.649257  2475 raft_consensus.cc:1081] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Signalling peer 45281c12ca694ae1bbd01c89f0cf5899 to start an election
I20260709 12:15:44.650962  1965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb"
dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
 from {username='slave'} at 127.0.0.1:42034
I20260709 12:15:44.651568  1965 raft_consensus.cc:493] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:44.651887  1965 raft_consensus.cc:3060] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.658242  1965 raft_consensus.cc:515] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:44.660126  1965 leader_election.cc:290] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:44.661435  2046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:44.661304  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05a48b0dcf947b2b67e88dce20540fb" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ba5ba0aeb514c019743af20c0968a00"
I20260709 12:15:44.662227  2046 raft_consensus.cc:3055] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:44.662323  1893 raft_consensus.cc:3060] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.662597  2046 raft_consensus.cc:740] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f70dae7dc1c43b08d2c65022d53e6e3, State: Running, Role: LEADER
I20260709 12:15:44.663486  2046 consensus_queue.cc:260] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:44.664844  2046 raft_consensus.cc:3060] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.670596  1893 raft_consensus.cc:2468] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 3.
I20260709 12:15:44.671963  1935 leader_election.cc:304] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45281c12ca694ae1bbd01c89f0cf5899, 9ba5ba0aeb514c019743af20c0968a00; no voters: 
I20260709 12:15:44.672717  2046 raft_consensus.cc:2468] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45281c12ca694ae1bbd01c89f0cf5899 in term 3.
I20260709 12:15:44.672865  2402 raft_consensus.cc:2804] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:44.674021  2402 raft_consensus.cc:697] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 LEADER]: Becoming Leader. State: Replica: 45281c12ca694ae1bbd01c89f0cf5899, State: Running, Role: LEADER
I20260709 12:15:44.674957  2402 consensus_queue.cc:237] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:44.689252  1795 catalog_manager.cc:5697] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 reported cstate change: term changed from 2 to 3, leader changed from 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195) to 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194). New cstate: current_term: 3 leader_uuid: "45281c12ca694ae1bbd01c89f0cf5899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.143733  2046 raft_consensus.cc:1275] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:45.145201  2402 consensus_queue.cc:1048] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:45.174518  1893 raft_consensus.cc:1275] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Refusing update from remote peer 45281c12ca694ae1bbd01c89f0cf5899: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:45.176620  2402 consensus_queue.cc:1048] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:45.476668 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:45.483814 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:45.484244 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:45.727305  2445 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.728009  2445 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:45.730062  2445 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:45.731065  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899" is_pre_election: true
I20260709 12:15:45.731158  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:45.732187  2044 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 4.
I20260709 12:15:45.733404  1861 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:45.734149  2445 raft_consensus.cc:2804] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:45.734576  2445 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.734926  2445 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:45.741623  2445 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:45.743729  2445 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 5 election: Requested vote from peers 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:45.744949  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3"
I20260709 12:15:45.744752  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "9ba5ba0aeb514c019743af20c0968a00" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "45281c12ca694ae1bbd01c89f0cf5899"
I20260709 12:15:45.745640  2044 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:45.751622  2044 raft_consensus.cc:2468] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba5ba0aeb514c019743af20c0968a00 in term 5.
I20260709 12:15:45.752663  1861 leader_election.cc:304] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f70dae7dc1c43b08d2c65022d53e6e3, 9ba5ba0aeb514c019743af20c0968a00; no voters: 45281c12ca694ae1bbd01c89f0cf5899
I20260709 12:15:45.753525  2445 raft_consensus.cc:2804] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:45.754194  2445 raft_consensus.cc:697] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 5 LEADER]: Becoming Leader. State: Replica: 9ba5ba0aeb514c019743af20c0968a00, State: Running, Role: LEADER
I20260709 12:15:45.755635  2445 consensus_queue.cc:237] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:45.765348  1792 catalog_manager.cc:5697] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9ba5ba0aeb514c019743af20c0968a00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.850091  2490 raft_consensus.cc:493] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ba5ba0aeb514c019743af20c0968a00)
I20260709 12:15:45.850790  2490 raft_consensus.cc:515] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba5ba0aeb514c019743af20c0968a00" member_type: VOTER last_known_addr { host: "127.20.102.193" port: 33655 } } peers { permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 } } peers { permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 } }
I20260709 12:15:45.853619  2490 leader_election.cc:290] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655), 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777)
I20260709 12:15:45.853919  1893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9ba5ba0aeb514c019743af20c0968a00" is_pre_election: true
I20260709 12:15:45.854698  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a140ff30e17479c95f93e2348c6bdb5" candidate_uuid: "45281c12ca694ae1bbd01c89f0cf5899" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" is_pre_election: true
I20260709 12:15:45.855636  2044 raft_consensus.cc:2368] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45281c12ca694ae1bbd01c89f0cf5899 for earlier term 4. Current term is 5.
I20260709 12:15:45.857080  1936 leader_election.cc:400] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777) with higher term. Message: Invalid argument: T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45281c12ca694ae1bbd01c89f0cf5899 for earlier term 4. Current term is 5.
I20260709 12:15:45.857419  1936 leader_election.cc:403] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:45.858076  2490 raft_consensus.cc:3060] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:15:45.866087  2490 raft_consensus.cc:2749] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2f70dae7dc1c43b08d2c65022d53e6e3 (127.20.102.195:45777) with higher term. Message: Invalid argument: T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45281c12ca694ae1bbd01c89f0cf5899 for earlier term 4. Current term is 5.
I20260709 12:15:46.139158  1968 raft_consensus.cc:1275] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 5 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:15:46.140679  2437 consensus_queue.cc:1048] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45281c12ca694ae1bbd01c89f0cf5899" member_type: VOTER last_known_addr { host: "127.20.102.194" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:46.160529  2044 raft_consensus.cc:1275] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 5 FOLLOWER]: Refusing update from remote peer 9ba5ba0aeb514c019743af20c0968a00: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:15:46.163023  2437 consensus_queue.cc:1048] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f70dae7dc1c43b08d2c65022d53e6e3" member_type: VOTER last_known_addr { host: "127.20.102.195" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:46.485553 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:46.492684 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:46.493230 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:47.650134 20891 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:47.656272 20891 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:47.656730 20891 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:15:47.997124  2067 debug-util.cc:398] Leaking SignalData structure 0x7b080027bac0 after lost signal to thread 20894
W20260709 12:15:47.998301  2067 debug-util.cc:398] Leaking SignalData structure 0x7b080005fe60 after lost signal to thread 1829
W20260709 12:15:47.999413  2067 debug-util.cc:398] Leaking SignalData structure 0x7b08001da200 after lost signal to thread 1921
W20260709 12:15:48.000377  2067 debug-util.cc:398] Leaking SignalData structure 0x7b080015aa00 after lost signal to thread 1996
W20260709 12:15:48.001372  2067 debug-util.cc:398] Leaking SignalData structure 0x7b08001f4080 after lost signal to thread 2070
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:755: Failure
Expected: (leader.second) != (3), actual: 3 vs 3
I20260709 12:15:48.723104 20891 tablet_server.cc:179] TabletServer@127.20.102.193:0 shutting down...
W20260709 12:15:48.748819  1935 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
W20260709 12:15:48.761281  1935 consensus_peers.cc:597] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 -> Peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Couldn't send request to peer 9ba5ba0aeb514c019743af20c0968a00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.781415 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:48.782634 20891 tablet_replica.cc:333] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
W20260709 12:15:48.783061  2009 consensus_peers.cc:597] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 -> Peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Couldn't send request to peer 9ba5ba0aeb514c019743af20c0968a00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.783694 20891 raft_consensus.cc:2243] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.784498 20891 raft_consensus.cc:2272] T de5fd01b22d24de7b0ebd16e3bf4276e P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.787354 20891 tablet_replica.cc:333] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.788365 20891 raft_consensus.cc:2243] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.789088 20891 raft_consensus.cc:2272] T 9e4963adbf934f07addde68878a1db8d P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.791551 20891 tablet_replica.cc:333] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.792240 20891 raft_consensus.cc:2243] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.793249 20891 raft_consensus.cc:2272] T faf40fa603ea47c9ade85bbe75cdbd0c P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.796049 20891 tablet_replica.cc:333] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.796860 20891 raft_consensus.cc:2243] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.797405 20891 raft_consensus.cc:2272] T c63c053187f74f838cea1bfee35cffd5 P 9ba5ba0aeb514c019743af20c0968a00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.799928 20891 tablet_replica.cc:333] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.800581 20891 raft_consensus.cc:2243] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.801081 20891 raft_consensus.cc:2272] T 3095ee628fdb41808c568effe5711f80 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.804239 20891 tablet_replica.cc:333] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.805233 20891 raft_consensus.cc:2243] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.805749 20891 raft_consensus.cc:2272] T 20e51bd2a7da491ebb970d30afb8dc6f P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:48.806273  1935 consensus_peers.cc:597] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 -> Peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Couldn't send request to peer 9ba5ba0aeb514c019743af20c0968a00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.808192 20891 tablet_replica.cc:333] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.809026 20891 raft_consensus.cc:2243] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.809876 20891 raft_consensus.cc:2272] T 059d1f08e080485bb07140f9857e075f P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.813433 20891 tablet_replica.cc:333] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.814216 20891 raft_consensus.cc:2243] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:15:48.814391  1935 consensus_peers.cc:597] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 -> Peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Couldn't send request to peer 9ba5ba0aeb514c019743af20c0968a00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.815286 20891 raft_consensus.cc:2272] T d0b2c458d716469db89797427f5cc78b P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.818019 20891 tablet_replica.cc:333] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.818606 20891 raft_consensus.cc:2243] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.818996 20891 raft_consensus.cc:2272] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.821314 20891 tablet_replica.cc:333] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.821863 20891 raft_consensus.cc:2243] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.822269 20891 raft_consensus.cc:2272] T c4b44039da6645f2825cc5bbeb92dcbd P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.824681 20891 tablet_replica.cc:333] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.825312 20891 raft_consensus.cc:2243] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.826144 20891 raft_consensus.cc:2272] T 4d05e54ae17940119053ca939f60840b P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.828590 20891 tablet_replica.cc:333] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.829248 20891 raft_consensus.cc:2243] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.830029 20891 raft_consensus.cc:2272] T e8f7b70ca9f74046a805b8e76a18d9b8 P 9ba5ba0aeb514c019743af20c0968a00 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.832356 20891 tablet_replica.cc:333] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.832924 20891 raft_consensus.cc:2243] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.833326 20891 raft_consensus.cc:2272] T d05a48b0dcf947b2b67e88dce20540fb P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.835644 20891 tablet_replica.cc:333] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.836215 20891 raft_consensus.cc:2243] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.836844 20891 raft_consensus.cc:2272] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.839886 20891 tablet_replica.cc:333] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.840512 20891 raft_consensus.cc:2243] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:15:48.840998  2009 consensus_peers.cc:597] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 -> Peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Couldn't send request to peer 9ba5ba0aeb514c019743af20c0968a00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.841513 20891 raft_consensus.cc:2272] T 2a140ff30e17479c95f93e2348c6bdb5 P 9ba5ba0aeb514c019743af20c0968a00 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.844233 20891 tablet_replica.cc:333] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.844907 20891 raft_consensus.cc:2243] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.845468 20891 raft_consensus.cc:2272] T 0e37b9d2157f4472b9b94ff50988687d P 9ba5ba0aeb514c019743af20c0968a00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.848098 20891 tablet_replica.cc:333] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.848733 20891 raft_consensus.cc:2243] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.849439 20891 raft_consensus.cc:2272] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.851987 20891 tablet_replica.cc:333] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00: stopping tablet replica
I20260709 12:15:48.852599 20891 raft_consensus.cc:2243] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.853587 20891 raft_consensus.cc:2272] T 16e439d066c549529b6382b34a74aa00 P 9ba5ba0aeb514c019743af20c0968a00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.907078 20891 tablet_server.cc:196] TabletServer@127.20.102.193:0 shutdown complete.
W20260709 12:15:48.929507  2009 consensus_peers.cc:597] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 -> Peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Couldn't send request to peer 9ba5ba0aeb514c019743af20c0968a00. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:33655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.952225 20891 tablet_server.cc:179] TabletServer@127.20.102.194:0 shutting down...
W20260709 12:15:48.959717  2010 consensus_peers.cc:597] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 -> Peer 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375): Couldn't send request to peer 45281c12ca694ae1bbd01c89f0cf5899. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:48.966521  2009 consensus_peers.cc:597] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 -> Peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Couldn't send request to peer 9ba5ba0aeb514c019743af20c0968a00. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:33655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:48.996444  2010 consensus_peers.cc:597] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 -> Peer 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375): Couldn't send request to peer 45281c12ca694ae1bbd01c89f0cf5899. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.998806 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:48.999723 20891 tablet_replica.cc:333] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.000591 20891 raft_consensus.cc:2243] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.001305 20891 raft_consensus.cc:2272] T de5fd01b22d24de7b0ebd16e3bf4276e P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.003571 20891 tablet_replica.cc:333] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.004215 20891 raft_consensus.cc:2243] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.004647 20891 raft_consensus.cc:2272] T 9e4963adbf934f07addde68878a1db8d P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.006816 20891 tablet_replica.cc:333] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.007404 20891 raft_consensus.cc:2243] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.008250 20891 raft_consensus.cc:2272] T c63c053187f74f838cea1bfee35cffd5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.010397 20891 tablet_replica.cc:333] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.010980 20891 raft_consensus.cc:2243] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.011396 20891 raft_consensus.cc:2272] T faf40fa603ea47c9ade85bbe75cdbd0c P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.013429 20891 tablet_replica.cc:333] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.014004 20891 raft_consensus.cc:2243] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.014439 20891 raft_consensus.cc:2272] T 3095ee628fdb41808c568effe5711f80 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.016378 20891 tablet_replica.cc:333] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.017056 20891 raft_consensus.cc:2243] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.017596 20891 raft_consensus.cc:2272] T 059d1f08e080485bb07140f9857e075f P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.020277 20891 tablet_replica.cc:333] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.020920 20891 raft_consensus.cc:2243] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.021361 20891 raft_consensus.cc:2272] T d0b2c458d716469db89797427f5cc78b P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:49.022504  2009 consensus_peers.cc:597] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 -> Peer 9ba5ba0aeb514c019743af20c0968a00 (127.20.102.193:33655): Couldn't send request to peer 9ba5ba0aeb514c019743af20c0968a00. Status: Network error: Client connection negotiation failed: client connection to 127.20.102.193:33655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:49.023643 20891 tablet_replica.cc:333] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.024399 20891 raft_consensus.cc:2243] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.025246 20891 raft_consensus.cc:2272] T 20e51bd2a7da491ebb970d30afb8dc6f P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.027372 20891 tablet_replica.cc:333] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.027969 20891 raft_consensus.cc:2243] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.028434 20891 raft_consensus.cc:2272] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.031436 20891 tablet_replica.cc:333] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.032222 20891 raft_consensus.cc:2243] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.032826 20891 raft_consensus.cc:2272] T 4d05e54ae17940119053ca939f60840b P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.035907 20891 tablet_replica.cc:333] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.036615 20891 raft_consensus.cc:2243] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.037645 20891 raft_consensus.cc:2272] T c4b44039da6645f2825cc5bbeb92dcbd P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.039832 20891 tablet_replica.cc:333] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.040349 20891 raft_consensus.cc:2243] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.041220 20891 raft_consensus.cc:2272] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.043411 20891 tablet_replica.cc:333] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.043913 20891 raft_consensus.cc:2243] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.044332 20891 raft_consensus.cc:2272] T e8f7b70ca9f74046a805b8e76a18d9b8 P 45281c12ca694ae1bbd01c89f0cf5899 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.046439 20891 tablet_replica.cc:333] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.046919 20891 raft_consensus.cc:2243] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.047652 20891 raft_consensus.cc:2272] T d05a48b0dcf947b2b67e88dce20540fb P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.049801 20891 tablet_replica.cc:333] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.050323 20891 raft_consensus.cc:2243] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.050693 20891 raft_consensus.cc:2272] T 16e439d066c549529b6382b34a74aa00 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.052683 20891 tablet_replica.cc:333] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.053244 20891 raft_consensus.cc:2243] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.053628 20891 raft_consensus.cc:2272] T 2a140ff30e17479c95f93e2348c6bdb5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.055749 20891 tablet_replica.cc:333] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.056226 20891 raft_consensus.cc:2243] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.056619 20891 raft_consensus.cc:2272] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 45281c12ca694ae1bbd01c89f0cf5899 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.059363 20891 tablet_replica.cc:333] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899: stopping tablet replica
I20260709 12:15:49.060034 20891 raft_consensus.cc:2243] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.060611 20891 raft_consensus.cc:2272] T 0e37b9d2157f4472b9b94ff50988687d P 45281c12ca694ae1bbd01c89f0cf5899 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:49.061965  2010 consensus_peers.cc:597] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 -> Peer 45281c12ca694ae1bbd01c89f0cf5899 (127.20.102.194:37375): Couldn't send request to peer 45281c12ca694ae1bbd01c89f0cf5899. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:49.105960 20891 tablet_server.cc:196] TabletServer@127.20.102.194:0 shutdown complete.
I20260709 12:15:49.141832 20891 tablet_server.cc:179] TabletServer@127.20.102.195:0 shutting down...
I20260709 12:15:49.176355 20891 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:49.177124 20891 tablet_replica.cc:333] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.177788 20891 raft_consensus.cc:2243] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.178772 20891 raft_consensus.cc:2272] T de5fd01b22d24de7b0ebd16e3bf4276e P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.181022 20891 tablet_replica.cc:333] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.181635 20891 raft_consensus.cc:2243] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.182408 20891 raft_consensus.cc:2272] T 9e4963adbf934f07addde68878a1db8d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.184428 20891 tablet_replica.cc:333] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.185053 20891 raft_consensus.cc:2243] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.185493 20891 raft_consensus.cc:2272] T c63c053187f74f838cea1bfee35cffd5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.187425 20891 tablet_replica.cc:333] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.187994 20891 raft_consensus.cc:2243] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.188735 20891 raft_consensus.cc:2272] T 3095ee628fdb41808c568effe5711f80 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.190693 20891 tablet_replica.cc:333] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.191242 20891 raft_consensus.cc:2243] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.191656 20891 raft_consensus.cc:2272] T faf40fa603ea47c9ade85bbe75cdbd0c P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.193615 20891 tablet_replica.cc:333] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.194150 20891 raft_consensus.cc:2243] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.194618 20891 raft_consensus.cc:2272] T 20e51bd2a7da491ebb970d30afb8dc6f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.196527 20891 tablet_replica.cc:333] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.197119 20891 raft_consensus.cc:2243] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.197546 20891 raft_consensus.cc:2272] T 059d1f08e080485bb07140f9857e075f P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.199414 20891 tablet_replica.cc:333] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.199923 20891 raft_consensus.cc:2243] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.200368 20891 raft_consensus.cc:2272] T d0b2c458d716469db89797427f5cc78b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.202183 20891 tablet_replica.cc:333] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.202700 20891 raft_consensus.cc:2243] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.203099 20891 raft_consensus.cc:2272] T 8aaa3a7477434db49c6ee38cd3eb7d36 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.205082 20891 tablet_replica.cc:333] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.205587 20891 raft_consensus.cc:2243] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.206014 20891 raft_consensus.cc:2272] T 4d05e54ae17940119053ca939f60840b P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.207963 20891 tablet_replica.cc:333] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.208503 20891 raft_consensus.cc:2243] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.209049 20891 raft_consensus.cc:2272] T c4b44039da6645f2825cc5bbeb92dcbd P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.211083 20891 tablet_replica.cc:333] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.211674 20891 raft_consensus.cc:2243] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.212471 20891 raft_consensus.cc:2272] T 6b1da1a1ab8e44cd98f3f0a7e2cf3114 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.214668 20891 tablet_replica.cc:333] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.215188 20891 raft_consensus.cc:2243] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.215641 20891 raft_consensus.cc:2272] T 2a140ff30e17479c95f93e2348c6bdb5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.217542 20891 tablet_replica.cc:333] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.218079 20891 raft_consensus.cc:2243] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.218871 20891 raft_consensus.cc:2272] T 3016eb3ea9c04be4bbd0c00f2ffda7a5 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.221134 20891 tablet_replica.cc:333] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.221695 20891 raft_consensus.cc:2243] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.222489 20891 raft_consensus.cc:2272] T 0e37b9d2157f4472b9b94ff50988687d P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.224601 20891 tablet_replica.cc:333] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.225127 20891 raft_consensus.cc:2243] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.225582 20891 raft_consensus.cc:2272] T 16e439d066c549529b6382b34a74aa00 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.227463 20891 tablet_replica.cc:333] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.227869 20891 raft_consensus.cc:2243] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.228281 20891 raft_consensus.cc:2272] T e8f7b70ca9f74046a805b8e76a18d9b8 P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.230293 20891 tablet_replica.cc:333] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3: stopping tablet replica
I20260709 12:15:49.230777 20891 raft_consensus.cc:2243] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:49.231176 20891 raft_consensus.cc:2272] T d05a48b0dcf947b2b67e88dce20540fb P 2f70dae7dc1c43b08d2c65022d53e6e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.298846 20891 tablet_server.cc:196] TabletServer@127.20.102.195:0 shutdown complete.
I20260709 12:15:49.344185 20891 master.cc:562] Master@127.20.102.254:33247 shutting down...
I20260709 12:15:49.376071 20891 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:49.376907 20891 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:49.377305 20891 tablet_replica.cc:333] T 00000000000000000000000000000000 P ff9d51f7069245e7bb47ca72189c3e26: stopping tablet replica
I20260709 12:15:49.401072 20891 master.cc:584] Master@127.20.102.254:33247 shutdown complete.
I20260709 12:15:49.438544 20891 test_util.cc:182] -----------------------------------------------
I20260709 12:15:49.438812 20891 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task1LLoSm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895025208-20891-0
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true (25548 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (47910 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (454237 ms total)
[  PASSED  ] 6 tests.
[  FAILED  ] 2 tests, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true

 2 FAILED TESTS
I20260709 12:15:49.446053 20891 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2236 messages since previous log ~37 seconds ago
I20260709 12:15:49.446316 20891 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2236 messages since previous log ~37 seconds ago
I20260709 12:15:49.446533 20891 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2228 messages since previous log ~37 seconds ago
I20260709 12:15:49.446806 20891 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~56 seconds ago
I20260709 12:15:49.447022 20891 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~56 seconds ago
I20260709 12:15:49.447276 20891 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 8 messages since previous log ~173 seconds ago
I20260709 12:15:49.447480 20891 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~333 seconds ago
I20260709 12:15:49.447698 20891 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~332 seconds ago
I20260709 12:15:49.448001 20891 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:15:49.448338 20891 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~24 seconds ago
